JUnit version 4.13.2
.08:03:31.403 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779091411394
08:03:31.428 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779091411428
08:03:31.458 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
08:03:31.462 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
08:03:31.529 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
08:03:31.542 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskk4_r_T/test-tmp
08:03:31.546 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
08:03:31.549 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskk4_r_T/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
08:03:31.730 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

08:03:31.954 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:03:31.956 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

08:03:31.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:31.959921 23603 mini_oidc.cc:150] Starting JWKS server
08:03:31.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:31.963569 23603 webserver.cc:533] Webserver started at http://127.0.0.1:42249/ using document root <none> and password file <none>
08:03:31.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:31.964104 23603 mini_oidc.cc:186] Starting OIDC Discovery server
08:03:31.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:31.966463 23603 webserver.cc:533] Webserver started at http://127.0.0.1:38759/ using document root <none> and password file <none>
08:03:32.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:03:32Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
08:03:32.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:03:32Z Disabled control of system clock
08:03:32.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:32.031229 23603 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:03:32.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:03:32.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-0/wal
08:03:32.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-0/data
08:03:32.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:03:32.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:03:32.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:03:32.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:32.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:32.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:32.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-0/logs
08:03:32.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-0/data/info.pb
08:03:32.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:32.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:03:32.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:03:32.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:03:32.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:03:32.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:32.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:32.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:32.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:03:32.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:03:32.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:03:32.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:03:32.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.12.254:42055
08:03:32.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.12.254
08:03:32.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:32.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.12.212:33445
08:03:32.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:32.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:32.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:32.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:03:32.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.12.254:42055,127.23.12.253:45283,127.23.12.252:42637
08:03:32.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:03:32.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42249/jwks.json with env {}
08:03:32.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:32.350850 23615 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:03:32.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:32.351540 23615 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:03:32.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:32.352339 23615 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:03:32.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:32.386292 23615 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:03:32.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:32.386708 23615 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:03:32.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:32.387032 23615 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:03:32.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:32.387358 23615 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:03:32.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:32.387719 23615 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:03:32.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:32.388005 23615 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:42249/jwks.json
08:03:32.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:32.425647 23615 master_runner.cc:387] Master server non-default flags:
08:03:32.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:32.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.12.212:33445
08:03:32.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:32.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:32.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-0/data
08:03:32.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-0/wal
08:03:32.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:03:32.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.12.254:42055,127.23.12.253:45283,127.23.12.252:42637
08:03:32.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:32.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:32.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:03:32.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.12.254:42055
08:03:32.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:03:32.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:03:32.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:03:32.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42249/jwks.json
08:03:32.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:32.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:32.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-0/data/info.pb
08:03:32.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.12.254
08:03:32.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:32.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:03:32.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:32.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:03:32.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:03:32.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:32.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-0/logs
08:03:32.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:32.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:03:32.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:03:32.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:03:32.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:03:32.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:03:32.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:03:32.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:03:32.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:03:32.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:03:32.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:32.427562 23615 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:03:32.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:32.429941 23615 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:03:32.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:32.445267 23621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:33.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:32.445271 23622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:33.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:33.679840 23623 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1232 milliseconds
08:03:33.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:33.681890 23624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:33.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:33.686112 23615 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.241s	user 0.473s	sys 0.766s
08:03:33.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:33.686532 23615 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.242s	user 0.473s	sys 0.766s
08:03:33.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.686854 23615 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:03:33.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.688541 23615 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:03:33.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.692480 23615 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:03:33.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.694535 23615 hybrid_clock.cc:648] HybridClock initialized: now 1779091413694495 us; error 53 us; skew 500 ppm
08:03:33.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.695787 23615 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:03:33.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.705484 23615 webserver.cc:533] Webserver started at http://127.23.12.254:37331/ using document root <none> and password file <none>
08:03:33.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.706980 23615 fs_manager.cc:362] Metadata directory not provided
08:03:33.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.707301 23615 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:03:33.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.707918 23615 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:03:33.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.716141 23615 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-0/data/instance:
08:03:33.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "296c061cc02a4d93a85ae34f72f59bd1"
08:03:33.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:33 on dist-test-slave-1jss"
08:03:33.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.717912 23615 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-0/wal/instance:
08:03:33.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "296c061cc02a4d93a85ae34f72f59bd1"
08:03:33.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:33 on dist-test-slave-1jss"
08:03:33.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.728592 23615 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.005s	sys 0.004s
08:03:33.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.736699 23631 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:03:33.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.738541 23615 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.006s	sys 0.000s
08:03:33.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.738986 23615 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-0/wal
08:03:33.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "296c061cc02a4d93a85ae34f72f59bd1"
08:03:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:33 on dist-test-slave-1jss"
08:03:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.739457 23615 fs_report.cc:389] FS layout report
08:03:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:03:33.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-0/wal
08:03:33.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-0/wal
08:03:33.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-0/data/data
08:03:33.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:03:33.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:03:33.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:03:33.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:03:33.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:03:33.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:03:33.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:03:33.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:03:33.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:03:33.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:03:33.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:03:33.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.820044 23615 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:03:33.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.821650 23615 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:03:33.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.822124 23615 kserver.cc:163] Server-wide thread pool size limit: 3276
08:03:33.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.898151 23615 rpc_server.cc:307] RPC server started. Bound to: 127.23.12.254:42055
08:03:33.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.898257 23682 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.12.254:42055 every 8 connection(s)
08:03:33.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.901237 23615 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-0/data/info.pb
08:03:33.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.906034 23603 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 23615
08:03:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.906589 23603 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-0/wal/instance
08:03:33.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.908535 23683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:03:33.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.910593 23603 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:03:33.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:03:33.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-1/wal
08:03:33.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-1/data
08:03:33.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:03:33.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:03:33.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:03:33.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:33.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:33.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:33.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-1/logs
08:03:33.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-1/data/info.pb
08:03:33.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:33.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:03:33.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:03:33.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:03:33.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:03:33.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:33.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:33.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:33.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:03:33.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:03:33.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:03:33.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:03:33.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.12.253:45283
08:03:33.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.12.253
08:03:33.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:33.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.12.212:33445
08:03:33.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:33.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:33.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:33.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:03:33.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.12.254:42055,127.23.12.253:45283,127.23.12.252:42637
08:03:33.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:03:33.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42249/jwks.json with env {}
08:03:33.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.922073 23683 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.12.254" port: 42055 } has no permanent_uuid. Determining permanent_uuid...
08:03:33.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:33.951222 23683 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } has no permanent_uuid. Determining permanent_uuid...
08:03:33.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:33.953718 23633 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.12.253:45283: connect: Connection refused (error 111)
08:03:33.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:33.958412 23683 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.12.253:45283: Network error: Client connection negotiation failed: client connection to 127.23.12.253:45283: connect: Connection refused (error 111)
08:03:34.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:34.007948 23683 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } attempt: 1
08:03:34.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:34.012714 23683 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.12.253:45283: Network error: Client connection negotiation failed: client connection to 127.23.12.253:45283: connect: Connection refused (error 111)
08:03:34.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:34.081111 23683 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } attempt: 2
08:03:34.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:34.084993 23683 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.12.253:45283: Network error: Client connection negotiation failed: client connection to 127.23.12.253:45283: connect: Connection refused (error 111)
08:03:34.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:34.176505 23683 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } attempt: 3
08:03:34.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:34.180641 23683 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.12.253:45283: Network error: Client connection negotiation failed: client connection to 127.23.12.253:45283: connect: Connection refused (error 111)
08:03:34.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:34.232101 23685 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:03:34.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:34.232646 23685 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:03:34.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:34.233093 23685 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:03:34.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:34.267539 23685 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:03:34.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:34.267853 23685 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:03:34.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:34.268052 23685 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:03:34.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:34.268235 23685 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:03:34.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:34.268538 23685 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:03:34.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:34.268712 23685 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:42249/jwks.json
08:03:34.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:34.307875 23685 master_runner.cc:387] Master server non-default flags:
08:03:34.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:34.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.12.212:33445
08:03:34.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:34.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:34.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-1/data
08:03:34.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-1/wal
08:03:34.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:03:34.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.12.254:42055,127.23.12.253:45283,127.23.12.252:42637
08:03:34.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:34.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:34.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:03:34.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.12.253:45283
08:03:34.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:03:34.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:03:34.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:03:34.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42249/jwks.json
08:03:34.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:34.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:34.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-1/data/info.pb
08:03:34.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.12.253
08:03:34.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:34.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:03:34.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:34.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:03:34.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:03:34.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:34.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-1/logs
08:03:34.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:34.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:03:34.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:03:34.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:03:34.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:03:34.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:03:34.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:03:34.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:03:34.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:03:34.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:03:34.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:34.309755 23685 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:03:34.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:34.312256 23685 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:03:34.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:34.324126 23683 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } attempt: 4
08:03:34.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:34.325033 23694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:34.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:34.332044 23683 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.12.253:45283: Network error: Client connection negotiation failed: client connection to 127.23.12.253:45283: connect: Connection refused (error 111)
08:03:34.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:34.631609 23683 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } attempt: 5
08:03:34.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:34.641368 23683 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.12.253:45283: Network error: Client connection negotiation failed: client connection to 127.23.12.253:45283: connect: Connection refused (error 111)
08:03:35.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.188963 23683 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } attempt: 6
08:03:35.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:35.214702 23683 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.12.253:45283: Network error: Client connection negotiation failed: client connection to 127.23.12.253:45283: connect: Connection refused (error 111)
08:03:35.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:35.729388 23693 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 23685
08:03:35.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:35.776966 23685 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.450s	user 0.512s	sys 0.931s
08:03:35.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:35.777446 23685 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.451s	user 0.512s	sys 0.931s
08:03:35.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:34.327512 23695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:35.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:35.780534 23697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:35.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:35.786034 23696 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1451 milliseconds
08:03:35.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.786064 23685 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:03:35.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.787541 23685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:03:35.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.790699 23685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:03:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.792133 23685 hybrid_clock.cc:648] HybridClock initialized: now 1779091415792081 us; error 61 us; skew 500 ppm
08:03:35.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.792886 23685 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:03:35.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.799697 23685 webserver.cc:533] Webserver started at http://127.23.12.253:44349/ using document root <none> and password file <none>
08:03:35.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.800559 23685 fs_manager.cc:362] Metadata directory not provided
08:03:35.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.800812 23685 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:03:35.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.801411 23685 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:03:35.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.805977 23685 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-1/data/instance:
08:03:35.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "dd077a704c7a4a889977e45b086ff445"
08:03:35.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:35 on dist-test-slave-1jss"
08:03:35.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.807401 23685 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-1/wal/instance:
08:03:35.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "dd077a704c7a4a889977e45b086ff445"
08:03:35.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:35 on dist-test-slave-1jss"
08:03:35.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.814796 23685 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.002s
08:03:35.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.821053 23706 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:03:35.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.822294 23685 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
08:03:35.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.822675 23685 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-1/wal
08:03:35.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "dd077a704c7a4a889977e45b086ff445"
08:03:35.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:35 on dist-test-slave-1jss"
08:03:35.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.823103 23685 fs_report.cc:389] FS layout report
08:03:35.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:03:35.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-1/wal
08:03:35.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-1/wal
08:03:35.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-1/data/data
08:03:35.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:03:35.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:03:35.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:03:35.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:03:35.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:03:35.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:03:35.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:03:35.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:03:35.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:03:35.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:03:35.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:03:35.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.877051 23685 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:03:35.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.878808 23685 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:03:35.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.879349 23685 kserver.cc:163] Server-wide thread pool size limit: 3276
08:03:35.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.961122 23685 rpc_server.cc:307] RPC server started. Bound to: 127.23.12.253:45283
08:03:35.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.961200 23757 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.12.253:45283 every 8 connection(s)
08:03:35.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.964174 23685 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-1/data/info.pb
08:03:35.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.970266 23758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:03:35.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.972168 23603 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 23685
08:03:35.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.972641 23603 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-1/wal/instance
08:03:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.975658 23603 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:03:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:03:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-2/wal
08:03:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-2/data
08:03:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:03:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:03:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:03:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:35.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:35.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-2/logs
08:03:35.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-2/data/info.pb
08:03:35.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:35.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:03:35.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:03:35.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:03:35.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:03:35.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:35.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:35.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:35.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:03:35.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:03:35.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:03:35.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:03:35.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.12.252:42637
08:03:35.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.12.252
08:03:35.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:35.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.12.212:33445
08:03:35.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:35.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:35.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:35.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:03:35.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.12.254:42055,127.23.12.253:45283,127.23.12.252:42637
08:03:35.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:03:35.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42249/jwks.json with env {}
08:03:35.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:35.986476 23758 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.12.254" port: 42055 } has no permanent_uuid. Determining permanent_uuid...
08:03:36.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:36.008412 23758 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } has no permanent_uuid. Determining permanent_uuid...
08:03:36.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:36.023748 23758 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } has no permanent_uuid. Determining permanent_uuid...
08:03:36.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:36.026278 23707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.12.252:42637: connect: Connection refused (error 111)
08:03:36.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:36.030622 23758 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.12.252:42637: Network error: Client connection negotiation failed: client connection to 127.23.12.252:42637: connect: Connection refused (error 111)
08:03:36.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:36.080168 23758 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } attempt: 1
08:03:36.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:36.084610 23758 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.12.252:42637: Network error: Client connection negotiation failed: client connection to 127.23.12.252:42637: connect: Connection refused (error 111)
08:03:36.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:36.153041 23758 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } attempt: 2
08:03:36.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:36.157079 23758 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.12.252:42637: Network error: Client connection negotiation failed: client connection to 127.23.12.252:42637: connect: Connection refused (error 111)
08:03:36.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:36.248596 23758 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } attempt: 3
08:03:36.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:36.253203 23758 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.12.252:42637: Network error: Client connection negotiation failed: client connection to 127.23.12.252:42637: connect: Connection refused (error 111)
08:03:36.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:36.275311 23683 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } attempt: 7
08:03:36.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:36.288295 23683 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } has no permanent_uuid. Determining permanent_uuid...
08:03:36.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:36.294096 23683 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.12.252:42637: Network error: Client connection negotiation failed: client connection to 127.23.12.252:42637: connect: Connection refused (error 111)
08:03:36.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:36.311196 23760 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:03:36.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:36.312077 23760 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:03:36.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:36.312983 23760 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:03:36.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:36.347751 23760 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:03:36.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:36.348147 23760 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:03:36.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:36.348476 23760 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:03:36.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:36.348865 23760 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:03:36.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:36.349232 23760 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:03:36.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:36.349509 23760 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:42249/jwks.json
08:03:36.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:36.352507 23683 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } attempt: 1
08:03:36.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:36.356786 23683 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.12.252:42637: Network error: Client connection negotiation failed: client connection to 127.23.12.252:42637: connect: Connection refused (error 111)
08:03:36.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:36.388936 23760 master_runner.cc:387] Master server non-default flags:
08:03:36.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:36.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.12.212:33445
08:03:36.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:36.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:36.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-2/data
08:03:36.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-2/wal
08:03:36.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:03:36.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.12.254:42055,127.23.12.253:45283,127.23.12.252:42637
08:03:36.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:36.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:36.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:03:36.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.12.252:42637
08:03:36.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:03:36.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:03:36.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:03:36.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42249/jwks.json
08:03:36.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:36.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:36.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-2/data/info.pb
08:03:36.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.12.252
08:03:36.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:36.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:03:36.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:36.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:03:36.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:03:36.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:36.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-2/logs
08:03:36.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:36.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:03:36.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:03:36.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:03:36.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:03:36.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:03:36.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:03:36.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:03:36.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:03:36.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:03:36.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:36.390769 23760 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:03:36.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:36.393187 23760 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:03:36.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:36.396656 23758 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } attempt: 4
08:03:36.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:36.401055 23758 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.12.252:42637: Network error: Client connection negotiation failed: client connection to 127.23.12.252:42637: connect: Connection refused (error 111)
08:03:36.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:36.406823 23772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:36.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:36.438242 23683 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } attempt: 2
08:03:36.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:36.444806 23683 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.12.252:42637: Network error: Client connection negotiation failed: client connection to 127.23.12.252:42637: connect: Connection refused (error 111)
08:03:36.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:36.530484 23683 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } attempt: 3
08:03:36.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:36.537086 23683 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.12.252:42637: Network error: Client connection negotiation failed: client connection to 127.23.12.252:42637: connect: Connection refused (error 111)
08:03:36.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:36.677765 23683 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } attempt: 4
08:03:36.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:36.684649 23683 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.12.252:42637: Network error: Client connection negotiation failed: client connection to 127.23.12.252:42637: connect: Connection refused (error 111)
08:03:36.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:36.700654 23758 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } attempt: 5
08:03:36.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:36.707329 23758 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.12.252:42637: Network error: Client connection negotiation failed: client connection to 127.23.12.252:42637: connect: Connection refused (error 111)
08:03:36.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:36.968302 23683 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } attempt: 5
08:03:36.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:36.977145 23683 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.12.252:42637: Network error: Client connection negotiation failed: client connection to 127.23.12.252:42637: connect: Connection refused (error 111)
08:03:37.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.254966 23758 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } attempt: 6
08:03:37.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:37.265784 23758 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.12.252:42637: Network error: Client connection negotiation failed: client connection to 127.23.12.252:42637: connect: Connection refused (error 111)
08:03:37.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.529786 23683 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } attempt: 6
08:03:37.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:37.540728 23683 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.12.252:42637: Network error: Client connection negotiation failed: client connection to 127.23.12.252:42637: connect: Connection refused (error 111)
08:03:37.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:36.408031 23773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:37.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:36.411509 23775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:37.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:37.752509 23774 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1340 milliseconds
08:03:37.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.752632 23760 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:03:37.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.754374 23760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:03:37.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.757831 23760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:03:37.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.759269 23760 hybrid_clock.cc:648] HybridClock initialized: now 1779091417759225 us; error 63 us; skew 500 ppm
08:03:37.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.760044 23760 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:03:37.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.766474 23760 webserver.cc:533] Webserver started at http://127.23.12.252:35871/ using document root <none> and password file <none>
08:03:37.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.767354 23760 fs_manager.cc:362] Metadata directory not provided
08:03:37.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.767540 23760 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:03:37.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.767984 23760 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:03:37.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.772557 23760 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-2/data/instance:
08:03:37.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3130d0881f1d4cdbbb0586258ced9309"
08:03:37.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:37 on dist-test-slave-1jss"
08:03:37.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.773692 23760 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-2/wal/instance:
08:03:37.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3130d0881f1d4cdbbb0586258ced9309"
08:03:37.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:37 on dist-test-slave-1jss"
08:03:37.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.781764 23760 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
08:03:37.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.787762 23786 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:03:37.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.789105 23760 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.003s
08:03:37.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.789436 23760 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-2/wal
08:03:37.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3130d0881f1d4cdbbb0586258ced9309"
08:03:37.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:37 on dist-test-slave-1jss"
08:03:37.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.789984 23760 fs_report.cc:389] FS layout report
08:03:37.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:03:37.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-2/wal
08:03:37.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-2/wal
08:03:37.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-2/data/data
08:03:37.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:03:37.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:03:37.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:03:37.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:03:37.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:03:37.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:03:37.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:03:37.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:03:37.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:03:37.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:03:37.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:03:37.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.847532 23760 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:03:37.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.849037 23760 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:03:37.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.849440 23760 kserver.cc:163] Server-wide thread pool size limit: 3276
08:03:37.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.928769 23760 rpc_server.cc:307] RPC server started. Bound to: 127.23.12.252:42637
08:03:37.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.928862 23837 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.12.252:42637 every 8 connection(s)
08:03:37.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.931433 23760 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-2/data/info.pb
08:03:37.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.935812 23603 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 23760
08:03:37.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.936300 23603 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/master-2/wal/instance
08:03:37.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.938542 23838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:03:37.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:37.955616 23838 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.12.254" port: 42055 } has no permanent_uuid. Determining permanent_uuid...
08:03:38.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.001148 23838 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } has no permanent_uuid. Determining permanent_uuid...
08:03:38.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.012872 23838 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } has no permanent_uuid. Determining permanent_uuid...
08:03:38.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.031069 23838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309: Bootstrap starting.
08:03:38.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.038579 23838 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309: Neither blocks nor log segments found. Creating new log.
08:03:38.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.040658 23838 log.cc:826] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309: Log is configured to *not* fsync() on all Append() calls
08:03:38.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.046790 23838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309: No bootstrap required, opened a new log
08:03:38.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.069521 23838 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "296c061cc02a4d93a85ae34f72f59bd1" member_type: VOTER last_known_addr { host: "127.23.12.254" port: 42055 } } peers { permanent_uuid: "dd077a704c7a4a889977e45b086ff445" member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } } peers { permanent_uuid: "3130d0881f1d4cdbbb0586258ced9309" member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } }
08:03:38.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.070336 23838 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:03:38.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.070556 23838 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3130d0881f1d4cdbbb0586258ced9309, State: Initialized, Role: FOLLOWER
08:03:38.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.071265 23838 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "296c061cc02a4d93a85ae34f72f59bd1" member_type: VOTER last_known_addr { host: "127.23.12.254" port: 42055 } } peers { permanent_uuid: "dd077a704c7a4a889977e45b086ff445" member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } } peers { permanent_uuid: "3130d0881f1d4cdbbb0586258ced9309" member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } }
08:03:38.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.073822 23846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "296c061cc02a4d93a85ae34f72f59bd1" member_type: VOTER last_known_addr { host: "127.23.12.254" port: 42055 } } peers { permanent_uuid: "dd077a704c7a4a889977e45b086ff445" member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } } peers { permanent_uuid: "3130d0881f1d4cdbbb0586258ced9309" member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } } }
08:03:38.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.074474 23846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [sys.catalog]: This master's current role is: FOLLOWER
08:03:38.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.075573 23838 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [sys.catalog]: configured and running, proceeding with master startup.
08:03:38.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:38.105063 23857 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:03:38.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:38.105078 23792 tablet.cc:2404] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:03:38.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:38.106050 23857 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:03:38.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.098595 23760 master_runner.cc:187] Error getting master registration for 127.23.12.254:42055: OK, instance_id { permanent_uuid: "296c061cc02a4d93a85ae34f72f59bd1" instance_seqno: 1779091413878159 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:03:38.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.122588 23760 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:03:38.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.326434 23758 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } attempt: 7
08:03:38.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.348129 23758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd077a704c7a4a889977e45b086ff445: Bootstrap starting.
08:03:38.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.355847 23758 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd077a704c7a4a889977e45b086ff445: Neither blocks nor log segments found. Creating new log.
08:03:38.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.358325 23758 log.cc:826] T 00000000000000000000000000000000 P dd077a704c7a4a889977e45b086ff445: Log is configured to *not* fsync() on all Append() calls
08:03:38.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.365154 23758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd077a704c7a4a889977e45b086ff445: No bootstrap required, opened a new log
08:03:38.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.378268 23846 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:03:38.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.378842 23846 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "296c061cc02a4d93a85ae34f72f59bd1" member_type: VOTER last_known_addr { host: "127.23.12.254" port: 42055 } } peers { permanent_uuid: "dd077a704c7a4a889977e45b086ff445" member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } } peers { permanent_uuid: "3130d0881f1d4cdbbb0586258ced9309" member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } }
08:03:38.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.382299 23846 leader_election.cc:290] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 296c061cc02a4d93a85ae34f72f59bd1 (127.23.12.254:42055), dd077a704c7a4a889977e45b086ff445 (127.23.12.253:45283)
08:03:38.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.394991 23758 raft_consensus.cc:359] T 00000000000000000000000000000000 P dd077a704c7a4a889977e45b086ff445 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "296c061cc02a4d93a85ae34f72f59bd1" member_type: VOTER last_known_addr { host: "127.23.12.254" port: 42055 } } peers { permanent_uuid: "dd077a704c7a4a889977e45b086ff445" member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } } peers { permanent_uuid: "3130d0881f1d4cdbbb0586258ced9309" member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } }
08:03:38.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.395891 23758 raft_consensus.cc:385] T 00000000000000000000000000000000 P dd077a704c7a4a889977e45b086ff445 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:03:38.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.396184 23758 raft_consensus.cc:740] T 00000000000000000000000000000000 P dd077a704c7a4a889977e45b086ff445 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd077a704c7a4a889977e45b086ff445, State: Initialized, Role: FOLLOWER
08:03:38.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.397082 23758 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd077a704c7a4a889977e45b086ff445 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "296c061cc02a4d93a85ae34f72f59bd1" member_type: VOTER last_known_addr { host: "127.23.12.254" port: 42055 } } peers { permanent_uuid: "dd077a704c7a4a889977e45b086ff445" member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } } peers { permanent_uuid: "3130d0881f1d4cdbbb0586258ced9309" member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } }
08:03:38.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.400810 23861 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd077a704c7a4a889977e45b086ff445 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "296c061cc02a4d93a85ae34f72f59bd1" member_type: VOTER last_known_addr { host: "127.23.12.254" port: 42055 } } peers { permanent_uuid: "dd077a704c7a4a889977e45b086ff445" member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } } peers { permanent_uuid: "3130d0881f1d4cdbbb0586258ced9309" member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } } }
08:03:38.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.402619 23861 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd077a704c7a4a889977e45b086ff445 [sys.catalog]: This master's current role is: FOLLOWER
08:03:38.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.403972 23758 sys_catalog.cc:565] T 00000000000000000000000000000000 P dd077a704c7a4a889977e45b086ff445 [sys.catalog]: configured and running, proceeding with master startup.
08:03:38.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.404145 23733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3130d0881f1d4cdbbb0586258ced9309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd077a704c7a4a889977e45b086ff445" is_pre_election: true
08:03:38.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.405072 23733 raft_consensus.cc:2468] T 00000000000000000000000000000000 P dd077a704c7a4a889977e45b086ff445 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3130d0881f1d4cdbbb0586258ced9309 in term 0.
08:03:38.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.407228 23788 leader_election.cc:304] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3130d0881f1d4cdbbb0586258ced9309, dd077a704c7a4a889977e45b086ff445; no voters: 
08:03:38.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.408583 23846 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:03:38.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.408980 23846 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:03:38.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.409292 23846 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [term 0 FOLLOWER]: Advancing to term 1
08:03:38.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.425745 23846 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "296c061cc02a4d93a85ae34f72f59bd1" member_type: VOTER last_known_addr { host: "127.23.12.254" port: 42055 } } peers { permanent_uuid: "dd077a704c7a4a889977e45b086ff445" member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } } peers { permanent_uuid: "3130d0881f1d4cdbbb0586258ced9309" member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } }
08:03:38.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.442559 23733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3130d0881f1d4cdbbb0586258ced9309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd077a704c7a4a889977e45b086ff445"
08:03:38.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.443574 23733 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dd077a704c7a4a889977e45b086ff445 [term 0 FOLLOWER]: Advancing to term 1
08:03:38.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.445362 23846 leader_election.cc:290] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [CANDIDATE]: Term 1 election: Requested vote from peers 296c061cc02a4d93a85ae34f72f59bd1 (127.23.12.254:42055), dd077a704c7a4a889977e45b086ff445 (127.23.12.253:45283)
08:03:38.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.452607 23733 raft_consensus.cc:2468] T 00000000000000000000000000000000 P dd077a704c7a4a889977e45b086ff445 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3130d0881f1d4cdbbb0586258ced9309 in term 1.
08:03:38.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.454574 23788 leader_election.cc:304] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3130d0881f1d4cdbbb0586258ced9309, dd077a704c7a4a889977e45b086ff445; no voters: 
08:03:38.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.455690 23846 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [term 1 FOLLOWER]: Leader election won for term 1
08:03:38.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.458184 23846 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [term 1 LEADER]: Becoming Leader. State: Replica: 3130d0881f1d4cdbbb0586258ced9309, State: Running, Role: LEADER
08:03:38.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.459450 23846 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "296c061cc02a4d93a85ae34f72f59bd1" member_type: VOTER last_known_addr { host: "127.23.12.254" port: 42055 } } peers { permanent_uuid: "dd077a704c7a4a889977e45b086ff445" member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } } peers { permanent_uuid: "3130d0881f1d4cdbbb0586258ced9309" member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } }
08:03:38.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.476639 23868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3130d0881f1d4cdbbb0586258ced9309. Latest consensus state: current_term: 1 leader_uuid: "3130d0881f1d4cdbbb0586258ced9309" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "296c061cc02a4d93a85ae34f72f59bd1" member_type: VOTER last_known_addr { host: "127.23.12.254" port: 42055 } } peers { permanent_uuid: "dd077a704c7a4a889977e45b086ff445" member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } } peers { permanent_uuid: "3130d0881f1d4cdbbb0586258ced9309" member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } } }
08:03:38.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.478259 23868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [sys.catalog]: This master's current role is: LEADER
08:03:38.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.488255 23873 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
08:03:38.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.495826 23875 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
08:03:38.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.496289 23873 catalog_manager.cc:1519] Initializing Kudu cluster ID...
08:03:38.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.521828 23733 raft_consensus.cc:1275] T 00000000000000000000000000000000 P dd077a704c7a4a889977e45b086ff445 [term 1 FOLLOWER]: Refusing update from remote peer 3130d0881f1d4cdbbb0586258ced9309: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:03:38.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.524286 23868 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd077a704c7a4a889977e45b086ff445" member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:03:38.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.499975 23685 master_runner.cc:187] Error getting master registration for 127.23.12.254:42055: OK, instance_id { permanent_uuid: "296c061cc02a4d93a85ae34f72f59bd1" instance_seqno: 1779091413878159 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:03:38.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.532897 23685 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:03:38.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.552769 23861 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd077a704c7a4a889977e45b086ff445 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3130d0881f1d4cdbbb0586258ced9309. Latest consensus state: current_term: 1 leader_uuid: "3130d0881f1d4cdbbb0586258ced9309" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "296c061cc02a4d93a85ae34f72f59bd1" member_type: VOTER last_known_addr { host: "127.23.12.254" port: 42055 } } peers { permanent_uuid: "dd077a704c7a4a889977e45b086ff445" member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } } peers { permanent_uuid: "3130d0881f1d4cdbbb0586258ced9309" member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } } }
08:03:38.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.553740 23861 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd077a704c7a4a889977e45b086ff445 [sys.catalog]: This master's current role is: FOLLOWER
08:03:38.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.558928 23846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3130d0881f1d4cdbbb0586258ced9309" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "296c061cc02a4d93a85ae34f72f59bd1" member_type: VOTER last_known_addr { host: "127.23.12.254" port: 42055 } } peers { permanent_uuid: "dd077a704c7a4a889977e45b086ff445" member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } } peers { permanent_uuid: "3130d0881f1d4cdbbb0586258ced9309" member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } } }
08:03:38.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.559762 23846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [sys.catalog]: This master's current role is: LEADER
08:03:38.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.562652 23873 catalog_manager.cc:1382] Generated new cluster ID: 8e7d0933bc9647c3b422f9727b48824f
08:03:38.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.562963 23873 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
08:03:38.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.565378 23861 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd077a704c7a4a889977e45b086ff445 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3130d0881f1d4cdbbb0586258ced9309" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "296c061cc02a4d93a85ae34f72f59bd1" member_type: VOTER last_known_addr { host: "127.23.12.254" port: 42055 } } peers { permanent_uuid: "dd077a704c7a4a889977e45b086ff445" member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } } peers { permanent_uuid: "3130d0881f1d4cdbbb0586258ced9309" member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } } }
08:03:38.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.566150 23861 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd077a704c7a4a889977e45b086ff445 [sys.catalog]: This master's current role is: FOLLOWER
08:03:38.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.574137 23683 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } attempt: 7
08:03:38.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.604756 23873 catalog_manager.cc:1405] Generated new certificate authority record
08:03:38.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.607334 23683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 296c061cc02a4d93a85ae34f72f59bd1: Bootstrap starting.
08:03:38.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.610302 23873 catalog_manager.cc:1539] Loading token signing keys...
08:03:38.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.618134 23683 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 296c061cc02a4d93a85ae34f72f59bd1: Neither blocks nor log segments found. Creating new log.
08:03:38.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.621053 23683 log.cc:826] T 00000000000000000000000000000000 P 296c061cc02a4d93a85ae34f72f59bd1: Log is configured to *not* fsync() on all Append() calls
08:03:38.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.626911 23683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 296c061cc02a4d93a85ae34f72f59bd1: No bootstrap required, opened a new log
08:03:38.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.646173 23873 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309: Generated new TSK 0
08:03:38.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.647306 23873 catalog_manager.cc:1549] Initializing in-progress tserver states...
08:03:38.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.658215 23683 raft_consensus.cc:359] T 00000000000000000000000000000000 P 296c061cc02a4d93a85ae34f72f59bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "296c061cc02a4d93a85ae34f72f59bd1" member_type: VOTER last_known_addr { host: "127.23.12.254" port: 42055 } } peers { permanent_uuid: "dd077a704c7a4a889977e45b086ff445" member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } } peers { permanent_uuid: "3130d0881f1d4cdbbb0586258ced9309" member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } }
08:03:38.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.659569 23683 raft_consensus.cc:385] T 00000000000000000000000000000000 P 296c061cc02a4d93a85ae34f72f59bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:03:38.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.659916 23683 raft_consensus.cc:740] T 00000000000000000000000000000000 P 296c061cc02a4d93a85ae34f72f59bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 296c061cc02a4d93a85ae34f72f59bd1, State: Initialized, Role: FOLLOWER
08:03:38.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.661223 23683 consensus_queue.cc:260] T 00000000000000000000000000000000 P 296c061cc02a4d93a85ae34f72f59bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "296c061cc02a4d93a85ae34f72f59bd1" member_type: VOTER last_known_addr { host: "127.23.12.254" port: 42055 } } peers { permanent_uuid: "dd077a704c7a4a889977e45b086ff445" member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } } peers { permanent_uuid: "3130d0881f1d4cdbbb0586258ced9309" member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } }
08:03:38.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.665129 23883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 296c061cc02a4d93a85ae34f72f59bd1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "296c061cc02a4d93a85ae34f72f59bd1" member_type: VOTER last_known_addr { host: "127.23.12.254" port: 42055 } } peers { permanent_uuid: "dd077a704c7a4a889977e45b086ff445" member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } } peers { permanent_uuid: "3130d0881f1d4cdbbb0586258ced9309" member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } } }
08:03:38.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.665548 23603 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:03:38.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:03:38.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-0/wal
08:03:38.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-0/data
08:03:38.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:03:38.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:03:38.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:03:38.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:38.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:38.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:38.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-0/logs
08:03:38.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-0/data/info.pb
08:03:38.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:38.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:03:38.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:03:38.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:03:38.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:03:38.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:38.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:38.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:03:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:03:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.12.193:0
08:03:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.12.193
08:03:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.12.193
08:03:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.12.254:42055,127.23.12.253:45283,127.23.12.252:42637
08:03:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.12.212:33445
08:03:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:38.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:03:38.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.677626 23883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 296c061cc02a4d93a85ae34f72f59bd1 [sys.catalog]: This master's current role is: FOLLOWER
08:03:38.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.677994 23683 sys_catalog.cc:565] T 00000000000000000000000000000000 P 296c061cc02a4d93a85ae34f72f59bd1 [sys.catalog]: configured and running, proceeding with master startup.
08:03:38.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.678169 23658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3130d0881f1d4cdbbb0586258ced9309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "296c061cc02a4d93a85ae34f72f59bd1" is_pre_election: true
08:03:38.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.678740 23657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3130d0881f1d4cdbbb0586258ced9309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "296c061cc02a4d93a85ae34f72f59bd1"
08:03:38.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.679466 23656 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 296c061cc02a4d93a85ae34f72f59bd1 [term 0 FOLLOWER]: Advancing to term 1
08:03:38.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.697649 23656 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 296c061cc02a4d93a85ae34f72f59bd1 [term 1 FOLLOWER]: Refusing update from remote peer 3130d0881f1d4cdbbb0586258ced9309: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:03:38.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.700546 23868 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [LEADER]: Connected to new peer: Peer: permanent_uuid: "296c061cc02a4d93a85ae34f72f59bd1" member_type: VOTER last_known_addr { host: "127.23.12.254" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:03:38.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.780642 23890 sys_catalog.cc:455] T 00000000000000000000000000000000 P 296c061cc02a4d93a85ae34f72f59bd1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3130d0881f1d4cdbbb0586258ced9309" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "296c061cc02a4d93a85ae34f72f59bd1" member_type: VOTER last_known_addr { host: "127.23.12.254" port: 42055 } } peers { permanent_uuid: "dd077a704c7a4a889977e45b086ff445" member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } } peers { permanent_uuid: "3130d0881f1d4cdbbb0586258ced9309" member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } } }
08:03:38.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.783452 23883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 296c061cc02a4d93a85ae34f72f59bd1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3130d0881f1d4cdbbb0586258ced9309. Latest consensus state: current_term: 1 leader_uuid: "3130d0881f1d4cdbbb0586258ced9309" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "296c061cc02a4d93a85ae34f72f59bd1" member_type: VOTER last_known_addr { host: "127.23.12.254" port: 42055 } } peers { permanent_uuid: "dd077a704c7a4a889977e45b086ff445" member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } } peers { permanent_uuid: "3130d0881f1d4cdbbb0586258ced9309" member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } } }
08:03:38.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.784376 23883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 296c061cc02a4d93a85ae34f72f59bd1 [sys.catalog]: This master's current role is: FOLLOWER
08:03:38.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.785475 23890 sys_catalog.cc:458] T 00000000000000000000000000000000 P 296c061cc02a4d93a85ae34f72f59bd1 [sys.catalog]: This master's current role is: FOLLOWER
08:03:38.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.820595 23901 catalog_manager.cc:1294] Loaded cluster ID: 8e7d0933bc9647c3b422f9727b48824f
08:03:38.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.820900 23901 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 296c061cc02a4d93a85ae34f72f59bd1: loading cluster ID for follower catalog manager: success
08:03:38.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.828851 23901 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 296c061cc02a4d93a85ae34f72f59bd1: acquiring CA information for follower catalog manager: success
08:03:38.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:38.834719 23901 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 296c061cc02a4d93a85ae34f72f59bd1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:03:39.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:39.203604 23884 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:03:39.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:39.204857 23884 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:03:39.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:39.205994 23884 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:03:39.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:39.223230 23868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3130d0881f1d4cdbbb0586258ced9309" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "296c061cc02a4d93a85ae34f72f59bd1" member_type: VOTER last_known_addr { host: "127.23.12.254" port: 42055 } } peers { permanent_uuid: "dd077a704c7a4a889977e45b086ff445" member_type: VOTER last_known_addr { host: "127.23.12.253" port: 45283 } } peers { permanent_uuid: "3130d0881f1d4cdbbb0586258ced9309" member_type: VOTER last_known_addr { host: "127.23.12.252" port: 42637 } } }
08:03:39.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:39.224789 23868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3130d0881f1d4cdbbb0586258ced9309 [sys.catalog]: This master's current role is: LEADER
08:03:39.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:39.269779 23884 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:03:39.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:39.271315 23884 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.12.193
08:03:39.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:39.340518 23884 tablet_server_runner.cc:78] Tablet server non-default flags:
08:03:39.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:39.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.12.212:33445
08:03:39.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:39.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:39.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-0/data
08:03:39.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-0/wal
08:03:39.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:39.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:39.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.12.193:0
08:03:39.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:03:39.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:39.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:39.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-0/data/info.pb
08:03:39.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.12.193
08:03:39.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:39.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.12.254:42055,127.23.12.253:45283,127.23.12.252:42637
08:03:39.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:03:39.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:39.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:03:39.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:03:39.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:39.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.12.193
08:03:39.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-0/logs
08:03:39.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:39.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:03:39.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:03:39.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:03:39.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:03:39.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:03:39.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:03:39.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:03:39.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:03:39.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:03:39.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:39.342312 23884 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:03:39.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:39.344597 23884 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:03:39.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:39.361730 23910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:39.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:39.522330 23875 catalog_manager.cc:1294] Loaded cluster ID: 8e7d0933bc9647c3b422f9727b48824f
08:03:39.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:39.523185 23875 catalog_manager.cc:1587] T 00000000000000000000000000000000 P dd077a704c7a4a889977e45b086ff445: loading cluster ID for follower catalog manager: success
08:03:39.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:39.544214 23875 catalog_manager.cc:1609] T 00000000000000000000000000000000 P dd077a704c7a4a889977e45b086ff445: acquiring CA information for follower catalog manager: success
08:03:39.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:39.561702 23875 catalog_manager.cc:1637] T 00000000000000000000000000000000 P dd077a704c7a4a889977e45b086ff445: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:03:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:40.768368 23909 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 23884
08:03:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:41.356181 23909 kernel_stack_watchdog.cc:198] Thread 23884 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 402ms:
08:03:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:03:41.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:03:41.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:03:41.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:03:41.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:39.365079 23911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:41.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:41.362346 23884 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.999s	user 0.560s	sys 0.844s
08:03:41.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:41.362701 23884 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.999s	user 0.560s	sys 0.844s
08:03:41.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.372860 23884 server_base.cc:1061] running on GCE node
08:03:41.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:41.373747 23918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:41.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.375303 23884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:03:41.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.379290 23884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:03:41.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.383678 23884 hybrid_clock.cc:648] HybridClock initialized: now 1779091421383616 us; error 46 us; skew 500 ppm
08:03:41.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.384862 23884 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:03:41.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.410365 23884 webserver.cc:533] Webserver started at http://127.23.12.193:40083/ using document root <none> and password file <none>
08:03:41.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.411710 23884 fs_manager.cc:362] Metadata directory not provided
08:03:41.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.412050 23884 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:03:41.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.412581 23884 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:03:41.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.418926 23884 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-0/data/instance:
08:03:41.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e5318a97a53d44a0ab8a000d860514ac"
08:03:41.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:41 on dist-test-slave-1jss"
08:03:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.420439 23884 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-0/wal/instance:
08:03:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e5318a97a53d44a0ab8a000d860514ac"
08:03:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:41 on dist-test-slave-1jss"
08:03:41.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.453646 23884 fs_manager.cc:696] Time spent creating directory manager: real 0.032s	user 0.016s	sys 0.016s
08:03:41.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.474781 23923 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:03:41.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.476321 23884 fs_manager.cc:730] Time spent opening block manager: real 0.018s	user 0.007s	sys 0.008s
08:03:41.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.476760 23884 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-0/wal
08:03:41.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e5318a97a53d44a0ab8a000d860514ac"
08:03:41.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:41 on dist-test-slave-1jss"
08:03:41.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.477239 23884 fs_report.cc:389] FS layout report
08:03:41.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:03:41.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-0/wal
08:03:41.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-0/wal
08:03:41.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-0/data/data
08:03:41.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:03:41.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:03:41.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:03:41.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:03:41.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:03:41.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:03:41.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:03:41.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:03:41.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:03:41.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:03:41.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:03:41.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.577322 23884 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:03:41.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.579401 23884 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:03:41.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.580008 23884 kserver.cc:163] Server-wide thread pool size limit: 3276
08:03:41.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.589406 23884 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:03:41.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.601236 23884 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:03:41.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.601544 23884 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:03:41.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.601922 23884 ts_tablet_manager.cc:616] Registered 0 tablets
08:03:41.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.602169 23884 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:03:41.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.934230 24036 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.12.193:35651 every 8 connection(s)
08:03:41.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.934818 23884 rpc_server.cc:307] RPC server started. Bound to: 127.23.12.193:35651
08:03:41.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.938493 23884 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-0/data/info.pb
08:03:41.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.944850 23603 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 23884
08:03:41.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.945520 23603 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-0/wal/instance
08:03:41.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.988533 23603 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:03:41.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:03:41.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-1/wal
08:03:41.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-1/data
08:03:41.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:03:41.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:03:41.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:03:41.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:41.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:41.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:41.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-1/logs
08:03:41.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-1/data/info.pb
08:03:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:03:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:03:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:03:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:03:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:03:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:03:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.12.194:0
08:03:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.12.194
08:03:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.12.194
08:03:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.12.254:42055,127.23.12.253:45283,127.23.12.252:42637
08:03:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.12.212:33445
08:03:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:03:42.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.029345 24043 heartbeater.cc:344] Connected to a master server at 127.23.12.254:42055
08:03:42.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.029919 24043 heartbeater.cc:461] Registering TS with master...
08:03:42.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.031291 24043 heartbeater.cc:507] Master 127.23.12.254:42055 requested a full tablet report, sending...
08:03:42.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.035537 23648 ts_manager.cc:194] Registered new tserver with Master: e5318a97a53d44a0ab8a000d860514ac (127.23.12.193:35651)
08:03:42.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.049348 24037 heartbeater.cc:344] Connected to a master server at 127.23.12.252:42637
08:03:42.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.049746 24037 heartbeater.cc:461] Registering TS with master...
08:03:42.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.050995 24037 heartbeater.cc:507] Master 127.23.12.252:42637 requested a full tablet report, sending...
08:03:42.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.054575 23803 ts_manager.cc:194] Registered new tserver with Master: e5318a97a53d44a0ab8a000d860514ac (127.23.12.193:35651)
08:03:42.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.057363 23803 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.12.193:40197
08:03:42.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.065933 24040 heartbeater.cc:344] Connected to a master server at 127.23.12.253:45283
08:03:42.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.066315 24040 heartbeater.cc:461] Registering TS with master...
08:03:42.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.066995 24040 heartbeater.cc:507] Master 127.23.12.253:45283 requested a full tablet report, sending...
08:03:42.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.072834 23723 ts_manager.cc:194] Registered new tserver with Master: e5318a97a53d44a0ab8a000d860514ac (127.23.12.193:35651)
08:03:42.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:42.529539 24047 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:03:42.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:42.530231 24047 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:03:42.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:42.530956 24047 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:03:42.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:42.594180 24047 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:03:42.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:42.595502 24047 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.12.194
08:03:42.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.647483 24047 tablet_server_runner.cc:78] Tablet server non-default flags:
08:03:42.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:42.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.12.212:33445
08:03:42.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:42.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:42.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-1/data
08:03:42.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-1/wal
08:03:42.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:42.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:42.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.12.194:0
08:03:42.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:03:42.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:42.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:42.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-1/data/info.pb
08:03:42.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.12.194
08:03:42.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:42.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.12.254:42055,127.23.12.253:45283,127.23.12.252:42637
08:03:42.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:03:42.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:42.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:03:42.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:03:42.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:42.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.12.194
08:03:42.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-1/logs
08:03:42.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:42.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:03:42.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:03:42.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:03:42.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:03:42.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:03:42.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:03:42.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:03:42.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:03:42.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:03:42.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.648806 24047 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:03:42.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.650576 24047 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:03:42.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:42.665782 24054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:43.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:43.062778 24037 heartbeater.cc:499] Master 127.23.12.252:42637 was elected leader, sending a full tablet report...
08:03:44.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:42.667840 24055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:44.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:44.028841 24057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:44.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:44.032351 24056 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1365 milliseconds
08:03:44.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:44.032486 24047 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.366s	user 0.424s	sys 0.805s
08:03:44.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:44.033025 24047 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.367s	user 0.424s	sys 0.805s
08:03:44.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.033356 24047 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:03:44.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.034449 24047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:03:44.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.039381 24047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:03:44.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.040982 24047 hybrid_clock.cc:648] HybridClock initialized: now 1779091424040866 us; error 88 us; skew 500 ppm
08:03:44.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.043413 24047 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:03:44.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.053293 24047 webserver.cc:533] Webserver started at http://127.23.12.194:45567/ using document root <none> and password file <none>
08:03:44.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.054768 24047 fs_manager.cc:362] Metadata directory not provided
08:03:44.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.055097 24047 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:03:44.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.055732 24047 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:03:44.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.063297 24047 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-1/data/instance:
08:03:44.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "28aa3d1914814f939e6cedae64740867"
08:03:44.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:44 on dist-test-slave-1jss"
08:03:44.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.064929 24047 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-1/wal/instance:
08:03:44.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "28aa3d1914814f939e6cedae64740867"
08:03:44.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:44 on dist-test-slave-1jss"
08:03:44.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.075888 24047 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.008s	sys 0.004s
08:03:44.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.084365 24064 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:03:44.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.085580 24047 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.004s
08:03:44.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.085979 24047 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-1/wal
08:03:44.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "28aa3d1914814f939e6cedae64740867"
08:03:44.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:44 on dist-test-slave-1jss"
08:03:44.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.086344 24047 fs_report.cc:389] FS layout report
08:03:44.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:03:44.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-1/wal
08:03:44.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-1/wal
08:03:44.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-1/data/data
08:03:44.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:03:44.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:03:44.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:03:44.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:03:44.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:03:44.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:03:44.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:03:44.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:03:44.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:03:44.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:03:44.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:03:44.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.163347 24047 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:03:44.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.164827 24047 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:03:44.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.165223 24047 kserver.cc:163] Server-wide thread pool size limit: 3276
08:03:44.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.167917 24047 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:03:44.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.172122 24047 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:03:44.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.172317 24047 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:03:44.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.172521 24047 ts_tablet_manager.cc:616] Registered 0 tablets
08:03:44.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.172662 24047 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:03:44.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.320050 24047 rpc_server.cc:307] RPC server started. Bound to: 127.23.12.194:44439
08:03:44.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.320158 24177 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.12.194:44439 every 8 connection(s)
08:03:44.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.323318 24047 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-1/data/info.pb
08:03:44.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.331772 23603 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 24047
08:03:44.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.332343 23603 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-1/wal/instance
08:03:44.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.358361 23603 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:03:44.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:03:44.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-2/wal
08:03:44.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-2/data
08:03:44.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:03:44.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:03:44.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:03:44.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:44.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:44.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:44.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-2/logs
08:03:44.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-2/data/info.pb
08:03:44.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:44.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:03:44.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:03:44.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:03:44.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:03:44.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:44.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:44.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:44.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:03:44.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:03:44.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.12.195:0
08:03:44.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.12.195
08:03:44.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.12.195
08:03:44.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:44.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.12.254:42055,127.23.12.253:45283,127.23.12.252:42637
08:03:44.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.12.212:33445
08:03:44.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:44.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:44.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:03:44.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.369462 24179 heartbeater.cc:344] Connected to a master server at 127.23.12.253:45283
08:03:44.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.369987 24179 heartbeater.cc:461] Registering TS with master...
08:03:44.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.371011 24179 heartbeater.cc:507] Master 127.23.12.253:45283 requested a full tablet report, sending...
08:03:44.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.373759 24178 heartbeater.cc:344] Connected to a master server at 127.23.12.252:42637
08:03:44.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.374120 24178 heartbeater.cc:461] Registering TS with master...
08:03:44.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.374150 23723 ts_manager.cc:194] Registered new tserver with Master: 28aa3d1914814f939e6cedae64740867 (127.23.12.194:44439)
08:03:44.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.375087 24178 heartbeater.cc:507] Master 127.23.12.252:42637 requested a full tablet report, sending...
08:03:44.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.378377 23803 ts_manager.cc:194] Registered new tserver with Master: 28aa3d1914814f939e6cedae64740867 (127.23.12.194:44439)
08:03:44.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.379695 24180 heartbeater.cc:344] Connected to a master server at 127.23.12.254:42055
08:03:44.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.380056 24180 heartbeater.cc:461] Registering TS with master...
08:03:44.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.380219 23803 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.12.194:38853
08:03:44.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.380950 24180 heartbeater.cc:507] Master 127.23.12.254:42055 requested a full tablet report, sending...
08:03:44.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.383459 23648 ts_manager.cc:194] Registered new tserver with Master: 28aa3d1914814f939e6cedae64740867 (127.23.12.194:44439)
08:03:44.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:44.686444 24188 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:03:44.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:44.686928 24188 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:03:44.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:44.687322 24188 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:03:44.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:44.721412 24188 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:03:44.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:44.722707 24188 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.12.195
08:03:44.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.759961 24188 tablet_server_runner.cc:78] Tablet server non-default flags:
08:03:44.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:44.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.12.212:33445
08:03:44.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:44.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:44.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-2/data
08:03:44.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-2/wal
08:03:44.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:44.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:44.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.12.195:0
08:03:44.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:03:44.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:44.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:44.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-2/data/info.pb
08:03:44.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.12.195
08:03:44.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:44.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.12.254:42055,127.23.12.253:45283,127.23.12.252:42637
08:03:44.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:03:44.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:44.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:03:44.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:03:44.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:44.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.12.195
08:03:44.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-2/logs
08:03:44.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:44.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:03:44.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:03:44.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:03:44.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:03:44.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:03:44.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:03:44.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:03:44.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:03:44.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:03:44.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.761399 24188 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:03:44.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.763001 24188 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:03:44.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:44.775408 24194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:45.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:45.384308 24178 heartbeater.cc:499] Master 127.23.12.252:42637 was elected leader, sending a full tablet report...
08:03:46.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:46.178520 24193 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 24188
08:03:46.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:46.490775 24193 kernel_stack_watchdog.cc:198] Thread 24188 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 400ms:
08:03:46.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:03:46.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:03:46.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:03:46.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:03:46.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:44.778048 24195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:46.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:46.493482 24188 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.718s	user 0.591s	sys 1.080s
08:03:46.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:46.494520 24188 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.719s	user 0.592s	sys 1.080s
08:03:46.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:46.495729 24197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:46.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:46.497668 24196 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1717 milliseconds
08:03:46.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.497720 24188 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:03:46.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.499013 24188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:03:46.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.501137 24188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:03:46.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.502525 24188 hybrid_clock.cc:648] HybridClock initialized: now 1779091426502489 us; error 35 us; skew 500 ppm
08:03:46.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.503525 24188 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:03:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.509696 24188 webserver.cc:533] Webserver started at http://127.23.12.195:46089/ using document root <none> and password file <none>
08:03:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.510742 24188 fs_manager.cc:362] Metadata directory not provided
08:03:46.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.510983 24188 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:03:46.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.511514 24188 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:03:46.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.516109 24188 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-2/data/instance:
08:03:46.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "aff3e5847231454bad66ef71cb36c4d3"
08:03:46.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:46 on dist-test-slave-1jss"
08:03:46.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.517290 24188 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-2/wal/instance:
08:03:46.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "aff3e5847231454bad66ef71cb36c4d3"
08:03:46.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:46 on dist-test-slave-1jss"
08:03:46.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.524873 24188 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.001s
08:03:46.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.531088 24205 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:03:46.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.532222 24188 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
08:03:46.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.532632 24188 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-2/wal
08:03:46.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "aff3e5847231454bad66ef71cb36c4d3"
08:03:46.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:46 on dist-test-slave-1jss"
08:03:46.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.533035 24188 fs_report.cc:389] FS layout report
08:03:46.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:03:46.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-2/wal
08:03:46.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-2/wal
08:03:46.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-2/data/data
08:03:46.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:03:46.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:03:46.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:03:46.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:03:46.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:03:46.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:03:46.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:03:46.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:03:46.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:03:46.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:03:46.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:03:46.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.592170 24188 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:03:46.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.593763 24188 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:03:46.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.594305 24188 kserver.cc:163] Server-wide thread pool size limit: 3276
08:03:46.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.596964 24188 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:03:46.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.601336 24188 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:03:46.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.601562 24188 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:03:46.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.601930 24188 ts_tablet_manager.cc:616] Registered 0 tablets
08:03:46.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.602131 24188 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:03:46.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.743626 24188 rpc_server.cc:307] RPC server started. Bound to: 127.23.12.195:32809
08:03:46.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.743728 24317 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.12.195:32809 every 8 connection(s)
08:03:46.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.747138 24188 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-2/data/info.pb
08:03:46.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.750540 23603 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 24188
08:03:46.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.751037 23603 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster15985066505029607554/ts-2/wal/instance
08:03:46.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.792188 24318 heartbeater.cc:344] Connected to a master server at 127.23.12.252:42637
08:03:46.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.792620 24318 heartbeater.cc:461] Registering TS with master...
08:03:46.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.793988 24318 heartbeater.cc:507] Master 127.23.12.252:42637 requested a full tablet report, sending...
08:03:46.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.794368 24319 heartbeater.cc:344] Connected to a master server at 127.23.12.253:45283
08:03:46.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.794694 24319 heartbeater.cc:461] Registering TS with master...
08:03:46.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.795560 24320 heartbeater.cc:344] Connected to a master server at 127.23.12.254:42055
08:03:46.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.795882 24320 heartbeater.cc:461] Registering TS with master...
08:03:46.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.795837 24319 heartbeater.cc:507] Master 127.23.12.253:45283 requested a full tablet report, sending...
08:03:46.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.796805 24320 heartbeater.cc:507] Master 127.23.12.254:42055 requested a full tablet report, sending...
08:03:46.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.798743 23722 ts_manager.cc:194] Registered new tserver with Master: aff3e5847231454bad66ef71cb36c4d3 (127.23.12.195:32809)
08:03:46.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.800633 23803 ts_manager.cc:194] Registered new tserver with Master: aff3e5847231454bad66ef71cb36c4d3 (127.23.12.195:32809)
08:03:46.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.801532 23647 ts_manager.cc:194] Registered new tserver with Master: aff3e5847231454bad66ef71cb36c4d3 (127.23.12.195:32809)
08:03:46.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.802567 23803 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.12.195:56453
08:03:46.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.821974 23603 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
08:03:46.834 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:03:46.835 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

08:03:46.844 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.23.12.254"
      port: 42055
    }
    bound_http_address {
      host: "127.23.12.254"
      port: 37331
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.23.12.253"
      port: 45283
    }
    bound_http_address {
      host: "127.23.12.253"
      port: 44349
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.23.12.252"
      port: 42637
    }
    bound_http_address {
      host: "127.23.12.252"
      port: 35871
    }
  }
}

08:03:46.848 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

08:03:46.850 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.23.12.193"
      port: 35651
    }
    bound_http_address {
      host: "127.23.12.193"
      port: 40083
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.23.12.194"
      port: 44439
    }
    bound_http_address {
      host: "127.23.12.194"
      port: 45567
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.23.12.195"
      port: 32809
    }
    bound_http_address {
      host: "127.23.12.195"
      port: 46089
    }
  }
}

08:03:46.851 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
08:03:46.865 [DEBUG - main] (InternalLoggerFactory.java:63) Using SLF4J as the default logging framework
08:03:46.869 [DEBUG - main] (ResourceLeakDetector.java:129) -Dorg.apache.kudu.shaded.io.netty.leakDetection.level: simple
08:03:46.870 [DEBUG - main] (ResourceLeakDetector.java:130) -Dorg.apache.kudu.shaded.io.netty.leakDetection.targetRecords: 4
08:03:46.875 [DEBUG - main] (ResourceLeakDetectorFactory.java:196) Loaded default ResourceLeakDetector: org.apache.kudu.shaded.io.netty.util.ResourceLeakDetector@21a21c64
08:03:46.900 [DEBUG - main] (PlatformDependent0.java:1138) Java version: 17
08:03:46.901 [DEBUG - main] (PlatformDependent0.java:616) -Dio.netty.noUnsafe: false
08:03:46.901 [DEBUG - main] (PlatformDependent0.java:559) Thread.isVirtual() is not available: 
08:03:46.901 [DEBUG - main] (PlatformDependent0.java:572) java.lang.BaseVirtualThread is not available: 
08:03:46.902 [DEBUG - main] (PlatformDependent0.java:145) sun.misc.Unsafe.theUnsafe: available
08:03:46.904 [DEBUG - main] (PlatformDependent0.java:208) sun.misc.Unsafe base methods: all available
08:03:46.904 [DEBUG - main] (PlatformDependent0.java:240) sun.misc.Unsafe.storeFence: available
08:03:46.904 [DEBUG - main] (PlatformDependent0.java:283) java.nio.Buffer.address: available
08:03:46.905 [DEBUG - main] (PlatformDependent0.java:369) direct buffer constructor: unavailable: Reflective setAccessible(true) disabled
08:03:46.906 [DEBUG - main] (PlatformDependent0.java:447) java.nio.Bits.unaligned: available, true
08:03:46.907 [DEBUG - main] (PlatformDependent0.java:515) jdk.internal.misc.Unsafe.allocateUninitializedArray(int): unavailable: class org.apache.kudu.shaded.io.netty.util.internal.PlatformDependent0$7 cannot access class jdk.internal.misc.Unsafe (in module java.base) because module java.base does not export jdk.internal.misc to unnamed module @c540f5a
08:03:46.909 [DEBUG - main] (PlatformDependent0.java:545) java.nio.DirectByteBuffer.<init>(long, {int,long}): unavailable
08:03:46.909 [DEBUG - main] (PlatformDependent.java:1214) sun.misc.Unsafe: available
08:03:46.909 [DEBUG - main] (PlatformDependent.java:1360) -Dio.netty.tmpdir: /tmp (java.io.tmpdir)
08:03:46.909 [DEBUG - main] (PlatformDependent.java:1439) -Dio.netty.bitMode: 64 (sun.arch.data.model)
08:03:46.910 [DEBUG - main] (PlatformDependent.java:181) -Dio.netty.maxDirectMemory: -1 bytes
08:03:46.910 [DEBUG - main] (PlatformDependent.java:188) -Dio.netty.uninitializedArrayAllocationThreshold: -1
08:03:46.911 [DEBUG - main] (CleanerJava9.java:71) java.nio.ByteBuffer.cleaner(): available
08:03:46.911 [DEBUG - main] (PlatformDependent.java:209) -Dio.netty.noPreferDirect: false
08:03:46.923 [DEBUG - main] (PlatformDependent.java:1048) org.jctools-core.MpscChunkedArrayQueue: available
08:03:46.974 [DEBUG - main] (MultithreadEventLoopGroup.java:44) -Dio.netty.eventLoopThreads: 8
08:03:46.987 [DEBUG - main] (GlobalEventExecutor.java:54) -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1
08:03:46.993 [DEBUG - main] (InternalThreadLocalMap.java:100) -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024
08:03:46.993 [DEBUG - main] (InternalThreadLocalMap.java:101) -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096
08:03:47.001 [DEBUG - main] (NioEventLoop.java:110) -Dio.netty.noKeySetOptimization: false
08:03:47.001 [DEBUG - main] (NioEventLoop.java:111) -Dio.netty.selectorAutoRebuildThreshold: 512
08:03:47.050 [DEBUG - main] (PooledByteBufAllocator.java:161) -Dio.netty.allocator.numHeapArenas: 8
08:03:47.051 [DEBUG - main] (PooledByteBufAllocator.java:162) -Dio.netty.allocator.numDirectArenas: 8
08:03:47.051 [DEBUG - main] (PooledByteBufAllocator.java:164) -Dio.netty.allocator.pageSize: 8192
08:03:47.051 [DEBUG - main] (PooledByteBufAllocator.java:169) -Dio.netty.allocator.maxOrder: 9
08:03:47.051 [DEBUG - main] (PooledByteBufAllocator.java:173) -Dio.netty.allocator.chunkSize: 4194304
08:03:47.051 [DEBUG - main] (PooledByteBufAllocator.java:174) -Dio.netty.allocator.smallCacheSize: 256
08:03:47.051 [DEBUG - main] (PooledByteBufAllocator.java:175) -Dio.netty.allocator.normalCacheSize: 64
08:03:47.051 [DEBUG - main] (PooledByteBufAllocator.java:176) -Dio.netty.allocator.maxCachedBufferCapacity: 32768
08:03:47.051 [DEBUG - main] (PooledByteBufAllocator.java:177) -Dio.netty.allocator.cacheTrimInterval: 8192
08:03:47.051 [DEBUG - main] (PooledByteBufAllocator.java:178) -Dio.netty.allocator.cacheTrimIntervalMillis: 0
08:03:47.051 [DEBUG - main] (PooledByteBufAllocator.java:179) -Dio.netty.allocator.useCacheForAllThreads: false
08:03:47.051 [DEBUG - main] (PooledByteBufAllocator.java:180) -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023
08:03:47.051 [DEBUG - main] (PooledByteBufAllocator.java:182) -Dio.netty.allocator.disableCacheFinalizersForFastThreadLocalThreads: false
08:03:47.068 [DEBUG - main] (CompositeStrategy.java:59) Unable to load modern Subject methods, relying only on legacy methods
java.lang.NoSuchMethodException: javax.security.auth.Subject.current()
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2677)
	at org.apache.kudu.client.internals.ModernStrategy.<init>(ModernStrategy.java:51)
	at org.apache.kudu.client.internals.CompositeStrategy.<init>(CompositeStrategy.java:52)
	at org.apache.kudu.client.internals.CompositeStrategy.<clinit>(CompositeStrategy.java:41)
	at org.apache.kudu.client.internals.SecurityManagerCompatibility.get(SecurityManagerCompatibility.java:43)
	at org.apache.kudu.client.SecurityContext.setupSubject(SecurityContext.java:155)
	at org.apache.kudu.client.SecurityContext.<init>(SecurityContext.java:138)
	at org.apache.kudu.client.AsyncKuduClient.<init>(AsyncKuduClient.java:431)
	at org.apache.kudu.client.AsyncKuduClient$AsyncKuduClientBuilder.build(AsyncKuduClient.java:3109)
	at org.apache.kudu.test.KuduTestHarness.before(KuduTestHarness.java:161)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
08:03:47.139 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:03:47.221 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
08:03:47.222 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskk4_r_T/test-tmp
08:03:47.222 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
08:03:47.222 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskk4_r_T/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
08:03:47.226 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

08:03:47.575 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:03:47.575 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

08:03:47.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.578929 24329 mini_oidc.cc:150] Starting JWKS server
08:03:47.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.582166 24329 webserver.cc:533] Webserver started at http://127.0.0.1:43495/ using document root <none> and password file <none>
08:03:47.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.582574 24329 mini_oidc.cc:186] Starting OIDC Discovery server
08:03:47.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.584327 24329 webserver.cc:533] Webserver started at http://127.0.0.1:38279/ using document root <none> and password file <none>
08:03:47.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:03:47Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
08:03:47.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:03:47Z Disabled control of system clock
08:03:47.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.647965 24329 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:03:47.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:03:47.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-0/wal
08:03:47.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-0/data
08:03:47.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:03:47.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:03:47.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:03:47.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:47.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:47.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:47.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-0/logs
08:03:47.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-0/data/info.pb
08:03:47.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:47.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:03:47.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:03:47.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:03:47.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:03:47.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:47.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:47.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:47.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:03:47.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:03:47.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:03:47.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:03:47.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.194.126:38579
08:03:47.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.194.126
08:03:47.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:47.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.194.84:42435
08:03:47.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:47.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:47.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:47.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:03:47.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943
08:03:47.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:03:47.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43495/jwks.json with env {}
08:03:47.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.806172 24318 heartbeater.cc:499] Master 127.23.12.252:42637 was elected leader, sending a full tablet report...
08:03:47.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:47.985261 24342 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:03:47.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:47.985888 24342 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:03:47.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:47.986384 24342 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:03:48.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:48.022317 24342 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:03:48.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:48.022620 24342 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:03:48.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:48.022817 24342 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:03:48.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:48.023103 24342 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:03:48.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:48.023423 24342 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:03:48.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:48.023716 24342 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:43495/jwks.json
08:03:48.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:48.062496 24342 master_runner.cc:387] Master server non-default flags:
08:03:48.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:48.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.194.84:42435
08:03:48.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:48.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:48.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-0/data
08:03:48.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-0/wal
08:03:48.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:03:48.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943
08:03:48.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:48.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:48.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:03:48.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.194.126:38579
08:03:48.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:03:48.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:03:48.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:03:48.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43495/jwks.json
08:03:48.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:48.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:48.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-0/data/info.pb
08:03:48.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.194.126
08:03:48.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:48.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:03:48.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:48.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:03:48.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:03:48.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:48.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-0/logs
08:03:48.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:48.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:03:48.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:03:48.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:03:48.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:03:48.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:03:48.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:03:48.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:03:48.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:03:48.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:03:48.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:48.064352 24342 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:03:48.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:48.066382 24342 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:03:48.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:48.079613 24349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:49.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:48.082872 24351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:49.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:48.081002 24348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:49.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:49.309054 24350 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
08:03:49.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.309091 24342 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:03:49.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.314051 24342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:03:49.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.317065 24342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:03:49.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.318504 24342 hybrid_clock.cc:648] HybridClock initialized: now 1779091429318423 us; error 78 us; skew 500 ppm
08:03:49.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.319535 24342 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:03:49.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.326992 24342 webserver.cc:533] Webserver started at http://127.23.194.126:33503/ using document root <none> and password file <none>
08:03:49.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.328233 24342 fs_manager.cc:362] Metadata directory not provided
08:03:49.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.328522 24342 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:03:49.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.329182 24342 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:03:49.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.336007 24342 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-0/data/instance:
08:03:49.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8413f65f08f54193b86b91961e1b28b8"
08:03:49.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:49 on dist-test-slave-1jss"
08:03:49.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.337570 24342 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-0/wal/instance:
08:03:49.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8413f65f08f54193b86b91961e1b28b8"
08:03:49.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:49 on dist-test-slave-1jss"
08:03:49.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.346531 24342 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.001s
08:03:49.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.352896 24359 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:03:49.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.354130 24342 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
08:03:49.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.354496 24342 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-0/wal
08:03:49.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8413f65f08f54193b86b91961e1b28b8"
08:03:49.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:49 on dist-test-slave-1jss"
08:03:49.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.354916 24342 fs_report.cc:389] FS layout report
08:03:49.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:03:49.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-0/wal
08:03:49.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-0/wal
08:03:49.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-0/data/data
08:03:49.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:03:49.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:03:49.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:03:49.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:03:49.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:03:49.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:03:49.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:03:49.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:03:49.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:03:49.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:03:49.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:03:49.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.413610 24342 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:03:49.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.415169 24342 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:03:49.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.415566 24342 kserver.cc:163] Server-wide thread pool size limit: 3276
08:03:49.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.491042 24342 rpc_server.cc:307] RPC server started. Bound to: 127.23.194.126:38579
08:03:49.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.491192 24410 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.194.126:38579 every 8 connection(s)
08:03:49.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.494028 24342 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-0/data/info.pb
08:03:49.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.500085 24411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:03:49.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.502885 24329 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 24342
08:03:49.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.503373 24329 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-0/wal/instance
08:03:49.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.508911 24329 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:03:49.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:03:49.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-1/wal
08:03:49.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-1/data
08:03:49.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:03:49.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:03:49.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:03:49.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:49.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:49.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:49.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-1/logs
08:03:49.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-1/data/info.pb
08:03:49.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:49.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:03:49.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:03:49.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:03:49.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:03:49.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:49.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:49.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:49.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:03:49.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:03:49.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:03:49.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:03:49.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.194.125:38689
08:03:49.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.194.125
08:03:49.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:49.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.194.84:42435
08:03:49.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:49.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:49.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:49.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:03:49.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943
08:03:49.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:03:49.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43495/jwks.json with env {}
08:03:49.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.515954 24411 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.194.126" port: 38579 } has no permanent_uuid. Determining permanent_uuid...
08:03:49.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.545099 24411 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } has no permanent_uuid. Determining permanent_uuid...
08:03:49.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:49.547438 24362 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.194.125:38689: connect: Connection refused (error 111)
08:03:49.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:49.551744 24411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.194.125:38689: Network error: Client connection negotiation failed: client connection to 127.23.194.125:38689: connect: Connection refused (error 111)
08:03:49.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.601316 24411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } attempt: 1
08:03:49.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:49.605614 24411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.194.125:38689: Network error: Client connection negotiation failed: client connection to 127.23.194.125:38689: connect: Connection refused (error 111)
08:03:49.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.674146 24411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } attempt: 2
08:03:49.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:49.679001 24411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.194.125:38689: Network error: Client connection negotiation failed: client connection to 127.23.194.125:38689: connect: Connection refused (error 111)
08:03:49.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.770483 24411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } attempt: 3
08:03:49.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:49.775213 24411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.194.125:38689: Network error: Client connection negotiation failed: client connection to 127.23.194.125:38689: connect: Connection refused (error 111)
08:03:49.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:49.838347 24413 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:03:49.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:49.838872 24413 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:03:49.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:49.839308 24413 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:03:49.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:49.872831 24413 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:03:49.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:49.873238 24413 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:03:49.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:49.873616 24413 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:03:49.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:49.873992 24413 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:03:49.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:49.874359 24413 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:03:49.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:49.874630 24413 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:43495/jwks.json
08:03:49.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.918679 24411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } attempt: 4
08:03:49.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:49.925220 24411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.194.125:38689: Network error: Client connection negotiation failed: client connection to 127.23.194.125:38689: connect: Connection refused (error 111)
08:03:49.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.928478 24413 master_runner.cc:387] Master server non-default flags:
08:03:49.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:49.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.194.84:42435
08:03:49.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:49.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:49.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-1/data
08:03:49.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-1/wal
08:03:49.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:03:49.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943
08:03:49.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:49.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:49.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:03:49.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.194.125:38689
08:03:49.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:03:49.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:03:49.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:03:49.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43495/jwks.json
08:03:49.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:49.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:49.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-1/data/info.pb
08:03:49.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.194.125
08:03:49.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:49.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:03:49.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:49.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:03:49.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:03:49.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:49.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-1/logs
08:03:49.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:49.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:03:49.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:03:49.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:03:49.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:03:49.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:03:49.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:03:49.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:03:49.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:03:49.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:03:49.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.930228 24413 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:03:49.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:49.932381 24413 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:03:49.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:49.945948 24422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:50.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.224635 24411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } attempt: 5
08:03:50.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:50.228895 24411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.194.125:38689: Network error: Client connection negotiation failed: client connection to 127.23.194.125:38689: connect: Connection refused (error 111)
08:03:50.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.776276 24411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } attempt: 6
08:03:50.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:50.783555 24411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.194.125:38689: Network error: Client connection negotiation failed: client connection to 127.23.194.125:38689: connect: Connection refused (error 111)
08:03:51.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:49.946465 24423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:51.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:49.951858 24425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:51.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.176934 24424 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
08:03:51.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.177085 24413 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:03:51.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.182174 24413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:03:51.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.185369 24413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:03:51.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.186797 24413 hybrid_clock.cc:648] HybridClock initialized: now 1779091431186752 us; error 62 us; skew 500 ppm
08:03:51.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.187573 24413 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:03:51.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.193977 24413 webserver.cc:533] Webserver started at http://127.23.194.125:46485/ using document root <none> and password file <none>
08:03:51.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.194859 24413 fs_manager.cc:362] Metadata directory not provided
08:03:51.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.195048 24413 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:03:51.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.195438 24413 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:03:51.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.200004 24413 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-1/data/instance:
08:03:51.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bf3bff2bfe2c48098e1d54555850d04b"
08:03:51.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:51 on dist-test-slave-1jss"
08:03:51.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.201175 24413 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-1/wal/instance:
08:03:51.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bf3bff2bfe2c48098e1d54555850d04b"
08:03:51.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:51 on dist-test-slave-1jss"
08:03:51.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.209052 24413 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.010s	sys 0.000s
08:03:51.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.214689 24434 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:03:51.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.215837 24413 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
08:03:51.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.216128 24413 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-1/wal
08:03:51.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bf3bff2bfe2c48098e1d54555850d04b"
08:03:51.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:51 on dist-test-slave-1jss"
08:03:51.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.216426 24413 fs_report.cc:389] FS layout report
08:03:51.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:03:51.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-1/wal
08:03:51.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-1/wal
08:03:51.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-1/data/data
08:03:51.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:03:51.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:03:51.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:03:51.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:03:51.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:03:51.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:03:51.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:03:51.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:03:51.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:03:51.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:03:51.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:03:51.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.278697 24413 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:03:51.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.280167 24413 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:03:51.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.280568 24413 kserver.cc:163] Server-wide thread pool size limit: 3276
08:03:51.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.355391 24413 rpc_server.cc:307] RPC server started. Bound to: 127.23.194.125:38689
08:03:51.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.355472 24485 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.194.125:38689 every 8 connection(s)
08:03:51.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.358191 24413 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-1/data/info.pb
08:03:51.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.363880 24486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:03:51.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.366833 24329 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 24413
08:03:51.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.367280 24329 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-1/wal/instance
08:03:51.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.370183 24329 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:03:51.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:03:51.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-2/wal
08:03:51.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-2/data
08:03:51.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:03:51.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:03:51.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:03:51.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:51.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:51.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:51.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-2/logs
08:03:51.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-2/data/info.pb
08:03:51.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:51.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:03:51.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:03:51.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:03:51.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:03:51.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:51.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:51.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:51.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:03:51.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:03:51.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:03:51.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:03:51.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.194.124:38943
08:03:51.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.194.124
08:03:51.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:51.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.194.84:42435
08:03:51.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:51.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:51.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:51.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:03:51.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943
08:03:51.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:03:51.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43495/jwks.json with env {}
08:03:51.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.378731 24486 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.194.126" port: 38579 } has no permanent_uuid. Determining permanent_uuid...
08:03:51.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.404175 24486 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } has no permanent_uuid. Determining permanent_uuid...
08:03:51.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.420624 24486 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } has no permanent_uuid. Determining permanent_uuid...
08:03:51.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.423574 24435 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.194.124:38943: connect: Connection refused (error 111)
08:03:51.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.428422 24486 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.194.124:38943: Network error: Client connection negotiation failed: client connection to 127.23.194.124:38943: connect: Connection refused (error 111)
08:03:51.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.477963 24486 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } attempt: 1
08:03:51.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.482702 24486 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.194.124:38943: Network error: Client connection negotiation failed: client connection to 127.23.194.124:38943: connect: Connection refused (error 111)
08:03:51.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.551080 24486 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } attempt: 2
08:03:51.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.555347 24486 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.194.124:38943: Network error: Client connection negotiation failed: client connection to 127.23.194.124:38943: connect: Connection refused (error 111)
08:03:51.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.646741 24486 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } attempt: 3
08:03:51.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.650967 24486 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.194.124:38943: Network error: Client connection negotiation failed: client connection to 127.23.194.124:38943: connect: Connection refused (error 111)
08:03:51.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.701735 24488 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:03:51.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.702471 24488 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:03:51.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.703075 24488 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:03:51.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.737787 24488 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:03:51.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.738219 24488 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:03:51.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.738554 24488 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:03:51.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.738893 24488 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:03:51.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.739219 24488 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:03:51.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.739464 24488 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:43495/jwks.json
08:03:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.777666 24488 master_runner.cc:387] Master server non-default flags:
08:03:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.194.84:42435
08:03:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-2/data
08:03:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-2/wal
08:03:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:03:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943
08:03:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:51.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:51.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:03:51.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.194.124:38943
08:03:51.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:03:51.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:03:51.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:03:51.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43495/jwks.json
08:03:51.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:51.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:51.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-2/data/info.pb
08:03:51.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.194.124
08:03:51.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:51.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:03:51.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:51.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:03:51.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:03:51.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:51.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-2/logs
08:03:51.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:51.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:03:51.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:03:51.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:03:51.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:03:51.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:03:51.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:03:51.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:03:51.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:03:51.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:03:51.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.779429 24488 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:03:51.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.781388 24488 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:03:51.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.792500 24498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:51.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.794307 24486 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } attempt: 4
08:03:51.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.800284 24486 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.194.124:38943: Network error: Client connection negotiation failed: client connection to 127.23.194.124:38943: connect: Connection refused (error 111)
08:03:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.844321 24411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } attempt: 7
08:03:51.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.889416 24411 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } has no permanent_uuid. Determining permanent_uuid...
08:03:51.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.933205 24411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.194.124:38943: Network error: Client connection negotiation failed: client connection to 127.23.194.124:38943: connect: Connection refused (error 111)
08:03:51.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.991786 24411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } attempt: 1
08:03:51.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.997726 24411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.194.124:38943: Network error: Client connection negotiation failed: client connection to 127.23.194.124:38943: connect: Connection refused (error 111)
08:03:52.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.079181 24411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } attempt: 2
08:03:52.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:52.086982 24411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.194.124:38943: Network error: Client connection negotiation failed: client connection to 127.23.194.124:38943: connect: Connection refused (error 111)
08:03:52.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.099740 24486 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } attempt: 5
08:03:52.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:52.107614 24486 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.194.124:38943: Network error: Client connection negotiation failed: client connection to 127.23.194.124:38943: connect: Connection refused (error 111)
08:03:52.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.172535 24411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } attempt: 3
08:03:52.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:52.180728 24411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.194.124:38943: Network error: Client connection negotiation failed: client connection to 127.23.194.124:38943: connect: Connection refused (error 111)
08:03:52.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.321274 24411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } attempt: 4
08:03:52.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:52.330799 24411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.194.124:38943: Network error: Client connection negotiation failed: client connection to 127.23.194.124:38943: connect: Connection refused (error 111)
08:03:52.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.614280 24411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } attempt: 5
08:03:52.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:52.627375 24411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.194.124:38943: Network error: Client connection negotiation failed: client connection to 127.23.194.124:38943: connect: Connection refused (error 111)
08:03:52.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.655170 24486 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } attempt: 6
08:03:52.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:52.690230 24486 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.194.124:38943: Network error: Client connection negotiation failed: client connection to 127.23.194.124:38943: connect: Connection refused (error 111)
08:03:53.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.180024 24411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } attempt: 6
08:03:53.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:53.209697 24411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.194.124:38943: Network error: Client connection negotiation failed: client connection to 127.23.194.124:38943: connect: Connection refused (error 111)
08:03:53.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:53.195420 24497 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 24488
08:03:53.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.794193 24499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:53.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:53.471666 24488 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.672s	user 0.569s	sys 0.992s
08:03:53.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:53.472836 24488 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.680s	user 0.569s	sys 0.993s
08:03:53.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:53.473989 24501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:53.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:53.479084 24500 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1678 milliseconds
08:03:53.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.479106 24488 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:03:53.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.480516 24488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:03:53.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.482977 24488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:03:53.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.484328 24488 hybrid_clock.cc:648] HybridClock initialized: now 1779091433484294 us; error 79 us; skew 500 ppm
08:03:53.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.485106 24488 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:03:53.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.492103 24488 webserver.cc:533] Webserver started at http://127.23.194.124:44547/ using document root <none> and password file <none>
08:03:53.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.493316 24488 fs_manager.cc:362] Metadata directory not provided
08:03:53.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.493582 24488 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:03:53.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.494184 24488 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:03:53.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.500681 24488 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-2/data/instance:
08:03:53.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ceb52c38d50c4a4ba18ba84890fee76a"
08:03:53.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:53 on dist-test-slave-1jss"
08:03:53.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.502197 24488 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-2/wal/instance:
08:03:53.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ceb52c38d50c4a4ba18ba84890fee76a"
08:03:53.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:53 on dist-test-slave-1jss"
08:03:53.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.510285 24488 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
08:03:53.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.516062 24518 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:03:53.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.517362 24488 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.001s
08:03:53.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.517665 24488 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-2/wal
08:03:53.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ceb52c38d50c4a4ba18ba84890fee76a"
08:03:53.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:53 on dist-test-slave-1jss"
08:03:53.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.518051 24488 fs_report.cc:389] FS layout report
08:03:53.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:03:53.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-2/wal
08:03:53.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-2/wal
08:03:53.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-2/data/data
08:03:53.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:03:53.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:03:53.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:03:53.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:03:53.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:03:53.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:03:53.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:03:53.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:03:53.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:03:53.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:03:53.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:03:53.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.577418 24488 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:03:53.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.579102 24488 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:03:53.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.579535 24488 kserver.cc:163] Server-wide thread pool size limit: 3276
08:03:53.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.656504 24488 rpc_server.cc:307] RPC server started. Bound to: 127.23.194.124:38943
08:03:53.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.656574 24569 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.194.124:38943 every 8 connection(s)
08:03:53.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.659224 24488 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-2/data/info.pb
08:03:53.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.664687 24329 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 24488
08:03:53.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.665162 24329 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/master-2/wal/instance
08:03:53.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.665768 24570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:03:53.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.684154 24570 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.194.126" port: 38579 } has no permanent_uuid. Determining permanent_uuid...
08:03:53.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.709228 24570 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } has no permanent_uuid. Determining permanent_uuid...
08:03:53.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.719699 24570 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } has no permanent_uuid. Determining permanent_uuid...
08:03:53.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.736848 24570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ceb52c38d50c4a4ba18ba84890fee76a: Bootstrap starting.
08:03:53.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.743790 24570 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ceb52c38d50c4a4ba18ba84890fee76a: Neither blocks nor log segments found. Creating new log.
08:03:53.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.746115 24570 log.cc:826] T 00000000000000000000000000000000 P ceb52c38d50c4a4ba18ba84890fee76a: Log is configured to *not* fsync() on all Append() calls
08:03:53.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.750802 24486 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } attempt: 7
08:03:53.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.751185 24570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ceb52c38d50c4a4ba18ba84890fee76a: No bootstrap required, opened a new log
08:03:53.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.771824 24486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b: Bootstrap starting.
08:03:53.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.775381 24570 raft_consensus.cc:359] T 00000000000000000000000000000000 P ceb52c38d50c4a4ba18ba84890fee76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8413f65f08f54193b86b91961e1b28b8" member_type: VOTER last_known_addr { host: "127.23.194.126" port: 38579 } } peers { permanent_uuid: "bf3bff2bfe2c48098e1d54555850d04b" member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } } peers { permanent_uuid: "ceb52c38d50c4a4ba18ba84890fee76a" member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } }
08:03:53.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.776072 24570 raft_consensus.cc:385] T 00000000000000000000000000000000 P ceb52c38d50c4a4ba18ba84890fee76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:03:53.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.776350 24570 raft_consensus.cc:740] T 00000000000000000000000000000000 P ceb52c38d50c4a4ba18ba84890fee76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb52c38d50c4a4ba18ba84890fee76a, State: Initialized, Role: FOLLOWER
08:03:53.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.777254 24570 consensus_queue.cc:260] T 00000000000000000000000000000000 P ceb52c38d50c4a4ba18ba84890fee76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8413f65f08f54193b86b91961e1b28b8" member_type: VOTER last_known_addr { host: "127.23.194.126" port: 38579 } } peers { permanent_uuid: "bf3bff2bfe2c48098e1d54555850d04b" member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } } peers { permanent_uuid: "ceb52c38d50c4a4ba18ba84890fee76a" member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } }
08:03:53.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.778261 24486 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b: Neither blocks nor log segments found. Creating new log.
08:03:53.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.780720 24486 log.cc:826] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b: Log is configured to *not* fsync() on all Append() calls
08:03:53.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.780236 24580 sys_catalog.cc:455] T 00000000000000000000000000000000 P ceb52c38d50c4a4ba18ba84890fee76a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8413f65f08f54193b86b91961e1b28b8" member_type: VOTER last_known_addr { host: "127.23.194.126" port: 38579 } } peers { permanent_uuid: "bf3bff2bfe2c48098e1d54555850d04b" member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } } peers { permanent_uuid: "ceb52c38d50c4a4ba18ba84890fee76a" member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } } }
08:03:53.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.781069 24580 sys_catalog.cc:458] T 00000000000000000000000000000000 P ceb52c38d50c4a4ba18ba84890fee76a [sys.catalog]: This master's current role is: FOLLOWER
08:03:53.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.781780 24570 sys_catalog.cc:565] T 00000000000000000000000000000000 P ceb52c38d50c4a4ba18ba84890fee76a [sys.catalog]: configured and running, proceeding with master startup.
08:03:53.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.788070 24486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b: No bootstrap required, opened a new log
08:03:53.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:53.813066 24592 catalog_manager.cc:1593] T 00000000000000000000000000000000 P ceb52c38d50c4a4ba18ba84890fee76a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:03:53.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:53.813438 24592 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:03:53.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.819062 24486 raft_consensus.cc:359] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8413f65f08f54193b86b91961e1b28b8" member_type: VOTER last_known_addr { host: "127.23.194.126" port: 38579 } } peers { permanent_uuid: "bf3bff2bfe2c48098e1d54555850d04b" member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } } peers { permanent_uuid: "ceb52c38d50c4a4ba18ba84890fee76a" member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } }
08:03:53.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.820598 24486 raft_consensus.cc:385] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:03:53.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.820935 24486 raft_consensus.cc:740] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf3bff2bfe2c48098e1d54555850d04b, State: Initialized, Role: FOLLOWER
08:03:53.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.821866 24486 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8413f65f08f54193b86b91961e1b28b8" member_type: VOTER last_known_addr { host: "127.23.194.126" port: 38579 } } peers { permanent_uuid: "bf3bff2bfe2c48098e1d54555850d04b" member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } } peers { permanent_uuid: "ceb52c38d50c4a4ba18ba84890fee76a" member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } }
08:03:53.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.830405 24594 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8413f65f08f54193b86b91961e1b28b8" member_type: VOTER last_known_addr { host: "127.23.194.126" port: 38579 } } peers { permanent_uuid: "bf3bff2bfe2c48098e1d54555850d04b" member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } } peers { permanent_uuid: "ceb52c38d50c4a4ba18ba84890fee76a" member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } } }
08:03:53.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.834056 24486 sys_catalog.cc:565] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [sys.catalog]: configured and running, proceeding with master startup.
08:03:53.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:53.835153 24524 tablet.cc:2404] T 00000000000000000000000000000000 P ceb52c38d50c4a4ba18ba84890fee76a: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:03:53.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.808084 24488 master_runner.cc:187] Error getting master registration for 127.23.194.126:38579: OK, instance_id { permanent_uuid: "8413f65f08f54193b86b91961e1b28b8" instance_seqno: 1779091429470437 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:03:53.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.839174 24488 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:03:53.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.834405 24594 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [sys.catalog]: This master's current role is: FOLLOWER
08:03:53.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:53.875403 24605 catalog_manager.cc:1593] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:03:53.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:53.876173 24605 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:03:53.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.870347 24413 master_runner.cc:187] Error getting master registration for 127.23.194.126:38579: OK, instance_id { permanent_uuid: "8413f65f08f54193b86b91961e1b28b8" instance_seqno: 1779091429470437 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:03:53.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.902289 24413 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:03:53.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.949430 24594 raft_consensus.cc:493] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:03:53.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.950073 24594 raft_consensus.cc:515] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8413f65f08f54193b86b91961e1b28b8" member_type: VOTER last_known_addr { host: "127.23.194.126" port: 38579 } } peers { permanent_uuid: "bf3bff2bfe2c48098e1d54555850d04b" member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } } peers { permanent_uuid: "ceb52c38d50c4a4ba18ba84890fee76a" member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } }
08:03:53.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.969343 24594 leader_election.cc:290] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8413f65f08f54193b86b91961e1b28b8 (127.23.194.126:38579), ceb52c38d50c4a4ba18ba84890fee76a (127.23.194.124:38943)
08:03:53.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.970784 24545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bf3bff2bfe2c48098e1d54555850d04b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb52c38d50c4a4ba18ba84890fee76a" is_pre_election: true
08:03:53.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.971778 24545 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ceb52c38d50c4a4ba18ba84890fee76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf3bff2bfe2c48098e1d54555850d04b in term 0.
08:03:53.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.973167 24435 leader_election.cc:304] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bf3bff2bfe2c48098e1d54555850d04b, ceb52c38d50c4a4ba18ba84890fee76a; no voters: 
08:03:53.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.977074 24594 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [term 0 FOLLOWER]: Leader pre-election won for term 1
08:03:53.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.977461 24594 raft_consensus.cc:493] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:03:53.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.977965 24594 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [term 0 FOLLOWER]: Advancing to term 1
08:03:53.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.998451 24594 raft_consensus.cc:515] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8413f65f08f54193b86b91961e1b28b8" member_type: VOTER last_known_addr { host: "127.23.194.126" port: 38579 } } peers { permanent_uuid: "bf3bff2bfe2c48098e1d54555850d04b" member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } } peers { permanent_uuid: "ceb52c38d50c4a4ba18ba84890fee76a" member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } }
08:03:54.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.010504 24594 leader_election.cc:290] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [CANDIDATE]: Term 1 election: Requested vote from peers 8413f65f08f54193b86b91961e1b28b8 (127.23.194.126:38579), ceb52c38d50c4a4ba18ba84890fee76a (127.23.194.124:38943)
08:03:54.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.011667 24545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bf3bff2bfe2c48098e1d54555850d04b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb52c38d50c4a4ba18ba84890fee76a"
08:03:54.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.012290 24545 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ceb52c38d50c4a4ba18ba84890fee76a [term 0 FOLLOWER]: Advancing to term 1
08:03:54.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.019959 24545 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ceb52c38d50c4a4ba18ba84890fee76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf3bff2bfe2c48098e1d54555850d04b in term 1.
08:03:54.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.021343 24435 leader_election.cc:304] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bf3bff2bfe2c48098e1d54555850d04b, ceb52c38d50c4a4ba18ba84890fee76a; no voters: 
08:03:54.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.022600 24594 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [term 1 FOLLOWER]: Leader election won for term 1
08:03:54.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.033921 24594 raft_consensus.cc:697] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [term 1 LEADER]: Becoming Leader. State: Replica: bf3bff2bfe2c48098e1d54555850d04b, State: Running, Role: LEADER
08:03:54.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.035327 24594 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8413f65f08f54193b86b91961e1b28b8" member_type: VOTER last_known_addr { host: "127.23.194.126" port: 38579 } } peers { permanent_uuid: "bf3bff2bfe2c48098e1d54555850d04b" member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } } peers { permanent_uuid: "ceb52c38d50c4a4ba18ba84890fee76a" member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } }
08:03:54.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:54.038659 24440 tablet.cc:2404] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:03:54.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.048821 24607 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf3bff2bfe2c48098e1d54555850d04b. Latest consensus state: current_term: 1 leader_uuid: "bf3bff2bfe2c48098e1d54555850d04b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8413f65f08f54193b86b91961e1b28b8" member_type: VOTER last_known_addr { host: "127.23.194.126" port: 38579 } } peers { permanent_uuid: "bf3bff2bfe2c48098e1d54555850d04b" member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } } peers { permanent_uuid: "ceb52c38d50c4a4ba18ba84890fee76a" member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } } }
08:03:54.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.051517 24607 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [sys.catalog]: This master's current role is: LEADER
08:03:54.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.106503 24609 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
08:03:54.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.114835 24609 catalog_manager.cc:1519] Initializing Kudu cluster ID...
08:03:54.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.136857 24545 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ceb52c38d50c4a4ba18ba84890fee76a [term 1 FOLLOWER]: Refusing update from remote peer bf3bff2bfe2c48098e1d54555850d04b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:03:54.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.142001 24607 consensus_queue.cc:1048] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb52c38d50c4a4ba18ba84890fee76a" member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:03:54.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.180579 24580 sys_catalog.cc:455] T 00000000000000000000000000000000 P ceb52c38d50c4a4ba18ba84890fee76a [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf3bff2bfe2c48098e1d54555850d04b. Latest consensus state: current_term: 1 leader_uuid: "bf3bff2bfe2c48098e1d54555850d04b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8413f65f08f54193b86b91961e1b28b8" member_type: VOTER last_known_addr { host: "127.23.194.126" port: 38579 } } peers { permanent_uuid: "bf3bff2bfe2c48098e1d54555850d04b" member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } } peers { permanent_uuid: "ceb52c38d50c4a4ba18ba84890fee76a" member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } } }
08:03:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.183075 24609 catalog_manager.cc:1382] Generated new cluster ID: ac373351399c4bc3a4fb65331bda5e3b
08:03:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.183378 24609 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
08:03:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.184190 24594 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bf3bff2bfe2c48098e1d54555850d04b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8413f65f08f54193b86b91961e1b28b8" member_type: VOTER last_known_addr { host: "127.23.194.126" port: 38579 } } peers { permanent_uuid: "bf3bff2bfe2c48098e1d54555850d04b" member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } } peers { permanent_uuid: "ceb52c38d50c4a4ba18ba84890fee76a" member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } } }
08:03:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.184923 24594 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [sys.catalog]: This master's current role is: LEADER
08:03:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.185930 24580 sys_catalog.cc:458] T 00000000000000000000000000000000 P ceb52c38d50c4a4ba18ba84890fee76a [sys.catalog]: This master's current role is: FOLLOWER
08:03:54.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.208817 24580 sys_catalog.cc:455] T 00000000000000000000000000000000 P ceb52c38d50c4a4ba18ba84890fee76a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bf3bff2bfe2c48098e1d54555850d04b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8413f65f08f54193b86b91961e1b28b8" member_type: VOTER last_known_addr { host: "127.23.194.126" port: 38579 } } peers { permanent_uuid: "bf3bff2bfe2c48098e1d54555850d04b" member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } } peers { permanent_uuid: "ceb52c38d50c4a4ba18ba84890fee76a" member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } } }
08:03:54.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.209602 24580 sys_catalog.cc:458] T 00000000000000000000000000000000 P ceb52c38d50c4a4ba18ba84890fee76a [sys.catalog]: This master's current role is: FOLLOWER
08:03:54.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.225955 24609 catalog_manager.cc:1405] Generated new certificate authority record
08:03:54.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.228588 24609 catalog_manager.cc:1539] Loading token signing keys...
08:03:54.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.243156 24411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } attempt: 7
08:03:54.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.263399 24609 catalog_manager.cc:6069] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b: Generated new TSK 0
08:03:54.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.269595 24609 catalog_manager.cc:1549] Initializing in-progress tserver states...
08:03:54.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.286654 24411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8413f65f08f54193b86b91961e1b28b8: Bootstrap starting.
08:03:54.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.294220 24411 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8413f65f08f54193b86b91961e1b28b8: Neither blocks nor log segments found. Creating new log.
08:03:54.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.296916 24411 log.cc:826] T 00000000000000000000000000000000 P 8413f65f08f54193b86b91961e1b28b8: Log is configured to *not* fsync() on all Append() calls
08:03:54.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.324535 24411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8413f65f08f54193b86b91961e1b28b8: No bootstrap required, opened a new log
08:03:54.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.328275 24329 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:03:54.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:03:54.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-0/wal
08:03:54.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-0/data
08:03:54.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:03:54.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:03:54.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:03:54.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:54.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:54.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:54.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-0/logs
08:03:54.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-0/data/info.pb
08:03:54.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:54.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:03:54.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:03:54.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:03:54.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:03:54.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:54.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:54.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:54.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:03:54.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:03:54.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.194.65:0
08:03:54.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.194.65
08:03:54.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.194.65
08:03:54.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:54.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943
08:03:54.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.194.84:42435
08:03:54.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:54.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:54.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:03:54.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.354878 24411 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8413f65f08f54193b86b91961e1b28b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8413f65f08f54193b86b91961e1b28b8" member_type: VOTER last_known_addr { host: "127.23.194.126" port: 38579 } } peers { permanent_uuid: "bf3bff2bfe2c48098e1d54555850d04b" member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } } peers { permanent_uuid: "ceb52c38d50c4a4ba18ba84890fee76a" member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } }
08:03:54.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.356817 24411 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8413f65f08f54193b86b91961e1b28b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:03:54.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.357582 24411 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8413f65f08f54193b86b91961e1b28b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8413f65f08f54193b86b91961e1b28b8, State: Initialized, Role: FOLLOWER
08:03:54.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.358835 24411 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8413f65f08f54193b86b91961e1b28b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8413f65f08f54193b86b91961e1b28b8" member_type: VOTER last_known_addr { host: "127.23.194.126" port: 38579 } } peers { permanent_uuid: "bf3bff2bfe2c48098e1d54555850d04b" member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } } peers { permanent_uuid: "ceb52c38d50c4a4ba18ba84890fee76a" member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } }
08:03:54.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.367473 24620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8413f65f08f54193b86b91961e1b28b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8413f65f08f54193b86b91961e1b28b8" member_type: VOTER last_known_addr { host: "127.23.194.126" port: 38579 } } peers { permanent_uuid: "bf3bff2bfe2c48098e1d54555850d04b" member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } } peers { permanent_uuid: "ceb52c38d50c4a4ba18ba84890fee76a" member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } } }
08:03:54.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.371282 24620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8413f65f08f54193b86b91961e1b28b8 [sys.catalog]: This master's current role is: FOLLOWER
08:03:54.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.371527 24384 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8413f65f08f54193b86b91961e1b28b8 [term 0 FOLLOWER]: Advancing to term 1
08:03:54.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.370895 24411 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8413f65f08f54193b86b91961e1b28b8 [sys.catalog]: configured and running, proceeding with master startup.
08:03:54.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.374352 24385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bf3bff2bfe2c48098e1d54555850d04b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8413f65f08f54193b86b91961e1b28b8"
08:03:54.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.376995 24386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bf3bff2bfe2c48098e1d54555850d04b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8413f65f08f54193b86b91961e1b28b8" is_pre_election: true
08:03:54.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.384394 24384 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 8413f65f08f54193b86b91961e1b28b8 [term 1 FOLLOWER]: Refusing update from remote peer bf3bff2bfe2c48098e1d54555850d04b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:03:54.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.386396 24594 consensus_queue.cc:1048] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8413f65f08f54193b86b91961e1b28b8" member_type: VOTER last_known_addr { host: "127.23.194.126" port: 38579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:03:54.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.481419 24630 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8413f65f08f54193b86b91961e1b28b8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bf3bff2bfe2c48098e1d54555850d04b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8413f65f08f54193b86b91961e1b28b8" member_type: VOTER last_known_addr { host: "127.23.194.126" port: 38579 } } peers { permanent_uuid: "bf3bff2bfe2c48098e1d54555850d04b" member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } } peers { permanent_uuid: "ceb52c38d50c4a4ba18ba84890fee76a" member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } } }
08:03:54.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.482743 24630 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8413f65f08f54193b86b91961e1b28b8 [sys.catalog]: This master's current role is: FOLLOWER
08:03:54.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.481935 24620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8413f65f08f54193b86b91961e1b28b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf3bff2bfe2c48098e1d54555850d04b. Latest consensus state: current_term: 1 leader_uuid: "bf3bff2bfe2c48098e1d54555850d04b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8413f65f08f54193b86b91961e1b28b8" member_type: VOTER last_known_addr { host: "127.23.194.126" port: 38579 } } peers { permanent_uuid: "bf3bff2bfe2c48098e1d54555850d04b" member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } } peers { permanent_uuid: "ceb52c38d50c4a4ba18ba84890fee76a" member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } } }
08:03:54.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.484371 24620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8413f65f08f54193b86b91961e1b28b8 [sys.catalog]: This master's current role is: FOLLOWER
08:03:54.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.492621 24637 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
08:03:54.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.819695 24592 catalog_manager.cc:1294] Loaded cluster ID: ac373351399c4bc3a4fb65331bda5e3b
08:03:54.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.820340 24592 catalog_manager.cc:1587] T 00000000000000000000000000000000 P ceb52c38d50c4a4ba18ba84890fee76a: loading cluster ID for follower catalog manager: success
08:03:54.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.832243 24592 catalog_manager.cc:1609] T 00000000000000000000000000000000 P ceb52c38d50c4a4ba18ba84890fee76a: acquiring CA information for follower catalog manager: success
08:03:54.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.838431 24592 catalog_manager.cc:1637] T 00000000000000000000000000000000 P ceb52c38d50c4a4ba18ba84890fee76a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:03:54.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.877147 24640 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bf3bff2bfe2c48098e1d54555850d04b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8413f65f08f54193b86b91961e1b28b8" member_type: VOTER last_known_addr { host: "127.23.194.126" port: 38579 } } peers { permanent_uuid: "bf3bff2bfe2c48098e1d54555850d04b" member_type: VOTER last_known_addr { host: "127.23.194.125" port: 38689 } } peers { permanent_uuid: "ceb52c38d50c4a4ba18ba84890fee76a" member_type: VOTER last_known_addr { host: "127.23.194.124" port: 38943 } } }
08:03:54.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.878669 24640 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b [sys.catalog]: This master's current role is: LEADER
08:03:55.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:55.015288 24619 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:03:55.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:55.015971 24619 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:03:55.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:55.016637 24619 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:03:55.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:55.080163 24619 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:03:55.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:55.081583 24619 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.194.65
08:03:55.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.150514 24619 tablet_server_runner.cc:78] Tablet server non-default flags:
08:03:55.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:55.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.194.84:42435
08:03:55.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:55.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:55.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-0/data
08:03:55.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-0/wal
08:03:55.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:55.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:55.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.194.65:0
08:03:55.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:03:55.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:55.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:55.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-0/data/info.pb
08:03:55.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.194.65
08:03:55.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:55.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943
08:03:55.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:03:55.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:55.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:03:55.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:03:55.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:55.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.194.65
08:03:55.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-0/logs
08:03:55.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:55.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:03:55.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:03:55.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:03:55.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:03:55.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:03:55.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:03:55.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:03:55.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:03:55.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:03:55.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.152390 24619 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:03:55.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.154577 24619 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:03:55.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:55.173126 24648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:55.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.525991 24637 catalog_manager.cc:1294] Loaded cluster ID: ac373351399c4bc3a4fb65331bda5e3b
08:03:55.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.526808 24637 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 8413f65f08f54193b86b91961e1b28b8: loading cluster ID for follower catalog manager: success
08:03:55.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.540849 24637 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 8413f65f08f54193b86b91961e1b28b8: acquiring CA information for follower catalog manager: success
08:03:55.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.559507 24637 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 8413f65f08f54193b86b91961e1b28b8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:03:56.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:56.571627 24647 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 24619
08:03:56.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:56.766211 24647 kernel_stack_watchdog.cc:198] Thread 24619 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 391ms:
08:03:56.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:03:56.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:03:56.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:03:56.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:03:56.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:56.766294 24619 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.588s	user 0.378s	sys 0.532s
08:03:56.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:55.180153 24649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:56.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:56.766695 24619 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.588s	user 0.378s	sys 0.532s
08:03:56.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:56.776481 24654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:56.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.778784 24619 server_base.cc:1061] running on GCE node
08:03:56.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.780179 24619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:03:56.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.783984 24619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:03:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.787675 24619 hybrid_clock.cc:648] HybridClock initialized: now 1779091436786994 us; error 675 us; skew 500 ppm
08:03:56.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.788789 24619 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:03:56.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.819803 24619 webserver.cc:533] Webserver started at http://127.23.194.65:41653/ using document root <none> and password file <none>
08:03:56.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.821244 24619 fs_manager.cc:362] Metadata directory not provided
08:03:56.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.821542 24619 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:03:56.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.822170 24619 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:03:56.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.829137 24619 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-0/data/instance:
08:03:56.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a234e5e9c8f74f3bb92c0b83e703587e"
08:03:56.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:56 on dist-test-slave-1jss"
08:03:56.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.830709 24619 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-0/wal/instance:
08:03:56.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a234e5e9c8f74f3bb92c0b83e703587e"
08:03:56.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:56 on dist-test-slave-1jss"
08:03:56.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.856338 24619 fs_manager.cc:696] Time spent creating directory manager: real 0.025s	user 0.012s	sys 0.013s
08:03:56.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.879144 24660 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:03:56.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.882867 24619 fs_manager.cc:730] Time spent opening block manager: real 0.021s	user 0.004s	sys 0.013s
08:03:56.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.883309 24619 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-0/wal
08:03:56.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a234e5e9c8f74f3bb92c0b83e703587e"
08:03:56.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:56 on dist-test-slave-1jss"
08:03:56.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.883777 24619 fs_report.cc:389] FS layout report
08:03:56.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:03:56.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-0/wal
08:03:56.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-0/wal
08:03:56.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-0/data/data
08:03:56.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:03:56.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:03:56.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:03:56.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:03:56.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:03:56.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:03:56.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:03:56.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:03:56.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:03:56.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:03:56.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:03:57.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.102069 24619 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:03:57.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.104348 24619 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:03:57.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.104941 24619 kserver.cc:163] Server-wide thread pool size limit: 3276
08:03:57.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.118600 24619 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:03:57.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.138736 24619 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:03:57.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.139066 24619 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:03:57.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.139360 24619 ts_tablet_manager.cc:616] Registered 0 tablets
08:03:57.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.139570 24619 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:03:57.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.647588 24619 rpc_server.cc:307] RPC server started. Bound to: 127.23.194.65:37577
08:03:57.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.647711 24775 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.194.65:37577 every 8 connection(s)
08:03:57.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.652215 24619 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-0/data/info.pb
08:03:57.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.654342 24329 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 24619
08:03:57.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.654979 24329 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-0/wal/instance
08:03:57.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.671233 24329 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:03:57.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:03:57.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-1/wal
08:03:57.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-1/data
08:03:57.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:03:57.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:03:57.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:03:57.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:57.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:57.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:57.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-1/logs
08:03:57.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-1/data/info.pb
08:03:57.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:57.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:03:57.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:03:57.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:03:57.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:03:57.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:57.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:57.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:57.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:03:57.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:03:57.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.194.66:0
08:03:57.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.194.66
08:03:57.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.194.66
08:03:57.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:57.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943
08:03:57.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.194.84:42435
08:03:57.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:57.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:57.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:03:57.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.769605 24777 heartbeater.cc:344] Connected to a master server at 127.23.194.125:38689
08:03:57.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.770087 24777 heartbeater.cc:461] Registering TS with master...
08:03:57.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.771395 24777 heartbeater.cc:507] Master 127.23.194.125:38689 requested a full tablet report, sending...
08:03:57.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.776137 24451 ts_manager.cc:194] Registered new tserver with Master: a234e5e9c8f74f3bb92c0b83e703587e (127.23.194.65:37577)
08:03:57.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.778929 24451 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.194.65:41919
08:03:57.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.786487 24776 heartbeater.cc:344] Connected to a master server at 127.23.194.124:38943
08:03:57.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.786857 24776 heartbeater.cc:461] Registering TS with master...
08:03:57.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.787492 24776 heartbeater.cc:507] Master 127.23.194.124:38943 requested a full tablet report, sending...
08:03:57.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.791522 24535 ts_manager.cc:194] Registered new tserver with Master: a234e5e9c8f74f3bb92c0b83e703587e (127.23.194.65:37577)
08:03:57.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.807714 24783 heartbeater.cc:344] Connected to a master server at 127.23.194.126:38579
08:03:57.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.808125 24783 heartbeater.cc:461] Registering TS with master...
08:03:57.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.808791 24783 heartbeater.cc:507] Master 127.23.194.126:38579 requested a full tablet report, sending...
08:03:57.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:57.811936 24376 ts_manager.cc:194] Registered new tserver with Master: a234e5e9c8f74f3bb92c0b83e703587e (127.23.194.65:37577)
08:03:58.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:58.025740 24407 debug-util.cc:398] Leaking SignalData structure 0x7b08000a4900 after lost signal to thread 24343
08:03:58.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:58.250118 24778 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:03:58.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:58.250867 24778 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:03:58.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:58.251621 24778 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:03:58.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:58.314240 24778 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:03:58.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:58.316841 24778 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.194.66
08:03:58.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.411772 24778 tablet_server_runner.cc:78] Tablet server non-default flags:
08:03:58.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:58.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.194.84:42435
08:03:58.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:58.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:58.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-1/data
08:03:58.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-1/wal
08:03:58.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:58.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:58.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.194.66:0
08:03:58.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:03:58.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:58.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:58.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-1/data/info.pb
08:03:58.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.194.66
08:03:58.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:58.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943
08:03:58.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:03:58.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:58.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:03:58.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:03:58.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:58.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.194.66
08:03:58.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-1/logs
08:03:58.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:58.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:03:58.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:03:58.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:03:58.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:03:58.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:03:58.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:03:58.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:03:58.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:03:58.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:03:58.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.413571 24778 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:03:58.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.415885 24778 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:03:58.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:58.433946 24793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:58.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.785684 24777 heartbeater.cc:499] Master 127.23.194.125:38689 was elected leader, sending a full tablet report...
08:04:00.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:59.835377 24792 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 24778
08:04:00.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:00.260313 24792 kernel_stack_watchdog.cc:198] Thread 24778 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 395ms:
08:04:00.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:04:00.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:04:00.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:04:00.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:04:00.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:00.263864 24795 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1824 milliseconds
08:04:00.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:00.277554 24778 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.839s	user 0.597s	sys 0.871s
08:04:00.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:00.278003 24778 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.840s	user 0.598s	sys 0.871s
08:04:00.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:58.439352 24794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:00.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:00.279831 24796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:00.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.279834 24778 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:04:00.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.281409 24778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:04:00.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.284072 24778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:04:00.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.285491 24778 hybrid_clock.cc:648] HybridClock initialized: now 1779091440285403 us; error 99 us; skew 500 ppm
08:04:00.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.286463 24778 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:04:00.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.294035 24778 webserver.cc:533] Webserver started at http://127.23.194.66:34975/ using document root <none> and password file <none>
08:04:00.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.295145 24778 fs_manager.cc:362] Metadata directory not provided
08:04:00.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.295392 24778 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:04:00.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.295946 24778 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:04:00.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.300633 24778 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-1/data/instance:
08:04:00.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7eb69088ee284421ba9cfbd602fcb697"
08:04:00.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:00 on dist-test-slave-1jss"
08:04:00.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.301991 24778 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-1/wal/instance:
08:04:00.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7eb69088ee284421ba9cfbd602fcb697"
08:04:00.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:00 on dist-test-slave-1jss"
08:04:00.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.310560 24778 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.001s
08:04:00.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.320792 24805 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:04:00.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.326990 24778 fs_manager.cc:730] Time spent opening block manager: real 0.011s	user 0.001s	sys 0.005s
08:04:00.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.327435 24778 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-1/wal
08:04:00.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7eb69088ee284421ba9cfbd602fcb697"
08:04:00.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:00 on dist-test-slave-1jss"
08:04:00.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.328122 24778 fs_report.cc:389] FS layout report
08:04:00.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:04:00.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-1/wal
08:04:00.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-1/wal
08:04:00.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-1/data/data
08:04:00.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:04:00.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:04:00.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:04:00.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:04:00.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:04:00.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:04:00.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:04:00.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:04:00.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:04:00.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:04:00.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:04:00.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.419559 24778 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:04:00.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.422194 24778 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:04:00.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.422765 24778 kserver.cc:163] Server-wide thread pool size limit: 3276
08:04:00.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.427660 24778 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:04:00.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.434093 24778 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:04:00.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.434379 24778 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:04:00.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.434684 24778 ts_tablet_manager.cc:616] Registered 0 tablets
08:04:00.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.434895 24778 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:04:00.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.706796 24778 rpc_server.cc:307] RPC server started. Bound to: 127.23.194.66:39487
08:04:00.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.707031 24917 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.194.66:39487 every 8 connection(s)
08:04:00.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.710558 24778 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-1/data/info.pb
08:04:00.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.719499 24329 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 24778
08:04:00.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.719931 24329 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-1/wal/instance
08:04:00.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.752233 24329 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:00.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:00.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-2/wal
08:04:00.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-2/data
08:04:00.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:04:00.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:04:00.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:04:00.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:00.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:00.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:00.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-2/logs
08:04:00.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-2/data/info.pb
08:04:00.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:00.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:04:00.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:04:00.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:04:00.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:04:00.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:00.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:00.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:00.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:04:00.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:04:00.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.194.67:0
08:04:00.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.194.67
08:04:00.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.194.67
08:04:00.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:00.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943
08:04:00.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.194.84:42435
08:04:00.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:00.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:00.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:04:00.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.799522 24922 heartbeater.cc:344] Connected to a master server at 127.23.194.126:38579
08:04:00.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.800108 24922 heartbeater.cc:461] Registering TS with master...
08:04:00.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.802027 24918 heartbeater.cc:344] Connected to a master server at 127.23.194.124:38943
08:04:00.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.802413 24918 heartbeater.cc:461] Registering TS with master...
08:04:00.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.803279 24919 heartbeater.cc:344] Connected to a master server at 127.23.194.125:38689
08:04:00.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.803366 24918 heartbeater.cc:507] Master 127.23.194.124:38943 requested a full tablet report, sending...
08:04:00.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.803656 24919 heartbeater.cc:461] Registering TS with master...
08:04:00.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.804566 24919 heartbeater.cc:507] Master 127.23.194.125:38689 requested a full tablet report, sending...
08:04:00.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.807073 24451 ts_manager.cc:194] Registered new tserver with Master: 7eb69088ee284421ba9cfbd602fcb697 (127.23.194.66:39487)
08:04:00.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.808975 24451 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.194.66:34897
08:04:00.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.801683 24922 heartbeater.cc:507] Master 127.23.194.126:38579 requested a full tablet report, sending...
08:04:00.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.814406 24376 ts_manager.cc:194] Registered new tserver with Master: 7eb69088ee284421ba9cfbd602fcb697 (127.23.194.66:39487)
08:04:00.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:00.817854 24535 ts_manager.cc:194] Registered new tserver with Master: 7eb69088ee284421ba9cfbd602fcb697 (127.23.194.66:39487)
08:04:01.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:01.149495 24928 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:04:01.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:01.150406 24928 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:04:01.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:01.150848 24928 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:04:01.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:01.187971 24928 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:04:01.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:01.189249 24928 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.194.67
08:04:01.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:01.230187 24928 tablet_server_runner.cc:78] Tablet server non-default flags:
08:04:01.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:01.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.194.84:42435
08:04:01.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:01.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:04:01.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-2/data
08:04:01.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-2/wal
08:04:01.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:01.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:01.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.194.67:0
08:04:01.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:04:01.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:01.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:01.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-2/data/info.pb
08:04:01.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.194.67
08:04:01.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:01.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943
08:04:01.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:04:01.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:01.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:04:01.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:04:01.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:01.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.194.67
08:04:01.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-2/logs
08:04:01.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:01.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:04:01.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:04:01.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:04:01.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:04:01.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:04:01.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:04:01.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:04:01.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:04:01.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:04:01.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:01.231751 24928 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:04:01.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:01.233954 24928 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:04:01.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:01.248955 24934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:01.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:01.250005 24772 debug-util.cc:398] Leaking SignalData structure 0x7b08000ac580 after lost signal to thread 24642
08:04:01.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:01.251240 24772 debug-util.cc:398] Leaking SignalData structure 0x7b08000accc0 after lost signal to thread 24775
08:04:01.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:01.816699 24919 heartbeater.cc:499] Master 127.23.194.125:38689 was elected leader, sending a full tablet report...
08:04:03.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:02.651204 24933 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 24928
08:04:03.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:03.705705 24928 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.455s	user 0.684s	sys 1.437s
08:04:03.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:03.706090 24928 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.456s	user 0.684s	sys 1.437s
08:04:03.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:03.711048 24937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:03.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:03.712466 24928 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:04:03.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:03.713377 24936 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 2458 milliseconds
08:04:03.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:01.259984 24935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:03.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:03.719766 24928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:04:03.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:03.722640 24928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:04:03.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:03.724313 24928 hybrid_clock.cc:648] HybridClock initialized: now 1779091443724167 us; error 167 us; skew 500 ppm
08:04:03.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:03.725458 24928 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:04:03.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:03.736452 24928 webserver.cc:533] Webserver started at http://127.23.194.67:39037/ using document root <none> and password file <none>
08:04:03.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:03.737542 24928 fs_manager.cc:362] Metadata directory not provided
08:04:03.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:03.737825 24928 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:04:03.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:03.738566 24928 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:04:03.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:03.743781 24928 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-2/data/instance:
08:04:03.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b1ebf50f84fd43329637c4bbdd91ce31"
08:04:03.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:03 on dist-test-slave-1jss"
08:04:03.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:03.745105 24928 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-2/wal/instance:
08:04:03.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b1ebf50f84fd43329637c4bbdd91ce31"
08:04:03.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:03 on dist-test-slave-1jss"
08:04:03.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:03.757007 24928 fs_manager.cc:696] Time spent creating directory manager: real 0.011s	user 0.003s	sys 0.007s
08:04:03.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:03.765451 24949 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:04:03.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:03.767027 24928 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.007s	sys 0.000s
08:04:03.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:03.767560 24928 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-2/wal
08:04:03.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b1ebf50f84fd43329637c4bbdd91ce31"
08:04:03.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:03 on dist-test-slave-1jss"
08:04:03.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:03.768049 24928 fs_report.cc:389] FS layout report
08:04:03.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:04:03.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-2/wal
08:04:03.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-2/wal
08:04:03.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-2/data/data
08:04:03.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:04:03.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:04:03.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:04:03.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:04:03.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:04:03.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:04:03.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:04:03.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:04:03.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:04:03.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:04:03.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:04:03.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:03.774236 23754 debug-util.cc:398] Leaking SignalData structure 0x7b080008a5a0 after lost signal to thread 23689
08:04:03.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:03.775213 23754 debug-util.cc:398] Leaking SignalData structure 0x7b0800070440 after lost signal to thread 23757
08:04:03.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:03.868624 24928 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:04:03.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:03.872151 24928 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:04:03.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:03.873234 24928 kserver.cc:163] Server-wide thread pool size limit: 3276
08:04:03.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:03.941450 24928 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:04:03.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:03.986340 24928 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:04:03.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:03.986752 24928 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
08:04:03.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:03.987077 24928 ts_tablet_manager.cc:616] Registered 0 tablets
08:04:03.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:03.987303 24928 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:04:04.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:04.529712 24928 rpc_server.cc:307] RPC server started. Bound to: 127.23.194.67:42497
08:04:04.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:04.529850 25065 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.194.67:42497 every 8 connection(s)
08:04:04.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:04.532874 24928 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-2/data/info.pb
08:04:04.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:04.534546 24329 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 24928
08:04:04.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:04.535043 24329 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17088059596534999573/ts-2/wal/instance
08:04:04.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:04.833107 25066 heartbeater.cc:344] Connected to a master server at 127.23.194.124:38943
08:04:04.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:04.904858 25066 heartbeater.cc:461] Registering TS with master...
08:04:04.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:04.907109 25066 heartbeater.cc:507] Master 127.23.194.124:38943 requested a full tablet report, sending...
08:04:04.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:04.913072 24535 ts_manager.cc:194] Registered new tserver with Master: b1ebf50f84fd43329637c4bbdd91ce31 (127.23.194.67:42497)
08:04:04.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:04.919941 25069 heartbeater.cc:344] Connected to a master server at 127.23.194.125:38689
08:04:04.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:04.920486 25069 heartbeater.cc:461] Registering TS with master...
08:04:04.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:04.922338 25069 heartbeater.cc:507] Master 127.23.194.125:38689 requested a full tablet report, sending...
08:04:04.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:04.925396 24451 ts_manager.cc:194] Registered new tserver with Master: b1ebf50f84fd43329637c4bbdd91ce31 (127.23.194.67:42497)
08:04:04.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:04.929260 24451 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.194.67:45929
08:04:04.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:04.985896 25070 heartbeater.cc:344] Connected to a master server at 127.23.194.126:38579
08:04:04.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:04.986384 25070 heartbeater.cc:461] Registering TS with master...
08:04:04.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:04.988768 25070 heartbeater.cc:507] Master 127.23.194.126:38579 requested a full tablet report, sending...
08:04:04.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:04.992755 24376 ts_manager.cc:194] Registered new tserver with Master: b1ebf50f84fd43329637c4bbdd91ce31 (127.23.194.67:42497)
08:04:05.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:05.000530 24329 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
08:04:05.024 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:04:05.024 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

08:04:05.030 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.23.194.126"
      port: 38579
    }
    bound_http_address {
      host: "127.23.194.126"
      port: 33503
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.23.194.125"
      port: 38689
    }
    bound_http_address {
      host: "127.23.194.125"
      port: 46485
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.23.194.124"
      port: 38943
    }
    bound_http_address {
      host: "127.23.194.124"
      port: 44547
    }
  }
}

08:04:05.033 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

08:04:05.039 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.23.194.65"
      port: 37577
    }
    bound_http_address {
      host: "127.23.194.65"
      port: 41653
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.23.194.66"
      port: 39487
    }
    bound_http_address {
      host: "127.23.194.66"
      port: 34975
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.23.194.67"
      port: 42497
    }
    bound_http_address {
      host: "127.23.194.67"
      port: 39037
    }
  }
}

08:04:05.039 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
08:04:05.044 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:04:05.168 [DEBUG - main] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:05.180 [DEBUG - main] (DefaultChannelId.java:84) -Dio.netty.processId: 23577 (auto-detected)
08:04:05.183 [DEBUG - main] (NetUtil.java:149) -Djava.net.preferIPv4Stack: true
08:04:05.183 [DEBUG - main] (NetUtil.java:150) -Djava.net.preferIPv6Addresses: false
08:04:05.185 [DEBUG - main] (NetUtilInitializations.java:145) Loopback interface: lo (lo, 127.0.0.1)
08:04:05.187 [DEBUG - main] (NetUtil.java:198) /proc/sys/net/core/somaxconn: 4096
08:04:05.188 [DEBUG - main] (DefaultChannelId.java:106) -Dio.netty.machineId: 02:42:7f:ff:fe:1c:a9:da (auto-detected)
08:04:05.219 [DEBUG - main] (ByteBufUtil.java:89) -Dio.netty.allocator.type: pooled
08:04:05.220 [DEBUG - main] (ByteBufUtil.java:101) -Dio.netty.threadLocalDirectBufferSize: 0
08:04:05.220 [DEBUG - main] (ByteBufUtil.java:104) -Dio.netty.maxThreadLocalCharBufferSize: 16384
08:04:05.229 [DEBUG - main] (ChannelInitializerExtensions.java:54) -Dio.netty.bootstrap.extensions: null
08:04:05.234 [DEBUG - main] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:05.252 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.23.12.252:42637(127.23.12.252:42637)] Successfully connected to peer
08:04:05.278 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.23.12.254:42055(127.23.12.254:42055)] Successfully connected to peer
08:04:05.278 [DEBUG - main] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:05.281 [DEBUG - kudu-nio-0] (AbstractByteBuf.java:63) -Dorg.apache.kudu.shaded.io.netty.buffer.checkAccessible: true
08:04:05.281 [DEBUG - kudu-nio-0] (AbstractByteBuf.java:64) -Dorg.apache.kudu.shaded.io.netty.buffer.checkBounds: true
08:04:05.282 [DEBUG - kudu-nio-0] (ResourceLeakDetectorFactory.java:196) Loaded default ResourceLeakDetector: org.apache.kudu.shaded.io.netty.util.ResourceLeakDetector@46ade488
08:04:05.294 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.23.12.253:45283(127.23.12.253:45283)] Successfully connected to peer
08:04:05.298 [DEBUG - kudu-nio-0] (Recycler.java:96) -Dio.netty.recycler.maxCapacityPerThread: 4096
08:04:05.299 [DEBUG - kudu-nio-0] (Recycler.java:97) -Dio.netty.recycler.ratio: 8
08:04:05.299 [DEBUG - kudu-nio-0] (Recycler.java:98) -Dio.netty.recycler.chunkSize: 32
08:04:05.299 [DEBUG - kudu-nio-0] (Recycler.java:99) -Dio.netty.recycler.blocking: false
08:04:05.299 [DEBUG - kudu-nio-0] (Recycler.java:100) -Dio.netty.recycler.batchFastThreadLocalOnly: true
08:04:05.385 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.12.254
08:04:05.386 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.12.253
08:04:05.398 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.12.252
08:04:05.620 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:05.621 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:05.626 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:05.669 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x205564d1, L:/127.0.0.1:33436 - R:/127.23.12.252:42637] using SASL/PLAIN
08:04:05.669 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x10d5875a, L:/127.0.0.1:59418 - R:/127.23.12.254:42055] using SASL/PLAIN
08:04:05.669 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x0290bd26, L:/127.0.0.1:44090 - R:/127.23.12.253:45283] using SASL/PLAIN
08:04:05.721 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:04:05.723 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=618), Traces: [0ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [583ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: OK, [584ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: OK, [584ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: OK, deferred=null) after lookup
08:04:05.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:05.791483 23803 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33436:
08:04:05.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
08:04:05.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
08:04:05.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:04:05.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
08:04:05.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:04:05.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:04:05.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:04:05.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:04:05.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:04:05.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:04:05.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:04:05.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:04:05.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
08:04:05.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:04:05.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:04:05.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:04:05.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:04:05.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:04:05.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:04:05.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:04:05.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:04:05.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
08:04:05.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:04:05.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:04:05.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:04:05.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:04:05.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:04:05.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:04:05.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:04:05.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:04:05.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
08:04:05.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:04:05.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:04:05.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:04:05.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:04:05.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:04:05.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:04:05.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:04:05.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:04:05.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
08:04:05.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\001\000\000\000\000\007\0012\000\000\000\006\001d\000\000\000\007\001\310\000\000\000"
08:04:05.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:04:05.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
08:04:05.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
08:04:05.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
08:04:05.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
08:04:05.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:04:05.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:04:05.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:04:05.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:05.797070 23803 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
08:04:05.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:05.882251 24174 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad060 after lost signal to thread 24049
08:04:05.933 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table e785290ee4514812bbf41055a4694542
08:04:05.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:05.959272 25069 heartbeater.cc:499] Master 127.23.194.125:38689 was elected leader, sending a full tablet report...
08:04:06.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.039638 23970 tablet_service.cc:1511] Processing CreateTablet for tablet 08fb1cfeee8e45528078bdd8935cfb8f (DEFAULT_TABLE table=replication_test_table [id=e785290ee4514812bbf41055a4694542]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
08:04:06.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.044802 23970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08fb1cfeee8e45528078bdd8935cfb8f. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:06.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.050251 23971 tablet_service.cc:1511] Processing CreateTablet for tablet 9fd0331c3da74721a6bf81effaa2ca6d (DEFAULT_TABLE table=replication_test_table [id=e785290ee4514812bbf41055a4694542]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
08:04:06.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.064412 23971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fd0331c3da74721a6bf81effaa2ca6d. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:06.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.099298 24252 tablet_service.cc:1511] Processing CreateTablet for tablet 08fb1cfeee8e45528078bdd8935cfb8f (DEFAULT_TABLE table=replication_test_table [id=e785290ee4514812bbf41055a4694542]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
08:04:06.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.110241 24112 tablet_service.cc:1511] Processing CreateTablet for tablet 08fb1cfeee8e45528078bdd8935cfb8f (DEFAULT_TABLE table=replication_test_table [id=e785290ee4514812bbf41055a4694542]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
08:04:06.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.117604 24112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08fb1cfeee8e45528078bdd8935cfb8f. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:06.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.118875 24252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08fb1cfeee8e45528078bdd8935cfb8f. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:06.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.119973 24253 tablet_service.cc:1511] Processing CreateTablet for tablet 9fd0331c3da74721a6bf81effaa2ca6d (DEFAULT_TABLE table=replication_test_table [id=e785290ee4514812bbf41055a4694542]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
08:04:06.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.115022 24113 tablet_service.cc:1511] Processing CreateTablet for tablet 9fd0331c3da74721a6bf81effaa2ca6d (DEFAULT_TABLE table=replication_test_table [id=e785290ee4514812bbf41055a4694542]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
08:04:06.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.127156 24113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fd0331c3da74721a6bf81effaa2ca6d. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:06.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.131294 24253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fd0331c3da74721a6bf81effaa2ca6d. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:06.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.167640 25103 tablet_bootstrap.cc:492] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac: Bootstrap starting.
08:04:06.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.176951 25103 tablet_bootstrap.cc:654] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac: Neither blocks nor log segments found. Creating new log.
08:04:06.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.180002 25103 log.cc:826] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac: Log is configured to *not* fsync() on all Append() calls
08:04:06.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.210444 25103 tablet_bootstrap.cc:492] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac: No bootstrap required, opened a new log
08:04:06.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.211165 25103 ts_tablet_manager.cc:1403] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.025s
08:04:06.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.263163 25105 tablet_bootstrap.cc:492] T 9fd0331c3da74721a6bf81effaa2ca6d P 28aa3d1914814f939e6cedae64740867: Bootstrap starting.
08:04:06.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.266155 25103 raft_consensus.cc:359] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5318a97a53d44a0ab8a000d860514ac" member_type: VOTER last_known_addr { host: "127.23.12.193" port: 35651 } } peers { permanent_uuid: "28aa3d1914814f939e6cedae64740867" member_type: VOTER last_known_addr { host: "127.23.12.194" port: 44439 } } peers { permanent_uuid: "aff3e5847231454bad66ef71cb36c4d3" member_type: VOTER last_known_addr { host: "127.23.12.195" port: 32809 } }
08:04:06.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.267156 25103 raft_consensus.cc:385] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:06.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.267490 25103 raft_consensus.cc:740] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5318a97a53d44a0ab8a000d860514ac, State: Initialized, Role: FOLLOWER
08:04:06.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.268751 25103 consensus_queue.cc:260] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5318a97a53d44a0ab8a000d860514ac" member_type: VOTER last_known_addr { host: "127.23.12.193" port: 35651 } } peers { permanent_uuid: "28aa3d1914814f939e6cedae64740867" member_type: VOTER last_known_addr { host: "127.23.12.194" port: 44439 } } peers { permanent_uuid: "aff3e5847231454bad66ef71cb36c4d3" member_type: VOTER last_known_addr { host: "127.23.12.195" port: 32809 } }
08:04:06.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.283113 25103 ts_tablet_manager.cc:1434] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac: Time spent starting tablet: real 0.060s	user 0.019s	sys 0.033s
08:04:06.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.283950 25106 tablet_bootstrap.cc:492] T 08fb1cfeee8e45528078bdd8935cfb8f P aff3e5847231454bad66ef71cb36c4d3: Bootstrap starting.
08:04:06.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:06.286943 24046 tablet.cc:2404] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:04:06.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.311935 25105 tablet_bootstrap.cc:654] T 9fd0331c3da74721a6bf81effaa2ca6d P 28aa3d1914814f939e6cedae64740867: Neither blocks nor log segments found. Creating new log.
08:04:06.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.313198 25103 tablet_bootstrap.cc:492] T 9fd0331c3da74721a6bf81effaa2ca6d P e5318a97a53d44a0ab8a000d860514ac: Bootstrap starting.
08:04:06.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.320814 25106 tablet_bootstrap.cc:654] T 08fb1cfeee8e45528078bdd8935cfb8f P aff3e5847231454bad66ef71cb36c4d3: Neither blocks nor log segments found. Creating new log.
08:04:06.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.328466 25105 log.cc:826] T 9fd0331c3da74721a6bf81effaa2ca6d P 28aa3d1914814f939e6cedae64740867: Log is configured to *not* fsync() on all Append() calls
08:04:06.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.330999 25106 log.cc:826] T 08fb1cfeee8e45528078bdd8935cfb8f P aff3e5847231454bad66ef71cb36c4d3: Log is configured to *not* fsync() on all Append() calls
08:04:06.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.340257 25103 tablet_bootstrap.cc:654] T 9fd0331c3da74721a6bf81effaa2ca6d P e5318a97a53d44a0ab8a000d860514ac: Neither blocks nor log segments found. Creating new log.
08:04:06.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.345175 25106 tablet_bootstrap.cc:492] T 08fb1cfeee8e45528078bdd8935cfb8f P aff3e5847231454bad66ef71cb36c4d3: No bootstrap required, opened a new log
08:04:06.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.345958 25106 ts_tablet_manager.cc:1403] T 08fb1cfeee8e45528078bdd8935cfb8f P aff3e5847231454bad66ef71cb36c4d3: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.021s
08:04:06.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.356575 25105 tablet_bootstrap.cc:492] T 9fd0331c3da74721a6bf81effaa2ca6d P 28aa3d1914814f939e6cedae64740867: No bootstrap required, opened a new log
08:04:06.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.357149 25105 ts_tablet_manager.cc:1403] T 9fd0331c3da74721a6bf81effaa2ca6d P 28aa3d1914814f939e6cedae64740867: Time spent bootstrapping tablet: real 0.095s	user 0.018s	sys 0.010s
08:04:06.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.364058 25103 tablet_bootstrap.cc:492] T 9fd0331c3da74721a6bf81effaa2ca6d P e5318a97a53d44a0ab8a000d860514ac: No bootstrap required, opened a new log
08:04:06.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.364529 25103 ts_tablet_manager.cc:1403] T 9fd0331c3da74721a6bf81effaa2ca6d P e5318a97a53d44a0ab8a000d860514ac: Time spent bootstrapping tablet: real 0.052s	user 0.003s	sys 0.020s
08:04:06.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.372118 25103 raft_consensus.cc:359] T 9fd0331c3da74721a6bf81effaa2ca6d P e5318a97a53d44a0ab8a000d860514ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28aa3d1914814f939e6cedae64740867" member_type: VOTER last_known_addr { host: "127.23.12.194" port: 44439 } } peers { permanent_uuid: "aff3e5847231454bad66ef71cb36c4d3" member_type: VOTER last_known_addr { host: "127.23.12.195" port: 32809 } } peers { permanent_uuid: "e5318a97a53d44a0ab8a000d860514ac" member_type: VOTER last_known_addr { host: "127.23.12.193" port: 35651 } }
08:04:06.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.372890 25103 raft_consensus.cc:385] T 9fd0331c3da74721a6bf81effaa2ca6d P e5318a97a53d44a0ab8a000d860514ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:06.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.373184 25103 raft_consensus.cc:740] T 9fd0331c3da74721a6bf81effaa2ca6d P e5318a97a53d44a0ab8a000d860514ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5318a97a53d44a0ab8a000d860514ac, State: Initialized, Role: FOLLOWER
08:04:06.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.374193 25103 consensus_queue.cc:260] T 9fd0331c3da74721a6bf81effaa2ca6d P e5318a97a53d44a0ab8a000d860514ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28aa3d1914814f939e6cedae64740867" member_type: VOTER last_known_addr { host: "127.23.12.194" port: 44439 } } peers { permanent_uuid: "aff3e5847231454bad66ef71cb36c4d3" member_type: VOTER last_known_addr { host: "127.23.12.195" port: 32809 } } peers { permanent_uuid: "e5318a97a53d44a0ab8a000d860514ac" member_type: VOTER last_known_addr { host: "127.23.12.193" port: 35651 } }
08:04:06.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.402366 25103 ts_tablet_manager.cc:1434] T 9fd0331c3da74721a6bf81effaa2ca6d P e5318a97a53d44a0ab8a000d860514ac: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.003s
08:04:06.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.433743 25105 raft_consensus.cc:359] T 9fd0331c3da74721a6bf81effaa2ca6d P 28aa3d1914814f939e6cedae64740867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28aa3d1914814f939e6cedae64740867" member_type: VOTER last_known_addr { host: "127.23.12.194" port: 44439 } } peers { permanent_uuid: "aff3e5847231454bad66ef71cb36c4d3" member_type: VOTER last_known_addr { host: "127.23.12.195" port: 32809 } } peers { permanent_uuid: "e5318a97a53d44a0ab8a000d860514ac" member_type: VOTER last_known_addr { host: "127.23.12.193" port: 35651 } }
08:04:06.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.435068 25105 raft_consensus.cc:385] T 9fd0331c3da74721a6bf81effaa2ca6d P 28aa3d1914814f939e6cedae64740867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:06.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.435418 25105 raft_consensus.cc:740] T 9fd0331c3da74721a6bf81effaa2ca6d P 28aa3d1914814f939e6cedae64740867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28aa3d1914814f939e6cedae64740867, State: Initialized, Role: FOLLOWER
08:04:06.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.436704 25106 raft_consensus.cc:359] T 08fb1cfeee8e45528078bdd8935cfb8f P aff3e5847231454bad66ef71cb36c4d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5318a97a53d44a0ab8a000d860514ac" member_type: VOTER last_known_addr { host: "127.23.12.193" port: 35651 } } peers { permanent_uuid: "28aa3d1914814f939e6cedae64740867" member_type: VOTER last_known_addr { host: "127.23.12.194" port: 44439 } } peers { permanent_uuid: "aff3e5847231454bad66ef71cb36c4d3" member_type: VOTER last_known_addr { host: "127.23.12.195" port: 32809 } }
08:04:06.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.437563 25105 consensus_queue.cc:260] T 9fd0331c3da74721a6bf81effaa2ca6d P 28aa3d1914814f939e6cedae64740867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28aa3d1914814f939e6cedae64740867" member_type: VOTER last_known_addr { host: "127.23.12.194" port: 44439 } } peers { permanent_uuid: "aff3e5847231454bad66ef71cb36c4d3" member_type: VOTER last_known_addr { host: "127.23.12.195" port: 32809 } } peers { permanent_uuid: "e5318a97a53d44a0ab8a000d860514ac" member_type: VOTER last_known_addr { host: "127.23.12.193" port: 35651 } }
08:04:06.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.438808 25106 raft_consensus.cc:385] T 08fb1cfeee8e45528078bdd8935cfb8f P aff3e5847231454bad66ef71cb36c4d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:06.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.439338 25106 raft_consensus.cc:740] T 08fb1cfeee8e45528078bdd8935cfb8f P aff3e5847231454bad66ef71cb36c4d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff3e5847231454bad66ef71cb36c4d3, State: Initialized, Role: FOLLOWER
08:04:06.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.441112 25106 consensus_queue.cc:260] T 08fb1cfeee8e45528078bdd8935cfb8f P aff3e5847231454bad66ef71cb36c4d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5318a97a53d44a0ab8a000d860514ac" member_type: VOTER last_known_addr { host: "127.23.12.193" port: 35651 } } peers { permanent_uuid: "28aa3d1914814f939e6cedae64740867" member_type: VOTER last_known_addr { host: "127.23.12.194" port: 44439 } } peers { permanent_uuid: "aff3e5847231454bad66ef71cb36c4d3" member_type: VOTER last_known_addr { host: "127.23.12.195" port: 32809 } }
08:04:06.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.468732 25106 ts_tablet_manager.cc:1434] T 08fb1cfeee8e45528078bdd8935cfb8f P aff3e5847231454bad66ef71cb36c4d3: Time spent starting tablet: real 0.122s	user 0.040s	sys 0.022s
08:04:06.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.478974 25105 ts_tablet_manager.cc:1434] T 9fd0331c3da74721a6bf81effaa2ca6d P 28aa3d1914814f939e6cedae64740867: Time spent starting tablet: real 0.121s	user 0.045s	sys 0.026s
08:04:06.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.479104 25107 raft_consensus.cc:493] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:04:06.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.480136 25105 tablet_bootstrap.cc:492] T 08fb1cfeee8e45528078bdd8935cfb8f P 28aa3d1914814f939e6cedae64740867: Bootstrap starting.
08:04:06.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.479692 25107 raft_consensus.cc:515] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5318a97a53d44a0ab8a000d860514ac" member_type: VOTER last_known_addr { host: "127.23.12.193" port: 35651 } } peers { permanent_uuid: "28aa3d1914814f939e6cedae64740867" member_type: VOTER last_known_addr { host: "127.23.12.194" port: 44439 } } peers { permanent_uuid: "aff3e5847231454bad66ef71cb36c4d3" member_type: VOTER last_known_addr { host: "127.23.12.195" port: 32809 } }
08:04:06.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.497892 25107 leader_election.cc:290] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28aa3d1914814f939e6cedae64740867 (127.23.12.194:44439), aff3e5847231454bad66ef71cb36c4d3 (127.23.12.195:32809)
08:04:06.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.503551 25106 tablet_bootstrap.cc:492] T 9fd0331c3da74721a6bf81effaa2ca6d P aff3e5847231454bad66ef71cb36c4d3: Bootstrap starting.
08:04:06.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.509984 25105 tablet_bootstrap.cc:654] T 08fb1cfeee8e45528078bdd8935cfb8f P 28aa3d1914814f939e6cedae64740867: Neither blocks nor log segments found. Creating new log.
08:04:06.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.515668 25106 tablet_bootstrap.cc:654] T 9fd0331c3da74721a6bf81effaa2ca6d P aff3e5847231454bad66ef71cb36c4d3: Neither blocks nor log segments found. Creating new log.
08:04:06.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.522264 24133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fb1cfeee8e45528078bdd8935cfb8f" candidate_uuid: "e5318a97a53d44a0ab8a000d860514ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28aa3d1914814f939e6cedae64740867" is_pre_election: true
08:04:06.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:06.524783 23925 leader_election.cc:343] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28aa3d1914814f939e6cedae64740867 (127.23.12.194:44439): Illegal state: must be running to vote when last-logged opid is not known
08:04:06.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.526614 25105 tablet_bootstrap.cc:492] T 08fb1cfeee8e45528078bdd8935cfb8f P 28aa3d1914814f939e6cedae64740867: No bootstrap required, opened a new log
08:04:06.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.527079 25105 ts_tablet_manager.cc:1403] T 08fb1cfeee8e45528078bdd8935cfb8f P 28aa3d1914814f939e6cedae64740867: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.004s
08:04:06.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.531291 25105 raft_consensus.cc:359] T 08fb1cfeee8e45528078bdd8935cfb8f P 28aa3d1914814f939e6cedae64740867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5318a97a53d44a0ab8a000d860514ac" member_type: VOTER last_known_addr { host: "127.23.12.193" port: 35651 } } peers { permanent_uuid: "28aa3d1914814f939e6cedae64740867" member_type: VOTER last_known_addr { host: "127.23.12.194" port: 44439 } } peers { permanent_uuid: "aff3e5847231454bad66ef71cb36c4d3" member_type: VOTER last_known_addr { host: "127.23.12.195" port: 32809 } }
08:04:06.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.532027 25105 raft_consensus.cc:385] T 08fb1cfeee8e45528078bdd8935cfb8f P 28aa3d1914814f939e6cedae64740867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:06.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.532325 25105 raft_consensus.cc:740] T 08fb1cfeee8e45528078bdd8935cfb8f P 28aa3d1914814f939e6cedae64740867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28aa3d1914814f939e6cedae64740867, State: Initialized, Role: FOLLOWER
08:04:06.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.532999 25105 consensus_queue.cc:260] T 08fb1cfeee8e45528078bdd8935cfb8f P 28aa3d1914814f939e6cedae64740867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5318a97a53d44a0ab8a000d860514ac" member_type: VOTER last_known_addr { host: "127.23.12.193" port: 35651 } } peers { permanent_uuid: "28aa3d1914814f939e6cedae64740867" member_type: VOTER last_known_addr { host: "127.23.12.194" port: 44439 } } peers { permanent_uuid: "aff3e5847231454bad66ef71cb36c4d3" member_type: VOTER last_known_addr { host: "127.23.12.195" port: 32809 } }
08:04:06.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.543377 25105 ts_tablet_manager.cc:1434] T 08fb1cfeee8e45528078bdd8935cfb8f P 28aa3d1914814f939e6cedae64740867: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
08:04:06.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:06.549775 24327 tablet.cc:2404] T 08fb1cfeee8e45528078bdd8935cfb8f P aff3e5847231454bad66ef71cb36c4d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:04:06.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.555195 24273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fb1cfeee8e45528078bdd8935cfb8f" candidate_uuid: "e5318a97a53d44a0ab8a000d860514ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3e5847231454bad66ef71cb36c4d3" is_pre_election: true
08:04:06.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.562564 24273 raft_consensus.cc:2468] T 08fb1cfeee8e45528078bdd8935cfb8f P aff3e5847231454bad66ef71cb36c4d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5318a97a53d44a0ab8a000d860514ac in term 0.
08:04:06.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.565089 23925 leader_election.cc:304] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aff3e5847231454bad66ef71cb36c4d3, e5318a97a53d44a0ab8a000d860514ac; no voters: 28aa3d1914814f939e6cedae64740867
08:04:06.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.570197 25107 raft_consensus.cc:2804] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac [term 0 FOLLOWER]: Leader pre-election won for term 1
08:04:06.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.570751 25107 raft_consensus.cc:493] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:04:06.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.571202 25107 raft_consensus.cc:3060] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac [term 0 FOLLOWER]: Advancing to term 1
08:04:06.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.586575 25106 tablet_bootstrap.cc:492] T 9fd0331c3da74721a6bf81effaa2ca6d P aff3e5847231454bad66ef71cb36c4d3: No bootstrap required, opened a new log
08:04:06.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.587670 25106 ts_tablet_manager.cc:1403] T 9fd0331c3da74721a6bf81effaa2ca6d P aff3e5847231454bad66ef71cb36c4d3: Time spent bootstrapping tablet: real 0.084s	user 0.007s	sys 0.007s
08:04:06.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.591830 25106 raft_consensus.cc:359] T 9fd0331c3da74721a6bf81effaa2ca6d P aff3e5847231454bad66ef71cb36c4d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28aa3d1914814f939e6cedae64740867" member_type: VOTER last_known_addr { host: "127.23.12.194" port: 44439 } } peers { permanent_uuid: "aff3e5847231454bad66ef71cb36c4d3" member_type: VOTER last_known_addr { host: "127.23.12.195" port: 32809 } } peers { permanent_uuid: "e5318a97a53d44a0ab8a000d860514ac" member_type: VOTER last_known_addr { host: "127.23.12.193" port: 35651 } }
08:04:06.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.603606 25106 raft_consensus.cc:385] T 9fd0331c3da74721a6bf81effaa2ca6d P aff3e5847231454bad66ef71cb36c4d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:06.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.599793 25107 raft_consensus.cc:515] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5318a97a53d44a0ab8a000d860514ac" member_type: VOTER last_known_addr { host: "127.23.12.193" port: 35651 } } peers { permanent_uuid: "28aa3d1914814f939e6cedae64740867" member_type: VOTER last_known_addr { host: "127.23.12.194" port: 44439 } } peers { permanent_uuid: "aff3e5847231454bad66ef71cb36c4d3" member_type: VOTER last_known_addr { host: "127.23.12.195" port: 32809 } }
08:04:06.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.605376 25106 raft_consensus.cc:740] T 9fd0331c3da74721a6bf81effaa2ca6d P aff3e5847231454bad66ef71cb36c4d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff3e5847231454bad66ef71cb36c4d3, State: Initialized, Role: FOLLOWER
08:04:06.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.606572 25107 leader_election.cc:290] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac [CANDIDATE]: Term 1 election: Requested vote from peers 28aa3d1914814f939e6cedae64740867 (127.23.12.194:44439), aff3e5847231454bad66ef71cb36c4d3 (127.23.12.195:32809)
08:04:06.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.608078 24133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fb1cfeee8e45528078bdd8935cfb8f" candidate_uuid: "e5318a97a53d44a0ab8a000d860514ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28aa3d1914814f939e6cedae64740867"
08:04:06.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.608994 24133 raft_consensus.cc:3060] T 08fb1cfeee8e45528078bdd8935cfb8f P 28aa3d1914814f939e6cedae64740867 [term 0 FOLLOWER]: Advancing to term 1
08:04:06.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.609483 24273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fb1cfeee8e45528078bdd8935cfb8f" candidate_uuid: "e5318a97a53d44a0ab8a000d860514ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3e5847231454bad66ef71cb36c4d3"
08:04:06.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.610092 24273 raft_consensus.cc:3060] T 08fb1cfeee8e45528078bdd8935cfb8f P aff3e5847231454bad66ef71cb36c4d3 [term 0 FOLLOWER]: Advancing to term 1
08:04:06.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.620573 24273 raft_consensus.cc:2468] T 08fb1cfeee8e45528078bdd8935cfb8f P aff3e5847231454bad66ef71cb36c4d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5318a97a53d44a0ab8a000d860514ac in term 1.
08:04:06.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.624420 25106 consensus_queue.cc:260] T 9fd0331c3da74721a6bf81effaa2ca6d P aff3e5847231454bad66ef71cb36c4d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28aa3d1914814f939e6cedae64740867" member_type: VOTER last_known_addr { host: "127.23.12.194" port: 44439 } } peers { permanent_uuid: "aff3e5847231454bad66ef71cb36c4d3" member_type: VOTER last_known_addr { host: "127.23.12.195" port: 32809 } } peers { permanent_uuid: "e5318a97a53d44a0ab8a000d860514ac" member_type: VOTER last_known_addr { host: "127.23.12.193" port: 35651 } }
08:04:06.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:06.627959 24185 tablet.cc:2404] T 08fb1cfeee8e45528078bdd8935cfb8f P 28aa3d1914814f939e6cedae64740867: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:04:06.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.629910 23925 leader_election.cc:304] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aff3e5847231454bad66ef71cb36c4d3, e5318a97a53d44a0ab8a000d860514ac; no voters: 
08:04:06.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.631536 25106 ts_tablet_manager.cc:1434] T 9fd0331c3da74721a6bf81effaa2ca6d P aff3e5847231454bad66ef71cb36c4d3: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
08:04:06.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.632889 25107 raft_consensus.cc:2804] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac [term 1 FOLLOWER]: Leader election won for term 1
08:04:06.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.637104 24133 raft_consensus.cc:2468] T 08fb1cfeee8e45528078bdd8935cfb8f P 28aa3d1914814f939e6cedae64740867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5318a97a53d44a0ab8a000d860514ac in term 1.
08:04:06.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.675310 25107 raft_consensus.cc:697] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac [term 1 LEADER]: Becoming Leader. State: Replica: e5318a97a53d44a0ab8a000d860514ac, State: Running, Role: LEADER
08:04:06.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.692323 25107 consensus_queue.cc:237] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5318a97a53d44a0ab8a000d860514ac" member_type: VOTER last_known_addr { host: "127.23.12.193" port: 35651 } } peers { permanent_uuid: "28aa3d1914814f939e6cedae64740867" member_type: VOTER last_known_addr { host: "127.23.12.194" port: 44439 } } peers { permanent_uuid: "aff3e5847231454bad66ef71cb36c4d3" member_type: VOTER last_known_addr { host: "127.23.12.195" port: 32809 } }
08:04:06.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.742774 23803 catalog_manager.cc:5696] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac reported cstate change: term changed from 0 to 1, leader changed from <none> to e5318a97a53d44a0ab8a000d860514ac (127.23.12.193). New cstate: current_term: 1 leader_uuid: "e5318a97a53d44a0ab8a000d860514ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5318a97a53d44a0ab8a000d860514ac" member_type: VOTER last_known_addr { host: "127.23.12.193" port: 35651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28aa3d1914814f939e6cedae64740867" member_type: VOTER last_known_addr { host: "127.23.12.194" port: 44439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aff3e5847231454bad66ef71cb36c4d3" member_type: VOTER last_known_addr { host: "127.23.12.195" port: 32809 } health_report { overall_health: UNKNOWN } } }
08:04:06.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.761345 25112 raft_consensus.cc:493] T 9fd0331c3da74721a6bf81effaa2ca6d P 28aa3d1914814f939e6cedae64740867 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:04:06.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.762027 25112 raft_consensus.cc:515] T 9fd0331c3da74721a6bf81effaa2ca6d P 28aa3d1914814f939e6cedae64740867 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28aa3d1914814f939e6cedae64740867" member_type: VOTER last_known_addr { host: "127.23.12.194" port: 44439 } } peers { permanent_uuid: "aff3e5847231454bad66ef71cb36c4d3" member_type: VOTER last_known_addr { host: "127.23.12.195" port: 32809 } } peers { permanent_uuid: "e5318a97a53d44a0ab8a000d860514ac" member_type: VOTER last_known_addr { host: "127.23.12.193" port: 35651 } }
08:04:06.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.774143 25107 raft_consensus.cc:493] T 9fd0331c3da74721a6bf81effaa2ca6d P e5318a97a53d44a0ab8a000d860514ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:04:06.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.774610 25107 raft_consensus.cc:515] T 9fd0331c3da74721a6bf81effaa2ca6d P e5318a97a53d44a0ab8a000d860514ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28aa3d1914814f939e6cedae64740867" member_type: VOTER last_known_addr { host: "127.23.12.194" port: 44439 } } peers { permanent_uuid: "aff3e5847231454bad66ef71cb36c4d3" member_type: VOTER last_known_addr { host: "127.23.12.195" port: 32809 } } peers { permanent_uuid: "e5318a97a53d44a0ab8a000d860514ac" member_type: VOTER last_known_addr { host: "127.23.12.193" port: 35651 } }
08:04:06.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.776855 25107 leader_election.cc:290] T 9fd0331c3da74721a6bf81effaa2ca6d P e5318a97a53d44a0ab8a000d860514ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28aa3d1914814f939e6cedae64740867 (127.23.12.194:44439), aff3e5847231454bad66ef71cb36c4d3 (127.23.12.195:32809)
08:04:06.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.778595 25112 leader_election.cc:290] T 9fd0331c3da74721a6bf81effaa2ca6d P 28aa3d1914814f939e6cedae64740867 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aff3e5847231454bad66ef71cb36c4d3 (127.23.12.195:32809), e5318a97a53d44a0ab8a000d860514ac (127.23.12.193:35651)
08:04:06.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.780630 24133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd0331c3da74721a6bf81effaa2ca6d" candidate_uuid: "e5318a97a53d44a0ab8a000d860514ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28aa3d1914814f939e6cedae64740867" is_pre_election: true
08:04:06.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.781198 24133 raft_consensus.cc:2468] T 9fd0331c3da74721a6bf81effaa2ca6d P 28aa3d1914814f939e6cedae64740867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5318a97a53d44a0ab8a000d860514ac in term 0.
08:04:06.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.782263 24273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd0331c3da74721a6bf81effaa2ca6d" candidate_uuid: "e5318a97a53d44a0ab8a000d860514ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3e5847231454bad66ef71cb36c4d3" is_pre_election: true
08:04:06.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.782984 24273 raft_consensus.cc:2468] T 9fd0331c3da74721a6bf81effaa2ca6d P aff3e5847231454bad66ef71cb36c4d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5318a97a53d44a0ab8a000d860514ac in term 0.
08:04:06.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.803514 23925 leader_election.cc:304] T 9fd0331c3da74721a6bf81effaa2ca6d P e5318a97a53d44a0ab8a000d860514ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28aa3d1914814f939e6cedae64740867, e5318a97a53d44a0ab8a000d860514ac; no voters: 
08:04:06.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.808058 25107 raft_consensus.cc:2804] T 9fd0331c3da74721a6bf81effaa2ca6d P e5318a97a53d44a0ab8a000d860514ac [term 0 FOLLOWER]: Leader pre-election won for term 1
08:04:06.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.808662 25107 raft_consensus.cc:493] T 9fd0331c3da74721a6bf81effaa2ca6d P e5318a97a53d44a0ab8a000d860514ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:04:06.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.809144 25107 raft_consensus.cc:3060] T 9fd0331c3da74721a6bf81effaa2ca6d P e5318a97a53d44a0ab8a000d860514ac [term 0 FOLLOWER]: Advancing to term 1
08:04:06.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.821033 25107 raft_consensus.cc:515] T 9fd0331c3da74721a6bf81effaa2ca6d P e5318a97a53d44a0ab8a000d860514ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28aa3d1914814f939e6cedae64740867" member_type: VOTER last_known_addr { host: "127.23.12.194" port: 44439 } } peers { permanent_uuid: "aff3e5847231454bad66ef71cb36c4d3" member_type: VOTER last_known_addr { host: "127.23.12.195" port: 32809 } } peers { permanent_uuid: "e5318a97a53d44a0ab8a000d860514ac" member_type: VOTER last_known_addr { host: "127.23.12.193" port: 35651 } }
08:04:06.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.838335 24133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd0331c3da74721a6bf81effaa2ca6d" candidate_uuid: "e5318a97a53d44a0ab8a000d860514ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28aa3d1914814f939e6cedae64740867"
08:04:06.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.839363 24133 raft_consensus.cc:3060] T 9fd0331c3da74721a6bf81effaa2ca6d P 28aa3d1914814f939e6cedae64740867 [term 0 FOLLOWER]: Advancing to term 1
08:04:06.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.840096 24273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd0331c3da74721a6bf81effaa2ca6d" candidate_uuid: "e5318a97a53d44a0ab8a000d860514ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3e5847231454bad66ef71cb36c4d3"
08:04:06.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.840708 24273 raft_consensus.cc:3060] T 9fd0331c3da74721a6bf81effaa2ca6d P aff3e5847231454bad66ef71cb36c4d3 [term 0 FOLLOWER]: Advancing to term 1
08:04:06.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.852329 25107 leader_election.cc:290] T 9fd0331c3da74721a6bf81effaa2ca6d P e5318a97a53d44a0ab8a000d860514ac [CANDIDATE]: Term 1 election: Requested vote from peers 28aa3d1914814f939e6cedae64740867 (127.23.12.194:44439), aff3e5847231454bad66ef71cb36c4d3 (127.23.12.195:32809)
08:04:06.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.853909 24133 raft_consensus.cc:2468] T 9fd0331c3da74721a6bf81effaa2ca6d P 28aa3d1914814f939e6cedae64740867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5318a97a53d44a0ab8a000d860514ac in term 1.
08:04:06.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.862951 24272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd0331c3da74721a6bf81effaa2ca6d" candidate_uuid: "28aa3d1914814f939e6cedae64740867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff3e5847231454bad66ef71cb36c4d3" is_pre_election: true
08:04:06.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.855152 23925 leader_election.cc:304] T 9fd0331c3da74721a6bf81effaa2ca6d P e5318a97a53d44a0ab8a000d860514ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28aa3d1914814f939e6cedae64740867, e5318a97a53d44a0ab8a000d860514ac; no voters: 
08:04:06.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.869019 25107 raft_consensus.cc:2804] T 9fd0331c3da74721a6bf81effaa2ca6d P e5318a97a53d44a0ab8a000d860514ac [term 1 FOLLOWER]: Leader election won for term 1
08:04:06.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.879014 25107 raft_consensus.cc:697] T 9fd0331c3da74721a6bf81effaa2ca6d P e5318a97a53d44a0ab8a000d860514ac [term 1 LEADER]: Becoming Leader. State: Replica: e5318a97a53d44a0ab8a000d860514ac, State: Running, Role: LEADER
08:04:06.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.881155 24273 raft_consensus.cc:2468] T 9fd0331c3da74721a6bf81effaa2ca6d P aff3e5847231454bad66ef71cb36c4d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5318a97a53d44a0ab8a000d860514ac in term 1.
08:04:06.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.882516 25107 consensus_queue.cc:237] T 9fd0331c3da74721a6bf81effaa2ca6d P e5318a97a53d44a0ab8a000d860514ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28aa3d1914814f939e6cedae64740867" member_type: VOTER last_known_addr { host: "127.23.12.194" port: 44439 } } peers { permanent_uuid: "aff3e5847231454bad66ef71cb36c4d3" member_type: VOTER last_known_addr { host: "127.23.12.195" port: 32809 } } peers { permanent_uuid: "e5318a97a53d44a0ab8a000d860514ac" member_type: VOTER last_known_addr { host: "127.23.12.193" port: 35651 } }
08:04:06.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.919332 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd0331c3da74721a6bf81effaa2ca6d" candidate_uuid: "28aa3d1914814f939e6cedae64740867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5318a97a53d44a0ab8a000d860514ac" is_pre_election: true
08:04:06.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.922358 24065 leader_election.cc:304] T 9fd0331c3da74721a6bf81effaa2ca6d P 28aa3d1914814f939e6cedae64740867 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28aa3d1914814f939e6cedae64740867; no voters: aff3e5847231454bad66ef71cb36c4d3, e5318a97a53d44a0ab8a000d860514ac
08:04:06.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.924307 25112 raft_consensus.cc:2749] T 9fd0331c3da74721a6bf81effaa2ca6d P 28aa3d1914814f939e6cedae64740867 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
08:04:06.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:06.963778 23803 catalog_manager.cc:5696] T 9fd0331c3da74721a6bf81effaa2ca6d P e5318a97a53d44a0ab8a000d860514ac reported cstate change: term changed from 0 to 1, leader changed from <none> to e5318a97a53d44a0ab8a000d860514ac (127.23.12.193). New cstate: current_term: 1 leader_uuid: "e5318a97a53d44a0ab8a000d860514ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28aa3d1914814f939e6cedae64740867" member_type: VOTER last_known_addr { host: "127.23.12.194" port: 44439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aff3e5847231454bad66ef71cb36c4d3" member_type: VOTER last_known_addr { host: "127.23.12.195" port: 32809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5318a97a53d44a0ab8a000d860514ac" member_type: VOTER last_known_addr { host: "127.23.12.193" port: 35651 } health_report { overall_health: HEALTHY } } }
08:04:07.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:07.261178 25107 consensus_queue.cc:1048] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff3e5847231454bad66ef71cb36c4d3" member_type: VOTER last_known_addr { host: "127.23.12.195" port: 32809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:04:07.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:07.271679 25107 consensus_queue.cc:1048] T 08fb1cfeee8e45528078bdd8935cfb8f P e5318a97a53d44a0ab8a000d860514ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "28aa3d1914814f939e6cedae64740867" member_type: VOTER last_known_addr { host: "127.23.12.194" port: 44439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:04:07.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:07.361102 25135 consensus_queue.cc:1048] T 9fd0331c3da74721a6bf81effaa2ca6d P e5318a97a53d44a0ab8a000d860514ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "28aa3d1914814f939e6cedae64740867" member_type: VOTER last_known_addr { host: "127.23.12.194" port: 44439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:04:07.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:07.374449 25135 consensus_queue.cc:1048] T 9fd0331c3da74721a6bf81effaa2ca6d P e5318a97a53d44a0ab8a000d860514ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff3e5847231454bad66ef71cb36c4d3" member_type: VOTER last_known_addr { host: "127.23.12.195" port: 32809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:04:07.656 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table e785290ee4514812bbf41055a4694542
08:04:07.687 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 9fd0331c3da74721a6bf81effaa2ca6d for table 'replication_test_table' with partition [0x80000000, 0x80000032)
08:04:07.688 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 08fb1cfeee8e45528078bdd8935cfb8f for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
08:04:07.691 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299997, tablet=9fd0331c3da74721a6bf81effaa2ca6d@[28aa3d1914814f939e6cedae64740867(127.23.12.194:44439),aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809),e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299997}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299997, tablet=08fb1cfeee8e45528078bdd8935cfb8f@[28aa3d1914814f939e6cedae64740867(127.23.12.194:44439),aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809),e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299996}]
08:04:07.693 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=27), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.12.252:42637, [13ms] Sub RPC GetTableLocations: received response from server master-127.23.12.252:42637: OK, deferred=null) after lookup
08:04:07.703 [DEBUG - kudu-nio-0] (Connection.java:748) [peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)] connecting to peer
08:04:07.710 [DEBUG - kudu-nio-3] (Connection.java:757) [peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)] Successfully connected to peer
08:04:07.817 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:07.826 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x305766c8, L:/127.0.0.1:36286 - R:/127.23.12.193:35651] using TOKEN/null
08:04:08.124 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table e785290ee4514812bbf41055a4694542
08:04:08.292 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:04:08.297 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:04:08.301 [DEBUG - main] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:08.304 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.23.194.126:38579(127.23.194.126:38579)] Successfully connected to peer
08:04:08.319 [DEBUG - main] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:08.323 [DEBUG - main] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:08.324 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.23.194.125:38689(127.23.194.125:38689)] Successfully connected to peer
08:04:08.337 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.194.126
08:04:08.337 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.23.194.124:38943(127.23.194.124:38943)] Successfully connected to peer
08:04:08.366 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.194.124
08:04:08.370 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.194.125
08:04:08.412 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:08.417 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x78c2454c, L:/127.0.0.1:38260 - R:/127.23.194.125:38689] using SASL/PLAIN
08:04:08.421 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:08.428 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:04:08.428 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=129), Traces: [0ms] refreshing cache from master, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [128ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: OK, deferred=null) after lookup
08:04:08.452 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:08.454 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x6fb7df91, L:/127.0.0.1:55364 - R:/127.23.194.126:38579] using SASL/PLAIN
08:04:08.456 [DEBUG - main] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:08.460 [DEBUG - main] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:08.462 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.23.12.252:42637(127.23.12.252:42637)] Successfully connected to peer
08:04:08.475 [DEBUG - main] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:08.478 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x80dc20f2, L:/127.0.0.1:47802 - R:/127.23.194.124:38943] using SASL/PLAIN
08:04:08.484 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.23.12.254:42055(127.23.12.254:42055)] Successfully connected to peer
08:04:08.488 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.12.252
08:04:08.488 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.12.254
08:04:08.494 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.23.12.253:45283(127.23.12.253:45283)] Successfully connected to peer
08:04:08.509 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.12.253
08:04:08.537 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:08.541 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:08.544 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x58a4412f, L:/127.0.0.1:43558 - R:/127.23.12.254:42055] using SASL/PLAIN
08:04:08.548 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xbbd8a054, L:/127.0.0.1:47894 - R:/127.23.12.253:45283] using SASL/PLAIN
08:04:08.553 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:08.557 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xff0e3d9e, L:/127.0.0.1:49314 - R:/127.23.12.252:42637] using SASL/PLAIN
08:04:08.561 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:04:08.562 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=115), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [94ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: OK, [96ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: OK, [106ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: OK, deferred=null) after lookup
08:04:08.566 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table e785290ee4514812bbf41055a4694542
08:04:08.614 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 9fd0331c3da74721a6bf81effaa2ca6d for table 'replication_test_table' with partition [0x80000000, 0x80000032)
08:04:08.614 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 08fb1cfeee8e45528078bdd8935cfb8f for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
08:04:08.615 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=9fd0331c3da74721a6bf81effaa2ca6d@[28aa3d1914814f939e6cedae64740867(127.23.12.194:44439),aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809),e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=08fb1cfeee8e45528078bdd8935cfb8f@[28aa3d1914814f939e6cedae64740867(127.23.12.194:44439),aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809),e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:04:08.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:08.632398 24451 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38260:
08:04:08.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
08:04:08.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
08:04:08.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:04:08.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
08:04:08.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:04:08.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:04:08.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:04:08.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:04:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
08:04:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:04:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:04:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:04:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:04:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:04:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:04:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:04:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:04:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:04:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:04:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
08:04:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
08:04:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\001\000\000\000\000\007\0012\000\000\000"
08:04:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:04:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
08:04:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
08:04:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
08:04:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
08:04:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:04:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:04:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:04:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
08:04:08.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:08.636955 24451 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
08:04:08.723 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table e8f6cd1cdab0401da8f16766996e833e
08:04:08.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:08.834915 24853 tablet_service.cc:1511] Processing CreateTablet for tablet fedc9af6dceb44d58a0849858639a7b9 (DEFAULT_TABLE table=replication_test_table [id=e8f6cd1cdab0401da8f16766996e833e]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
08:04:08.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:08.839247 24853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fedc9af6dceb44d58a0849858639a7b9. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:08.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:08.839010 24711 tablet_service.cc:1511] Processing CreateTablet for tablet fedc9af6dceb44d58a0849858639a7b9 (DEFAULT_TABLE table=replication_test_table [id=e8f6cd1cdab0401da8f16766996e833e]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
08:04:08.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:08.843231 24711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fedc9af6dceb44d58a0849858639a7b9. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:08.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:08.856055 24999 tablet_service.cc:1511] Processing CreateTablet for tablet fedc9af6dceb44d58a0849858639a7b9 (DEFAULT_TABLE table=replication_test_table [id=e8f6cd1cdab0401da8f16766996e833e]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
08:04:08.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:08.860018 24999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fedc9af6dceb44d58a0849858639a7b9. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:08.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:08.895659 25183 tablet_bootstrap.cc:492] T fedc9af6dceb44d58a0849858639a7b9 P 7eb69088ee284421ba9cfbd602fcb697: Bootstrap starting.
08:04:08.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:08.904516 25183 tablet_bootstrap.cc:654] T fedc9af6dceb44d58a0849858639a7b9 P 7eb69088ee284421ba9cfbd602fcb697: Neither blocks nor log segments found. Creating new log.
08:04:08.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:08.905781 25182 tablet_bootstrap.cc:492] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e: Bootstrap starting.
08:04:08.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:08.907958 25183 log.cc:826] T fedc9af6dceb44d58a0849858639a7b9 P 7eb69088ee284421ba9cfbd602fcb697: Log is configured to *not* fsync() on all Append() calls
08:04:08.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:08.928006 25182 tablet_bootstrap.cc:654] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e: Neither blocks nor log segments found. Creating new log.
08:04:08.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:08.931170 25182 log.cc:826] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e: Log is configured to *not* fsync() on all Append() calls
08:04:08.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:08.968344 25183 tablet_bootstrap.cc:492] T fedc9af6dceb44d58a0849858639a7b9 P 7eb69088ee284421ba9cfbd602fcb697: No bootstrap required, opened a new log
08:04:08.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:08.968948 25183 ts_tablet_manager.cc:1403] T fedc9af6dceb44d58a0849858639a7b9 P 7eb69088ee284421ba9cfbd602fcb697: Time spent bootstrapping tablet: real 0.074s	user 0.017s	sys 0.003s
08:04:08.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:08.987372 25182 tablet_bootstrap.cc:492] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e: No bootstrap required, opened a new log
08:04:08.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:08.988169 25182 ts_tablet_manager.cc:1403] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e: Time spent bootstrapping tablet: real 0.095s	user 0.017s	sys 0.017s
08:04:09.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.013851 25186 tablet_bootstrap.cc:492] T fedc9af6dceb44d58a0849858639a7b9 P b1ebf50f84fd43329637c4bbdd91ce31: Bootstrap starting.
08:04:09.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.037667 25186 tablet_bootstrap.cc:654] T fedc9af6dceb44d58a0849858639a7b9 P b1ebf50f84fd43329637c4bbdd91ce31: Neither blocks nor log segments found. Creating new log.
08:04:09.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.040170 25186 log.cc:826] T fedc9af6dceb44d58a0849858639a7b9 P b1ebf50f84fd43329637c4bbdd91ce31: Log is configured to *not* fsync() on all Append() calls
08:04:09.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.057427 25186 tablet_bootstrap.cc:492] T fedc9af6dceb44d58a0849858639a7b9 P b1ebf50f84fd43329637c4bbdd91ce31: No bootstrap required, opened a new log
08:04:09.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.058013 25186 ts_tablet_manager.cc:1403] T fedc9af6dceb44d58a0849858639a7b9 P b1ebf50f84fd43329637c4bbdd91ce31: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.011s
08:04:09.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.093317 25186 raft_consensus.cc:359] T fedc9af6dceb44d58a0849858639a7b9 P b1ebf50f84fd43329637c4bbdd91ce31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" member_type: VOTER last_known_addr { host: "127.23.194.65" port: 37577 } } peers { permanent_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" member_type: VOTER last_known_addr { host: "127.23.194.67" port: 42497 } } peers { permanent_uuid: "7eb69088ee284421ba9cfbd602fcb697" member_type: VOTER last_known_addr { host: "127.23.194.66" port: 39487 } }
08:04:09.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.094393 25186 raft_consensus.cc:385] T fedc9af6dceb44d58a0849858639a7b9 P b1ebf50f84fd43329637c4bbdd91ce31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:09.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.094702 25186 raft_consensus.cc:740] T fedc9af6dceb44d58a0849858639a7b9 P b1ebf50f84fd43329637c4bbdd91ce31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1ebf50f84fd43329637c4bbdd91ce31, State: Initialized, Role: FOLLOWER
08:04:09.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.097729 25186 consensus_queue.cc:260] T fedc9af6dceb44d58a0849858639a7b9 P b1ebf50f84fd43329637c4bbdd91ce31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" member_type: VOTER last_known_addr { host: "127.23.194.65" port: 37577 } } peers { permanent_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" member_type: VOTER last_known_addr { host: "127.23.194.67" port: 42497 } } peers { permanent_uuid: "7eb69088ee284421ba9cfbd602fcb697" member_type: VOTER last_known_addr { host: "127.23.194.66" port: 39487 } }
08:04:09.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.106156 25182 raft_consensus.cc:359] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" member_type: VOTER last_known_addr { host: "127.23.194.65" port: 37577 } } peers { permanent_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" member_type: VOTER last_known_addr { host: "127.23.194.67" port: 42497 } } peers { permanent_uuid: "7eb69088ee284421ba9cfbd602fcb697" member_type: VOTER last_known_addr { host: "127.23.194.66" port: 39487 } }
08:04:09.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.107362 25182 raft_consensus.cc:385] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:09.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.107684 25182 raft_consensus.cc:740] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a234e5e9c8f74f3bb92c0b83e703587e, State: Initialized, Role: FOLLOWER
08:04:09.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.108307 25183 raft_consensus.cc:359] T fedc9af6dceb44d58a0849858639a7b9 P 7eb69088ee284421ba9cfbd602fcb697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" member_type: VOTER last_known_addr { host: "127.23.194.65" port: 37577 } } peers { permanent_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" member_type: VOTER last_known_addr { host: "127.23.194.67" port: 42497 } } peers { permanent_uuid: "7eb69088ee284421ba9cfbd602fcb697" member_type: VOTER last_known_addr { host: "127.23.194.66" port: 39487 } }
08:04:09.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.108562 25182 consensus_queue.cc:260] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" member_type: VOTER last_known_addr { host: "127.23.194.65" port: 37577 } } peers { permanent_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" member_type: VOTER last_known_addr { host: "127.23.194.67" port: 42497 } } peers { permanent_uuid: "7eb69088ee284421ba9cfbd602fcb697" member_type: VOTER last_known_addr { host: "127.23.194.66" port: 39487 } }
08:04:09.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.109488 25183 raft_consensus.cc:385] T fedc9af6dceb44d58a0849858639a7b9 P 7eb69088ee284421ba9cfbd602fcb697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:09.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.110504 25183 raft_consensus.cc:740] T fedc9af6dceb44d58a0849858639a7b9 P 7eb69088ee284421ba9cfbd602fcb697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb69088ee284421ba9cfbd602fcb697, State: Initialized, Role: FOLLOWER
08:04:09.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.111720 25183 consensus_queue.cc:260] T fedc9af6dceb44d58a0849858639a7b9 P 7eb69088ee284421ba9cfbd602fcb697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" member_type: VOTER last_known_addr { host: "127.23.194.65" port: 37577 } } peers { permanent_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" member_type: VOTER last_known_addr { host: "127.23.194.67" port: 42497 } } peers { permanent_uuid: "7eb69088ee284421ba9cfbd602fcb697" member_type: VOTER last_known_addr { host: "127.23.194.66" port: 39487 } }
08:04:09.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.117643 25186 ts_tablet_manager.cc:1434] T fedc9af6dceb44d58a0849858639a7b9 P b1ebf50f84fd43329637c4bbdd91ce31: Time spent starting tablet: real 0.059s	user 0.032s	sys 0.008s
08:04:09.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.136724 25182 ts_tablet_manager.cc:1434] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e: Time spent starting tablet: real 0.148s	user 0.038s	sys 0.006s
08:04:09.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.140069 25183 ts_tablet_manager.cc:1434] T fedc9af6dceb44d58a0849858639a7b9 P 7eb69088ee284421ba9cfbd602fcb697: Time spent starting tablet: real 0.169s	user 0.033s	sys 0.028s
08:04:09.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.182035 25188 raft_consensus.cc:493] T fedc9af6dceb44d58a0849858639a7b9 P b1ebf50f84fd43329637c4bbdd91ce31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:04:09.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.182680 25188 raft_consensus.cc:515] T fedc9af6dceb44d58a0849858639a7b9 P b1ebf50f84fd43329637c4bbdd91ce31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" member_type: VOTER last_known_addr { host: "127.23.194.65" port: 37577 } } peers { permanent_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" member_type: VOTER last_known_addr { host: "127.23.194.67" port: 42497 } } peers { permanent_uuid: "7eb69088ee284421ba9cfbd602fcb697" member_type: VOTER last_known_addr { host: "127.23.194.66" port: 39487 } }
08:04:09.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.187330 25190 raft_consensus.cc:493] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:04:09.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.187988 25188 leader_election.cc:290] T fedc9af6dceb44d58a0849858639a7b9 P b1ebf50f84fd43329637c4bbdd91ce31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a234e5e9c8f74f3bb92c0b83e703587e (127.23.194.65:37577), 7eb69088ee284421ba9cfbd602fcb697 (127.23.194.66:39487)
08:04:09.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.188097 25190 raft_consensus.cc:515] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" member_type: VOTER last_known_addr { host: "127.23.194.65" port: 37577 } } peers { permanent_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" member_type: VOTER last_known_addr { host: "127.23.194.67" port: 42497 } } peers { permanent_uuid: "7eb69088ee284421ba9cfbd602fcb697" member_type: VOTER last_known_addr { host: "127.23.194.66" port: 39487 } }
08:04:09.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.194674 25190 leader_election.cc:290] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1ebf50f84fd43329637c4bbdd91ce31 (127.23.194.67:42497), 7eb69088ee284421ba9cfbd602fcb697 (127.23.194.66:39487)
08:04:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.221655 25020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedc9af6dceb44d58a0849858639a7b9" candidate_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" is_pre_election: true
08:04:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.222609 25020 raft_consensus.cc:2468] T fedc9af6dceb44d58a0849858639a7b9 P b1ebf50f84fd43329637c4bbdd91ce31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a234e5e9c8f74f3bb92c0b83e703587e in term 0.
08:04:09.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.225829 24666 leader_election.cc:304] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a234e5e9c8f74f3bb92c0b83e703587e, b1ebf50f84fd43329637c4bbdd91ce31; no voters: 
08:04:09.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.226905 25190 raft_consensus.cc:2804] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e [term 0 FOLLOWER]: Leader pre-election won for term 1
08:04:09.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.227463 25190 raft_consensus.cc:493] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:04:09.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.228013 25190 raft_consensus.cc:3060] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e [term 0 FOLLOWER]: Advancing to term 1
08:04:09.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:09.230995 24784 tablet.cc:2404] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:04:09.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.238492 25190 raft_consensus.cc:515] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" member_type: VOTER last_known_addr { host: "127.23.194.65" port: 37577 } } peers { permanent_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" member_type: VOTER last_known_addr { host: "127.23.194.67" port: 42497 } } peers { permanent_uuid: "7eb69088ee284421ba9cfbd602fcb697" member_type: VOTER last_known_addr { host: "127.23.194.66" port: 39487 } }
08:04:09.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.242012 25020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedc9af6dceb44d58a0849858639a7b9" candidate_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1ebf50f84fd43329637c4bbdd91ce31"
08:04:09.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.242705 25020 raft_consensus.cc:3060] T fedc9af6dceb44d58a0849858639a7b9 P b1ebf50f84fd43329637c4bbdd91ce31 [term 0 FOLLOWER]: Advancing to term 1
08:04:09.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.245481 24873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedc9af6dceb44d58a0849858639a7b9" candidate_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb69088ee284421ba9cfbd602fcb697" is_pre_election: true
08:04:09.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.246589 24873 raft_consensus.cc:2468] T fedc9af6dceb44d58a0849858639a7b9 P 7eb69088ee284421ba9cfbd602fcb697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1ebf50f84fd43329637c4bbdd91ce31 in term 0.
08:04:09.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.248442 24951 leader_election.cc:304] T fedc9af6dceb44d58a0849858639a7b9 P b1ebf50f84fd43329637c4bbdd91ce31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb69088ee284421ba9cfbd602fcb697, b1ebf50f84fd43329637c4bbdd91ce31; no voters: 
08:04:09.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.248961 24731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedc9af6dceb44d58a0849858639a7b9" candidate_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" is_pre_election: true
08:04:09.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.250362 24731 raft_consensus.cc:2393] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1ebf50f84fd43329637c4bbdd91ce31 in current term 1: Already voted for candidate a234e5e9c8f74f3bb92c0b83e703587e in this term.
08:04:09.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.255515 25020 raft_consensus.cc:2468] T fedc9af6dceb44d58a0849858639a7b9 P b1ebf50f84fd43329637c4bbdd91ce31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a234e5e9c8f74f3bb92c0b83e703587e in term 1.
08:04:09.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.256222 25188 raft_consensus.cc:2764] T fedc9af6dceb44d58a0849858639a7b9 P b1ebf50f84fd43329637c4bbdd91ce31 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
08:04:09.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.263608 25190 leader_election.cc:290] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e [CANDIDATE]: Term 1 election: Requested vote from peers b1ebf50f84fd43329637c4bbdd91ce31 (127.23.194.67:42497), 7eb69088ee284421ba9cfbd602fcb697 (127.23.194.66:39487)
08:04:09.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.265051 24666 leader_election.cc:304] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a234e5e9c8f74f3bb92c0b83e703587e, b1ebf50f84fd43329637c4bbdd91ce31; no voters: 
08:04:09.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.265918 25190 raft_consensus.cc:2804] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e [term 1 FOLLOWER]: Leader election won for term 1
08:04:09.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.269905 24873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedc9af6dceb44d58a0849858639a7b9" candidate_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb69088ee284421ba9cfbd602fcb697" is_pre_election: true
08:04:09.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.270538 24873 raft_consensus.cc:2468] T fedc9af6dceb44d58a0849858639a7b9 P 7eb69088ee284421ba9cfbd602fcb697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a234e5e9c8f74f3bb92c0b83e703587e in term 0.
08:04:09.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.270555 24872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedc9af6dceb44d58a0849858639a7b9" candidate_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb69088ee284421ba9cfbd602fcb697"
08:04:09.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.271209 24872 raft_consensus.cc:3060] T fedc9af6dceb44d58a0849858639a7b9 P 7eb69088ee284421ba9cfbd602fcb697 [term 0 FOLLOWER]: Advancing to term 1
08:04:09.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.273993 25190 raft_consensus.cc:697] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e [term 1 LEADER]: Becoming Leader. State: Replica: a234e5e9c8f74f3bb92c0b83e703587e, State: Running, Role: LEADER
08:04:09.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.276101 25190 consensus_queue.cc:237] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" member_type: VOTER last_known_addr { host: "127.23.194.65" port: 37577 } } peers { permanent_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" member_type: VOTER last_known_addr { host: "127.23.194.67" port: 42497 } } peers { permanent_uuid: "7eb69088ee284421ba9cfbd602fcb697" member_type: VOTER last_known_addr { host: "127.23.194.66" port: 39487 } }
08:04:09.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.278829 24872 raft_consensus.cc:2468] T fedc9af6dceb44d58a0849858639a7b9 P 7eb69088ee284421ba9cfbd602fcb697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a234e5e9c8f74f3bb92c0b83e703587e in term 1.
08:04:09.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:09.285559 24925 tablet.cc:2404] T fedc9af6dceb44d58a0849858639a7b9 P 7eb69088ee284421ba9cfbd602fcb697: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:04:09.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.293467 24451 catalog_manager.cc:5696] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e reported cstate change: term changed from 0 to 1, leader changed from <none> to a234e5e9c8f74f3bb92c0b83e703587e (127.23.194.65). New cstate: current_term: 1 leader_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" member_type: VOTER last_known_addr { host: "127.23.194.65" port: 37577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" member_type: VOTER last_known_addr { host: "127.23.194.67" port: 42497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb69088ee284421ba9cfbd602fcb697" member_type: VOTER last_known_addr { host: "127.23.194.66" port: 39487 } health_report { overall_health: UNKNOWN } } }
08:04:09.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:09.332270 25076 tablet.cc:2404] T fedc9af6dceb44d58a0849858639a7b9 P b1ebf50f84fd43329637c4bbdd91ce31: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:04:09.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.584291 24451 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38260:
08:04:09.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "replication_test_table" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\001d\000\000\000\007\001\310\000\000\000" } } } schema { columns { name: "key1" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key2" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key3" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "data" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } }
08:04:09.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:09.604278 24451 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2224f7d7285c4b59921b0d6c9c323924 has no consensus state
08:04:09.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.630815 24711 tablet_service.cc:1511] Processing CreateTablet for tablet 2224f7d7285c4b59921b0d6c9c323924 (DEFAULT_TABLE table=replication_test_table [id=e8f6cd1cdab0401da8f16766996e833e]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
08:04:09.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.632352 24711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2224f7d7285c4b59921b0d6c9c323924. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:09.636564 24438 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 2224f7d7285c4b59921b0d6c9c323924 (table replication_test_table [id=e8f6cd1cdab0401da8f16766996e833e], current schema version=0) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2224f7d7285c4b59921b0d6c9c323924 consensus state has no leader
08:04:09.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.640158 24853 tablet_service.cc:1511] Processing CreateTablet for tablet 2224f7d7285c4b59921b0d6c9c323924 (DEFAULT_TABLE table=replication_test_table [id=e8f6cd1cdab0401da8f16766996e833e]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
08:04:09.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.641427 24853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2224f7d7285c4b59921b0d6c9c323924. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:09.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.647864 24999 tablet_service.cc:1511] Processing CreateTablet for tablet 2224f7d7285c4b59921b0d6c9c323924 (DEFAULT_TABLE table=replication_test_table [id=e8f6cd1cdab0401da8f16766996e833e]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
08:04:09.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.649712 24999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2224f7d7285c4b59921b0d6c9c323924. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:09.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.662503 25210 tablet_bootstrap.cc:492] T 2224f7d7285c4b59921b0d6c9c323924 P 7eb69088ee284421ba9cfbd602fcb697: Bootstrap starting.
08:04:09.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.671350 25210 tablet_bootstrap.cc:654] T 2224f7d7285c4b59921b0d6c9c323924 P 7eb69088ee284421ba9cfbd602fcb697: Neither blocks nor log segments found. Creating new log.
08:04:09.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.684875 25210 tablet_bootstrap.cc:492] T 2224f7d7285c4b59921b0d6c9c323924 P 7eb69088ee284421ba9cfbd602fcb697: No bootstrap required, opened a new log
08:04:09.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.685326 25210 ts_tablet_manager.cc:1403] T 2224f7d7285c4b59921b0d6c9c323924 P 7eb69088ee284421ba9cfbd602fcb697: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.015s
08:04:09.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.689014 25210 raft_consensus.cc:359] T 2224f7d7285c4b59921b0d6c9c323924 P 7eb69088ee284421ba9cfbd602fcb697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" member_type: VOTER last_known_addr { host: "127.23.194.65" port: 37577 } } peers { permanent_uuid: "7eb69088ee284421ba9cfbd602fcb697" member_type: VOTER last_known_addr { host: "127.23.194.66" port: 39487 } } peers { permanent_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" member_type: VOTER last_known_addr { host: "127.23.194.67" port: 42497 } }
08:04:09.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.689720 25210 raft_consensus.cc:385] T 2224f7d7285c4b59921b0d6c9c323924 P 7eb69088ee284421ba9cfbd602fcb697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:09.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.690089 25210 raft_consensus.cc:740] T 2224f7d7285c4b59921b0d6c9c323924 P 7eb69088ee284421ba9cfbd602fcb697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb69088ee284421ba9cfbd602fcb697, State: Initialized, Role: FOLLOWER
08:04:09.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.690768 25210 consensus_queue.cc:260] T 2224f7d7285c4b59921b0d6c9c323924 P 7eb69088ee284421ba9cfbd602fcb697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" member_type: VOTER last_known_addr { host: "127.23.194.65" port: 37577 } } peers { permanent_uuid: "7eb69088ee284421ba9cfbd602fcb697" member_type: VOTER last_known_addr { host: "127.23.194.66" port: 39487 } } peers { permanent_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" member_type: VOTER last_known_addr { host: "127.23.194.67" port: 42497 } }
08:04:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.698469 25190 consensus_queue.cc:1048] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" member_type: VOTER last_known_addr { host: "127.23.194.67" port: 42497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:04:09.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.702870 25210 ts_tablet_manager.cc:1434] T 2224f7d7285c4b59921b0d6c9c323924 P 7eb69088ee284421ba9cfbd602fcb697: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.003s
08:04:09.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.703608 25211 tablet_bootstrap.cc:492] T 2224f7d7285c4b59921b0d6c9c323924 P a234e5e9c8f74f3bb92c0b83e703587e: Bootstrap starting.
08:04:09.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.714852 25214 tablet_bootstrap.cc:492] T 2224f7d7285c4b59921b0d6c9c323924 P b1ebf50f84fd43329637c4bbdd91ce31: Bootstrap starting.
08:04:09.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.734517 25213 raft_consensus.cc:493] T 2224f7d7285c4b59921b0d6c9c323924 P 7eb69088ee284421ba9cfbd602fcb697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:04:09.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.735101 25213 raft_consensus.cc:515] T 2224f7d7285c4b59921b0d6c9c323924 P 7eb69088ee284421ba9cfbd602fcb697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" member_type: VOTER last_known_addr { host: "127.23.194.65" port: 37577 } } peers { permanent_uuid: "7eb69088ee284421ba9cfbd602fcb697" member_type: VOTER last_known_addr { host: "127.23.194.66" port: 39487 } } peers { permanent_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" member_type: VOTER last_known_addr { host: "127.23.194.67" port: 42497 } }
08:04:09.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.757263 25214 tablet_bootstrap.cc:654] T 2224f7d7285c4b59921b0d6c9c323924 P b1ebf50f84fd43329637c4bbdd91ce31: Neither blocks nor log segments found. Creating new log.
08:04:09.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.758955 25211 tablet_bootstrap.cc:654] T 2224f7d7285c4b59921b0d6c9c323924 P a234e5e9c8f74f3bb92c0b83e703587e: Neither blocks nor log segments found. Creating new log.
08:04:09.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.768966 24451 catalog_manager.cc:6241] T 00000000000000000000000000000000 P bf3bff2bfe2c48098e1d54555850d04b: replication_test_table [id=e8f6cd1cdab0401da8f16766996e833e] alter complete (version 0)
08:04:09.788 [DEBUG - main] (Connection.java:575) [peer master-127.23.12.254:42055(127.23.12.254:42055)] disconnecting while in state READY
08:04:09.791 [DEBUG - main] (Connection.java:575) [peer master-127.23.12.253:45283(127.23.12.253:45283)] disconnecting while in state READY
08:04:09.798 [DEBUG - main] (Connection.java:575) [peer master-127.23.12.252:42637(127.23.12.252:42637)] disconnecting while in state READY
08:04:09.798 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.23.12.253:45283(127.23.12.253:45283)] handling channelInactive
08:04:09.801 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.23.12.254:42055(127.23.12.254:42055)] handling channelInactive
08:04:09.802 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state READY due to: connection closed
08:04:09.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.741353 25213 leader_election.cc:290] T 2224f7d7285c4b59921b0d6c9c323924 P 7eb69088ee284421ba9cfbd602fcb697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a234e5e9c8f74f3bb92c0b83e703587e (127.23.194.65:37577), b1ebf50f84fd43329637c4bbdd91ce31 (127.23.194.67:42497)
08:04:09.805 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.23.12.252:42637(127.23.12.252:42637)] handling channelInactive
08:04:09.809 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state READY due to: connection closed
08:04:09.815 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state READY due to: connection closed
08:04:09.816 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:04:09.822 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
08:04:09.823 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
08:04:09.836 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
08:04:09.837 [DEBUG - main] (Connection.java:575) [peer master-127.23.194.124:38943(127.23.194.124:38943)] disconnecting while in state READY
08:04:09.837 [DEBUG - main] (Connection.java:575) [peer master-127.23.194.125:38689(127.23.194.125:38689)] disconnecting while in state READY
08:04:09.838 [DEBUG - main] (Connection.java:575) [peer master-127.23.194.126:38579(127.23.194.126:38579)] disconnecting while in state READY
08:04:09.838 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.23.194.124:38943(127.23.194.124:38943)] handling channelInactive
08:04:09.839 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state READY due to: connection closed
08:04:09.839 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.23.194.125:38689(127.23.194.125:38689)] handling channelInactive
08:04:09.839 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state READY due to: connection closed
08:04:09.839 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:04:09.847 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
08:04:09.848 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-1
08:04:09.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.850418 25211 tablet_bootstrap.cc:492] T 2224f7d7285c4b59921b0d6c9c323924 P a234e5e9c8f74f3bb92c0b83e703587e: No bootstrap required, opened a new log
08:04:09.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.851096 25211 ts_tablet_manager.cc:1403] T 2224f7d7285c4b59921b0d6c9c323924 P a234e5e9c8f74f3bb92c0b83e703587e: Time spent bootstrapping tablet: real 0.148s	user 0.013s	sys 0.016s
08:04:09.860 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.23.194.126:38579(127.23.194.126:38579)] handling channelInactive
08:04:09.860 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state READY due to: connection closed
08:04:09.861 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:04:09.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.869536 25198 consensus_queue.cc:1048] T fedc9af6dceb44d58a0849858639a7b9 P a234e5e9c8f74f3bb92c0b83e703587e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb69088ee284421ba9cfbd602fcb697" member_type: VOTER last_known_addr { host: "127.23.194.66" port: 39487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:04:09.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.872437 25214 tablet_bootstrap.cc:492] T 2224f7d7285c4b59921b0d6c9c323924 P b1ebf50f84fd43329637c4bbdd91ce31: No bootstrap required, opened a new log
08:04:09.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.873268 25214 ts_tablet_manager.cc:1403] T 2224f7d7285c4b59921b0d6c9c323924 P b1ebf50f84fd43329637c4bbdd91ce31: Time spent bootstrapping tablet: real 0.159s	user 0.017s	sys 0.009s
08:04:09.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.879850 25211 raft_consensus.cc:359] T 2224f7d7285c4b59921b0d6c9c323924 P a234e5e9c8f74f3bb92c0b83e703587e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" member_type: VOTER last_known_addr { host: "127.23.194.65" port: 37577 } } peers { permanent_uuid: "7eb69088ee284421ba9cfbd602fcb697" member_type: VOTER last_known_addr { host: "127.23.194.66" port: 39487 } } peers { permanent_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" member_type: VOTER last_known_addr { host: "127.23.194.67" port: 42497 } }
08:04:09.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.880913 25211 raft_consensus.cc:385] T 2224f7d7285c4b59921b0d6c9c323924 P a234e5e9c8f74f3bb92c0b83e703587e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:09.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.881312 25211 raft_consensus.cc:740] T 2224f7d7285c4b59921b0d6c9c323924 P a234e5e9c8f74f3bb92c0b83e703587e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a234e5e9c8f74f3bb92c0b83e703587e, State: Initialized, Role: FOLLOWER
08:04:09.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.890323 25214 raft_consensus.cc:359] T 2224f7d7285c4b59921b0d6c9c323924 P b1ebf50f84fd43329637c4bbdd91ce31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" member_type: VOTER last_known_addr { host: "127.23.194.65" port: 37577 } } peers { permanent_uuid: "7eb69088ee284421ba9cfbd602fcb697" member_type: VOTER last_known_addr { host: "127.23.194.66" port: 39487 } } peers { permanent_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" member_type: VOTER last_known_addr { host: "127.23.194.67" port: 42497 } }
08:04:09.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.882310 25211 consensus_queue.cc:260] T 2224f7d7285c4b59921b0d6c9c323924 P a234e5e9c8f74f3bb92c0b83e703587e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" member_type: VOTER last_known_addr { host: "127.23.194.65" port: 37577 } } peers { permanent_uuid: "7eb69088ee284421ba9cfbd602fcb697" member_type: VOTER last_known_addr { host: "127.23.194.66" port: 39487 } } peers { permanent_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" member_type: VOTER last_known_addr { host: "127.23.194.67" port: 42497 } }
08:04:09.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.891304 25214 raft_consensus.cc:385] T 2224f7d7285c4b59921b0d6c9c323924 P b1ebf50f84fd43329637c4bbdd91ce31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:09.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.891594 25214 raft_consensus.cc:740] T 2224f7d7285c4b59921b0d6c9c323924 P b1ebf50f84fd43329637c4bbdd91ce31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1ebf50f84fd43329637c4bbdd91ce31, State: Initialized, Role: FOLLOWER
08:04:09.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.894949 25214 consensus_queue.cc:260] T 2224f7d7285c4b59921b0d6c9c323924 P b1ebf50f84fd43329637c4bbdd91ce31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" member_type: VOTER last_known_addr { host: "127.23.194.65" port: 37577 } } peers { permanent_uuid: "7eb69088ee284421ba9cfbd602fcb697" member_type: VOTER last_known_addr { host: "127.23.194.66" port: 39487 } } peers { permanent_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" member_type: VOTER last_known_addr { host: "127.23.194.67" port: 42497 } }
08:04:09.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.905927 25214 ts_tablet_manager.cc:1434] T 2224f7d7285c4b59921b0d6c9c323924 P b1ebf50f84fd43329637c4bbdd91ce31: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.001s
08:04:09.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:09.930361 25211 ts_tablet_manager.cc:1434] T 2224f7d7285c4b59921b0d6c9c323924 P a234e5e9c8f74f3bb92c0b83e703587e: Time spent starting tablet: real 0.079s	user 0.007s	sys 0.004s
08:04:10.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:10.003202 24731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2224f7d7285c4b59921b0d6c9c323924" candidate_uuid: "7eb69088ee284421ba9cfbd602fcb697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" is_pre_election: true
08:04:10.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:10.003907 24731 raft_consensus.cc:2468] T 2224f7d7285c4b59921b0d6c9c323924 P a234e5e9c8f74f3bb92c0b83e703587e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb69088ee284421ba9cfbd602fcb697 in term 0.
08:04:10.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:10.005281 24807 leader_election.cc:304] T 2224f7d7285c4b59921b0d6c9c323924 P 7eb69088ee284421ba9cfbd602fcb697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb69088ee284421ba9cfbd602fcb697, a234e5e9c8f74f3bb92c0b83e703587e; no voters: 
08:04:10.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:10.006184 25213 raft_consensus.cc:2804] T 2224f7d7285c4b59921b0d6c9c323924 P 7eb69088ee284421ba9cfbd602fcb697 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:04:10.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:10.006518 25213 raft_consensus.cc:493] T 2224f7d7285c4b59921b0d6c9c323924 P 7eb69088ee284421ba9cfbd602fcb697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:04:10.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:10.006870 25213 raft_consensus.cc:3060] T 2224f7d7285c4b59921b0d6c9c323924 P 7eb69088ee284421ba9cfbd602fcb697 [term 0 FOLLOWER]: Advancing to term 1
08:04:10.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:10.006773 25020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2224f7d7285c4b59921b0d6c9c323924" candidate_uuid: "7eb69088ee284421ba9cfbd602fcb697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" is_pre_election: true
08:04:10.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:10.007403 25020 raft_consensus.cc:2468] T 2224f7d7285c4b59921b0d6c9c323924 P b1ebf50f84fd43329637c4bbdd91ce31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb69088ee284421ba9cfbd602fcb697 in term 0.
08:04:10.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:10.015075 25213 raft_consensus.cc:515] T 2224f7d7285c4b59921b0d6c9c323924 P 7eb69088ee284421ba9cfbd602fcb697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" member_type: VOTER last_known_addr { host: "127.23.194.65" port: 37577 } } peers { permanent_uuid: "7eb69088ee284421ba9cfbd602fcb697" member_type: VOTER last_known_addr { host: "127.23.194.66" port: 39487 } } peers { permanent_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" member_type: VOTER last_known_addr { host: "127.23.194.67" port: 42497 } }
08:04:10.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:10.018136 24731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2224f7d7285c4b59921b0d6c9c323924" candidate_uuid: "7eb69088ee284421ba9cfbd602fcb697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a234e5e9c8f74f3bb92c0b83e703587e"
08:04:10.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:10.018682 24731 raft_consensus.cc:3060] T 2224f7d7285c4b59921b0d6c9c323924 P a234e5e9c8f74f3bb92c0b83e703587e [term 0 FOLLOWER]: Advancing to term 1
08:04:10.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:10.026325 24731 raft_consensus.cc:2468] T 2224f7d7285c4b59921b0d6c9c323924 P a234e5e9c8f74f3bb92c0b83e703587e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb69088ee284421ba9cfbd602fcb697 in term 1.
08:04:10.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:10.028013 24807 leader_election.cc:304] T 2224f7d7285c4b59921b0d6c9c323924 P 7eb69088ee284421ba9cfbd602fcb697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb69088ee284421ba9cfbd602fcb697, a234e5e9c8f74f3bb92c0b83e703587e; no voters: 
08:04:10.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:10.035889 25213 leader_election.cc:290] T 2224f7d7285c4b59921b0d6c9c323924 P 7eb69088ee284421ba9cfbd602fcb697 [CANDIDATE]: Term 1 election: Requested vote from peers a234e5e9c8f74f3bb92c0b83e703587e (127.23.194.65:37577), b1ebf50f84fd43329637c4bbdd91ce31 (127.23.194.67:42497)
08:04:10.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:10.036286 25020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2224f7d7285c4b59921b0d6c9c323924" candidate_uuid: "7eb69088ee284421ba9cfbd602fcb697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1ebf50f84fd43329637c4bbdd91ce31"
08:04:10.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:10.036947 25020 raft_consensus.cc:3060] T 2224f7d7285c4b59921b0d6c9c323924 P b1ebf50f84fd43329637c4bbdd91ce31 [term 0 FOLLOWER]: Advancing to term 1
08:04:10.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:10.037835 25213 raft_consensus.cc:2804] T 2224f7d7285c4b59921b0d6c9c323924 P 7eb69088ee284421ba9cfbd602fcb697 [term 1 FOLLOWER]: Leader election won for term 1
08:04:10.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:10.038837 25213 raft_consensus.cc:697] T 2224f7d7285c4b59921b0d6c9c323924 P 7eb69088ee284421ba9cfbd602fcb697 [term 1 LEADER]: Becoming Leader. State: Replica: 7eb69088ee284421ba9cfbd602fcb697, State: Running, Role: LEADER
08:04:10.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:10.040560 25213 consensus_queue.cc:237] T 2224f7d7285c4b59921b0d6c9c323924 P 7eb69088ee284421ba9cfbd602fcb697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" member_type: VOTER last_known_addr { host: "127.23.194.65" port: 37577 } } peers { permanent_uuid: "7eb69088ee284421ba9cfbd602fcb697" member_type: VOTER last_known_addr { host: "127.23.194.66" port: 39487 } } peers { permanent_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" member_type: VOTER last_known_addr { host: "127.23.194.67" port: 42497 } }
08:04:10.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:10.045704 25020 raft_consensus.cc:2468] T 2224f7d7285c4b59921b0d6c9c323924 P b1ebf50f84fd43329637c4bbdd91ce31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb69088ee284421ba9cfbd602fcb697 in term 1.
08:04:10.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:10.074119 24450 catalog_manager.cc:5696] T 2224f7d7285c4b59921b0d6c9c323924 P 7eb69088ee284421ba9cfbd602fcb697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7eb69088ee284421ba9cfbd602fcb697 (127.23.194.66). New cstate: current_term: 1 leader_uuid: "7eb69088ee284421ba9cfbd602fcb697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" member_type: VOTER last_known_addr { host: "127.23.194.65" port: 37577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb69088ee284421ba9cfbd602fcb697" member_type: VOTER last_known_addr { host: "127.23.194.66" port: 39487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" member_type: VOTER last_known_addr { host: "127.23.194.67" port: 42497 } health_report { overall_health: UNKNOWN } } }
08:04:10.303 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:04:10.306 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
08:04:10.306 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
08:04:10.306 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:04:10.306 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:04:10.310 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:04:10.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:10.530403 25213 consensus_queue.cc:1048] T 2224f7d7285c4b59921b0d6c9c323924 P 7eb69088ee284421ba9cfbd602fcb697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1ebf50f84fd43329637c4bbdd91ce31" member_type: VOTER last_known_addr { host: "127.23.194.67" port: 42497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:04:10.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:10.584821 25213 consensus_queue.cc:1048] T 2224f7d7285c4b59921b0d6c9c323924 P 7eb69088ee284421ba9cfbd602fcb697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a234e5e9c8f74f3bb92c0b83e703587e" member_type: VOTER last_known_addr { host: "127.23.194.65" port: 37577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
08:04:10.774 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
08:04:10.774 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
08:04:10.774 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
08:04:10.775 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
08:04:10.775 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
08:04:10.776 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
08:04:10.780 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
08:04:11.108 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
08:04:11.202 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
08:04:11.202 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
08:04:11.202 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
08:04:11.227 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
08:04:12.027 [INFO - flink-pekko.actor.default-dispatcher-5] (Slf4jLogger.scala:117) Slf4jLogger started
08:04:12.187 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
08:04:12.209 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
08:04:12.229 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
08:04:12.243 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
08:04:12.264 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
08:04:12.380 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
08:04:12.387 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
08:04:12.387 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
08:04:12.410 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
08:04:12.411 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
08:04:12.413 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
08:04:12.413 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
08:04:12.414 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
08:04:12.416 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
08:04:12.417 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
08:04:12.417 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
08:04:12.419 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
08:04:12.419 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
08:04:12.419 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
08:04:12.419 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
08:04:12.419 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
08:04:12.421 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
08:04:12.421 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
08:04:12.421 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
08:04:12.422 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
08:04:12.422 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
08:04:12.423 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
08:04:12.423 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
08:04:12.423 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
08:04:12.436 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_6bb3c347f4335b1862c025bb91ec8391/blobStorage
08:04:12.441 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:33697 - max concurrent requests: 50 - max backlog: 1000
08:04:12.450 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_6bb3c347f4335b1862c025bb91ec8391/blobStorage
08:04:12.454 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_6bb3c347f4335b1862c025bb91ec8391/blobStorage
08:04:12.456 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
08:04:12.468 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: 3f60cd48-2db8-44da-a97b-80d36cd69725
08:04:12.502 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 37 GB (77.08% usable)
08:04:12.509 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-555eb079-9fe3-4fb6-80d5-8df565beb7d6
08:04:12.524 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-d2bde091-7409-462e-8716-abd2bb994dd9
08:04:12.694 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
08:04:12.713 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
08:04:12.714 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
08:04:12.717 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
08:04:12.760 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
08:04:12.774 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_0 .
08:04:12.826 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultJobLeaderService.java:127) Start job leader service.
08:04:12.827 [INFO - flink-pekko.actor.default-dispatcher-5] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-53d89338-9071-46f4-b2c2-d3d3cea0881b
08:04:12.894 [INFO - main] (RestServerEndpoint.java:567) Upload directory /tmp/flink-web-upload does not exist. 
08:04:12.894 [INFO - main] (RestServerEndpoint.java:592) Created directory /tmp/flink-web-upload for file uploads.
08:04:12.898 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
08:04:12.902 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
08:04:13.246 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
08:04:13.246 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
08:04:13.431 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:36549
08:04:13.431 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
08:04:13.436 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:36549 was granted leadership with leaderSessionID=829e2272-4d99-4962-811d-7d56327facfe
08:04:13.436 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:36549 , session=829e2272-4d99-4962-811d-7d56327facfe
08:04:13.451 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
08:04:13.452 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
08:04:13.452 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
08:04:13.454 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id 43a1bf71-bb4d-4d1d-9827-c91065c767bf. Creating new DispatcherLeaderProcess.
08:04:13.460 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
08:04:13.494 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
08:04:13.497 [INFO - pool-11-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id 6e4d8c8a-f5c6-4cb1-aae1-63eb22c844e9.
08:04:13.500 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
08:04:13.500 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
08:04:13.532 [INFO - mini-cluster-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_1 .
08:04:13.546 [INFO - pool-11-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_2 .
08:04:13.559 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:253) Starting the resource manager.
08:04:13.565 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:212) Starting the slot manager.
08:04:13.567 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:308) Starting tokens update task
08:04:13.568 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
08:04:13.568 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
08:04:13.570 [INFO - mini-cluster-io-thread-3] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_2 , session=6e4d8c8a-f5c6-4cb1-aae1-63eb22c844e9
08:04:13.573 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_2(aae163eb22c844e96e4d8c8af5c64cb1).
08:04:13.587 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_1 , session=43a1bf71-bb4d-4d1d-9827-c91065c767bf
08:04:13.656 [INFO - flink-pekko.actor.default-dispatcher-9] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
08:04:13.674 [INFO - flink-pekko.actor.default-dispatcher-7] (ResourceManager.java:1080) Registering TaskManager with ResourceID 3f60cd48-2db8-44da-a97b-80d36cd69725 (pekko://flink/user/rpc/taskmanager_0) at ResourceManager
08:04:13.690 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_2 under registration id 7039be58310416ec48db26eea073f9d0.
08:04:13.695 [INFO - flink-pekko.actor.default-dispatcher-5] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (b42812d69c586178cf7556c3c92998f3).
08:04:13.698 [INFO - flink-pekko.actor.default-dispatcher-5] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (b42812d69c586178cf7556c3c92998f3).
08:04:13.702 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:344) Registering task executor 3f60cd48-2db8-44da-a97b-80d36cd69725 under 7039be58310416ec48db26eea073f9d0 at the slot manager.
08:04:13.728 [INFO - flink-pekko.actor.default-dispatcher-5] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-b42812d69c586178cf7556c3c92998f3'.
08:04:13.732 [INFO - mini-cluster-io-thread-1] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job b42812d69c586178cf7556c3c92998f3 was granted leadership with leader id f07098e8-faf1-41cf-a745-ff6b3b61d013. Creating new JobMasterServiceProcess.
08:04:13.749 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_3 .
08:04:13.757 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (b42812d69c586178cf7556c3c92998f3).
08:04:13.784 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (b42812d69c586178cf7556c3c92998f3).
08:04:13.829 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph 76e1c5722212c7e382eed42461b63c38 for job b42812d69c586178cf7556c3c92998f3.
08:04:13.858 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (b42812d69c586178cf7556c3c92998f3).
08:04:13.859 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
08:04:13.906 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 3 ms, total 4 pipelined regions currently.
08:04:13.916 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4b06bffb
08:04:13.916 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:04:13.918 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit1738461414297871817/checkpoints")
08:04:13.962 [INFO - jobmanager-io-thread-1] (FileSystem.java:1139) Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available.
08:04:14.001 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
08:04:14.012 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@74be965c for Flink Streaming Job (b42812d69c586178cf7556c3c92998f3).
08:04:14.026 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_3 , session=f07098e8-faf1-41cf-a745-ff6b3b61d013
08:04:14.031 [INFO - flink-pekko.actor.default-dispatcher-5] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (b42812d69c586178cf7556c3c92998f3) under job master id a745ff6b3b61d013f07098e8faf141cf.
08:04:14.035 [INFO - flink-pekko.actor.default-dispatcher-5] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
08:04:14.041 [DEBUG - flink-pekko.actor.default-dispatcher-5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:04:14.043 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
08:04:14.044 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (b42812d69c586178cf7556c3c92998f3) switched from state CREATED to RUNNING.
08:04:14.054 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
08:04:14.055 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:14.058 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:14.061 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.23.12.252:42637(127.23.12.252:42637)] Successfully connected to peer
08:04:14.063 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:14.065 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.23.12.254:42055(127.23.12.254:42055)] Successfully connected to peer
08:04:14.070 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.12.254
08:04:14.078 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.12.252
08:04:14.084 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
08:04:14.086 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
08:04:14.087 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
08:04:14.088 [INFO - flink-pekko.actor.default-dispatcher-5] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_2(aae163eb22c844e96e4d8c8af5c64cb1)
08:04:14.088 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.23.12.253:45283(127.23.12.253:45283)] Successfully connected to peer
08:04:14.091 [INFO - flink-pekko.actor.default-dispatcher-7] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
08:04:14.093 [INFO - flink-pekko.actor.default-dispatcher-9] (ResourceManager.java:390) Registering job manager a745ff6b3b61d013f07098e8faf141cf@pekko://flink/user/rpc/jobmanager_3 for job b42812d69c586178cf7556c3c92998f3.
08:04:14.101 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:14.102 [INFO - flink-pekko.actor.default-dispatcher-7] (ResourceManager.java:1015) Registered job manager a745ff6b3b61d013f07098e8faf141cf@pekko://flink/user/rpc/jobmanager_3 for job b42812d69c586178cf7556c3c92998f3.
08:04:14.106 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x2f8e664c, L:/127.0.0.1:43566 - R:/127.23.12.254:42055] using SASL/PLAIN
08:04:14.115 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.12.253
08:04:14.117 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:14.117 [INFO - flink-pekko.actor.default-dispatcher-9] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: aae163eb22c844e96e4d8c8af5c64cb1.
08:04:14.120 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:04:14.120 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x3286cc39, L:/127.0.0.1:49324 - R:/127.23.12.252:42637] using SASL/PLAIN
08:04:14.126 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:04:14.126 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=72), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [60ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: OK, [71ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: OK, deferred=null) after lookup
08:04:14.128 [DEBUG - main] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:14.130 [DEBUG - main] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:14.131 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table e785290ee4514812bbf41055a4694542
08:04:14.133 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.23.194.126:38579(127.23.194.126:38579)] Successfully connected to peer
08:04:14.135 [DEBUG - main] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:14.136 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:14.138 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.23.194.125:38689(127.23.194.125:38689)] Successfully connected to peer
08:04:14.143 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 9fd0331c3da74721a6bf81effaa2ca6d for table 'replication_test_table' with partition [0x80000000, 0x80000032)
08:04:14.143 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 08fb1cfeee8e45528078bdd8935cfb8f for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
08:04:14.143 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=9fd0331c3da74721a6bf81effaa2ca6d@[28aa3d1914814f939e6cedae64740867(127.23.12.194:44439),aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809),e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=08fb1cfeee8e45528078bdd8935cfb8f@[28aa3d1914814f939e6cedae64740867(127.23.12.194:44439),aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809),e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:04:14.146 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x801fb6c6, L:/127.0.0.1:47902 - R:/127.23.12.253:45283] using SASL/PLAIN
08:04:14.151 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.23.194.124:38943(127.23.194.124:38943)] Successfully connected to peer
08:04:14.152 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.194.126
08:04:14.156 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.194.125
08:04:14.162 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.194.124
08:04:14.164 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:14.171 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x117c43a7, L:/127.0.0.1:55374 - R:/127.23.194.126:38579] using SASL/PLAIN
08:04:14.181 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:14.192 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job b42812d69c586178cf7556c3c92998f3
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager 3f60cd48-2db8-44da-a97b-80d36cd69725
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
08:04:14.195 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xd5fec701, L:/127.0.0.1:38268 - R:/127.23.194.125:38689] using SASL/PLAIN
08:04:14.200 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:04:14.201 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=84), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [48ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: OK, [73ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: OK, deferred=null) after lookup
08:04:14.203 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:14.208 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table e8f6cd1cdab0401da8f16766996e833e
08:04:14.208 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 391af734dfdfeaed0c68916087a69729 from 3f60cd48-2db8-44da-a97b-80d36cd69725 for job b42812d69c586178cf7556c3c92998f3 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:04:14.210 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xd5e0c2ea, L:/127.0.0.1:47812 - R:/127.23.194.124:38943] using SASL/PLAIN
08:04:14.214 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1149) Receive slot request 391af734dfdfeaed0c68916087a69729 for job b42812d69c586178cf7556c3c92998f3 from resource manager with leader id aae163eb22c844e96e4d8c8af5c64cb1.
08:04:14.215 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot f685fed6d8c7bf82d861c023bdea4512 from 3f60cd48-2db8-44da-a97b-80d36cd69725 for job b42812d69c586178cf7556c3c92998f3 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:04:14.215 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:321) Allocated slot for 391af734dfdfeaed0c68916087a69729 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:04:14.222 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 4c78869737ef27e21dadfe7d1a23010d from 3f60cd48-2db8-44da-a97b-80d36cd69725 for job b42812d69c586178cf7556c3c92998f3 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:04:14.223 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 2f9a5ebd231a465571d2109e36591407 from 3f60cd48-2db8-44da-a97b-80d36cd69725 for job b42812d69c586178cf7556c3c92998f3 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:04:14.226 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultJobLeaderService.java:192) Add job b42812d69c586178cf7556c3c92998f3 for job leader monitoring.
08:04:14.230 [INFO - mini-cluster-io-thread-1] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_3 with leader id f07098e8-faf1-41cf-a745-ff6b3b61d013.
08:04:14.236 [INFO - flink-pekko.actor.default-dispatcher-5] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
08:04:14.237 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1149) Receive slot request f685fed6d8c7bf82d861c023bdea4512 for job b42812d69c586178cf7556c3c92998f3 from resource manager with leader id aae163eb22c844e96e4d8c8af5c64cb1.
08:04:14.237 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:321) Allocated slot for f685fed6d8c7bf82d861c023bdea4512 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:04:14.238 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1149) Receive slot request 4c78869737ef27e21dadfe7d1a23010d for job b42812d69c586178cf7556c3c92998f3 from resource manager with leader id aae163eb22c844e96e4d8c8af5c64cb1.
08:04:14.238 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:321) Allocated slot for 4c78869737ef27e21dadfe7d1a23010d with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:04:14.238 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1149) Receive slot request 2f9a5ebd231a465571d2109e36591407 for job b42812d69c586178cf7556c3c92998f3 from resource manager with leader id aae163eb22c844e96e4d8c8af5c64cb1.
08:04:14.238 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:321) Allocated slot for 2f9a5ebd231a465571d2109e36591407 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:04:14.240 [DEBUG - main] (AsyncKuduClient.java:2538) Learned about tablet fedc9af6dceb44d58a0849858639a7b9 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
08:04:14.240 [DEBUG - main] (AsyncKuduClient.java:2538) Learned about tablet 2224f7d7285c4b59921b0d6c9c323924 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
08:04:14.241 [DEBUG - main] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=fedc9af6dceb44d58a0849858639a7b9@[7eb69088ee284421ba9cfbd602fcb697(127.23.194.66:39487),a234e5e9c8f74f3bb92c0b83e703587e(127.23.194.65:37577)[L],b1ebf50f84fd43329637c4bbdd91ce31(127.23.194.67:42497)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=2224f7d7285c4b59921b0d6c9c323924@[7eb69088ee284421ba9cfbd602fcb697(127.23.194.66:39487)[L],a234e5e9c8f74f3bb92c0b83e703587e(127.23.194.65:37577),b1ebf50f84fd43329637c4bbdd91ce31(127.23.194.67:42497)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:04:14.243 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_3 for job b42812d69c586178cf7556c3c92998f3.
08:04:14.244 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1783) Establish JobManager connection for job b42812d69c586178cf7556c3c92998f3.
08:04:14.247 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1633) Offer reserved slots to the leader of job b42812d69c586178cf7556c3c92998f3.
08:04:14.248 [DEBUG - main] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=14), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.194.125:38689, [12ms] Sub RPC GetTableLocations: received response from server master-127.23.194.125:38689: OK, deferred=null)) after lookup
08:04:14.259 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
08:04:14.260 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1) with allocation id 2f9a5ebd231a465571d2109e36591407
08:04:14.261 [DEBUG - main] (Connection.java:748) [peer a234e5e9c8f74f3bb92c0b83e703587e(127.23.194.65:37577)] connecting to peer
08:04:14.265 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 2f9a5ebd231a465571d2109e36591407.
08:04:14.266 [DEBUG - kudu-nio-3] (Connection.java:757) [peer a234e5e9c8f74f3bb92c0b83e703587e(127.23.194.65:37577)] Successfully connected to peer
08:04:14.292 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
08:04:14.293 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1) with allocation id 391af734dfdfeaed0c68916087a69729
08:04:14.303 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
08:04:14.303 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1) with allocation id f685fed6d8c7bf82d861c023bdea4512
08:04:14.306 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
08:04:14.306 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1) with allocation id 4c78869737ef27e21dadfe7d1a23010d
08:04:14.306 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job b42812d69c586178cf7556c3c92998f3.
08:04:14.310 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:14.315 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x099e14c4, L:/127.0.0.1:38280 - R:/127.23.194.65:37577] using TOKEN/null
08:04:14.329 [INFO - flink-pekko.actor.default-dispatcher-9] (StateChangelogStorageLoader.java:84) StateChangelogStorageLoader initialized with shortcut names {memory,filesystem}.
08:04:14.329 [INFO - flink-pekko.actor.default-dispatcher-9] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
08:04:14.349 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:14.350 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:14.351 [DEBUG - main] (Connection.java:748) [peer 7eb69088ee284421ba9cfbd602fcb697(127.23.194.66:39487)] connecting to peer
08:04:14.357 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 7eb69088ee284421ba9cfbd602fcb697(127.23.194.66:39487)] Successfully connected to peer
08:04:14.364 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id b42812d69c586178cf7556c3c92998f3
08:04:14.378 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 2f9a5ebd231a465571d2109e36591407.
08:04:14.379 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
08:04:14.391 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:04:14.391 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 391af734dfdfeaed0c68916087a69729.
08:04:14.398 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
08:04:14.410 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id 391af734dfdfeaed0c68916087a69729.
08:04:14.416 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
08:04:14.416 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
08:04:14.419 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:14.430 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0xc957473e, L:/127.0.0.1:51534 - R:/127.23.194.66:39487] using TOKEN/null
08:04:14.432 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot f685fed6d8c7bf82d861c023bdea4512.
08:04:14.435 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id f685fed6d8c7bf82d861c023bdea4512.
08:04:14.440 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 4c78869737ef27e21dadfe7d1a23010d.
08:04:14.445 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id 4c78869737ef27e21dadfe7d1a23010d.
08:04:14.445 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
08:04:14.446 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
08:04:14.454 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@15c545e0
08:04:14.454 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6442bad5
08:04:14.454 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:04:14.454 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@ffc585f
08:04:14.455 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:04:14.455 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit1738461414297871817/checkpoints")
08:04:14.455 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit1738461414297871817/checkpoints")
08:04:14.454 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:04:14.472 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit1738461414297871817/checkpoints")
08:04:14.474 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
08:04:14.474 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
08:04:14.475 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
08:04:14.478 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:14.478 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 2f9a5ebd231a465571d2109e36591407.
08:04:14.478 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:14.479 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 391af734dfdfeaed0c68916087a69729.
08:04:14.479 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot f685fed6d8c7bf82d861c023bdea4512.
08:04:14.479 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 4c78869737ef27e21dadfe7d1a23010d.
08:04:14.479 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
08:04:14.480 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
08:04:14.480 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
08:04:14.482 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@328f4112
08:04:14.482 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:04:14.486 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
08:04:14.486 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
08:04:14.497 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit1738461414297871817/checkpoints")
08:04:14.498 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
08:04:14.499 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
08:04:14.537 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:14.538 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:14.545 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:14.545 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:14.604 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:14.604 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:14.612 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:14.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:14.612075 24914 debug-util.cc:398] Leaking SignalData structure 0x7b08000ca800 after lost signal to thread 24788
08:04:14.623 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:14.673 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@a982b6f
08:04:14.674 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@39e9167e
08:04:14.674 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@50d91a61
08:04:14.677 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@698c3386
08:04:14.681 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:14.682 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:14.693 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:14.694 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:14.753 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:14.754 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:14.763 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:14.763 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:14.779 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:04:14.788 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:04:14.789 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:04:14.790 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:14.807 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:14.814 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:14.816 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.23.194.126:38579(127.23.194.126:38579)] Successfully connected to peer
08:04:14.824 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:04:14.825 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:14.826 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:14.828 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:14.836 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:14.837 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:14.841 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.194.126
08:04:14.850 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:14.858 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:14.863 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.23.194.125:38689(127.23.194.125:38689)] Successfully connected to peer
08:04:14.868 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:14.875 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:14.879 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x8f2d1609, L:/127.0.0.1:55388 - R:/127.23.194.126:38579] using SASL/PLAIN
08:04:14.882 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:04:14.895 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:14.896 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:14.902 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.23.194.126:38579(127.23.194.126:38579)] Successfully connected to peer
08:04:14.913 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:14.914 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.23.194.125:38689(127.23.194.125:38689)] Successfully connected to peer
08:04:14.915 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:14.916 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:14.916 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:14.917 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.23.194.126:38579(127.23.194.126:38579)] Successfully connected to peer
08:04:14.920 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.194.126
08:04:14.927 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.194.126
08:04:14.929 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.194.125
08:04:14.930 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:14.932 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.23.194.126:38579(127.23.194.126:38579)] Successfully connected to peer
08:04:14.938 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.23.194.124:38943(127.23.194.124:38943)] Successfully connected to peer
08:04:14.958 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:14.961 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:14.963 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.23.194.125:38689(127.23.194.125:38689)] Successfully connected to peer
08:04:14.965 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:14.974 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:14.974 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:14.976 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.23.194.124:38943(127.23.194.124:38943)] Successfully connected to peer
08:04:14.979 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.23.194.124:38943(127.23.194.124:38943)] Successfully connected to peer
08:04:14.981 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:14.983 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:14.995 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.194.126
08:04:14.997 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.194.125
08:04:15.005 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.194.124
08:04:15.032 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xcd1cc37e, L:/127.0.0.1:38272 - R:/127.23.194.125:38689] using SASL/PLAIN
08:04:15.038 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:04:15.039 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=258), Traces: [0ms] refreshing cache from master, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [98ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: OK, [251ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: OK, deferred=null) after lookup
08:04:15.040 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.041 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:15.045 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table e8f6cd1cdab0401da8f16766996e833e
08:04:15.050 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.051 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:15.053 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.23.194.125:38689(127.23.194.125:38689)] Successfully connected to peer
08:04:15.055 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table e8f6cd1cdab0401da8f16766996e833e
08:04:15.056 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@63d2ab89
08:04:15.071 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.194.125
08:04:15.081 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.194.125
08:04:15.086 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.194.124
08:04:15.088 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.194.124
08:04:15.089 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.23.194.124:38943(127.23.194.124:38943)] Successfully connected to peer
08:04:15.095 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:15.096 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:15.102 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:15.104 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:15.113 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.194.124
08:04:15.125 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x9f09d451, L:/127.0.0.1:55426 - R:/127.23.194.126:38579] using SASL/PLAIN
08:04:15.137 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
08:04:15.138 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
08:04:15.147 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:15.153 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x76e9def3, L:/127.0.0.1:38284 - R:/127.23.194.125:38689] using SASL/PLAIN
08:04:15.160 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:04:15.161 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=367), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [332ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: OK, deferred=null) after lookup
08:04:15.165 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.165 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:15.178 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table e8f6cd1cdab0401da8f16766996e833e
08:04:15.178 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.178 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:15.154 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xe9d619fc, L:/127.0.0.1:47814 - R:/127.23.194.124:38943] using SASL/PLAIN
08:04:15.187 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table e8f6cd1cdab0401da8f16766996e833e
08:04:15.188 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3779f5c7
08:04:15.194 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
08:04:15.194 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
08:04:15.205 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:15.210 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x12037984, L:/127.0.0.1:55418 - R:/127.23.194.126:38579] using SASL/PLAIN
08:04:15.211 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
08:04:15.212 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='8ae857700cc4afea6cb037e1ad97776e2038f0ed1e4a5b2320aaf08943fa5c05'}]
08:04:15.214 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf4cdd0be, L:/127.0.0.1:55402 - R:/127.23.194.126:38579] using SASL/PLAIN
08:04:15.224 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:15.227 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
08:04:15.230 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:15.237 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x803e1a41, L:/127.0.0.1:47830 - R:/127.23.194.124:38943] using SASL/PLAIN
08:04:15.251 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:15.254 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.254 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:15.276 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:04:15.277 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:15.286 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x21b86c5a, L:/127.0.0.1:47840 - R:/127.23.194.124:38943] using SASL/PLAIN
08:04:15.292 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x8643859d, L:/127.0.0.1:38294 - R:/127.23.194.125:38689] using SASL/PLAIN
08:04:15.297 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x99973dac, L:/127.0.0.1:47850 - R:/127.23.194.124:38943] using SASL/PLAIN
08:04:15.298 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xd5e96508, L:/127.0.0.1:38300 - R:/127.23.194.125:38689] using SASL/PLAIN
08:04:15.300 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:04:15.300 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=510), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [357ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: OK, [485ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: OK, [493ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: OK, deferred=null) after lookup
08:04:15.303 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.304 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:15.305 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:04:15.305 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=480), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [384ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: OK, [399ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: OK, [455ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: OK, deferred=null) after lookup
08:04:15.307 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table e8f6cd1cdab0401da8f16766996e833e
08:04:15.310 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table e8f6cd1cdab0401da8f16766996e833e
08:04:15.314 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:04:15.316 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table e8f6cd1cdab0401da8f16766996e833e
08:04:15.316 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@95b8d2b
08:04:15.318 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
08:04:15.319 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
08:04:15.321 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table e8f6cd1cdab0401da8f16766996e833e
08:04:15.322 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@66c32eb0
08:04:15.324 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
08:04:15.324 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
08:04:15.326 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
08:04:15.327 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='997eaeda3df4dc31ad8326f0bbe0835be7f6e0cd37c58d0fee989f23784e5393'}]
08:04:15.328 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299993, tablet=08fb1cfeee8e45528078bdd8935cfb8f@[28aa3d1914814f939e6cedae64740867(127.23.12.194:44439),aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809),e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)[L]]}]
08:04:15.330 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:04:15.341 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
08:04:15.362 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.363 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:15.369 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
08:04:15.370 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.371 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:15.383 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:04:15.385 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299993, tablet=9fd0331c3da74721a6bf81effaa2ca6d@[28aa3d1914814f939e6cedae64740867(127.23.12.194:44439)[L],aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809),e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)]}]
08:04:15.398 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
08:04:15.407 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809)] connecting to peer
08:04:15.422 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)] connecting to peer
08:04:15.427 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
08:04:15.428 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
08:04:15.435 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.435 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:15.436 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091455380 for job b42812d69c586178cf7556c3c92998f3.
08:04:15.439 [DEBUG - kudu-nio-0] (Connection.java:757) [peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809)] Successfully connected to peer
08:04:15.450 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.450 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:15.468 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.12.195
08:04:15.495 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)] Successfully connected to peer
08:04:15.500 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:15.519 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.520 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:15.529 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x25db244f, L:/127.0.0.1:40184 - R:/127.23.12.195:32809] using SASL/PLAIN
08:04:15.534 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.534 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:15.554 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.12.193
08:04:15.596 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.596 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:15.606 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.606 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:15.629 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false, responseScanTimestamp = 7287158595801088001) for scanner KuduScanner(table=replication_test_table, tablet=08fb1cfeee8e45528078bdd8935cfb8f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.632 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [8ae857700cc4afea6cb037e1ad97776e2038f0ed1e4a5b2320aaf08943fa5c05]
08:04:15.636 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
08:04:15.660 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:15.680 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.680 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:15.696 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.696 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:15.702 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x6b6884b3, L:/127.0.0.1:36300 - R:/127.23.12.193:35651] using SASL/PLAIN
08:04:15.755 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.755 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:15.764 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.765 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:15.778 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job b42812d69c586178cf7556c3c92998f3 (2244 bytes, checkpointDuration=361 ms, finalizationTime=37 ms).
08:04:15.789 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false, responseScanTimestamp = 7287158595801088001) for scanner KuduScanner(table=replication_test_table, tablet=9fd0331c3da74721a6bf81effaa2ca6d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.790 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [997eaeda3df4dc31ad8326f0bbe0835be7f6e0cd37c58d0fee989f23784e5393]
08:04:15.790 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
08:04:15.792 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
08:04:15.824 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.825 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:15.845 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.846 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:15.853 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2224f7d7285c4b59921b0d6c9c323924 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
08:04:15.853 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=2224f7d7285c4b59921b0d6c9c323924@[7eb69088ee284421ba9cfbd602fcb697(127.23.194.66:39487)[L],a234e5e9c8f74f3bb92c0b83e703587e(127.23.194.65:37577),b1ebf50f84fd43329637c4bbdd91ce31(127.23.194.67:42497)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:04:15.861 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduClient.java:2538) Learned about tablet fedc9af6dceb44d58a0849858639a7b9 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
08:04:15.862 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduClient.java:2538) Learned about tablet 2224f7d7285c4b59921b0d6c9c323924 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
08:04:15.862 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=fedc9af6dceb44d58a0849858639a7b9@[7eb69088ee284421ba9cfbd602fcb697(127.23.194.66:39487),a234e5e9c8f74f3bb92c0b83e703587e(127.23.194.65:37577)[L],b1ebf50f84fd43329637c4bbdd91ce31(127.23.194.67:42497)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=2224f7d7285c4b59921b0d6c9c323924@[7eb69088ee284421ba9cfbd602fcb697(127.23.194.66:39487)[L],a234e5e9c8f74f3bb92c0b83e703587e(127.23.194.65:37577),b1ebf50f84fd43329637c4bbdd91ce31(127.23.194.67:42497)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:04:15.880 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [997eaeda3df4dc31ad8326f0bbe0835be7f6e0cd37c58d0fee989f23784e5393]
08:04:15.881 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091455880 for job b42812d69c586178cf7556c3c92998f3.
08:04:15.894 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=5, operationSize=325, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@56543522, flushNotification=Deferred@1889525056(state=PENDING, result=null, callback=<none>, errback=<none>)}
08:04:15.898 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 7eb69088ee284421ba9cfbd602fcb697(127.23.194.66:39487)] connecting to peer
08:04:15.904 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.904 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:15.911 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.911 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:15.913 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 997eaeda3df4dc31ad8326f0bbe0835be7f6e0cd37c58d0fee989f23784e5393 finished by subtask 0; deferring removal (restored in pending)
08:04:15.916 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
08:04:15.916 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
08:04:15.916 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=5, operationSize=315, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@2f4ec17d, flushNotification=Deferred@81671040(state=PENDING, result=null, callback=<none>, errback=<none>)}
08:04:15.917 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer a234e5e9c8f74f3bb92c0b83e703587e(127.23.194.65:37577)] connecting to peer
08:04:15.918 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)] disconnecting while in state READY
08:04:15.919 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:04:15.948 [DEBUG - kudu-nio-3] (Connection.java:757) [peer a234e5e9c8f74f3bb92c0b83e703587e(127.23.194.65:37577)] Successfully connected to peer
08:04:15.969 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.970 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:15.990 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 7eb69088ee284421ba9cfbd602fcb697(127.23.194.66:39487)] Successfully connected to peer
08:04:15.990 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:15.991 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:16.016 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)] handling channelInactive
08:04:16.016 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)] cleaning up while in state READY due to: connection closed
08:04:16.017 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:04:16.017 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
08:04:16.056 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:16.056 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:16.057 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:16.057 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:16.066 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:16.066 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:16.080 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x2935c093, L:/127.0.0.1:38292 - R:/127.23.194.65:37577] using TOKEN/null
08:04:16.101 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xd19d71b1, L:/127.0.0.1:51544 - R:/127.23.194.66:39487] using TOKEN/null
08:04:16.125 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:16.126 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:16.147 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:16.148 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:16.210 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:16.210 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:16.222 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:16.222 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:16.293 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:16.299 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:16.311 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:16.311 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:16.334 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [8ae857700cc4afea6cb037e1ad97776e2038f0ed1e4a5b2320aaf08943fa5c05]
08:04:16.336 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
08:04:16.336 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
08:04:16.336 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809)] disconnecting while in state READY
08:04:16.337 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:04:16.340 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 8ae857700cc4afea6cb037e1ad97776e2038f0ed1e4a5b2320aaf08943fa5c05 finished by subtask 3; deferring removal (restored in pending)
08:04:16.361 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job b42812d69c586178cf7556c3c92998f3 (2244 bytes, checkpointDuration=464 ms, finalizationTime=17 ms).
08:04:16.375 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
08:04:16.377 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 8ae857700cc4afea6cb037e1ad97776e2038f0ed1e4a5b2320aaf08943fa5c05 from pending
08:04:16.377 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:16.378 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:16.377 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 997eaeda3df4dc31ad8326f0bbe0835be7f6e0cd37c58d0fee989f23784e5393 from pending
08:04:16.380 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 2 complete: removed 2 finished splits from enumerator state
08:04:16.382 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091456381 for job b42812d69c586178cf7556c3c92998f3.
08:04:16.404 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:16.404 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:16.408 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job b42812d69c586178cf7556c3c92998f3 (964 bytes, checkpointDuration=25 ms, finalizationTime=2 ms).
08:04:16.410 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
08:04:16.410 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table e785290ee4514812bbf41055a4694542
08:04:16.425 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table e8f6cd1cdab0401da8f16766996e833e
08:04:16.431 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table e785290ee4514812bbf41055a4694542
08:04:16.437 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table e8f6cd1cdab0401da8f16766996e833e
08:04:16.439 [DEBUG - kudu-nio-0] (Connection.java:239) [peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809)] handling channelInactive
08:04:16.439 [DEBUG - kudu-nio-0] (Connection.java:709) [peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809)] cleaning up while in state READY due to: connection closed
08:04:16.440 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:04:16.440 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
08:04:16.443 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 9fd0331c3da74721a6bf81effaa2ca6d for table 'replication_test_table' with partition [0x80000000, 0x80000032)
08:04:16.444 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 08fb1cfeee8e45528078bdd8935cfb8f for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
08:04:16.444 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=9fd0331c3da74721a6bf81effaa2ca6d@[28aa3d1914814f939e6cedae64740867(127.23.12.194:44439),aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809),e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=08fb1cfeee8e45528078bdd8935cfb8f@[28aa3d1914814f939e6cedae64740867(127.23.12.194:44439),aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809),e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:04:16.454 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet fedc9af6dceb44d58a0849858639a7b9 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
08:04:16.454 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2224f7d7285c4b59921b0d6c9c323924 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
08:04:16.455 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=fedc9af6dceb44d58a0849858639a7b9@[7eb69088ee284421ba9cfbd602fcb697(127.23.194.66:39487),a234e5e9c8f74f3bb92c0b83e703587e(127.23.194.65:37577)[L],b1ebf50f84fd43329637c4bbdd91ce31(127.23.194.67:42497)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=2224f7d7285c4b59921b0d6c9c323924@[7eb69088ee284421ba9cfbd602fcb697(127.23.194.66:39487)[L],a234e5e9c8f74f3bb92c0b83e703587e(127.23.194.65:37577),b1ebf50f84fd43329637c4bbdd91ce31(127.23.194.67:42497)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:04:16.461 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table e785290ee4514812bbf41055a4694542
08:04:16.469 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table e8f6cd1cdab0401da8f16766996e833e
08:04:16.475 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 9fd0331c3da74721a6bf81effaa2ca6d for table 'replication_test_table' with partition [0x80000000, 0x80000032)
08:04:16.476 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 08fb1cfeee8e45528078bdd8935cfb8f for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
08:04:16.476 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=9fd0331c3da74721a6bf81effaa2ca6d@[28aa3d1914814f939e6cedae64740867(127.23.12.194:44439),aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809),e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=08fb1cfeee8e45528078bdd8935cfb8f@[28aa3d1914814f939e6cedae64740867(127.23.12.194:44439),aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809),e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:04:16.476 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=7), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.12.252:42637, [6ms] Sub RPC GetTableLocations: received response from server master-127.23.12.252:42637: OK, deferred=null)) after lookup
08:04:16.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:16.500480 23925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.12.195:32809, user_credentials={real_user=slave}} blocked reactor thread for 71501.7us
08:04:16.535 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9fd0331c3da74721a6bf81effaa2ca6d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:16.536 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9fd0331c3da74721a6bf81effaa2ca6d for partition [0x80000000, 0x80000032) with scanner id null
08:04:16.558 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=08fb1cfeee8e45528078bdd8935cfb8f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:16.559 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 08fb1cfeee8e45528078bdd8935cfb8f for partition [0x80000064, 0x800000C8) with scanner id null
08:04:16.564 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet fedc9af6dceb44d58a0849858639a7b9 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
08:04:16.564 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2224f7d7285c4b59921b0d6c9c323924 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
08:04:16.565 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=fedc9af6dceb44d58a0849858639a7b9@[7eb69088ee284421ba9cfbd602fcb697(127.23.194.66:39487),a234e5e9c8f74f3bb92c0b83e703587e(127.23.194.65:37577)[L],b1ebf50f84fd43329637c4bbdd91ce31(127.23.194.67:42497)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=2224f7d7285c4b59921b0d6c9c323924@[7eb69088ee284421ba9cfbd602fcb697(127.23.194.66:39487)[L],a234e5e9c8f74f3bb92c0b83e703587e(127.23.194.65:37577),b1ebf50f84fd43329637c4bbdd91ce31(127.23.194.67:42497)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:04:16.565 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=5), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.194.125:38689, [5ms] Sub RPC GetTableLocations: received response from server master-127.23.194.125:38689: OK, deferred=null)) after lookup
08:04:16.582 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:16.582 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:16.592 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:16.592 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:16.627 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9fd0331c3da74721a6bf81effaa2ca6d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:16.627 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9fd0331c3da74721a6bf81effaa2ca6d for partition [0x80000000, 0x80000032) with scanner id null
08:04:16.647 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=08fb1cfeee8e45528078bdd8935cfb8f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:16.647 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 08fb1cfeee8e45528078bdd8935cfb8f for partition [0x80000064, 0x800000C8) with scanner id null
08:04:16.660 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fedc9af6dceb44d58a0849858639a7b9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:16.660 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fedc9af6dceb44d58a0849858639a7b9 for partition [0x80000000, 0x80000032) with scanner id null
08:04:16.674 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2224f7d7285c4b59921b0d6c9c323924, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:16.674 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2224f7d7285c4b59921b0d6c9c323924 for partition [0x80000064, 0x800000C8) with scanner id null
08:04:16.675 [DEBUG - main] (Connection.java:575) [peer a234e5e9c8f74f3bb92c0b83e703587e(127.23.194.65:37577)] disconnecting while in state READY
08:04:16.676 [DEBUG - main] (Connection.java:575) [peer master-127.23.194.124:38943(127.23.194.124:38943)] disconnecting while in state READY
08:04:16.676 [DEBUG - main] (Connection.java:575) [peer master-127.23.194.125:38689(127.23.194.125:38689)] disconnecting while in state READY
08:04:16.676 [DEBUG - main] (Connection.java:575) [peer master-127.23.194.126:38579(127.23.194.126:38579)] disconnecting while in state READY
08:04:16.676 [DEBUG - main] (Connection.java:575) [peer 7eb69088ee284421ba9cfbd602fcb697(127.23.194.66:39487)] disconnecting while in state READY
08:04:16.677 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.23.194.126:38579(127.23.194.126:38579)] handling channelInactive
08:04:16.677 [DEBUG - kudu-nio-3] (Connection.java:239) [peer a234e5e9c8f74f3bb92c0b83e703587e(127.23.194.65:37577)] handling channelInactive
08:04:16.677 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state READY due to: connection closed
08:04:16.678 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.23.194.124:38943(127.23.194.124:38943)] handling channelInactive
08:04:16.678 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state READY due to: connection closed
08:04:16.677 [DEBUG - kudu-nio-3] (Connection.java:709) [peer a234e5e9c8f74f3bb92c0b83e703587e(127.23.194.65:37577)] cleaning up while in state READY due to: connection closed
08:04:16.679 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.23.194.125:38689(127.23.194.125:38689)] handling channelInactive
08:04:16.679 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state READY due to: connection closed
08:04:16.681 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:04:16.682 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
08:04:16.683 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-1
08:04:16.683 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-3
08:04:16.684 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:04:16.686 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 7eb69088ee284421ba9cfbd602fcb697(127.23.194.66:39487)] handling channelInactive
08:04:16.686 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 7eb69088ee284421ba9cfbd602fcb697(127.23.194.66:39487)] cleaning up while in state READY due to: connection closed
08:04:16.687 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-4
08:04:16.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:16.687654 24329 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 24619
08:04:16.797 [DEBUG - kudu-nio-3] (Connection.java:239) [peer a234e5e9c8f74f3bb92c0b83e703587e(127.23.194.65:37577)] handling channelInactive
08:04:16.797 [DEBUG - kudu-nio-3] (Connection.java:709) [peer a234e5e9c8f74f3bb92c0b83e703587e(127.23.194.65:37577)] cleaning up while in state READY due to: connection closed
08:04:16.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:16.809132 24329 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 24778
08:04:16.860 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 7eb69088ee284421ba9cfbd602fcb697(127.23.194.66:39487)] handling channelInactive
08:04:16.860 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 7eb69088ee284421ba9cfbd602fcb697(127.23.194.66:39487)] cleaning up while in state READY due to: connection closed
08:04:16.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:16.867470 24329 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 24928
08:04:16.885 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091456882 for job b42812d69c586178cf7556c3c92998f3.
08:04:16.910 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job b42812d69c586178cf7556c3c92998f3 (964 bytes, checkpointDuration=27 ms, finalizationTime=1 ms).
08:04:16.916 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
08:04:17.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:17.029645 24329 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 24342
08:04:17.068 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.23.194.126:38579(127.23.194.126:38579)] handling channelInactive
08:04:17.068 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state READY due to: connection closed
08:04:17.071 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.23.194.126:38579(127.23.194.126:38579)] handling channelInactive
08:04:17.071 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state READY due to: connection closed
08:04:17.072 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.23.194.126:38579(127.23.194.126:38579)] handling channelInactive
08:04:17.072 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.23.194.126:38579(127.23.194.126:38579)] handling channelInactive
08:04:17.073 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state READY due to: connection closed
08:04:17.073 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state READY due to: connection closed
08:04:17.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:17.075407 24329 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 24413
08:04:17.109 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.23.194.125:38689(127.23.194.125:38689)] handling channelInactive
08:04:17.109 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state READY due to: connection closed
08:04:17.110 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.23.194.125:38689(127.23.194.125:38689)] handling channelInactive
08:04:17.110 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state READY due to: connection closed
08:04:17.111 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.23.194.125:38689(127.23.194.125:38689)] handling channelInactive
08:04:17.111 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state READY due to: connection closed
08:04:17.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:17.113097 24329 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 24488
08:04:17.125 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.23.194.125:38689(127.23.194.125:38689)] handling channelInactive
08:04:17.126 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state READY due to: connection closed
08:04:17.158 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.23.194.124:38943(127.23.194.124:38943)] handling channelInactive
08:04:17.158 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state READY due to: connection closed
08:04:17.161 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.23.194.124:38943(127.23.194.124:38943)] handling channelInactive
08:04:17.162 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state READY due to: connection closed
08:04:17.162 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.23.194.124:38943(127.23.194.124:38943)] handling channelInactive
08:04:17.162 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state READY due to: connection closed
08:04:17.163 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.23.194.124:38943(127.23.194.124:38943)] handling channelInactive
08:04:17.163 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state READY due to: connection closed
08:04:17.382 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091457380 for job b42812d69c586178cf7556c3c92998f3.
08:04:17.432 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job b42812d69c586178cf7556c3c92998f3 (964 bytes, checkpointDuration=50 ms, finalizationTime=2 ms).
08:04:17.436 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
08:04:17.881 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091457880 for job b42812d69c586178cf7556c3c92998f3.
08:04:17.931 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job b42812d69c586178cf7556c3c92998f3 (964 bytes, checkpointDuration=49 ms, finalizationTime=1 ms).
08:04:17.932 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
08:04:18.060 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table e785290ee4514812bbf41055a4694542
08:04:18.066 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 9fd0331c3da74721a6bf81effaa2ca6d for table 'replication_test_table' with partition [0x80000000, 0x80000032)
08:04:18.069 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 08fb1cfeee8e45528078bdd8935cfb8f for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
08:04:18.075 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=9fd0331c3da74721a6bf81effaa2ca6d@[28aa3d1914814f939e6cedae64740867(127.23.12.194:44439),aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809),e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299998}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299998, tablet=08fb1cfeee8e45528078bdd8935cfb8f@[28aa3d1914814f939e6cedae64740867(127.23.12.194:44439),aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809),e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299994}]
08:04:18.080 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='ae96e8324dafa422db155a527c2264071faac63dafe7ef218f8943ad7da23bf3'}]
08:04:18.083 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='d2204757ac3f33be7a8979d7f9613a54bfd4c165b612fa8dcb66f007a71a6207'}]
08:04:18.091 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:04:18.100 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:04:18.118 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:04:18.120 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299992, tablet=9fd0331c3da74721a6bf81effaa2ca6d@[28aa3d1914814f939e6cedae64740867(127.23.12.194:44439)[L],aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809),e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)]}]
08:04:18.126 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:04:18.127 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299992, tablet=08fb1cfeee8e45528078bdd8935cfb8f@[28aa3d1914814f939e6cedae64740867(127.23.12.194:44439),aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809),e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)[L]]}]
08:04:18.137 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)] connecting to peer
08:04:18.143 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809)] connecting to peer
08:04:18.151 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)] Successfully connected to peer
08:04:18.155 [DEBUG - kudu-nio-0] (Connection.java:757) [peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809)] Successfully connected to peer
08:04:18.168 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.12.195
08:04:18.181 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:18.187 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.12.193
08:04:18.198 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xaef8a07a, L:/127.0.0.1:52296 - R:/127.23.12.195:32809] using SASL/PLAIN
08:04:18.241 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:18.279 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7c881116, L:/127.0.0.1:59174 - R:/127.23.12.193:35651] using SASL/PLAIN
08:04:18.290 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287158612164608001) for scanner KuduScanner(table=replication_test_table, tablet=9fd0331c3da74721a6bf81effaa2ca6d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:18.291 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [ae96e8324dafa422db155a527c2264071faac63dafe7ef218f8943ad7da23bf3]
08:04:18.291 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [ae96e8324dafa422db155a527c2264071faac63dafe7ef218f8943ad7da23bf3]
08:04:18.292 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
08:04:18.292 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
08:04:18.294 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split ae96e8324dafa422db155a527c2264071faac63dafe7ef218f8943ad7da23bf3 finished by subtask 1; deferring removal (restored in pending)
08:04:18.295 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)] disconnecting while in state READY
08:04:18.302 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:04:18.333 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)] handling channelInactive
08:04:18.333 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)] cleaning up while in state READY due to: connection closed
08:04:18.334 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
08:04:18.336 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
08:04:18.367 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287158612164608001) for scanner KuduScanner(table=replication_test_table, tablet=08fb1cfeee8e45528078bdd8935cfb8f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:04:18.367 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [d2204757ac3f33be7a8979d7f9613a54bfd4c165b612fa8dcb66f007a71a6207]
08:04:18.367 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [d2204757ac3f33be7a8979d7f9613a54bfd4c165b612fa8dcb66f007a71a6207]
08:04:18.368 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
08:04:18.368 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
08:04:18.369 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809)] disconnecting while in state READY
08:04:18.370 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split d2204757ac3f33be7a8979d7f9613a54bfd4c165b612fa8dcb66f007a71a6207 finished by subtask 2; deferring removal (restored in pending)
08:04:18.373 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:04:18.381 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091458380 for job b42812d69c586178cf7556c3c92998f3.
08:04:18.392 [DEBUG - kudu-nio-0] (Connection.java:239) [peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809)] handling channelInactive
08:04:18.392 [DEBUG - kudu-nio-0] (Connection.java:709) [peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809)] cleaning up while in state READY due to: connection closed
08:04:18.392 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:04:18.393 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
08:04:18.411 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=27 ms, finalizationTime=4 ms).
08:04:18.412 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
08:04:18.413 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 7 complete: removed split d2204757ac3f33be7a8979d7f9613a54bfd4c165b612fa8dcb66f007a71a6207 from pending
08:04:18.413 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 7 complete: removed split ae96e8324dafa422db155a527c2264071faac63dafe7ef218f8943ad7da23bf3 from pending
08:04:18.413 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 7 complete: removed 2 finished splits from enumerator state
08:04:18.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:04:18Z chronyd exiting
08:04:18.881 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091458880 for job b42812d69c586178cf7556c3c92998f3.
08:04:18.958 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job b42812d69c586178cf7556c3c92998f3 (964 bytes, checkpointDuration=75 ms, finalizationTime=3 ms).
08:04:18.965 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
08:04:19.381 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091459380 for job b42812d69c586178cf7556c3c92998f3.
08:04:19.401 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job b42812d69c586178cf7556c3c92998f3 (964 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
08:04:19.403 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
08:04:19.763 [ERROR - main] (RetryRule.java:206) org.apache.kudu.replication.TestReplicationTableInitializer.testNonCoveredRangePartitioning: failed attempt 1
org.apache.kudu.shaded.org.apache.commons.logging.LogConfigurationException: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl (Caused by java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1158)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory$2.run(LogFactory.java:960)
	at java.base/java.security.AccessController.doPrivileged(AccessController.java:318)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.newFactory(LogFactory.java:957)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getFactory(LogFactory.java:624)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getLog(LogFactory.java:655)
	at org.apache.kudu.shaded.org.apache.http.conn.ssl.DefaultHostnameVerifier.<init>(DefaultHostnameVerifier.java:82)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClientBuilder.build(HttpClientBuilder.java:970)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClients.createDefault(HttpClients.java:56)
	at org.apache.kudu.test.junit.ResultReporter.reportResult(ResultReporter.java:207)
	at org.apache.kudu.test.junit.ResultReporter.tryReportResult(ResultReporter.java:244)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.report(RetryRule.java:165)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:191)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
Caused by: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1020)
	... 42 more
08:04:19.868 [ERROR - main] (RetryRule.java:253) org.apache.kudu.replication.TestReplicationTableInitializer.testNonCoveredRangePartitioning: giving up after 1 attempts
08:04:19.869 [DEBUG - main] (Connection.java:575) [peer master-127.23.12.254:42055(127.23.12.254:42055)] disconnecting while in state READY
08:04:19.869 [DEBUG - main] (Connection.java:575) [peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)] disconnecting while in state READY
08:04:19.869 [DEBUG - main] (Connection.java:575) [peer master-127.23.12.253:45283(127.23.12.253:45283)] disconnecting while in state READY
08:04:19.869 [DEBUG - main] (Connection.java:575) [peer master-127.23.12.252:42637(127.23.12.252:42637)] disconnecting while in state READY
08:04:19.870 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.23.12.254:42055(127.23.12.254:42055)] handling channelInactive
08:04:19.870 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state READY due to: connection closed
08:04:19.871 [DEBUG - kudu-nio-3] (Connection.java:239) [peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)] handling channelInactive
08:04:19.871 [DEBUG - kudu-nio-3] (Connection.java:709) [peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)] cleaning up while in state READY due to: connection closed
08:04:19.870 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.23.12.253:45283(127.23.12.253:45283)] handling channelInactive
08:04:19.871 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state READY due to: connection closed
08:04:19.871 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:04:19.875 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.23.12.252:42637(127.23.12.252:42637)] handling channelInactive
08:04:19.875 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state READY due to: connection closed
08:04:19.875 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-0
08:04:19.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:19.876643 23603 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 23884
08:04:19.878 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
08:04:19.879 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-3
08:04:19.879 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
08:04:19.881 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091459880 for job b42812d69c586178cf7556c3c92998f3.
08:04:19.903 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job b42812d69c586178cf7556c3c92998f3 (964 bytes, checkpointDuration=22 ms, finalizationTime=0 ms).
08:04:19.905 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
08:04:19.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:19.942205 23603 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 24047
08:04:20.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:20.000239 23603 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 24188
08:04:20.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:20.041167 23603 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 23615
08:04:20.056 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table e785290ee4514812bbf41055a4694542
08:04:20.063 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 9fd0331c3da74721a6bf81effaa2ca6d for table 'replication_test_table' with partition [0x80000000, 0x80000032)
08:04:20.063 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 08fb1cfeee8e45528078bdd8935cfb8f for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
08:04:20.064 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=9fd0331c3da74721a6bf81effaa2ca6d@[28aa3d1914814f939e6cedae64740867(127.23.12.194:44439),aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809),e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=08fb1cfeee8e45528078bdd8935cfb8f@[28aa3d1914814f939e6cedae64740867(127.23.12.194:44439),aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809),e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:04:20.070 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='2d7b3b5f864a6091b196121adbdb1277dbc69b6339f1c1b9006d88567e276fc5'}]
08:04:20.073 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:04:20.073 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
08:04:20.075 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299996, tablet=08fb1cfeee8e45528078bdd8935cfb8f@[28aa3d1914814f939e6cedae64740867(127.23.12.194:44439),aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809),e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)[L]]}]
08:04:20.075 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='548d6a36251fba9a0da9eba6d4aad9f906b8ceb6daedf505eb6bd2b3a1234c8e'}]
08:04:20.079 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:04:20.081 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
08:04:20.082 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809)] connecting to peer
08:04:20.082 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299996, tablet=9fd0331c3da74721a6bf81effaa2ca6d@[28aa3d1914814f939e6cedae64740867(127.23.12.194:44439)[L],aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809),e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)]}]
08:04:20.085 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)] connecting to peer
08:04:20.089 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.23.12.254:42055(127.23.12.254:42055)] handling channelInactive
08:04:20.089 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state READY due to: connection closed
08:04:20.092 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809): Connection refused: /127.23.12.195:32809
08:04:20.093 [DEBUG - kudu-nio-0] (Connection.java:709) [peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809)] cleaning up while in state CONNECTING due to: Failed to connect to peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809): Connection refused: /127.23.12.195:32809
08:04:20.094 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809) for tablet 08fb1cfeee8e45528078bdd8935cfb8f: Failed to connect to peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809): Connection refused: /127.23.12.195:32809
08:04:20.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:20.095430 23603 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 23685
08:04:20.097 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651): Connection refused: /127.23.12.193:35651
08:04:20.097 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)] cleaning up while in state CONNECTING due to: Failed to connect to peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651): Connection refused: /127.23.12.193:35651
08:04:20.097 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651) for tablet 9fd0331c3da74721a6bf81effaa2ca6d: Failed to connect to peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651): Connection refused: /127.23.12.193:35651
08:04:20.103 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)] connecting to peer
08:04:20.106 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809)] connecting to peer
08:04:20.113 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651): Connection refused: /127.23.12.193:35651
08:04:20.113 [DEBUG - kudu-nio-1] (Connection.java:709) [peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)] cleaning up while in state CONNECTING due to: Failed to connect to peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651): Connection refused: /127.23.12.193:35651
08:04:20.113 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651) for tablet 08fb1cfeee8e45528078bdd8935cfb8f: Failed to connect to peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651): Connection refused: /127.23.12.193:35651
08:04:20.115 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809): Connection refused: /127.23.12.195:32809
08:04:20.115 [DEBUG - kudu-nio-1] (Connection.java:709) [peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809)] cleaning up while in state CONNECTING due to: Failed to connect to peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809): Connection refused: /127.23.12.195:32809
08:04:20.115 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809) for tablet 9fd0331c3da74721a6bf81effaa2ca6d: Failed to connect to peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809): Connection refused: /127.23.12.195:32809
08:04:20.123 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer 28aa3d1914814f939e6cedae64740867(127.23.12.194:44439)] connecting to peer
08:04:20.126 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer 28aa3d1914814f939e6cedae64740867(127.23.12.194:44439): Connection refused: /127.23.12.194:44439
08:04:20.126 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 28aa3d1914814f939e6cedae64740867(127.23.12.194:44439)] cleaning up while in state CONNECTING due to: Failed to connect to peer 28aa3d1914814f939e6cedae64740867(127.23.12.194:44439): Connection refused: /127.23.12.194:44439
08:04:20.126 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 28aa3d1914814f939e6cedae64740867(127.23.12.194:44439) for tablet 08fb1cfeee8e45528078bdd8935cfb8f: Failed to connect to peer 28aa3d1914814f939e6cedae64740867(127.23.12.194:44439): Connection refused: /127.23.12.194:44439
08:04:20.127 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer 28aa3d1914814f939e6cedae64740867(127.23.12.194:44439)] connecting to peer
08:04:20.131 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer 28aa3d1914814f939e6cedae64740867(127.23.12.194:44439): Connection refused: /127.23.12.194:44439
08:04:20.131 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 28aa3d1914814f939e6cedae64740867(127.23.12.194:44439)] cleaning up while in state CONNECTING due to: Failed to connect to peer 28aa3d1914814f939e6cedae64740867(127.23.12.194:44439): Connection refused: /127.23.12.194:44439
08:04:20.131 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 28aa3d1914814f939e6cedae64740867(127.23.12.194:44439) for tablet 9fd0331c3da74721a6bf81effaa2ca6d: Failed to connect to peer 28aa3d1914814f939e6cedae64740867(127.23.12.194:44439): Connection refused: /127.23.12.194:44439
08:04:20.134 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.23.12.253:45283(127.23.12.253:45283)] handling channelInactive
08:04:20.134 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state READY due to: connection closed
08:04:20.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:20.135386 23603 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 23760
08:04:20.143 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:20.144 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:20.145 [DEBUG - kudu-nio-3] (Connection.java:757) [peer master-127.23.12.252:42637(127.23.12.252:42637)] Successfully connected to peer
08:04:20.145 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:20.146 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:20.147 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.147 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.148 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.148 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.148 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.148 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.151 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:20.152 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:20.152 [DEBUG - kudu-nio-3] (Connection.java:757) [peer master-127.23.12.252:42637(127.23.12.252:42637)] Successfully connected to peer
08:04:20.153 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.153 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.153 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.154 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.154 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.154 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.177 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.23.12.252:42637(127.23.12.252:42637)] handling channelInactive
08:04:20.177 [ERROR - kudu-nio-3] (Connection.java:452) [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x7a650031, L:/127.0.0.1:35118 - R:/127.23.12.252:42637]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:04:20.178 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state READY due to: connection closed
08:04:20.178 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state NEGOTIATING due to: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x7a650031, L:/127.0.0.1:35118 - R:/127.23.12.252:42637]
08:04:20.179 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x7a650031, L:/127.0.0.1:35118 - R:/127.23.12.252:42637]
08:04:20.180 [ERROR - kudu-nio-3] (Connection.java:452) [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x526ec86c, L:/127.0.0.1:35106 - R:/127.23.12.252:42637]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:04:20.181 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state NEGOTIATING due to: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x526ec86c, L:/127.0.0.1:35106 - R:/127.23.12.252:42637]
08:04:20.181 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x526ec86c, L:/127.0.0.1:35106 - R:/127.23.12.252:42637]
08:04:20.182 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:20.183 [DEBUG - kudu-nio-3] (Connection.java:239) [peer master-127.23.12.252:42637(127.23.12.252:42637)] handling channelInactive
08:04:20.183 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:20.184 [DEBUG - kudu-nio-3] (Connection.java:239) [peer master-127.23.12.252:42637(127.23.12.252:42637)] handling channelInactive
08:04:20.185 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:20.188 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:20.189 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.189 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.189 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.190 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:20.191 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.191 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.191 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.191 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.191 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.191 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.191 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:20.203 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:20.204 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:20.205 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.205 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:20.205 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.205 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.205 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:20.206 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:20.206 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:20.206 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.206 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.207 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.207 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.207 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.207 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.208 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.208 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.208 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.208 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.208 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.208 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.208 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:20.210 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.210 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.210 [INFO - pool-32-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.210 [WARN - pool-32-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:20.222 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:20.223 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:20.223 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:20.223 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.224 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.224 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.224 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.224 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.224 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.225 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.225 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.225 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.225 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:20.226 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:20.226 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:20.227 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.227 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.227 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.228 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.229 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.229 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.227 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:20.231 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.231 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.231 [INFO - pool-32-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.231 [WARN - pool-32-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:20.243 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:20.244 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:20.244 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.244 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.244 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:20.245 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.246 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.246 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.246 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.247 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.247 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.247 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.247 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:20.248 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:20.251 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:20.251 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.252 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.252 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.252 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:20.252 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.252 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.252 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.252 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.252 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.253 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.253 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:20.263 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:20.264 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:20.264 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.264 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.264 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.265 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:20.265 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.265 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.265 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.266 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.266 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.266 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.267 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:20.283 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:20.284 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:20.284 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.284 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.285 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.285 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:20.285 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.286 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.286 [INFO - pool-30-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.286 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.286 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:20.286 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.287 [INFO - pool-32-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.287 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:20.287 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.287 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.288 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.288 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:20.289 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.289 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.289 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.289 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:20.290 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.290 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.290 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.290 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:20.345 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:20.346 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:20.347 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.347 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:20.347 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.347 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.347 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.347 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.348 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.348 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.348 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.348 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.349 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:20.363 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:20.364 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:20.364 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.364 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.364 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.365 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:20.365 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.365 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.366 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.366 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.366 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.367 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.367 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:20.382 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091460381 for job b42812d69c586178cf7556c3c92998f3.
08:04:20.385 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:20.386 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:20.387 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:20.388 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.388 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.388 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.389 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.389 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.389 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.390 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.390 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.390 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.390 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:20.401 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
08:04:20.402 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:20.403 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:20.403 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:20.404 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.404 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.404 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.404 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.404 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.404 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.405 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
08:04:20.405 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.405 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.406 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.406 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:20.546 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:20.547 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:20.548 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.548 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.548 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.549 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.549 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.549 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:20.549 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.550 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.550 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.551 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.551 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:20.562 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:20.563 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:20.563 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.563 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.563 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:20.563 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.564 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.564 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.564 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.564 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.564 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.564 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.564 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:20.602 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:20.603 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:20.603 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.603 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.604 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:20.604 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.604 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.604 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:20.604 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:20.605 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.605 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.605 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:20.605 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:20.881 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091460880 for job b42812d69c586178cf7556c3c92998f3.
08:04:20.895 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
08:04:20.897 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
08:04:21.065 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:21.066 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:21.066 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:21.067 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:21.067 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:21.067 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:21.067 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:21.067 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:21.067 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:21.067 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:21.067 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:21.067 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:21.068 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:21.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:04:21Z chronyd exiting
08:04:21.381 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091461380 for job b42812d69c586178cf7556c3c92998f3.
08:04:21.392 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:04:21.393 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
08:04:21.523 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:21.523 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:21.524 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:21.524 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:21.524 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:21.524 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:21.524 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:21.524 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:21.524 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:21.524 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:21.525 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:21.525 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:21.525 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:21.706 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:21.707 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:21.707 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:21.707 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:21.707 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:21.708 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:21.708 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:21.708 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:21.708 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:21.708 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:21.708 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:21.708 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:21.709 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:21.881 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091461880 for job b42812d69c586178cf7556c3c92998f3.
08:04:21.893 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
08:04:21.894 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
08:04:22.381 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091462380 for job b42812d69c586178cf7556c3c92998f3.
08:04:22.392 [ERROR - main] (RetryRule.java:206) org.apache.kudu.replication.TestReplicationTableInitializer.testNonCoveredRangePartitioning: failed attempt 1
org.apache.kudu.shaded.org.apache.commons.logging.LogConfigurationException: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl (Caused by java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1158)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory$2.run(LogFactory.java:960)
	at java.base/java.security.AccessController.doPrivileged(AccessController.java:318)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.newFactory(LogFactory.java:957)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getFactory(LogFactory.java:624)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getLog(LogFactory.java:655)
	at org.apache.kudu.shaded.org.apache.http.conn.ssl.DefaultHostnameVerifier.<init>(DefaultHostnameVerifier.java:82)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClientBuilder.build(HttpClientBuilder.java:970)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClients.createDefault(HttpClients.java:56)
	at org.apache.kudu.test.junit.ResultReporter.reportResult(ResultReporter.java:207)
	at org.apache.kudu.test.junit.ResultReporter.tryReportResult(ResultReporter.java:244)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.report(RetryRule.java:165)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:216)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
Caused by: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1020)
	... 42 more
08:04:22.397 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
08:04:22.399 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
08:04:22.411 [ERROR - main] (RetryRule.java:253) org.apache.kudu.replication.TestReplicationTableInitializer.testNonCoveredRangePartitioning: giving up after 1 attempts
E.08:04:22.413 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779091462413
08:04:22.413 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779091462413
08:04:22.416 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
08:04:22.419 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
08:04:22.420 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
08:04:22.420 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskk4_r_T/test-tmp
08:04:22.421 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
08:04:22.421 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskk4_r_T/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
08:04:22.424 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

08:04:22.582 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:22.583 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:22.583 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:22.583 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:22.583 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:22.583 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:22.584 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:22.584 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:22.584 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:22.584 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:22.585 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:22.585 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:22.585 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:22.776 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:04:22.776 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

08:04:22.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:22.779752 25499 mini_oidc.cc:150] Starting JWKS server
08:04:22.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:22.783017 25499 webserver.cc:533] Webserver started at http://127.0.0.1:44113/ using document root <none> and password file <none>
08:04:22.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:22.783432 25499 mini_oidc.cc:186] Starting OIDC Discovery server
08:04:22.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:22.785118 25499 webserver.cc:533] Webserver started at http://127.0.0.1:44481/ using document root <none> and password file <none>
08:04:22.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:04:22Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
08:04:22.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:04:22Z Disabled control of system clock
08:04:22.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:22.858142 25499 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:22.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:22.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-0/wal
08:04:22.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-0/data
08:04:22.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:04:22.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:04:22.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:04:22.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:22.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:22.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:22.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-0/logs
08:04:22.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-0/data/info.pb
08:04:22.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:22.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:04:22.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:04:22.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:04:22.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:04:22.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:22.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:22.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:22.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:04:22.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:04:22.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:04:22.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:04:22.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.230.254:40685
08:04:22.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.230.254
08:04:22.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:22.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.230.212:37577
08:04:22.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:22.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:22.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:04:22.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:04:22.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.24.230.254:40685,127.24.230.253:39511,127.24.230.252:40255
08:04:22.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:04:22.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44113/jwks.json with env {}
08:04:22.881 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091462880 for job b42812d69c586178cf7556c3c92998f3.
08:04:22.895 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
08:04:22.896 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
08:04:23.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:23.184615 25511 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:04:23.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:23.185206 25511 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:04:23.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:23.185671 25511 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:04:23.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:23.221165 25511 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:04:23.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:23.221475 25511 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:04:23.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:23.221693 25511 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:04:23.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:23.221987 25511 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:04:23.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:23.222201 25511 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:04:23.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:23.222350 25511 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:44113/jwks.json
08:04:23.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:23.261286 25511 master_runner.cc:387] Master server non-default flags:
08:04:23.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:23.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.230.212:37577
08:04:23.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:23.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:04:23.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-0/data
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-0/wal
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.24.230.254:40685,127.24.230.253:39511,127.24.230.252:40255
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.230.254:40685
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44113/jwks.json
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-0/data/info.pb
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.230.254
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-0/logs
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:04:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:04:23.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:23.262794 25511 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:04:23.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:23.264353 25511 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:04:23.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:23.275682 25517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:23.385 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091463380 for job b42812d69c586178cf7556c3c92998f3.
08:04:23.418 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=36 ms, finalizationTime=2 ms).
08:04:23.420 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
08:04:23.606 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:23.607 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:23.609 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:23.611 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:23.611 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:23.610 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:23.611 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:23.612 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:23.610 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:23.616 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:23.616 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:23.617 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:23.617 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:23.881 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091463880 for job b42812d69c586178cf7556c3c92998f3.
08:04:23.911 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=29 ms, finalizationTime=2 ms).
08:04:23.916 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
08:04:24.381 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091464380 for job b42812d69c586178cf7556c3c92998f3.
08:04:24.401 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
08:04:24.404 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
08:04:24.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:23.276191 25518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:24.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:24.605011 25511 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.329s	user 0.395s	sys 0.927s
08:04:24.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:24.605742 25511 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.330s	user 0.396s	sys 0.929s
08:04:24.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:24.607959 25519 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1329 milliseconds
08:04:24.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:24.608557 25520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:24.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.608657 25511 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:04:24.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.610407 25511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:04:24.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.613818 25511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:04:24.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.615361 25511 hybrid_clock.cc:648] HybridClock initialized: now 1779091464615314 us; error 37 us; skew 500 ppm
08:04:24.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.616621 25511 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:04:24.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.626446 25511 webserver.cc:533] Webserver started at http://127.24.230.254:36949/ using document root <none> and password file <none>
08:04:24.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.627825 25511 fs_manager.cc:362] Metadata directory not provided
08:04:24.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.628180 25511 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:04:24.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.628844 25511 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:04:24.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.636214 25511 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-0/data/instance:
08:04:24.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "391584ce11a44fc3bd553603290a22c2"
08:04:24.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:24 on dist-test-slave-1jss"
08:04:24.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.638006 25511 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-0/wal/instance:
08:04:24.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "391584ce11a44fc3bd553603290a22c2"
08:04:24.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:24 on dist-test-slave-1jss"
08:04:24.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.648728 25511 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.005s	sys 0.005s
08:04:24.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.655342 25527 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:04:24.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.656564 25511 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.003s
08:04:24.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.656873 25511 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-0/wal
08:04:24.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "391584ce11a44fc3bd553603290a22c2"
08:04:24.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:24 on dist-test-slave-1jss"
08:04:24.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.657166 25511 fs_report.cc:389] FS layout report
08:04:24.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:04:24.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-0/wal
08:04:24.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-0/wal
08:04:24.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-0/data/data
08:04:24.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:04:24.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:04:24.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:04:24.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:04:24.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:04:24.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:04:24.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:04:24.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:04:24.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:04:24.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:04:24.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:04:24.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.726426 25511 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:04:24.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.727988 25511 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:04:24.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.728494 25511 kserver.cc:163] Server-wide thread pool size limit: 3276
08:04:24.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.803618 25511 rpc_server.cc:307] RPC server started. Bound to: 127.24.230.254:40685
08:04:24.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.803709 25578 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.230.254:40685 every 8 connection(s)
08:04:24.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.806677 25511 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-0/data/info.pb
08:04:24.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.812692 25579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:24.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.817235 25499 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 25511
08:04:24.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.817836 25499 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-0/wal/instance
08:04:24.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.823292 25499 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:24.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:24.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-1/wal
08:04:24.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-1/data
08:04:24.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:04:24.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:04:24.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-1/logs
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-1/data/info.pb
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.230.253:39511
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.230.253
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.230.212:37577
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.24.230.254:40685,127.24.230.253:39511,127.24.230.252:40255
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:04:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44113/jwks.json with env {}
08:04:24.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.827327 25579 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.230.254" port: 40685 } has no permanent_uuid. Determining permanent_uuid...
08:04:24.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.855027 25579 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } has no permanent_uuid. Determining permanent_uuid...
08:04:24.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:24.857683 25531 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.230.253:39511: connect: Connection refused (error 111)
08:04:24.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:24.861898 25579 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.230.253:39511: Network error: Client connection negotiation failed: client connection to 127.24.230.253:39511: connect: Connection refused (error 111)
08:04:24.881 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091464880 for job b42812d69c586178cf7556c3c92998f3.
08:04:24.894 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
08:04:24.894 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
08:04:24.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.911388 25579 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } attempt: 1
08:04:24.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:24.915722 25579 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.230.253:39511: Network error: Client connection negotiation failed: client connection to 127.24.230.253:39511: connect: Connection refused (error 111)
08:04:24.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:24.984143 25579 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } attempt: 2
08:04:24.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:24.988381 25579 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.230.253:39511: Network error: Client connection negotiation failed: client connection to 127.24.230.253:39511: connect: Connection refused (error 111)
08:04:25.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:25.079793 25579 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } attempt: 3
08:04:25.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:25.083979 25579 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.230.253:39511: Network error: Client connection negotiation failed: client connection to 127.24.230.253:39511: connect: Connection refused (error 111)
08:04:25.102 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:25.103 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:25.103 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:25.103 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:25.104 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:25.104 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:25.104 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:25.104 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:25.104 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:25.104 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:25.104 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:25.104 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:25.105 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:25.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:25.156481 25581 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:04:25.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:25.157059 25581 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:04:25.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:25.157514 25581 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:04:25.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:25.192001 25581 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:04:25.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:25.192303 25581 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:04:25.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:25.192504 25581 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:04:25.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:25.192726 25581 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:04:25.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:25.192953 25581 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:04:25.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:25.193105 25581 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:44113/jwks.json
08:04:25.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:25.227386 25579 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } attempt: 4
08:04:25.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:25.231396 25579 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.230.253:39511: Network error: Client connection negotiation failed: client connection to 127.24.230.253:39511: connect: Connection refused (error 111)
08:04:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:25.232391 25581 master_runner.cc:387] Master server non-default flags:
08:04:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.230.212:37577
08:04:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:04:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-1/data
08:04:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-1/wal
08:04:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:04:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.24.230.254:40685,127.24.230.253:39511,127.24.230.252:40255
08:04:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:04:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.230.253:39511
08:04:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:04:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:04:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:04:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44113/jwks.json
08:04:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-1/data/info.pb
08:04:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.230.253
08:04:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:04:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:04:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:04:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-1/logs
08:04:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:04:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:04:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:04:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:04:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:04:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:04:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:04:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:04:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:04:25.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:25.233668 25581 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:04:25.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:25.235694 25581 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:04:25.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:25.247838 25591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:25.382 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091465380 for job b42812d69c586178cf7556c3c92998f3.
08:04:25.402 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=21 ms, finalizationTime=1 ms).
08:04:25.404 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
08:04:25.523 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:25.524 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:25.525 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:25.525 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:25.525 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:25.525 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:25.526 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:25.526 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:25.526 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:25.528 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:25.528 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:25.528 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:25.529 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:25.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:25.530879 25579 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } attempt: 5
08:04:25.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:25.537211 25579 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.230.253:39511: Network error: Client connection negotiation failed: client connection to 127.24.230.253:39511: connect: Connection refused (error 111)
08:04:25.882 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091465881 for job b42812d69c586178cf7556c3c92998f3.
08:04:25.901 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
08:04:25.904 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
08:04:26.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.084787 25579 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } attempt: 6
08:04:26.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:26.095744 25579 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.230.253:39511: Network error: Client connection negotiation failed: client connection to 127.24.230.253:39511: connect: Connection refused (error 111)
08:04:26.381 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091466380 for job b42812d69c586178cf7556c3c92998f3.
08:04:26.382 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:26.392 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:26.393 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:26.393 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:26.393 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:26.394 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:26.394 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:26.394 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:26.394 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:26.394 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:26.394 [INFO - pool-30-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:26.395 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:26.395 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:26.398 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
08:04:26.402 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
08:04:26.445 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:26.446 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:26.447 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:26.447 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:26.447 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:26.447 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:26.447 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:26.447 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:26.448 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:26.448 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:26.448 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:26.448 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:26.448 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:26.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:25.248432 25592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:26.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:26.532310 25594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:26.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:26.535611 25593 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1281 milliseconds
08:04:26.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.535761 25581 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:04:26.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.537127 25581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:04:26.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.540009 25581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:04:26.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.541435 25581 hybrid_clock.cc:648] HybridClock initialized: now 1779091466541365 us; error 66 us; skew 500 ppm
08:04:26.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.542421 25581 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:04:26.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.548954 25581 webserver.cc:533] Webserver started at http://127.24.230.253:36767/ using document root <none> and password file <none>
08:04:26.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.550038 25581 fs_manager.cc:362] Metadata directory not provided
08:04:26.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.550288 25581 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:04:26.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.550853 25581 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:04:26.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.555403 25581 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-1/data/instance:
08:04:26.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c6c5825ae0fe4268825b3292af35336f"
08:04:26.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:26 on dist-test-slave-1jss"
08:04:26.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.556595 25581 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-1/wal/instance:
08:04:26.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c6c5825ae0fe4268825b3292af35336f"
08:04:26.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:26 on dist-test-slave-1jss"
08:04:26.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.564306 25581 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.004s
08:04:26.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.570516 25604 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:04:26.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.571605 25581 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
08:04:26.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.572021 25581 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-1/wal
08:04:26.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c6c5825ae0fe4268825b3292af35336f"
08:04:26.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:26 on dist-test-slave-1jss"
08:04:26.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.572386 25581 fs_report.cc:389] FS layout report
08:04:26.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:04:26.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-1/wal
08:04:26.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-1/wal
08:04:26.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-1/data/data
08:04:26.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:04:26.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:04:26.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:04:26.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:04:26.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:04:26.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:04:26.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:04:26.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:04:26.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:04:26.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:04:26.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:04:26.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.624993 25581 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:04:26.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.626701 25581 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:04:26.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.627233 25581 kserver.cc:163] Server-wide thread pool size limit: 3276
08:04:26.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.702497 25581 rpc_server.cc:307] RPC server started. Bound to: 127.24.230.253:39511
08:04:26.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.702581 25655 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.230.253:39511 every 8 connection(s)
08:04:26.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.705452 25581 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-1/data/info.pb
08:04:26.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.710261 25499 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 25581
08:04:26.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.710711 25499 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-1/wal/instance
08:04:26.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.712179 25656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:26.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.713194 25499 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:26.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:26.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-2/wal
08:04:26.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-2/data
08:04:26.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:04:26.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:04:26.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:04:26.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:26.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:26.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:26.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-2/logs
08:04:26.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-2/data/info.pb
08:04:26.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:26.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:04:26.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:04:26.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:04:26.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:04:26.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:26.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:26.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:26.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:04:26.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:04:26.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:04:26.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:04:26.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.230.252:40255
08:04:26.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.230.252
08:04:26.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:26.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.230.212:37577
08:04:26.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:26.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:26.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:04:26.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:04:26.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.24.230.254:40685,127.24.230.253:39511,127.24.230.252:40255
08:04:26.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:04:26.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44113/jwks.json with env {}
08:04:26.726 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:26.726 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:26.727 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:26.727 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:26.727 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:26.727 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:26.728 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:26.728 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:26.728 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:26.729 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:26.729 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:26.729 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:26.729 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:26.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.726383 25656 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.230.254" port: 40685 } has no permanent_uuid. Determining permanent_uuid...
08:04:26.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.753525 25656 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } has no permanent_uuid. Determining permanent_uuid...
08:04:26.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.769631 25656 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } has no permanent_uuid. Determining permanent_uuid...
08:04:26.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:26.772418 25606 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.230.252:40255: connect: Connection refused (error 111)
08:04:26.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:26.777386 25656 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.230.252:40255: Network error: Client connection negotiation failed: client connection to 127.24.230.252:40255: connect: Connection refused (error 111)
08:04:26.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.826944 25656 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } attempt: 1
08:04:26.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:26.831540 25656 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.230.252:40255: Network error: Client connection negotiation failed: client connection to 127.24.230.252:40255: connect: Connection refused (error 111)
08:04:26.881 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091466880 for job b42812d69c586178cf7556c3c92998f3.
08:04:26.893 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
08:04:26.894 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
08:04:26.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.899955 25656 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } attempt: 2
08:04:26.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:26.904218 25656 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.230.252:40255: Network error: Client connection negotiation failed: client connection to 127.24.230.252:40255: connect: Connection refused (error 111)
08:04:26.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:26.995651 25656 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } attempt: 3
08:04:27.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:26.999958 25656 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.230.252:40255: Network error: Client connection negotiation failed: client connection to 127.24.230.252:40255: connect: Connection refused (error 111)
08:04:27.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:27.052331 25658 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:04:27.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:27.052896 25658 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:04:27.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:27.053341 25658 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:04:27.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:27.087085 25658 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:04:27.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:27.087366 25658 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:04:27.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:27.087561 25658 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:04:27.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:27.087767 25658 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:04:27.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:27.087952 25658 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:04:27.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:27.088099 25658 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:44113/jwks.json
08:04:27.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:27.125998 25658 master_runner.cc:387] Master server non-default flags:
08:04:27.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:27.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.230.212:37577
08:04:27.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:27.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:04:27.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-2/data
08:04:27.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-2/wal
08:04:27.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:04:27.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.24.230.254:40685,127.24.230.253:39511,127.24.230.252:40255
08:04:27.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:27.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:27.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:04:27.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.230.252:40255
08:04:27.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:04:27.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:04:27.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:04:27.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44113/jwks.json
08:04:27.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:27.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:27.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-2/data/info.pb
08:04:27.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.230.252
08:04:27.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:27.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:04:27.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:27.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:04:27.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:04:27.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:27.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-2/logs
08:04:27.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:27.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:04:27.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:04:27.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:04:27.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:04:27.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:04:27.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:04:27.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:04:27.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:04:27.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:04:27.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:27.127431 25658 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:04:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:27.129055 25658 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:04:27.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:27.141484 25668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:27.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:27.143432 25656 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } attempt: 4
08:04:27.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:27.148967 25656 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.230.252:40255: Network error: Client connection negotiation failed: client connection to 127.24.230.252:40255: connect: Connection refused (error 111)
08:04:27.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:27.156390 25579 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } attempt: 7
08:04:27.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:27.175634 25579 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } has no permanent_uuid. Determining permanent_uuid...
08:04:27.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:27.185149 25579 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.230.252:40255: Network error: Client connection negotiation failed: client connection to 127.24.230.252:40255: connect: Connection refused (error 111)
08:04:27.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:27.243917 25579 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } attempt: 1
08:04:27.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:27.251578 25579 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.230.252:40255: Network error: Client connection negotiation failed: client connection to 127.24.230.252:40255: connect: Connection refused (error 111)
08:04:27.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:27.333205 25579 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } attempt: 2
08:04:27.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:27.341835 25579 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.230.252:40255: Network error: Client connection negotiation failed: client connection to 127.24.230.252:40255: connect: Connection refused (error 111)
08:04:27.383 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091467380 for job b42812d69c586178cf7556c3c92998f3.
08:04:27.410 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=24 ms, finalizationTime=6 ms).
08:04:27.416 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
08:04:27.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:27.427944 25579 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } attempt: 3
08:04:27.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:27.435007 25579 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.230.252:40255: Network error: Client connection negotiation failed: client connection to 127.24.230.252:40255: connect: Connection refused (error 111)
08:04:27.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:27.448411 25656 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } attempt: 5
08:04:27.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:27.455120 25656 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.230.252:40255: Network error: Client connection negotiation failed: client connection to 127.24.230.252:40255: connect: Connection refused (error 111)
08:04:27.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:27.575718 25579 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } attempt: 4
08:04:27.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:27.582706 25579 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.230.252:40255: Network error: Client connection negotiation failed: client connection to 127.24.230.252:40255: connect: Connection refused (error 111)
08:04:27.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:27.866406 25579 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } attempt: 5
08:04:27.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:27.873476 25579 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.230.252:40255: Network error: Client connection negotiation failed: client connection to 127.24.230.252:40255: connect: Connection refused (error 111)
08:04:27.882 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091467880 for job b42812d69c586178cf7556c3c92998f3.
08:04:27.900 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
08:04:27.902 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
08:04:28.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.002704 25656 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } attempt: 6
08:04:28.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:28.034143 25656 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.230.252:40255: Network error: Client connection negotiation failed: client connection to 127.24.230.252:40255: connect: Connection refused (error 111)
08:04:28.202 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:28.204 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:28.204 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:28.209 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:28.209 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:28.209 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:28.211 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:28.211 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:28.211 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:28.215 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:28.215 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:28.215 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:28.215 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:28.382 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091468380 for job b42812d69c586178cf7556c3c92998f3.
08:04:28.400 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
08:04:28.402 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
08:04:28.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.426088 25579 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } attempt: 6
08:04:28.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:28.434708 25579 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.230.252:40255: Network error: Client connection negotiation failed: client connection to 127.24.230.252:40255: connect: Connection refused (error 111)
08:04:28.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:27.141469 25669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:28.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:28.483640 25671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:28.485 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:28.486 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:28.486 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:28.487 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:28.487 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:28.487 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:28.487 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:28.487 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:28.487 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:28.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:28.487596 25670 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1339 milliseconds
08:04:28.488 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:28.488 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:28.488 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:28.488 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:28.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.488087 25658 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:04:28.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.489655 25658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:04:28.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.492329 25658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:04:28.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.493714 25658 hybrid_clock.cc:648] HybridClock initialized: now 1779091468493644 us; error 105 us; skew 500 ppm
08:04:28.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.494583 25658 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:04:28.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.502555 25658 webserver.cc:533] Webserver started at http://127.24.230.252:41597/ using document root <none> and password file <none>
08:04:28.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.503826 25658 fs_manager.cc:362] Metadata directory not provided
08:04:28.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.504040 25658 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:04:28.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.504446 25658 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:04:28.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.509119 25658 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-2/data/instance:
08:04:28.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "03643fbf699d4d218c71591c5102f843"
08:04:28.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:28 on dist-test-slave-1jss"
08:04:28.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.510289 25658 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-2/wal/instance:
08:04:28.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "03643fbf699d4d218c71591c5102f843"
08:04:28.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:28 on dist-test-slave-1jss"
08:04:28.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.517761 25658 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.000s
08:04:28.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.523541 25685 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:04:28.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.524888 25658 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
08:04:28.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.525327 25658 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-2/wal
08:04:28.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "03643fbf699d4d218c71591c5102f843"
08:04:28.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:28 on dist-test-slave-1jss"
08:04:28.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.525830 25658 fs_report.cc:389] FS layout report
08:04:28.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:04:28.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-2/wal
08:04:28.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-2/wal
08:04:28.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-2/data/data
08:04:28.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:04:28.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:04:28.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:04:28.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:04:28.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:04:28.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:04:28.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:04:28.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:04:28.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:04:28.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:04:28.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:04:28.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.620093 25658 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:04:28.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.621618 25658 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:04:28.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.622071 25658 kserver.cc:163] Server-wide thread pool size limit: 3276
08:04:28.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.694669 25658 rpc_server.cc:307] RPC server started. Bound to: 127.24.230.252:40255
08:04:28.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.694841 25736 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.230.252:40255 every 8 connection(s)
08:04:28.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.697276 25658 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-2/data/info.pb
08:04:28.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.701398 25499 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 25658
08:04:28.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.701884 25499 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/master-2/wal/instance
08:04:28.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.704941 25737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:28.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.724646 25737 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.230.254" port: 40685 } has no permanent_uuid. Determining permanent_uuid...
08:04:28.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.749941 25737 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } has no permanent_uuid. Determining permanent_uuid...
08:04:28.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.760699 25737 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } has no permanent_uuid. Determining permanent_uuid...
08:04:28.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.777623 25737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843: Bootstrap starting.
08:04:28.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.785101 25737 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843: Neither blocks nor log segments found. Creating new log.
08:04:28.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.787873 25737 log.cc:826] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843: Log is configured to *not* fsync() on all Append() calls
08:04:28.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.793761 25737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843: No bootstrap required, opened a new log
08:04:28.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.816685 25737 raft_consensus.cc:359] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "391584ce11a44fc3bd553603290a22c2" member_type: VOTER last_known_addr { host: "127.24.230.254" port: 40685 } } peers { permanent_uuid: "c6c5825ae0fe4268825b3292af35336f" member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } } peers { permanent_uuid: "03643fbf699d4d218c71591c5102f843" member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } }
08:04:28.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.817366 25737 raft_consensus.cc:385] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:28.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.817569 25737 raft_consensus.cc:740] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03643fbf699d4d218c71591c5102f843, State: Initialized, Role: FOLLOWER
08:04:28.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.818482 25737 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "391584ce11a44fc3bd553603290a22c2" member_type: VOTER last_known_addr { host: "127.24.230.254" port: 40685 } } peers { permanent_uuid: "c6c5825ae0fe4268825b3292af35336f" member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } } peers { permanent_uuid: "03643fbf699d4d218c71591c5102f843" member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } }
08:04:28.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.821444 25746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "391584ce11a44fc3bd553603290a22c2" member_type: VOTER last_known_addr { host: "127.24.230.254" port: 40685 } } peers { permanent_uuid: "c6c5825ae0fe4268825b3292af35336f" member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } } peers { permanent_uuid: "03643fbf699d4d218c71591c5102f843" member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } } }
08:04:28.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.822986 25746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [sys.catalog]: This master's current role is: FOLLOWER
08:04:28.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.823416 25737 sys_catalog.cc:565] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [sys.catalog]: configured and running, proceeding with master startup.
08:04:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:28.849375 25757 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:04:28.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:28.849730 25757 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:04:28.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.845122 25658 master_runner.cc:187] Error getting master registration for 127.24.230.254:40685: OK, instance_id { permanent_uuid: "391584ce11a44fc3bd553603290a22c2" instance_seqno: 1779091464783694 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:04:28.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.870369 25658 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:04:28.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:28.877202 25691 tablet.cc:2404] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:04:28.881 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091468880 for job b42812d69c586178cf7556c3c92998f3.
08:04:28.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.893036 25746 raft_consensus.cc:493] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:04:28.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.893651 25746 raft_consensus.cc:515] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "391584ce11a44fc3bd553603290a22c2" member_type: VOTER last_known_addr { host: "127.24.230.254" port: 40685 } } peers { permanent_uuid: "c6c5825ae0fe4268825b3292af35336f" member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } } peers { permanent_uuid: "03643fbf699d4d218c71591c5102f843" member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } }
08:04:28.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:28.898110 25746 leader_election.cc:290] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 391584ce11a44fc3bd553603290a22c2 (127.24.230.254:40685), c6c5825ae0fe4268825b3292af35336f (127.24.230.253:39511)
08:04:28.901 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=20 ms, finalizationTime=0 ms).
08:04:28.902 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
08:04:29.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.094784 25656 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } attempt: 7
08:04:29.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.117405 25656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6c5825ae0fe4268825b3292af35336f: Bootstrap starting.
08:04:29.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.125383 25656 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c6c5825ae0fe4268825b3292af35336f: Neither blocks nor log segments found. Creating new log.
08:04:29.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.127748 25656 log.cc:826] T 00000000000000000000000000000000 P c6c5825ae0fe4268825b3292af35336f: Log is configured to *not* fsync() on all Append() calls
08:04:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.133145 25656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6c5825ae0fe4268825b3292af35336f: No bootstrap required, opened a new log
08:04:29.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.163018 25656 raft_consensus.cc:359] T 00000000000000000000000000000000 P c6c5825ae0fe4268825b3292af35336f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "391584ce11a44fc3bd553603290a22c2" member_type: VOTER last_known_addr { host: "127.24.230.254" port: 40685 } } peers { permanent_uuid: "c6c5825ae0fe4268825b3292af35336f" member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } } peers { permanent_uuid: "03643fbf699d4d218c71591c5102f843" member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } }
08:04:29.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.164047 25656 raft_consensus.cc:385] T 00000000000000000000000000000000 P c6c5825ae0fe4268825b3292af35336f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:29.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.164352 25656 raft_consensus.cc:740] T 00000000000000000000000000000000 P c6c5825ae0fe4268825b3292af35336f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c5825ae0fe4268825b3292af35336f, State: Initialized, Role: FOLLOWER
08:04:29.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.165249 25656 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6c5825ae0fe4268825b3292af35336f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "391584ce11a44fc3bd553603290a22c2" member_type: VOTER last_known_addr { host: "127.24.230.254" port: 40685 } } peers { permanent_uuid: "c6c5825ae0fe4268825b3292af35336f" member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } } peers { permanent_uuid: "03643fbf699d4d218c71591c5102f843" member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } }
08:04:29.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.168314 25761 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6c5825ae0fe4268825b3292af35336f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "391584ce11a44fc3bd553603290a22c2" member_type: VOTER last_known_addr { host: "127.24.230.254" port: 40685 } } peers { permanent_uuid: "c6c5825ae0fe4268825b3292af35336f" member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } } peers { permanent_uuid: "03643fbf699d4d218c71591c5102f843" member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } } }
08:04:29.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.169394 25761 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6c5825ae0fe4268825b3292af35336f [sys.catalog]: This master's current role is: FOLLOWER
08:04:29.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.172166 25656 sys_catalog.cc:565] T 00000000000000000000000000000000 P c6c5825ae0fe4268825b3292af35336f [sys.catalog]: configured and running, proceeding with master startup.
08:04:29.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.172497 25631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "03643fbf699d4d218c71591c5102f843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c5825ae0fe4268825b3292af35336f" is_pre_election: true
08:04:29.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.173405 25631 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c6c5825ae0fe4268825b3292af35336f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03643fbf699d4d218c71591c5102f843 in term 0.
08:04:29.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.175071 25689 leader_election.cc:304] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03643fbf699d4d218c71591c5102f843, c6c5825ae0fe4268825b3292af35336f; no voters: 
08:04:29.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.176335 25746 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:04:29.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.176693 25746 raft_consensus.cc:493] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:04:29.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.177033 25746 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [term 0 FOLLOWER]: Advancing to term 1
08:04:29.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.181733 25746 raft_consensus.cc:515] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "391584ce11a44fc3bd553603290a22c2" member_type: VOTER last_known_addr { host: "127.24.230.254" port: 40685 } } peers { permanent_uuid: "c6c5825ae0fe4268825b3292af35336f" member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } } peers { permanent_uuid: "03643fbf699d4d218c71591c5102f843" member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } }
08:04:29.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.184249 25746 leader_election.cc:290] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [CANDIDATE]: Term 1 election: Requested vote from peers 391584ce11a44fc3bd553603290a22c2 (127.24.230.254:40685), c6c5825ae0fe4268825b3292af35336f (127.24.230.253:39511)
08:04:29.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.184875 25631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "03643fbf699d4d218c71591c5102f843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6c5825ae0fe4268825b3292af35336f"
08:04:29.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.185422 25631 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c6c5825ae0fe4268825b3292af35336f [term 0 FOLLOWER]: Advancing to term 1
08:04:29.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.192744 25631 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c6c5825ae0fe4268825b3292af35336f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03643fbf699d4d218c71591c5102f843 in term 1.
08:04:29.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.194307 25689 leader_election.cc:304] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03643fbf699d4d218c71591c5102f843, c6c5825ae0fe4268825b3292af35336f; no voters: 
08:04:29.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.195446 25746 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [term 1 FOLLOWER]: Leader election won for term 1
08:04:29.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.197685 25746 raft_consensus.cc:697] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [term 1 LEADER]: Becoming Leader. State: Replica: 03643fbf699d4d218c71591c5102f843, State: Running, Role: LEADER
08:04:29.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.202359 25746 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "391584ce11a44fc3bd553603290a22c2" member_type: VOTER last_known_addr { host: "127.24.230.254" port: 40685 } } peers { permanent_uuid: "c6c5825ae0fe4268825b3292af35336f" member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } } peers { permanent_uuid: "03643fbf699d4d218c71591c5102f843" member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } }
08:04:29.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.224701 25767 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03643fbf699d4d218c71591c5102f843. Latest consensus state: current_term: 1 leader_uuid: "03643fbf699d4d218c71591c5102f843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "391584ce11a44fc3bd553603290a22c2" member_type: VOTER last_known_addr { host: "127.24.230.254" port: 40685 } } peers { permanent_uuid: "c6c5825ae0fe4268825b3292af35336f" member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } } peers { permanent_uuid: "03643fbf699d4d218c71591c5102f843" member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } } }
08:04:29.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.226069 25767 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [sys.catalog]: This master's current role is: LEADER
08:04:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.234431 25773 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
08:04:29.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.255972 25773 catalog_manager.cc:1519] Initializing Kudu cluster ID...
08:04:29.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:29.261252 25776 catalog_manager.cc:1593] T 00000000000000000000000000000000 P c6c5825ae0fe4268825b3292af35336f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:04:29.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:29.261637 25776 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:04:29.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.244189 25581 master_runner.cc:187] Error getting master registration for 127.24.230.254:40685: OK, instance_id { permanent_uuid: "391584ce11a44fc3bd553603290a22c2" instance_seqno: 1779091464783694 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:04:29.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.293253 25631 raft_consensus.cc:1275] T 00000000000000000000000000000000 P c6c5825ae0fe4268825b3292af35336f [term 1 FOLLOWER]: Refusing update from remote peer 03643fbf699d4d218c71591c5102f843: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:04:29.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.294162 25581 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:04:29.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.295534 25767 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6c5825ae0fe4268825b3292af35336f" member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:04:29.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.338583 25761 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6c5825ae0fe4268825b3292af35336f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03643fbf699d4d218c71591c5102f843. Latest consensus state: current_term: 1 leader_uuid: "03643fbf699d4d218c71591c5102f843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "391584ce11a44fc3bd553603290a22c2" member_type: VOTER last_known_addr { host: "127.24.230.254" port: 40685 } } peers { permanent_uuid: "c6c5825ae0fe4268825b3292af35336f" member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } } peers { permanent_uuid: "03643fbf699d4d218c71591c5102f843" member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } } }
08:04:29.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.339663 25761 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6c5825ae0fe4268825b3292af35336f [sys.catalog]: This master's current role is: FOLLOWER
08:04:29.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.341768 25746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "03643fbf699d4d218c71591c5102f843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "391584ce11a44fc3bd553603290a22c2" member_type: VOTER last_known_addr { host: "127.24.230.254" port: 40685 } } peers { permanent_uuid: "c6c5825ae0fe4268825b3292af35336f" member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } } peers { permanent_uuid: "03643fbf699d4d218c71591c5102f843" member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } } }
08:04:29.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.342609 25746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [sys.catalog]: This master's current role is: LEADER
08:04:29.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.350946 25773 catalog_manager.cc:1382] Generated new cluster ID: c16bbac8101a493995871ecbd2d893d2
08:04:29.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.351266 25773 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
08:04:29.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.364027 25761 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6c5825ae0fe4268825b3292af35336f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "03643fbf699d4d218c71591c5102f843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "391584ce11a44fc3bd553603290a22c2" member_type: VOTER last_known_addr { host: "127.24.230.254" port: 40685 } } peers { permanent_uuid: "c6c5825ae0fe4268825b3292af35336f" member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } } peers { permanent_uuid: "03643fbf699d4d218c71591c5102f843" member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } } }
08:04:29.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.364923 25761 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6c5825ae0fe4268825b3292af35336f [sys.catalog]: This master's current role is: FOLLOWER
08:04:29.383 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091469380 for job b42812d69c586178cf7556c3c92998f3.
08:04:29.414 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=24 ms, finalizationTime=10 ms).
08:04:29.416 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
08:04:29.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.427440 25773 catalog_manager.cc:1405] Generated new certificate authority record
08:04:29.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.434294 25773 catalog_manager.cc:1539] Loading token signing keys...
08:04:29.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.468173 25579 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } attempt: 7
08:04:29.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.477944 25773 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843: Generated new TSK 0
08:04:29.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.479136 25773 catalog_manager.cc:1549] Initializing in-progress tserver states...
08:04:29.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.503237 25499 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:29.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:29.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-0/wal
08:04:29.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-0/data
08:04:29.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-0/logs
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-0/data/info.pb
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.230.193:0
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.24.230.193
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.230.193
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.24.230.254:40685,127.24.230.253:39511,127.24.230.252:40255
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.230.212:37577
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:29.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:04:29.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.521816 25579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 391584ce11a44fc3bd553603290a22c2: Bootstrap starting.
08:04:29.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.529909 25579 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 391584ce11a44fc3bd553603290a22c2: Neither blocks nor log segments found. Creating new log.
08:04:29.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.536773 25579 log.cc:826] T 00000000000000000000000000000000 P 391584ce11a44fc3bd553603290a22c2: Log is configured to *not* fsync() on all Append() calls
08:04:29.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.561057 25579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 391584ce11a44fc3bd553603290a22c2: No bootstrap required, opened a new log
08:04:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.594393 25579 raft_consensus.cc:359] T 00000000000000000000000000000000 P 391584ce11a44fc3bd553603290a22c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "391584ce11a44fc3bd553603290a22c2" member_type: VOTER last_known_addr { host: "127.24.230.254" port: 40685 } } peers { permanent_uuid: "c6c5825ae0fe4268825b3292af35336f" member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } } peers { permanent_uuid: "03643fbf699d4d218c71591c5102f843" member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } }
08:04:29.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.595677 25579 raft_consensus.cc:385] T 00000000000000000000000000000000 P 391584ce11a44fc3bd553603290a22c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:29.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.596175 25579 raft_consensus.cc:740] T 00000000000000000000000000000000 P 391584ce11a44fc3bd553603290a22c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391584ce11a44fc3bd553603290a22c2, State: Initialized, Role: FOLLOWER
08:04:29.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.597473 25579 consensus_queue.cc:260] T 00000000000000000000000000000000 P 391584ce11a44fc3bd553603290a22c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "391584ce11a44fc3bd553603290a22c2" member_type: VOTER last_known_addr { host: "127.24.230.254" port: 40685 } } peers { permanent_uuid: "c6c5825ae0fe4268825b3292af35336f" member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } } peers { permanent_uuid: "03643fbf699d4d218c71591c5102f843" member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } }
08:04:29.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.614907 25786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 391584ce11a44fc3bd553603290a22c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "391584ce11a44fc3bd553603290a22c2" member_type: VOTER last_known_addr { host: "127.24.230.254" port: 40685 } } peers { permanent_uuid: "c6c5825ae0fe4268825b3292af35336f" member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } } peers { permanent_uuid: "03643fbf699d4d218c71591c5102f843" member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } } }
08:04:29.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.616422 25786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 391584ce11a44fc3bd553603290a22c2 [sys.catalog]: This master's current role is: FOLLOWER
08:04:29.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.617151 25579 sys_catalog.cc:565] T 00000000000000000000000000000000 P 391584ce11a44fc3bd553603290a22c2 [sys.catalog]: configured and running, proceeding with master startup.
08:04:29.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.617311 25554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "03643fbf699d4d218c71591c5102f843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391584ce11a44fc3bd553603290a22c2" is_pre_election: true
08:04:29.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.618201 25554 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 391584ce11a44fc3bd553603290a22c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03643fbf699d4d218c71591c5102f843 in term 0.
08:04:29.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.619637 25552 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 391584ce11a44fc3bd553603290a22c2 [term 0 FOLLOWER]: Advancing to term 1
08:04:29.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.623831 25553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "03643fbf699d4d218c71591c5102f843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391584ce11a44fc3bd553603290a22c2"
08:04:29.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.636363 25552 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 391584ce11a44fc3bd553603290a22c2 [term 1 FOLLOWER]: Refusing update from remote peer 03643fbf699d4d218c71591c5102f843: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:04:29.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.641170 25746 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "391584ce11a44fc3bd553603290a22c2" member_type: VOTER last_known_addr { host: "127.24.230.254" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:04:29.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.712035 25786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 391584ce11a44fc3bd553603290a22c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03643fbf699d4d218c71591c5102f843. Latest consensus state: current_term: 1 leader_uuid: "03643fbf699d4d218c71591c5102f843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "391584ce11a44fc3bd553603290a22c2" member_type: VOTER last_known_addr { host: "127.24.230.254" port: 40685 } } peers { permanent_uuid: "c6c5825ae0fe4268825b3292af35336f" member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } } peers { permanent_uuid: "03643fbf699d4d218c71591c5102f843" member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } } }
08:04:29.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.714720 25786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 391584ce11a44fc3bd553603290a22c2 [sys.catalog]: This master's current role is: FOLLOWER
08:04:29.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.713901 25792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 391584ce11a44fc3bd553603290a22c2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "03643fbf699d4d218c71591c5102f843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "391584ce11a44fc3bd553603290a22c2" member_type: VOTER last_known_addr { host: "127.24.230.254" port: 40685 } } peers { permanent_uuid: "c6c5825ae0fe4268825b3292af35336f" member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } } peers { permanent_uuid: "03643fbf699d4d218c71591c5102f843" member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } } }
08:04:29.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.715423 25792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 391584ce11a44fc3bd553603290a22c2 [sys.catalog]: This master's current role is: FOLLOWER
08:04:29.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:29.729991 25803 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
08:04:29.862 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:29.863 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:29.863 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:29.866 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:29.866 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:29.866 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:29.867 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:29.867 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:29.867 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:29.868 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:29.868 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:29.868 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:29.868 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:29.881 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091469880 for job b42812d69c586178cf7556c3c92998f3.
08:04:29.900 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
08:04:29.902 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
08:04:30.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:30.125598 25746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "03643fbf699d4d218c71591c5102f843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "391584ce11a44fc3bd553603290a22c2" member_type: VOTER last_known_addr { host: "127.24.230.254" port: 40685 } } peers { permanent_uuid: "c6c5825ae0fe4268825b3292af35336f" member_type: VOTER last_known_addr { host: "127.24.230.253" port: 39511 } } peers { permanent_uuid: "03643fbf699d4d218c71591c5102f843" member_type: VOTER last_known_addr { host: "127.24.230.252" port: 40255 } } }
08:04:30.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:30.126365 25746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03643fbf699d4d218c71591c5102f843 [sys.catalog]: This master's current role is: LEADER
08:04:30.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:30.134122 25784 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:04:30.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:30.134688 25784 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:04:30.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:30.135340 25784 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:04:30.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:30.173365 25784 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:04:30.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:30.174525 25784 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.230.193
08:04:30.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:30.215014 25784 tablet_server_runner.cc:78] Tablet server non-default flags:
08:04:30.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:30.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.230.212:37577
08:04:30.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:30.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:04:30.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-0/data
08:04:30.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-0/wal
08:04:30.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:30.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:30.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.230.193:0
08:04:30.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:04:30.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:30.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:30.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-0/data/info.pb
08:04:30.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.230.193
08:04:30.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:30.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.24.230.254:40685,127.24.230.253:39511,127.24.230.252:40255
08:04:30.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:04:30.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:30.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:04:30.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:04:30.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:30.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.24.230.193
08:04:30.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-0/logs
08:04:30.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:30.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:04:30.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:04:30.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:04:30.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:04:30.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:04:30.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:04:30.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:04:30.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:04:30.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:04:30.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:30.216706 25784 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:04:30.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:30.218392 25784 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:04:30.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:30.234370 25811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:30.266 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:30.266 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:30.267 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:30.267 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:30.267 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:30.267 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:30.267 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:30.268 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:30.268 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:30.268 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:30.268 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:30.268 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:30.269 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:30.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:30.272253 25776 catalog_manager.cc:1294] Loaded cluster ID: c16bbac8101a493995871ecbd2d893d2
08:04:30.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:30.272742 25776 catalog_manager.cc:1587] T 00000000000000000000000000000000 P c6c5825ae0fe4268825b3292af35336f: loading cluster ID for follower catalog manager: success
08:04:30.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:30.280869 25776 catalog_manager.cc:1609] T 00000000000000000000000000000000 P c6c5825ae0fe4268825b3292af35336f: acquiring CA information for follower catalog manager: success
08:04:30.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:30.287171 25776 catalog_manager.cc:1637] T 00000000000000000000000000000000 P c6c5825ae0fe4268825b3292af35336f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:04:30.381 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091470380 for job b42812d69c586178cf7556c3c92998f3.
08:04:30.400 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
08:04:30.402 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
08:04:30.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:30.752065 25803 catalog_manager.cc:1294] Loaded cluster ID: c16bbac8101a493995871ecbd2d893d2
08:04:30.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:30.762403 25803 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 391584ce11a44fc3bd553603290a22c2: loading cluster ID for follower catalog manager: success
08:04:30.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:30.794879 25803 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 391584ce11a44fc3bd553603290a22c2: acquiring CA information for follower catalog manager: success
08:04:30.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:30.830269 25803 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 391584ce11a44fc3bd553603290a22c2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:04:30.882 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091470880 for job b42812d69c586178cf7556c3c92998f3.
08:04:30.908 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=27 ms, finalizationTime=1 ms).
08:04:30.910 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
08:04:31.381 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091471380 for job b42812d69c586178cf7556c3c92998f3.
08:04:31.382 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:31.383 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:31.383 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:31.384 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:31.397 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:31.398 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:31.399 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:31.399 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:31.399 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:31.399 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:31.400 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:31.400 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:31.400 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:31.408 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=27 ms, finalizationTime=1 ms).
08:04:31.418 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
08:04:31.880 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091471880 for job b42812d69c586178cf7556c3c92998f3.
08:04:31.904 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=23 ms, finalizationTime=1 ms).
08:04:31.906 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
08:04:32.381 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091472380 for job b42812d69c586178cf7556c3c92998f3.
08:04:32.398 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
08:04:32.400 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
08:04:32.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:31.634462 25810 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 25784
08:04:32.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:32.573720 25810 kernel_stack_watchdog.cc:198] Thread 25784 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 387ms:
08:04:32.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:04:32.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:04:32.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:04:32.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:04:32.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:30.250872 25812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:32.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:32.575904 25814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:32.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:32.574867 25784 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.330s	user 0.729s	sys 1.193s
08:04:32.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:32.576447 25784 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.332s	user 0.729s	sys 1.193s
08:04:32.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:32.576735 25784 server_base.cc:1061] running on GCE node
08:04:32.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:32.578177 25784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:04:32.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:32.586493 25784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:04:32.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:32.587944 25784 hybrid_clock.cc:648] HybridClock initialized: now 1779091472587901 us; error 48 us; skew 500 ppm
08:04:32.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:32.589074 25784 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:04:32.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:32.618649 25784 webserver.cc:533] Webserver started at http://127.24.230.193:34543/ using document root <none> and password file <none>
08:04:32.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:32.620441 25784 fs_manager.cc:362] Metadata directory not provided
08:04:32.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:32.620942 25784 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:04:32.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:32.621735 25784 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:04:32.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:32.635402 25784 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-0/data/instance:
08:04:32.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "97ad2967f56a4511a42f5f0981fb24d5"
08:04:32.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:32 on dist-test-slave-1jss"
08:04:32.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:32.640245 25784 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-0/wal/instance:
08:04:32.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "97ad2967f56a4511a42f5f0981fb24d5"
08:04:32.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:32 on dist-test-slave-1jss"
08:04:32.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:32.666651 25784 fs_manager.cc:696] Time spent creating directory manager: real 0.023s	user 0.009s	sys 0.009s
08:04:32.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:32.679920 25824 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:04:32.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:32.681317 25784 fs_manager.cc:730] Time spent opening block manager: real 0.010s	user 0.005s	sys 0.004s
08:04:32.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:32.681732 25784 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-0/wal
08:04:32.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "97ad2967f56a4511a42f5f0981fb24d5"
08:04:32.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:32 on dist-test-slave-1jss"
08:04:32.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:32.682224 25784 fs_report.cc:389] FS layout report
08:04:32.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:04:32.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-0/wal
08:04:32.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-0/wal
08:04:32.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-0/data/data
08:04:32.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:04:32.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:04:32.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:04:32.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:04:32.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:04:32.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:04:32.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:04:32.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:04:32.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:04:32.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:04:32.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:04:32.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:32.804193 25784 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:04:32.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:32.806306 25784 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:04:32.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:32.806895 25784 kserver.cc:163] Server-wide thread pool size limit: 3276
08:04:32.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:32.816453 25784 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:04:32.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:32.828668 25784 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:04:32.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:32.828977 25784 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:04:32.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:32.829294 25784 ts_tablet_manager.cc:616] Registered 0 tablets
08:04:32.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:32.829519 25784 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:04:32.881 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091472880 for job b42812d69c586178cf7556c3c92998f3.
08:04:32.904 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=23 ms, finalizationTime=1 ms).
08:04:32.906 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
08:04:33.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:33.125909 25784 rpc_server.cc:307] RPC server started. Bound to: 127.24.230.193:33195
08:04:33.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:33.126077 25937 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.230.193:33195 every 8 connection(s)
08:04:33.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:33.128715 25784 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-0/data/info.pb
08:04:33.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:33.133975 25499 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 25784
08:04:33.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:33.134575 25499 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-0/wal/instance
08:04:33.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:33.173694 25499 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-1/wal
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-1/data
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-1/logs
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-1/data/info.pb
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.230.194:0
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.24.230.194
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.230.194
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.24.230.254:40685,127.24.230.253:39511,127.24.230.252:40255
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.230.212:37577
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:04:33.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:33.196230 25939 heartbeater.cc:344] Connected to a master server at 127.24.230.253:39511
08:04:33.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:33.196780 25939 heartbeater.cc:461] Registering TS with master...
08:04:33.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:33.198395 25938 heartbeater.cc:344] Connected to a master server at 127.24.230.252:40255
08:04:33.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:33.198755 25938 heartbeater.cc:461] Registering TS with master...
08:04:33.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:33.200031 25938 heartbeater.cc:507] Master 127.24.230.252:40255 requested a full tablet report, sending...
08:04:33.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:33.202242 25939 heartbeater.cc:507] Master 127.24.230.253:39511 requested a full tablet report, sending...
08:04:33.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:33.205231 25702 ts_manager.cc:194] Registered new tserver with Master: 97ad2967f56a4511a42f5f0981fb24d5 (127.24.230.193:33195)
08:04:33.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:33.205341 25621 ts_manager.cc:194] Registered new tserver with Master: 97ad2967f56a4511a42f5f0981fb24d5 (127.24.230.193:33195)
08:04:33.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:33.208374 25702 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.24.230.193:51893
08:04:33.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:33.216279 25940 heartbeater.cc:344] Connected to a master server at 127.24.230.254:40685
08:04:33.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:33.216658 25940 heartbeater.cc:461] Registering TS with master...
08:04:33.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:33.217372 25940 heartbeater.cc:507] Master 127.24.230.254:40685 requested a full tablet report, sending...
08:04:33.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:33.221940 25544 ts_manager.cc:194] Registered new tserver with Master: 97ad2967f56a4511a42f5f0981fb24d5 (127.24.230.193:33195)
08:04:33.381 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091473380 for job b42812d69c586178cf7556c3c92998f3.
08:04:33.396 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
08:04:33.399 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
08:04:33.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:33.531050 25949 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:04:33.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:33.531610 25949 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:04:33.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:33.532188 25949 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:04:33.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:33.567760 25949 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:04:33.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:33.568785 25949 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.230.194
08:04:33.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:33.610407 25949 tablet_server_runner.cc:78] Tablet server non-default flags:
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.230.212:37577
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-1/data
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-1/wal
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.230.194:0
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-1/data/info.pb
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.230.194
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.24.230.254:40685,127.24.230.253:39511,127.24.230.252:40255
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.24.230.194
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-1/logs
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:04:33.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:04:33.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:33.612291 25949 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:04:33.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:33.614084 25949 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:04:33.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:33.629096 25956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:33.842 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:33.843 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:33.844 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:33.844 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:33.844 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:33.845 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:33.846 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:33.846 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:33.846 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:33.847 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:33.847 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:33.847 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:33.847 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:33.882 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091473880 for job b42812d69c586178cf7556c3c92998f3.
08:04:33.907 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=26 ms, finalizationTime=1 ms).
08:04:33.909 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
08:04:33.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:33.932788 25689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.230.253:39511, user_credentials={real_user=slave}} blocked reactor thread for 62049.8us
08:04:34.186 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:34.187 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:34.187 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:34.188 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:34.188 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:34.188 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:34.188 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:34.188 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:34.189 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:34.189 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:34.190 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:34.188 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:34.190 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:34.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:34.212700 25938 heartbeater.cc:499] Master 127.24.230.252:40255 was elected leader, sending a full tablet report...
08:04:34.383 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091474381 for job b42812d69c586178cf7556c3c92998f3.
08:04:34.400 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=19 ms, finalizationTime=0 ms).
08:04:34.402 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
08:04:34.881 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091474880 for job b42812d69c586178cf7556c3c92998f3.
08:04:34.896 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
08:04:34.897 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
08:04:35.383 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091475381 for job b42812d69c586178cf7556c3c92998f3.
08:04:35.434 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=53 ms, finalizationTime=0 ms).
08:04:35.436 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
08:04:35.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:35.031456 25955 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 25949
08:04:35.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:33.629510 25957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:35.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:35.658775 25955 kernel_stack_watchdog.cc:198] Thread 25949 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 398ms:
08:04:35.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:04:35.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:04:35.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:04:35.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:04:35.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:35.665553 25958 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2029 milliseconds
08:04:35.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:35.665515 25949 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.036s	user 0.002s	sys 0.000s
08:04:35.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:35.666005 25949 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.036s	user 0.002s	sys 0.001s
08:04:35.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:35.667855 25960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:35.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.667940 25949 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:04:35.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.669219 25949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:04:35.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.672013 25949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:04:35.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.673528 25949 hybrid_clock.cc:648] HybridClock initialized: now 1779091475673476 us; error 59 us; skew 500 ppm
08:04:35.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.674510 25949 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:04:35.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.681383 25949 webserver.cc:533] Webserver started at http://127.24.230.194:34783/ using document root <none> and password file <none>
08:04:35.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.682850 25949 fs_manager.cc:362] Metadata directory not provided
08:04:35.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.683060 25949 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:04:35.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.683449 25949 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:04:35.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.687886 25949 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-1/data/instance:
08:04:35.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "37d338f6c5db4cc4bace5615d0b1421a"
08:04:35.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:35 on dist-test-slave-1jss"
08:04:35.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.689093 25949 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-1/wal/instance:
08:04:35.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "37d338f6c5db4cc4bace5615d0b1421a"
08:04:35.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:35 on dist-test-slave-1jss"
08:04:35.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.697585 25949 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.010s	sys 0.001s
08:04:35.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.706261 25969 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:04:35.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.707672 25949 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.001s	sys 0.003s
08:04:35.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.708065 25949 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-1/wal
08:04:35.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "37d338f6c5db4cc4bace5615d0b1421a"
08:04:35.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:35 on dist-test-slave-1jss"
08:04:35.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.708487 25949 fs_report.cc:389] FS layout report
08:04:35.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:04:35.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-1/wal
08:04:35.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-1/wal
08:04:35.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-1/data/data
08:04:35.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:04:35.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:04:35.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:04:35.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:04:35.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:04:35.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:04:35.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:04:35.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:04:35.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:04:35.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:04:35.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:04:35.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.770951 25949 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:04:35.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.772418 25949 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:04:35.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.772832 25949 kserver.cc:163] Server-wide thread pool size limit: 3276
08:04:35.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.775871 25949 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:04:35.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.780464 25949 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:04:35.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.780663 25949 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:04:35.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.780864 25949 ts_tablet_manager.cc:616] Registered 0 tablets
08:04:35.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.781000 25949 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:04:35.881 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091475880 for job b42812d69c586178cf7556c3c92998f3.
08:04:35.898 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
08:04:35.899 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
08:04:35.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.936251 25949 rpc_server.cc:307] RPC server started. Bound to: 127.24.230.194:36057
08:04:35.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.936327 26082 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.230.194:36057 every 8 connection(s)
08:04:35.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.938807 25949 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-1/data/info.pb
08:04:35.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.948935 25499 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 25949
08:04:35.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.949424 25499 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-1/wal/instance
08:04:35.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.972922 26083 heartbeater.cc:344] Connected to a master server at 127.24.230.252:40255
08:04:35.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.973471 26083 heartbeater.cc:461] Registering TS with master...
08:04:35.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.974933 26083 heartbeater.cc:507] Master 127.24.230.252:40255 requested a full tablet report, sending...
08:04:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.975943 25499 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-2/wal
08:04:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-2/data
08:04:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:04:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:04:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:04:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-2/logs
08:04:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-2/data/info.pb
08:04:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:04:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:04:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:04:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:04:35.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:35.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:35.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:35.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:04:35.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:04:35.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.230.195:0
08:04:35.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.24.230.195
08:04:35.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.230.195
08:04:35.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:35.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.24.230.254:40685,127.24.230.253:39511,127.24.230.252:40255
08:04:35.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.230.212:37577
08:04:35.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:35.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:35.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:04:35.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.977699 25702 ts_manager.cc:194] Registered new tserver with Master: 37d338f6c5db4cc4bace5615d0b1421a (127.24.230.194:36057)
08:04:35.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.979403 25702 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.24.230.194:54903
08:04:35.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.989377 26084 heartbeater.cc:344] Connected to a master server at 127.24.230.253:39511
08:04:35.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.989754 26084 heartbeater.cc:461] Registering TS with master...
08:04:35.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.990424 26085 heartbeater.cc:344] Connected to a master server at 127.24.230.254:40685
08:04:35.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.990535 26084 heartbeater.cc:507] Master 127.24.230.253:39511 requested a full tablet report, sending...
08:04:35.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.990779 26085 heartbeater.cc:461] Registering TS with master...
08:04:35.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.991426 26085 heartbeater.cc:507] Master 127.24.230.254:40685 requested a full tablet report, sending...
08:04:35.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.993340 25621 ts_manager.cc:194] Registered new tserver with Master: 37d338f6c5db4cc4bace5615d0b1421a (127.24.230.194:36057)
08:04:35.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:35.993537 25544 ts_manager.cc:194] Registered new tserver with Master: 37d338f6c5db4cc4bace5615d0b1421a (127.24.230.194:36057)
08:04:36.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:36.300359 26093 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:04:36.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:36.300832 26093 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:04:36.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:36.301227 26093 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:04:36.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:36.338456 26093 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:04:36.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:36.339530 26093 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.230.195
08:04:36.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:36.379166 26093 tablet_server_runner.cc:78] Tablet server non-default flags:
08:04:36.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:36.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.230.212:37577
08:04:36.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:36.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:04:36.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-2/data
08:04:36.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-2/wal
08:04:36.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:36.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:36.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.230.195:0
08:04:36.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:04:36.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:36.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:36.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-2/data/info.pb
08:04:36.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.230.195
08:04:36.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:36.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.24.230.254:40685,127.24.230.253:39511,127.24.230.252:40255
08:04:36.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:04:36.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:36.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:04:36.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:04:36.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:36.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.24.230.195
08:04:36.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-2/logs
08:04:36.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:36.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:04:36.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:04:36.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:04:36.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:04:36.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:04:36.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:04:36.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:04:36.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:04:36.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:04:36.380 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091476380 for job b42812d69c586178cf7556c3c92998f3.
08:04:36.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:36.380901 26093 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:04:36.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:36.383019 26093 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:04:36.391 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:04:36.396 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
08:04:36.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:36.401716 26099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:36.881 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091476880 for job b42812d69c586178cf7556c3c92998f3.
08:04:36.898 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
08:04:36.903 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
08:04:36.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:36.983724 26083 heartbeater.cc:499] Master 127.24.230.252:40255 was elected leader, sending a full tablet report...
08:04:37.243 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:37.244 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:37.244 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:37.246 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:37.246 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:37.246 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:37.247 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:37.248 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:37.248 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:37.250 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:37.250 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:37.250 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:37.250 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:37.381 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091477380 for job b42812d69c586178cf7556c3c92998f3.
08:04:37.401 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
08:04:37.403 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
08:04:37.881 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091477880 for job b42812d69c586178cf7556c3c92998f3.
08:04:37.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:37.807063 26098 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 26093
08:04:37.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:36.402204 26100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:37.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:37.906795 26101 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1504 milliseconds
08:04:37.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:37.908820 26102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:37.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:37.906491 26093 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.504s	user 0.455s	sys 0.877s
08:04:37.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:37.909821 26093 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.508s	user 0.455s	sys 0.877s
08:04:37.910 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=29 ms, finalizationTime=1 ms).
08:04:37.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:37.910352 26093 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:04:37.911 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
08:04:37.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:37.915865 26093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:04:37.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:37.919168 26093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:04:37.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:37.920701 26093 hybrid_clock.cc:648] HybridClock initialized: now 1779091477920553 us; error 142 us; skew 500 ppm
08:04:37.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:37.921952 26093 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:04:37.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:37.938311 26093 webserver.cc:533] Webserver started at http://127.24.230.195:34175/ using document root <none> and password file <none>
08:04:37.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:37.939950 26093 fs_manager.cc:362] Metadata directory not provided
08:04:37.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:37.940222 26093 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:04:37.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:37.940762 26093 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:04:37.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:37.945308 26093 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-2/data/instance:
08:04:37.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9bda994622fa49ac9fabfbf40edba4ff"
08:04:37.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:37 on dist-test-slave-1jss"
08:04:37.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:37.946523 26093 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-2/wal/instance:
08:04:37.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9bda994622fa49ac9fabfbf40edba4ff"
08:04:37.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:37 on dist-test-slave-1jss"
08:04:37.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:37.954034 26093 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.002s
08:04:37.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:37.960078 26110 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:04:37.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:37.961134 26093 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.003s
08:04:37.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:37.961511 26093 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-2/wal
08:04:37.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9bda994622fa49ac9fabfbf40edba4ff"
08:04:37.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:37 on dist-test-slave-1jss"
08:04:37.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:37.961902 26093 fs_report.cc:389] FS layout report
08:04:37.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:04:37.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-2/wal
08:04:37.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-2/wal
08:04:37.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-2/data/data
08:04:37.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:04:37.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:04:37.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:04:37.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:04:37.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:04:37.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:04:37.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:04:37.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:04:37.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:04:37.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:04:37.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:04:38.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.025441 26093 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:04:38.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.027108 26093 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:04:38.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.027654 26093 kserver.cc:163] Server-wide thread pool size limit: 3276
08:04:38.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.030818 26093 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:04:38.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.035290 26093 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:04:38.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.035550 26093 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:04:38.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.036022 26093 ts_tablet_manager.cc:616] Registered 0 tablets
08:04:38.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.036434 26093 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:04:38.186 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:38.187 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:38.187 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:38.187 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:38.187 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:38.187 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:38.188 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:38.188 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:38.188 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:38.188 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:38.188 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:38.188 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:38.189 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:38.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.194473 26093 rpc_server.cc:307] RPC server started. Bound to: 127.24.230.195:45755
08:04:38.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.194595 26223 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.230.195:45755 every 8 connection(s)
08:04:38.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.197204 26093 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-2/data/info.pb
08:04:38.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.203883 25499 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 26093
08:04:38.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.204457 25499 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster2459837113743527016/ts-2/wal/instance
08:04:38.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.247424 26225 heartbeater.cc:344] Connected to a master server at 127.24.230.253:39511
08:04:38.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.247702 26224 heartbeater.cc:344] Connected to a master server at 127.24.230.252:40255
08:04:38.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.247997 26225 heartbeater.cc:461] Registering TS with master...
08:04:38.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.248360 26224 heartbeater.cc:461] Registering TS with master...
08:04:38.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.249202 26226 heartbeater.cc:344] Connected to a master server at 127.24.230.254:40685
08:04:38.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.249560 26226 heartbeater.cc:461] Registering TS with master...
08:04:38.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.249506 26224 heartbeater.cc:507] Master 127.24.230.252:40255 requested a full tablet report, sending...
08:04:38.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.249538 26225 heartbeater.cc:507] Master 127.24.230.253:39511 requested a full tablet report, sending...
08:04:38.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.250607 26226 heartbeater.cc:507] Master 127.24.230.254:40685 requested a full tablet report, sending...
08:04:38.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.252951 25621 ts_manager.cc:194] Registered new tserver with Master: 9bda994622fa49ac9fabfbf40edba4ff (127.24.230.195:45755)
08:04:38.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.252933 25702 ts_manager.cc:194] Registered new tserver with Master: 9bda994622fa49ac9fabfbf40edba4ff (127.24.230.195:45755)
08:04:38.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.253329 25544 ts_manager.cc:194] Registered new tserver with Master: 9bda994622fa49ac9fabfbf40edba4ff (127.24.230.195:45755)
08:04:38.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.255079 25702 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.24.230.195:53555
08:04:38.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.264838 25499 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
08:04:38.276 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:04:38.276 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

08:04:38.278 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.24.230.254"
      port: 40685
    }
    bound_http_address {
      host: "127.24.230.254"
      port: 36949
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.24.230.253"
      port: 39511
    }
    bound_http_address {
      host: "127.24.230.253"
      port: 36767
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.24.230.252"
      port: 40255
    }
    bound_http_address {
      host: "127.24.230.252"
      port: 41597
    }
  }
}

08:04:38.279 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

08:04:38.282 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.24.230.193"
      port: 33195
    }
    bound_http_address {
      host: "127.24.230.193"
      port: 34543
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.24.230.194"
      port: 36057
    }
    bound_http_address {
      host: "127.24.230.194"
      port: 34783
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.24.230.195"
      port: 45755
    }
    bound_http_address {
      host: "127.24.230.195"
      port: 34175
    }
  }
}

08:04:38.282 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
08:04:38.285 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:04:38.286 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
08:04:38.286 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskk4_r_T/test-tmp
08:04:38.286 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
08:04:38.286 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskk4_r_T/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
08:04:38.289 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

08:04:38.381 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091478380 for job b42812d69c586178cf7556c3c92998f3.
08:04:38.392 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:04:38.393 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
08:04:38.644 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:04:38.644 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

08:04:38.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.647943 26234 mini_oidc.cc:150] Starting JWKS server
08:04:38.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.651257 26234 webserver.cc:533] Webserver started at http://127.0.0.1:39689/ using document root <none> and password file <none>
08:04:38.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.651925 26234 mini_oidc.cc:186] Starting OIDC Discovery server
08:04:38.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.653633 26234 webserver.cc:533] Webserver started at http://127.0.0.1:39065/ using document root <none> and password file <none>
08:04:38.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:04:38Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
08:04:38.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:04:38Z Disabled control of system clock
08:04:38.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:38.721922 26234 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:38.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:38.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-0/wal
08:04:38.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-0/data
08:04:38.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:04:38.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:04:38.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:04:38.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:38.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:38.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:38.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-0/logs
08:04:38.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-0/data/info.pb
08:04:38.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:38.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:04:38.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:04:38.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:04:38.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:04:38.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:38.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:38.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:38.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:04:38.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:04:38.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:04:38.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:04:38.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.158.190:44627
08:04:38.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.158.190
08:04:38.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:38.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.158.148:40175
08:04:38.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:38.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:38.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:04:38.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:04:38.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.25.158.190:44627,127.25.158.189:46677,127.25.158.188:41049
08:04:38.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:04:38.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39689/jwks.json with env {}
08:04:38.882 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091478881 for job b42812d69c586178cf7556c3c92998f3.
08:04:38.895 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
08:04:38.897 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
08:04:39.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:39.060796 26246 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:04:39.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:39.061350 26246 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:04:39.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:39.061861 26246 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:04:39.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:39.098191 26246 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:04:39.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:39.098471 26246 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:04:39.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:39.098753 26246 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:04:39.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:39.099069 26246 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:04:39.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:39.099419 26246 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:04:39.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:39.099642 26246 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:39689/jwks.json
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:39.141465 26246 master_runner.cc:387] Master server non-default flags:
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.158.148:40175
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-0/data
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-0/wal
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.25.158.190:44627,127.25.158.189:46677,127.25.158.188:41049
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.158.190:44627
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39689/jwks.json
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-0/data/info.pb
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.158.190
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-0/logs
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:04:39.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:04:39.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:04:39.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:04:39.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:04:39.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:04:39.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:39.142895 26246 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:04:39.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:39.144505 26246 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:04:39.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:39.156718 26252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:39.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:39.259379 26224 heartbeater.cc:499] Master 127.24.230.252:40255 was elected leader, sending a full tablet report...
08:04:39.382 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091479380 for job b42812d69c586178cf7556c3c92998f3.
08:04:39.419 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=32 ms, finalizationTime=7 ms).
08:04:39.422 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
08:04:39.881 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091479880 for job b42812d69c586178cf7556c3c92998f3.
08:04:39.909 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=28 ms, finalizationTime=1 ms).
08:04:39.911 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
08:04:40.381 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091480380 for job b42812d69c586178cf7556c3c92998f3.
08:04:40.404 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=23 ms, finalizationTime=1 ms).
08:04:40.406 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
08:04:40.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:39.157145 26253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:40.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:40.715117 26246 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.559s	user 0.553s	sys 0.986s
08:04:40.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:40.715647 26246 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.560s	user 0.553s	sys 0.986s
08:04:40.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:40.561920 26251 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 26246
08:04:40.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:40.717960 26255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:40.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:40.721576 26254 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1563 milliseconds
08:04:40.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.721598 26246 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:04:40.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.723254 26246 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:04:40.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.726795 26246 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:04:40.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.728412 26246 hybrid_clock.cc:648] HybridClock initialized: now 1779091480728332 us; error 71 us; skew 500 ppm
08:04:40.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.729588 26246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:04:40.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.740248 26246 webserver.cc:533] Webserver started at http://127.25.158.190:43483/ using document root <none> and password file <none>
08:04:40.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.741467 26246 fs_manager.cc:362] Metadata directory not provided
08:04:40.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.741778 26246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:04:40.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.742336 26246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:04:40.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.748704 26246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-0/data/instance:
08:04:40.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3e75d1b4f2144eed890ed78f0d5cccc0"
08:04:40.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:40 on dist-test-slave-1jss"
08:04:40.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.749790 26246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-0/wal/instance:
08:04:40.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3e75d1b4f2144eed890ed78f0d5cccc0"
08:04:40.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:40 on dist-test-slave-1jss"
08:04:40.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.757272 26246 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.001s
08:04:40.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.763159 26263 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:04:40.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.764575 26246 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
08:04:40.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.764886 26246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-0/wal
08:04:40.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3e75d1b4f2144eed890ed78f0d5cccc0"
08:04:40.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:40 on dist-test-slave-1jss"
08:04:40.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.765190 26246 fs_report.cc:389] FS layout report
08:04:40.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:04:40.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-0/wal
08:04:40.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-0/wal
08:04:40.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-0/data/data
08:04:40.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:04:40.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:04:40.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:04:40.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:04:40.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:04:40.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:04:40.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:04:40.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:04:40.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:04:40.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:04:40.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:04:40.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.836818 26246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:04:40.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.838809 26246 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:04:40.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.839370 26246 kserver.cc:163] Server-wide thread pool size limit: 3276
08:04:40.862 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:40.863 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:40.863 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:40.864 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:40.863 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:40.864 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:40.864 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:40.864 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:40.864 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:40.864 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:40.864 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:40.865 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:40.865 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:40.881 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091480880 for job b42812d69c586178cf7556c3c92998f3.
08:04:40.896 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
08:04:40.897 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
08:04:40.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.924494 26246 rpc_server.cc:307] RPC server started. Bound to: 127.25.158.190:44627
08:04:40.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.924595 26315 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.158.190:44627 every 8 connection(s)
08:04:40.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.927827 26246 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-0/data/info.pb
08:04:40.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.933367 26234 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 26246
08:04:40.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.933864 26234 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-0/wal/instance
08:04:40.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.934719 26316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:40.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.938557 26234 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:40.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:40.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-1/wal
08:04:40.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-1/data
08:04:40.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:04:40.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:04:40.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:04:40.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:40.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:40.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:40.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-1/logs
08:04:40.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-1/data/info.pb
08:04:40.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:40.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:04:40.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:04:40.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:04:40.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:04:40.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:40.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:40.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:40.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:04:40.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:04:40.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:04:40.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:04:40.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.158.189:46677
08:04:40.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.158.189
08:04:40.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:40.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.158.148:40175
08:04:40.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:40.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:40.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:04:40.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:04:40.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.25.158.190:44627,127.25.158.189:46677,127.25.158.188:41049
08:04:40.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:04:40.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39689/jwks.json with env {}
08:04:40.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.948879 26316 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.158.190" port: 44627 } has no permanent_uuid. Determining permanent_uuid...
08:04:40.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:40.983863 26316 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } has no permanent_uuid. Determining permanent_uuid...
08:04:40.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:40.986531 26267 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.158.189:46677: connect: Connection refused (error 111)
08:04:40.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:40.991240 26316 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.158.189:46677: Network error: Client connection negotiation failed: client connection to 127.25.158.189:46677: connect: Connection refused (error 111)
08:04:41.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:41.040863 26316 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } attempt: 1
08:04:41.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:41.045112 26316 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.158.189:46677: Network error: Client connection negotiation failed: client connection to 127.25.158.189:46677: connect: Connection refused (error 111)
08:04:41.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:41.113601 26316 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } attempt: 2
08:04:41.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:41.117858 26316 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.158.189:46677: Network error: Client connection negotiation failed: client connection to 127.25.158.189:46677: connect: Connection refused (error 111)
08:04:41.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:41.209324 26316 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } attempt: 3
08:04:41.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:41.213645 26316 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.158.189:46677: Network error: Client connection negotiation failed: client connection to 127.25.158.189:46677: connect: Connection refused (error 111)
08:04:41.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:41.273213 26318 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:04:41.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:41.273937 26318 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:04:41.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:41.274405 26318 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:04:41.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:41.313668 26318 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:04:41.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:41.313992 26318 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:04:41.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:41.314188 26318 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:04:41.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:41.314383 26318 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:04:41.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:41.314580 26318 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:04:41.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:41.314734 26318 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:39689/jwks.json
08:04:41.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:41.354507 26318 master_runner.cc:387] Master server non-default flags:
08:04:41.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:41.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.158.148:40175
08:04:41.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:41.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:04:41.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-1/data
08:04:41.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-1/wal
08:04:41.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:04:41.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.25.158.190:44627,127.25.158.189:46677,127.25.158.188:41049
08:04:41.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:41.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:04:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.158.189:46677
08:04:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:04:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:04:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:04:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39689/jwks.json
08:04:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-1/data/info.pb
08:04:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.158.189
08:04:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:04:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:04:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:04:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-1/logs
08:04:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:04:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:04:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:04:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:04:41.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:04:41.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:04:41.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:04:41.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:04:41.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:04:41.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:41.356165 26318 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:04:41.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:41.357124 26316 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } attempt: 4
08:04:41.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:41.358352 26318 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:04:41.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:41.361506 26316 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.158.189:46677: Network error: Client connection negotiation failed: client connection to 127.25.158.189:46677: connect: Connection refused (error 111)
08:04:41.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:41.373342 26327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:41.381 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091481380 for job b42812d69c586178cf7556c3c92998f3.
08:04:41.396 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
08:04:41.397 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
08:04:41.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:41.660984 26316 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } attempt: 5
08:04:41.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:41.669597 26316 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.158.189:46677: Network error: Client connection negotiation failed: client connection to 127.25.158.189:46677: connect: Connection refused (error 111)
08:04:41.881 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091481880 for job b42812d69c586178cf7556c3c92998f3.
08:04:41.898 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
08:04:41.900 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
08:04:41.926 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:41.926 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:41.927 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:41.927 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:41.927 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:41.927 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:41.927 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:41.927 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:41.927 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:41.927 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:41.928 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:41.928 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:41.929 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:42.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:42.217098 26316 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } attempt: 6
08:04:42.242 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:42.243 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:42.244 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:42.245 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:42.245 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:42.245 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:42.246 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:42.246 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:42.246 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:42.247 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:42.247 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:42.247 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:42.247 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:42.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:42.257920 26316 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.158.189:46677: Network error: Client connection negotiation failed: client connection to 127.25.158.189:46677: connect: Connection refused (error 111)
08:04:42.381 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091482380 for job b42812d69c586178cf7556c3c92998f3.
08:04:42.401 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=20 ms, finalizationTime=0 ms).
08:04:42.402 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
08:04:42.881 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091482880 for job b42812d69c586178cf7556c3c92998f3.
08:04:42.898 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
08:04:42.900 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
08:04:42.983 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:42.984 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:42.984 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:42.986 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:42.986 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:42.987 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:42.987 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:42.987 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:42.988 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:42.992 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:42.992 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:42.992 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:42.992 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:43.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:42.775352 26326 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 26318
08:04:43.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:41.375516 26328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:43.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.027310 26326 kernel_stack_watchdog.cc:198] Thread 26318 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 400ms:
08:04:43.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:04:43.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:04:43.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:04:43.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:04:43.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.028697 26329 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1654 milliseconds
08:04:43.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.028844 26318 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.656s	user 0.502s	sys 0.896s
08:04:43.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.029210 26318 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.657s	user 0.502s	sys 0.896s
08:04:43.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.030190 26318 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:04:43.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.030287 26330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:43.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.037133 26318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:04:43.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.040189 26318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:04:43.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.041577 26318 hybrid_clock.cc:648] HybridClock initialized: now 1779091483041532 us; error 40 us; skew 500 ppm
08:04:43.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.042541 26318 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:04:43.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.049083 26318 webserver.cc:533] Webserver started at http://127.25.158.189:38549/ using document root <none> and password file <none>
08:04:43.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.050256 26318 fs_manager.cc:362] Metadata directory not provided
08:04:43.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.050506 26318 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:04:43.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.051050 26318 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:04:43.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.055819 26318 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-1/data/instance:
08:04:43.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "346da7f1963c43be85b01e8ff9ad7f22"
08:04:43.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:43 on dist-test-slave-1jss"
08:04:43.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.057157 26318 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-1/wal/instance:
08:04:43.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "346da7f1963c43be85b01e8ff9ad7f22"
08:04:43.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:43 on dist-test-slave-1jss"
08:04:43.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.065125 26318 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.001s
08:04:43.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.071178 26342 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:04:43.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.072335 26318 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
08:04:43.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.072772 26318 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-1/wal
08:04:43.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "346da7f1963c43be85b01e8ff9ad7f22"
08:04:43.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:43 on dist-test-slave-1jss"
08:04:43.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.073145 26318 fs_report.cc:389] FS layout report
08:04:43.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:04:43.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-1/wal
08:04:43.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-1/wal
08:04:43.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-1/data/data
08:04:43.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:04:43.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:04:43.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:04:43.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:04:43.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:04:43.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:04:43.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:04:43.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:04:43.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:04:43.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:04:43.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:04:43.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.133530 26318 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:04:43.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.135298 26318 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:04:43.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.135828 26318 kserver.cc:163] Server-wide thread pool size limit: 3276
08:04:43.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.215920 26318 rpc_server.cc:307] RPC server started. Bound to: 127.25.158.189:46677
08:04:43.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.216060 26393 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.158.189:46677 every 8 connection(s)
08:04:43.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.218971 26318 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-1/data/info.pb
08:04:43.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.224794 26234 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 26318
08:04:43.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.225234 26234 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-1/wal/instance
08:04:43.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.225399 26394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:43.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.227468 26234 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:43.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:43.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-2/wal
08:04:43.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-2/data
08:04:43.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:04:43.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:04:43.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:04:43.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:43.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:43.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:43.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-2/logs
08:04:43.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-2/data/info.pb
08:04:43.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:43.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:04:43.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:04:43.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:04:43.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:04:43.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:43.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:43.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:43.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:04:43.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:04:43.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:04:43.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:04:43.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.158.188:41049
08:04:43.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.158.188
08:04:43.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:43.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.158.148:40175
08:04:43.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:43.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:43.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:04:43.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:04:43.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.25.158.190:44627,127.25.158.189:46677,127.25.158.188:41049
08:04:43.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:04:43.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39689/jwks.json with env {}
08:04:43.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.242478 26394 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.158.190" port: 44627 } has no permanent_uuid. Determining permanent_uuid...
08:04:43.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.267715 26394 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } has no permanent_uuid. Determining permanent_uuid...
08:04:43.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.282932 26394 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } has no permanent_uuid. Determining permanent_uuid...
08:04:43.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.285172 26345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.158.188:41049: connect: Connection refused (error 111)
08:04:43.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.289821 26394 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.158.188:41049: Network error: Client connection negotiation failed: client connection to 127.25.158.188:41049: connect: Connection refused (error 111)
08:04:43.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.318481 26316 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } attempt: 7
08:04:43.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.330189 26316 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } has no permanent_uuid. Determining permanent_uuid...
08:04:43.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.336822 26316 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.158.188:41049: Network error: Client connection negotiation failed: client connection to 127.25.158.188:41049: connect: Connection refused (error 111)
08:04:43.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.339334 26394 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } attempt: 1
08:04:43.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.344983 26394 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.158.188:41049: Network error: Client connection negotiation failed: client connection to 127.25.158.188:41049: connect: Connection refused (error 111)
08:04:43.381 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091483380 for job b42812d69c586178cf7556c3c92998f3.
08:04:43.390 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
08:04:43.391 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
08:04:43.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.395259 26316 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } attempt: 1
08:04:43.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.399672 26316 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.158.188:41049: Network error: Client connection negotiation failed: client connection to 127.25.158.188:41049: connect: Connection refused (error 111)
08:04:43.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.413607 26394 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } attempt: 2
08:04:43.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.417665 26394 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.158.188:41049: Network error: Client connection negotiation failed: client connection to 127.25.158.188:41049: connect: Connection refused (error 111)
08:04:43.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.481150 26316 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } attempt: 2
08:04:43.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.485914 26316 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.158.188:41049: Network error: Client connection negotiation failed: client connection to 127.25.158.188:41049: connect: Connection refused (error 111)
08:04:43.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.509183 26394 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } attempt: 3
08:04:43.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.513672 26394 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.158.188:41049: Network error: Client connection negotiation failed: client connection to 127.25.158.188:41049: connect: Connection refused (error 111)
08:04:43.546 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:43.547 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:43.547 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:43.547 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:43.547 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:43.548 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:43.548 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:43.548 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:43.548 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:43.548 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:43.548 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:43.548 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:43.549 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:43.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.571319 26316 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } attempt: 3
08:04:43.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.575914 26316 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.158.188:41049: Network error: Client connection negotiation failed: client connection to 127.25.158.188:41049: connect: Connection refused (error 111)
08:04:43.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.586297 26397 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:04:43.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.586834 26397 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:04:43.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.587366 26397 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:04:43.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.621671 26397 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:04:43.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.622056 26397 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:04:43.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.622273 26397 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:04:43.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.622468 26397 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:04:43.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.622664 26397 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:04:43.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.622831 26397 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:39689/jwks.json
08:04:43.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.657194 26394 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } attempt: 4
08:04:43.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.661520 26394 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.158.188:41049: Network error: Client connection negotiation failed: client connection to 127.25.158.188:41049: connect: Connection refused (error 111)
08:04:43.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.665009 26397 master_runner.cc:387] Master server non-default flags:
08:04:43.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:43.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.158.148:40175
08:04:43.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:43.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-2/data
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-2/wal
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.25.158.190:44627,127.25.158.189:46677,127.25.158.188:41049
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.158.188:41049
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39689/jwks.json
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-2/data/info.pb
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.158.188
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-2/logs
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:04:43.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.666520 26397 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:04:43.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.668119 26397 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:04:43.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.679585 26410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:43.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.717859 26316 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } attempt: 4
08:04:43.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.725950 26316 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.158.188:41049: Network error: Client connection negotiation failed: client connection to 127.25.158.188:41049: connect: Connection refused (error 111)
08:04:43.883 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091483882 for job b42812d69c586178cf7556c3c92998f3.
08:04:43.900 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
08:04:43.902 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
08:04:43.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:43.961011 26394 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } attempt: 5
08:04:43.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.968779 26394 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.158.188:41049: Network error: Client connection negotiation failed: client connection to 127.25.158.188:41049: connect: Connection refused (error 111)
08:04:44.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:44.009518 26316 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } attempt: 5
08:04:44.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:44.017360 26316 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.158.188:41049: Network error: Client connection negotiation failed: client connection to 127.25.158.188:41049: connect: Connection refused (error 111)
08:04:44.135 [DEBUG - pool-12-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30002), Traces: [0ms] sending RPC to server master-127.23.12.252:42637, [9ms] received response from server master-127.23.12.252:42637: OK, deferred=null) with no deferred attached!
08:04:44.382 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091484380 for job b42812d69c586178cf7556c3c92998f3.
08:04:44.397 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
08:04:44.399 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
08:04:44.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:44.516306 26394 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } attempt: 6
08:04:44.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:44.550575 26394 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.158.188:41049: Network error: Client connection negotiation failed: client connection to 127.25.158.188:41049: connect: Connection refused (error 111)
08:04:44.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:44.569989 26316 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } attempt: 6
08:04:44.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:44.600703 26316 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.25.158.188:41049: Network error: Client connection negotiation failed: client connection to 127.25.158.188:41049: connect: Connection refused (error 111)
08:04:44.881 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091484880 for job b42812d69c586178cf7556c3c92998f3.
08:04:44.901 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=20 ms, finalizationTime=0 ms).
08:04:44.903 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
08:04:45.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:45.083410 26409 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 26397
08:04:45.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:45.294173 26397 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.614s	user 0.469s	sys 0.996s
08:04:45.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:45.296277 26397 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.617s	user 0.469s	sys 0.996s
08:04:45.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:43.681002 26411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:45.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:45.296716 26412 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1614 milliseconds
08:04:45.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:45.297196 26413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:45.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.297163 26397 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:04:45.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.302763 26397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:04:45.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.305729 26397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:04:45.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.307199 26397 hybrid_clock.cc:648] HybridClock initialized: now 1779091485307085 us; error 110 us; skew 500 ppm
08:04:45.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.308018 26397 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:04:45.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.314996 26397 webserver.cc:533] Webserver started at http://127.25.158.188:39989/ using document root <none> and password file <none>
08:04:45.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.315966 26397 fs_manager.cc:362] Metadata directory not provided
08:04:45.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.316160 26397 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:04:45.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.316543 26397 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:04:45.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.321938 26397 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-2/data/instance:
08:04:45.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "46514e14ceff4344a18ad2a63fde27cf"
08:04:45.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:45 on dist-test-slave-1jss"
08:04:45.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.323565 26397 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-2/wal/instance:
08:04:45.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "46514e14ceff4344a18ad2a63fde27cf"
08:04:45.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:45 on dist-test-slave-1jss"
08:04:45.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.332069 26397 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.000s	sys 0.008s
08:04:45.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.339363 26425 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:04:45.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.340741 26397 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.003s
08:04:45.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.341058 26397 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-2/wal
08:04:45.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "46514e14ceff4344a18ad2a63fde27cf"
08:04:45.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:45 on dist-test-slave-1jss"
08:04:45.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.341363 26397 fs_report.cc:389] FS layout report
08:04:45.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:04:45.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-2/wal
08:04:45.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-2/wal
08:04:45.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-2/data/data
08:04:45.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:04:45.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:04:45.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:04:45.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:04:45.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:04:45.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:04:45.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:04:45.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:04:45.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:04:45.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:04:45.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:04:45.362 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:45.363 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:45.363 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:45.363 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:45.363 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:45.363 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:45.364 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:45.364 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:45.365 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:45.365 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:45.365 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:45.365 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:45.366 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:45.381 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091485380 for job b42812d69c586178cf7556c3c92998f3.
08:04:45.391 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:04:45.392 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
08:04:45.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.404930 26397 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:04:45.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.406505 26397 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:04:45.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.406926 26397 kserver.cc:163] Server-wide thread pool size limit: 3276
08:04:45.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.482771 26397 rpc_server.cc:307] RPC server started. Bound to: 127.25.158.188:41049
08:04:45.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.482970 26476 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.158.188:41049 every 8 connection(s)
08:04:45.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.485435 26397 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-2/data/info.pb
08:04:45.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.492182 26477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:45.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.492481 26234 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 26397
08:04:45.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.492988 26234 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/master-2/wal/instance
08:04:45.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.512987 26477 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.158.190" port: 44627 } has no permanent_uuid. Determining permanent_uuid...
08:04:45.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.553486 26477 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } has no permanent_uuid. Determining permanent_uuid...
08:04:45.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.570067 26477 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } has no permanent_uuid. Determining permanent_uuid...
08:04:45.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.586987 26477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf: Bootstrap starting.
08:04:45.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.594486 26477 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf: Neither blocks nor log segments found. Creating new log.
08:04:45.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.596333 26477 log.cc:826] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf: Log is configured to *not* fsync() on all Append() calls
08:04:45.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.602144 26477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf: No bootstrap required, opened a new log
08:04:45.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.611279 26394 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } attempt: 7
08:04:45.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.625551 26477 raft_consensus.cc:359] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e75d1b4f2144eed890ed78f0d5cccc0" member_type: VOTER last_known_addr { host: "127.25.158.190" port: 44627 } } peers { permanent_uuid: "346da7f1963c43be85b01e8ff9ad7f22" member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } } peers { permanent_uuid: "46514e14ceff4344a18ad2a63fde27cf" member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } }
08:04:45.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.626513 26477 raft_consensus.cc:385] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:45.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.626827 26477 raft_consensus.cc:740] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46514e14ceff4344a18ad2a63fde27cf, State: Initialized, Role: FOLLOWER
08:04:45.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.627816 26477 consensus_queue.cc:260] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e75d1b4f2144eed890ed78f0d5cccc0" member_type: VOTER last_known_addr { host: "127.25.158.190" port: 44627 } } peers { permanent_uuid: "346da7f1963c43be85b01e8ff9ad7f22" member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } } peers { permanent_uuid: "46514e14ceff4344a18ad2a63fde27cf" member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } }
08:04:45.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.630712 26488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e75d1b4f2144eed890ed78f0d5cccc0" member_type: VOTER last_known_addr { host: "127.25.158.190" port: 44627 } } peers { permanent_uuid: "346da7f1963c43be85b01e8ff9ad7f22" member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } } peers { permanent_uuid: "46514e14ceff4344a18ad2a63fde27cf" member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } } }
08:04:45.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.631366 26488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [sys.catalog]: This master's current role is: FOLLOWER
08:04:45.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.632763 26477 sys_catalog.cc:565] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [sys.catalog]: configured and running, proceeding with master startup.
08:04:45.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.633857 26394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 346da7f1963c43be85b01e8ff9ad7f22: Bootstrap starting.
08:04:45.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.634320 26316 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } attempt: 7
08:04:45.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.647225 26394 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 346da7f1963c43be85b01e8ff9ad7f22: Neither blocks nor log segments found. Creating new log.
08:04:45.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.649775 26394 log.cc:826] T 00000000000000000000000000000000 P 346da7f1963c43be85b01e8ff9ad7f22: Log is configured to *not* fsync() on all Append() calls
08:04:45.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.658555 26394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 346da7f1963c43be85b01e8ff9ad7f22: No bootstrap required, opened a new log
08:04:45.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:45.662938 26431 tablet.cc:2404] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:04:45.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.664703 26316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e75d1b4f2144eed890ed78f0d5cccc0: Bootstrap starting.
08:04:45.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.674834 26316 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e75d1b4f2144eed890ed78f0d5cccc0: Neither blocks nor log segments found. Creating new log.
08:04:45.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.678246 26316 log.cc:826] T 00000000000000000000000000000000 P 3e75d1b4f2144eed890ed78f0d5cccc0: Log is configured to *not* fsync() on all Append() calls
08:04:45.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:45.683368 26501 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:04:45.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:45.683739 26501 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:04:45.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.665408 26397 master_runner.cc:187] Error getting master registration for 127.25.158.190:44627: OK, instance_id { permanent_uuid: "3e75d1b4f2144eed890ed78f0d5cccc0" instance_seqno: 1779091480902705 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:04:45.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.693512 26397 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:04:45.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.693849 26316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e75d1b4f2144eed890ed78f0d5cccc0: No bootstrap required, opened a new log
08:04:45.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.713297 26394 raft_consensus.cc:359] T 00000000000000000000000000000000 P 346da7f1963c43be85b01e8ff9ad7f22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e75d1b4f2144eed890ed78f0d5cccc0" member_type: VOTER last_known_addr { host: "127.25.158.190" port: 44627 } } peers { permanent_uuid: "346da7f1963c43be85b01e8ff9ad7f22" member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } } peers { permanent_uuid: "46514e14ceff4344a18ad2a63fde27cf" member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } }
08:04:45.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.714308 26394 raft_consensus.cc:385] T 00000000000000000000000000000000 P 346da7f1963c43be85b01e8ff9ad7f22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:45.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.714635 26394 raft_consensus.cc:740] T 00000000000000000000000000000000 P 346da7f1963c43be85b01e8ff9ad7f22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346da7f1963c43be85b01e8ff9ad7f22, State: Initialized, Role: FOLLOWER
08:04:45.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.715479 26394 consensus_queue.cc:260] T 00000000000000000000000000000000 P 346da7f1963c43be85b01e8ff9ad7f22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e75d1b4f2144eed890ed78f0d5cccc0" member_type: VOTER last_known_addr { host: "127.25.158.190" port: 44627 } } peers { permanent_uuid: "346da7f1963c43be85b01e8ff9ad7f22" member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } } peers { permanent_uuid: "46514e14ceff4344a18ad2a63fde27cf" member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } }
08:04:45.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.724578 26316 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3e75d1b4f2144eed890ed78f0d5cccc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e75d1b4f2144eed890ed78f0d5cccc0" member_type: VOTER last_known_addr { host: "127.25.158.190" port: 44627 } } peers { permanent_uuid: "346da7f1963c43be85b01e8ff9ad7f22" member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } } peers { permanent_uuid: "46514e14ceff4344a18ad2a63fde27cf" member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } }
08:04:45.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.725827 26316 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3e75d1b4f2144eed890ed78f0d5cccc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:45.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.726261 26316 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3e75d1b4f2144eed890ed78f0d5cccc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e75d1b4f2144eed890ed78f0d5cccc0, State: Initialized, Role: FOLLOWER
08:04:45.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.727361 26316 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e75d1b4f2144eed890ed78f0d5cccc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e75d1b4f2144eed890ed78f0d5cccc0" member_type: VOTER last_known_addr { host: "127.25.158.190" port: 44627 } } peers { permanent_uuid: "346da7f1963c43be85b01e8ff9ad7f22" member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } } peers { permanent_uuid: "46514e14ceff4344a18ad2a63fde27cf" member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } }
08:04:45.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.737053 26505 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e75d1b4f2144eed890ed78f0d5cccc0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e75d1b4f2144eed890ed78f0d5cccc0" member_type: VOTER last_known_addr { host: "127.25.158.190" port: 44627 } } peers { permanent_uuid: "346da7f1963c43be85b01e8ff9ad7f22" member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } } peers { permanent_uuid: "46514e14ceff4344a18ad2a63fde27cf" member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } } }
08:04:45.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.741235 26505 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e75d1b4f2144eed890ed78f0d5cccc0 [sys.catalog]: This master's current role is: FOLLOWER
08:04:45.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.740880 26316 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3e75d1b4f2144eed890ed78f0d5cccc0 [sys.catalog]: configured and running, proceeding with master startup.
08:04:45.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.755613 26504 sys_catalog.cc:455] T 00000000000000000000000000000000 P 346da7f1963c43be85b01e8ff9ad7f22 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e75d1b4f2144eed890ed78f0d5cccc0" member_type: VOTER last_known_addr { host: "127.25.158.190" port: 44627 } } peers { permanent_uuid: "346da7f1963c43be85b01e8ff9ad7f22" member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } } peers { permanent_uuid: "46514e14ceff4344a18ad2a63fde27cf" member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } } }
08:04:45.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.756975 26504 sys_catalog.cc:458] T 00000000000000000000000000000000 P 346da7f1963c43be85b01e8ff9ad7f22 [sys.catalog]: This master's current role is: FOLLOWER
08:04:45.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.757298 26394 sys_catalog.cc:565] T 00000000000000000000000000000000 P 346da7f1963c43be85b01e8ff9ad7f22 [sys.catalog]: configured and running, proceeding with master startup.
08:04:45.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:45.818635 26521 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 3e75d1b4f2144eed890ed78f0d5cccc0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:04:45.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:45.819404 26521 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:04:45.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.844453 26529 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
08:04:45.848 [DEBUG - pool-16-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30004), Traces: [0ms] sending RPC to server master-127.23.194.125:38689, [8ms] received response from server master-127.23.194.125:38689: OK, deferred=null) with no deferred attached!
08:04:45.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:45.851888 26269 tablet.cc:2404] T 00000000000000000000000000000000 P 3e75d1b4f2144eed890ed78f0d5cccc0: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:04:45.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.812211 26246 master_runner.cc:187] Error getting master registration for 127.25.158.189:46677: OK, instance_id { permanent_uuid: "346da7f1963c43be85b01e8ff9ad7f22" instance_seqno: 1779091483193736 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:04:45.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.862340 26246 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:04:45.866 [DEBUG - pool-14-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30019), Traces: [0ms] sending RPC to server master-127.23.194.125:38689, [13ms] received response from server master-127.23.194.125:38689: OK, deferred=null) with no deferred attached!
08:04:45.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.867347 26318 master_runner.cc:264] No leader master found from master 346da7f1963c43be85b01e8ff9ad7f22
08:04:45.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.867919 26318 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:04:45.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.875304 26488 raft_consensus.cc:493] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:04:45.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.875885 26488 raft_consensus.cc:515] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e75d1b4f2144eed890ed78f0d5cccc0" member_type: VOTER last_known_addr { host: "127.25.158.190" port: 44627 } } peers { permanent_uuid: "346da7f1963c43be85b01e8ff9ad7f22" member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } } peers { permanent_uuid: "46514e14ceff4344a18ad2a63fde27cf" member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } }
08:04:45.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.878445 26488 leader_election.cc:290] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e75d1b4f2144eed890ed78f0d5cccc0 (127.25.158.190:44627), 346da7f1963c43be85b01e8ff9ad7f22 (127.25.158.189:46677)
08:04:45.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.879850 26369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "46514e14ceff4344a18ad2a63fde27cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346da7f1963c43be85b01e8ff9ad7f22" is_pre_election: true
08:04:45.881 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091485880 for job b42812d69c586178cf7556c3c92998f3.
08:04:45.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.880755 26369 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 346da7f1963c43be85b01e8ff9ad7f22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46514e14ceff4344a18ad2a63fde27cf in term 0.
08:04:45.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.882311 26429 leader_election.cc:304] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346da7f1963c43be85b01e8ff9ad7f22, 46514e14ceff4344a18ad2a63fde27cf; no voters: 
08:04:45.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.882386 26288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "46514e14ceff4344a18ad2a63fde27cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e75d1b4f2144eed890ed78f0d5cccc0" is_pre_election: true
08:04:45.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.883214 26288 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3e75d1b4f2144eed890ed78f0d5cccc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46514e14ceff4344a18ad2a63fde27cf in term 0.
08:04:45.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.883692 26488 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [term 0 FOLLOWER]: Leader pre-election won for term 1
08:04:45.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.884035 26488 raft_consensus.cc:493] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:04:45.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.884342 26488 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [term 0 FOLLOWER]: Advancing to term 1
08:04:45.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.891422 26488 raft_consensus.cc:515] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e75d1b4f2144eed890ed78f0d5cccc0" member_type: VOTER last_known_addr { host: "127.25.158.190" port: 44627 } } peers { permanent_uuid: "346da7f1963c43be85b01e8ff9ad7f22" member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } } peers { permanent_uuid: "46514e14ceff4344a18ad2a63fde27cf" member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } }
08:04:45.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.893740 26488 leader_election.cc:290] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [CANDIDATE]: Term 1 election: Requested vote from peers 3e75d1b4f2144eed890ed78f0d5cccc0 (127.25.158.190:44627), 346da7f1963c43be85b01e8ff9ad7f22 (127.25.158.189:46677)
08:04:45.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.894865 26369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "46514e14ceff4344a18ad2a63fde27cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346da7f1963c43be85b01e8ff9ad7f22"
08:04:45.896 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
08:04:45.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.895718 26369 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 346da7f1963c43be85b01e8ff9ad7f22 [term 0 FOLLOWER]: Advancing to term 1
08:04:45.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.896142 26288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "46514e14ceff4344a18ad2a63fde27cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e75d1b4f2144eed890ed78f0d5cccc0"
08:04:45.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:45.896546 26348 tablet.cc:2404] T 00000000000000000000000000000000 P 346da7f1963c43be85b01e8ff9ad7f22: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:04:45.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.896694 26288 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3e75d1b4f2144eed890ed78f0d5cccc0 [term 0 FOLLOWER]: Advancing to term 1
08:04:45.900 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
08:04:45.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.906417 26288 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3e75d1b4f2144eed890ed78f0d5cccc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46514e14ceff4344a18ad2a63fde27cf in term 1.
08:04:45.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.909833 26369 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 346da7f1963c43be85b01e8ff9ad7f22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46514e14ceff4344a18ad2a63fde27cf in term 1.
08:04:45.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.915849 26428 leader_election.cc:304] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e75d1b4f2144eed890ed78f0d5cccc0, 46514e14ceff4344a18ad2a63fde27cf; no voters: 
08:04:45.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.917274 26488 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [term 1 FOLLOWER]: Leader election won for term 1
08:04:45.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.923291 26488 raft_consensus.cc:697] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [term 1 LEADER]: Becoming Leader. State: Replica: 46514e14ceff4344a18ad2a63fde27cf, State: Running, Role: LEADER
08:04:45.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.924392 26488 consensus_queue.cc:237] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e75d1b4f2144eed890ed78f0d5cccc0" member_type: VOTER last_known_addr { host: "127.25.158.190" port: 44627 } } peers { permanent_uuid: "346da7f1963c43be85b01e8ff9ad7f22" member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } } peers { permanent_uuid: "46514e14ceff4344a18ad2a63fde27cf" member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } }
08:04:45.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.937057 26530 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 46514e14ceff4344a18ad2a63fde27cf. Latest consensus state: current_term: 1 leader_uuid: "46514e14ceff4344a18ad2a63fde27cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e75d1b4f2144eed890ed78f0d5cccc0" member_type: VOTER last_known_addr { host: "127.25.158.190" port: 44627 } } peers { permanent_uuid: "346da7f1963c43be85b01e8ff9ad7f22" member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } } peers { permanent_uuid: "46514e14ceff4344a18ad2a63fde27cf" member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } } }
08:04:45.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.942396 26530 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [sys.catalog]: This master's current role is: LEADER
08:04:45.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.949414 26532 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
08:04:45.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.957515 26532 catalog_manager.cc:1519] Initializing Kudu cluster ID...
08:04:45.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.981453 26369 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 346da7f1963c43be85b01e8ff9ad7f22 [term 1 FOLLOWER]: Refusing update from remote peer 46514e14ceff4344a18ad2a63fde27cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:04:45.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.983748 26530 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "346da7f1963c43be85b01e8ff9ad7f22" member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:04:45.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.996169 26288 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 3e75d1b4f2144eed890ed78f0d5cccc0 [term 1 FOLLOWER]: Refusing update from remote peer 46514e14ceff4344a18ad2a63fde27cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:04:45.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:45.998395 26488 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e75d1b4f2144eed890ed78f0d5cccc0" member_type: VOTER last_known_addr { host: "127.25.158.190" port: 44627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:04:46.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.020293 26504 sys_catalog.cc:455] T 00000000000000000000000000000000 P 346da7f1963c43be85b01e8ff9ad7f22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 46514e14ceff4344a18ad2a63fde27cf. Latest consensus state: current_term: 1 leader_uuid: "46514e14ceff4344a18ad2a63fde27cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e75d1b4f2144eed890ed78f0d5cccc0" member_type: VOTER last_known_addr { host: "127.25.158.190" port: 44627 } } peers { permanent_uuid: "346da7f1963c43be85b01e8ff9ad7f22" member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } } peers { permanent_uuid: "46514e14ceff4344a18ad2a63fde27cf" member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } } }
08:04:46.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.022028 26504 sys_catalog.cc:458] T 00000000000000000000000000000000 P 346da7f1963c43be85b01e8ff9ad7f22 [sys.catalog]: This master's current role is: FOLLOWER
08:04:46.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.038479 26530 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "46514e14ceff4344a18ad2a63fde27cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e75d1b4f2144eed890ed78f0d5cccc0" member_type: VOTER last_known_addr { host: "127.25.158.190" port: 44627 } } peers { permanent_uuid: "346da7f1963c43be85b01e8ff9ad7f22" member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } } peers { permanent_uuid: "46514e14ceff4344a18ad2a63fde27cf" member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } } }
08:04:46.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.039510 26530 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [sys.catalog]: This master's current role is: LEADER
08:04:46.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.056571 26532 catalog_manager.cc:1382] Generated new cluster ID: e40cb77f06564e508b647295a6d4d33b
08:04:46.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.056919 26532 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
08:04:46.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.060521 26505 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e75d1b4f2144eed890ed78f0d5cccc0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 46514e14ceff4344a18ad2a63fde27cf. Latest consensus state: current_term: 1 leader_uuid: "46514e14ceff4344a18ad2a63fde27cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e75d1b4f2144eed890ed78f0d5cccc0" member_type: VOTER last_known_addr { host: "127.25.158.190" port: 44627 } } peers { permanent_uuid: "346da7f1963c43be85b01e8ff9ad7f22" member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } } peers { permanent_uuid: "46514e14ceff4344a18ad2a63fde27cf" member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } } }
08:04:46.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.061249 26505 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e75d1b4f2144eed890ed78f0d5cccc0 [sys.catalog]: This master's current role is: FOLLOWER
08:04:46.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.065449 26504 sys_catalog.cc:455] T 00000000000000000000000000000000 P 346da7f1963c43be85b01e8ff9ad7f22 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "46514e14ceff4344a18ad2a63fde27cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e75d1b4f2144eed890ed78f0d5cccc0" member_type: VOTER last_known_addr { host: "127.25.158.190" port: 44627 } } peers { permanent_uuid: "346da7f1963c43be85b01e8ff9ad7f22" member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } } peers { permanent_uuid: "46514e14ceff4344a18ad2a63fde27cf" member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } } }
08:04:46.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.066167 26504 sys_catalog.cc:458] T 00000000000000000000000000000000 P 346da7f1963c43be85b01e8ff9ad7f22 [sys.catalog]: This master's current role is: FOLLOWER
08:04:46.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.072764 26488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "46514e14ceff4344a18ad2a63fde27cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e75d1b4f2144eed890ed78f0d5cccc0" member_type: VOTER last_known_addr { host: "127.25.158.190" port: 44627 } } peers { permanent_uuid: "346da7f1963c43be85b01e8ff9ad7f22" member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } } peers { permanent_uuid: "46514e14ceff4344a18ad2a63fde27cf" member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } } }
08:04:46.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.074843 26488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf [sys.catalog]: This master's current role is: LEADER
08:04:46.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.088052 26505 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e75d1b4f2144eed890ed78f0d5cccc0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "46514e14ceff4344a18ad2a63fde27cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e75d1b4f2144eed890ed78f0d5cccc0" member_type: VOTER last_known_addr { host: "127.25.158.190" port: 44627 } } peers { permanent_uuid: "346da7f1963c43be85b01e8ff9ad7f22" member_type: VOTER last_known_addr { host: "127.25.158.189" port: 46677 } } peers { permanent_uuid: "46514e14ceff4344a18ad2a63fde27cf" member_type: VOTER last_known_addr { host: "127.25.158.188" port: 41049 } } }
08:04:46.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.088783 26505 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e75d1b4f2144eed890ed78f0d5cccc0 [sys.catalog]: This master's current role is: FOLLOWER
08:04:46.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.109961 26532 catalog_manager.cc:1405] Generated new certificate authority record
08:04:46.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.112346 26532 catalog_manager.cc:1539] Loading token signing keys...
08:04:46.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.137126 26532 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 46514e14ceff4344a18ad2a63fde27cf: Generated new TSK 0
08:04:46.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.138650 26532 catalog_manager.cc:1549] Initializing in-progress tserver states...
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.175608 26234 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-0/wal
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-0/data
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-0/logs
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-0/data/info.pb
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.158.129:0
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.25.158.129
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.158.129
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.25.158.190:44627,127.25.158.189:46677,127.25.158.188:41049
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.158.148:40175
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:46.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:04:46.381 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091486380 for job b42812d69c586178cf7556c3c92998f3.
08:04:46.403 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=23 ms, finalizationTime=0 ms).
08:04:46.405 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
08:04:46.545 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:46.546 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:46.547 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:46.550 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:46.550 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:46.551 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:46.551 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:46.551 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:46.552 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:46.552 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:46.552 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:46.552 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:46.552 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:46.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:46.786350 26543 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:04:46.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:46.787649 26543 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:04:46.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:46.788400 26543 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:04:46.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.825392 26521 catalog_manager.cc:1294] Loaded cluster ID: e40cb77f06564e508b647295a6d4d33b
08:04:46.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.825685 26521 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 3e75d1b4f2144eed890ed78f0d5cccc0: loading cluster ID for follower catalog manager: success
08:04:46.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.835819 26521 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 3e75d1b4f2144eed890ed78f0d5cccc0: acquiring CA information for follower catalog manager: success
08:04:46.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.841676 26521 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 3e75d1b4f2144eed890ed78f0d5cccc0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:04:46.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.862128 26529 catalog_manager.cc:1294] Loaded cluster ID: e40cb77f06564e508b647295a6d4d33b
08:04:46.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.862393 26529 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 346da7f1963c43be85b01e8ff9ad7f22: loading cluster ID for follower catalog manager: success
08:04:46.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:46.874467 26543 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:04:46.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:46.876065 26543 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.158.129
08:04:46.880 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091486880 for job b42812d69c586178cf7556c3c92998f3.
08:04:46.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.869580 26529 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 346da7f1963c43be85b01e8ff9ad7f22: acquiring CA information for follower catalog manager: success
08:04:46.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.887612 26529 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 346da7f1963c43be85b01e8ff9ad7f22: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:04:46.900 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
08:04:46.903 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
08:04:46.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.949070 26543 tablet_server_runner.cc:78] Tablet server non-default flags:
08:04:46.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:46.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.158.148:40175
08:04:46.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:46.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:04:46.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-0/data
08:04:46.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-0/wal
08:04:46.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.158.129:0
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-0/data/info.pb
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.158.129
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.25.158.190:44627,127.25.158.189:46677,127.25.158.188:41049
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.25.158.129
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-0/logs
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:04:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:04:46.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.952379 26543 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:04:46.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:46.954984 26543 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:04:46.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:46.989650 26553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:47.381 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091487380 for job b42812d69c586178cf7556c3c92998f3.
08:04:47.403 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job b42812d69c586178cf7556c3c92998f3 (2264 bytes, checkpointDuration=22 ms, finalizationTime=1 ms).
08:04:47.405 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
08:04:47.426 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:47.426 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:47.427 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:47.428 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:47.428 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:47.428 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:47.429 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:47.429 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:47.429 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:47.430 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:47.430 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:47.430 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:47.430 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:47.431 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=22, TimeoutTracker(timeout=29938, elapsed=27285), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [7ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [8ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [32ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x7a650031, L:/127.0.0.1:35118 - R:/127.23.12.252:42637], [36ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x7a650031, L:/127.0.0.1:35118 - R:/127.23.12.252:42637], [39ms] refreshing cache from master, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [43ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [45ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [45ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [45ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [58ms] refreshing cache from master, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [60ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [62ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [64ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [64ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [85ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [85ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [106ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [106ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [106ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [107ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [107ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [139ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [141ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [144ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [145ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [199ms] refreshing cache from master, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [201ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [202ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [202ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [203ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [239ms] refreshing cache from master, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [242ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [243ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [244ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [244ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [399ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [402ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [403ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [403ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [404ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [405ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [919ms] refreshing cache from master, [919ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [921ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [921ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [921ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [922ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1559ms] refreshing cache from master, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1563ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [3459ms] refreshing cache from master, [3460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [3464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [3465ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [3465ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [3471ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [3471ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [6299ms] refreshing cache from master, [6299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [6300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [6300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [6301ms] too many traces: truncated at 100 traces, deferred=Deferred@1088355108(state=PENDING, result=null, callback=(continuation of Deferred@508383247 after retry RPC after error@945120307) -> (continuation of Deferred@17037323 after retry RPC after error@909321428) -> (continuation of Deferred@1108002613 after retry RPC after error@1366120379) -> (continuation of Deferred@1336946237 after retry RPC after error@1611310747) -> (continuation of Deferred@1957557952 after retry RPC after error@1338423137) -> (continuation of Deferred@21608802 after retry RPC after error@876804526) -> (continuation of Deferred@801247760 after retry RPC after error@1439024438) -> (continuation of Deferred@420213829 after retry RPC after error@984080707) -> (continuation of Deferred@88749717 after retry RPC after error@2120068991) -> (continuation of Deferred@942851373 after retry RPC after error@1025152657) -> (continuation of Deferred@1773199673 after retry RPC after error@2055572775) -> (continuation of Deferred@1412441335 after retry RPC after error@1039638270) -> (continuation of Deferred@1394608464 after retry RPC after error@85613222) -> (continuation of Deferred@1356382574 after retry RPC after error@1364829669) -> (continuation of Deferred@39869463 after retry RPC after error@1442376087) -> (continuation of Deferred@1136497143 after retry RPC after error@1607951080) -> (continuation of Deferred@1607929313 after retry RPC after error@1299313629) -> (continuation of Deferred@1659695533 after retry RPC after error@113778490) -> (continuation of Deferred@1628942855 after retry RPC after error@599415523) -> (continuation of Deferred@652129952 after retry RPC after error@1613323406) -> (continuation of Deferred@1022516486 after retry RPC after error@1307473209), errback=(continuation of Deferred@508383247 after retry RPC after error@945120307) -> (continuation of Deferred@17037323 after retry RPC after error@909321428) -> (continuation of Deferred@1108002613 after retry RPC after error@1366120379) -> (continuation of Deferred@1336946237 after retry RPC after error@1611310747) -> (continuation of Deferred@1957557952 after retry RPC after error@1338423137) -> (continuation of Deferred@21608802 after retry RPC after error@876804526) -> (continuation of Deferred@801247760 after retry RPC after error@1439024438) -> (continuation of Deferred@420213829 after retry RPC after error@984080707) -> (continuation of Deferred@88749717 after retry RPC after error@2120068991) -> (continuation of Deferred@942851373 after retry RPC after error@1025152657) -> (continuation of Deferred@1773199673 after retry RPC after error@2055572775) -> (continuation of Deferred@1412441335 after retry RPC after error@1039638270) -> (continuation of Deferred@1394608464 after retry RPC after error@85613222) -> (continuation of Deferred@1356382574 after retry RPC after error@1364829669) -> (continuation of Deferred@39869463 after retry RPC after error@1442376087) -> (continuation of Deferred@1136497143 after retry RPC after error@1607951080) -> (continuation of Deferred@1607929313 after retry RPC after error@1299313629) -> (continuation of Deferred@1659695533 after retry RPC after error@113778490) -> (continuation of Deferred@1628942855 after retry RPC after error@599415523) -> (continuation of Deferred@652129952 after retry RPC after error@1613323406) -> (continuation of Deferred@1022516486 after retry RPC after error@1307473209)))
08:04:47.435 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1523) Notify RPC ScanRequest(scannerId=null, state=OPENING, tablet=9fd0331c3da74721a6bf81effaa2ca6d, attempt=4, KuduRpc(method=Scan, tablet=9fd0331c3da74721a6bf81effaa2ca6d, attempt=4, TimeoutTracker(timeout=30000, elapsed=27351), Traces: [0ms] sending RPC to server e5318a97a53d44a0ab8a000d860514ac, [12ms] received response from server e5318a97a53d44a0ab8a000d860514ac: Network error: Failed to connect to peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651): Connection refused: /127.23.12.193:35651, [12ms] delaying RPC due to: Network error: Failed to connect to peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651): Connection refused: /127.23.12.193:35651, [20ms] sending RPC to server aff3e5847231454bad66ef71cb36c4d3, [30ms] received response from server aff3e5847231454bad66ef71cb36c4d3: Network error: Failed to connect to peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809): Connection refused: /127.23.12.195:32809, [30ms] delaying RPC due to: Network error: Failed to connect to peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809): Connection refused: /127.23.12.195:32809, [41ms] sending RPC to server 28aa3d1914814f939e6cedae64740867, [46ms] received response from server 28aa3d1914814f939e6cedae64740867: Network error: Failed to connect to peer 28aa3d1914814f939e6cedae64740867(127.23.12.194:44439): Connection refused: /127.23.12.194:44439, [46ms] delaying RPC due to: Network error: Failed to connect to peer 28aa3d1914814f939e6cedae64740867(127.23.12.194:44439): Connection refused: /127.23.12.194:44439, [60ms] refreshing cache from master, [61ms] Sub RPC GetTableLocations: refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [68ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [69ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [93ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x7a650031, L:/127.0.0.1:35118 - R:/127.23.12.252:42637], [97ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x7a650031, L:/127.0.0.1:35118 - R:/127.23.12.252:42637], [100ms] Sub RPC GetTableLocations: refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [104ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [106ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [106ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [106ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [119ms] Sub RPC GetTableLocations: refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [121ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [123ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [125ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [125ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [141ms] Sub RPC GetTableLocations: refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [144ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [146ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [146ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [163ms] Sub RPC GetTableLocations: refreshing cache from master, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [166ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [167ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [167ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [167ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [168ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [168ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [200ms] Sub RPC GetTableLocations: refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [202ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [204ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [205ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [206ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [260ms] Sub RPC GetTableLocations: refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [262ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [263ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [263ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [264ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [300ms] Sub RPC GetTableLocations: refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [303ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [304ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [305ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [305ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [460ms] Sub RPC GetTableLocations: refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [463ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [464ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [465ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [466ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [980ms] Sub RPC GetTableLocations: refreshing cache from master, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [982ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [982ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [982ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [983ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1620ms] Sub RPC GetTableLocations: refreshing cache from master, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [1623ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [1623ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1624ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [3520ms] Sub RPC GetTableLocations: refreshing cache from master, [3521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [3522ms] too many traces: truncated at 100 traces, deferred=Deferred@517382546(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0, errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0))) after lookup exception
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=22, TimeoutTracker(timeout=29938, elapsed=27285), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [7ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [8ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [32ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x7a650031, L:/127.0.0.1:35118 - R:/127.23.12.252:42637], [36ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x7a650031, L:/127.0.0.1:35118 - R:/127.23.12.252:42637], [39ms] refreshing cache from master, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [43ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [45ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [45ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [45ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [58ms] refreshing cache from master, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [60ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [62ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [64ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [64ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [85ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [85ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [106ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [106ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [106ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [107ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [107ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [139ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [141ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [144ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [145ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [199ms] refreshing cache from master, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [201ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [202ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [202ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [203ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [239ms] refreshing cache from master, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [242ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [243ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [244ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [244ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [399ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [402ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [403ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [403ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [404ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [405ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [919ms] refreshing cache from master, [919ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [921ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [921ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [921ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [922ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1559ms] refreshing cache from master, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1563ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [3459ms] refreshing cache from master, [3460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [3464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [3465ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [3465ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [3471ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [3471ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [6299ms] refreshing cache from master, [6299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [6300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [6300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [6301ms] too many traces: truncated at 100 traces, deferred=Deferred@1088355108(state=PENDING, result=null, callback=(continuation of Deferred@508383247 after retry RPC after error@945120307) -> (continuation of Deferred@17037323 after retry RPC after error@909321428) -> (continuation of Deferred@1108002613 after retry RPC after error@1366120379) -> (continuation of Deferred@1336946237 after retry RPC after error@1611310747) -> (continuation of Deferred@1957557952 after retry RPC after error@1338423137) -> (continuation of Deferred@21608802 after retry RPC after error@876804526) -> (continuation of Deferred@801247760 after retry RPC after error@1439024438) -> (continuation of Deferred@420213829 after retry RPC after error@984080707) -> (continuation of Deferred@88749717 after retry RPC after error@2120068991) -> (continuation of Deferred@942851373 after retry RPC after error@1025152657) -> (continuation of Deferred@1773199673 after retry RPC after error@2055572775) -> (continuation of Deferred@1412441335 after retry RPC after error@1039638270) -> (continuation of Deferred@1394608464 after retry RPC after error@85613222) -> (continuation of Deferred@1356382574 after retry RPC after error@1364829669) -> (continuation of Deferred@39869463 after retry RPC after error@1442376087) -> (continuation of Deferred@1136497143 after retry RPC after error@1607951080) -> (continuation of Deferred@1607929313 after retry RPC after error@1299313629) -> (continuation of Deferred@1659695533 after retry RPC after error@113778490) -> (continuation of Deferred@1628942855 after retry RPC after error@599415523) -> (continuation of Deferred@652129952 after retry RPC after error@1613323406) -> (continuation of Deferred@1022516486 after retry RPC after error@1307473209), errback=(continuation of Deferred@508383247 after retry RPC after error@945120307) -> (continuation of Deferred@17037323 after retry RPC after error@909321428) -> (continuation of Deferred@1108002613 after retry RPC after error@1366120379) -> (continuation of Deferred@1336946237 after retry RPC after error@1611310747) -> (continuation of Deferred@1957557952 after retry RPC after error@1338423137) -> (continuation of Deferred@21608802 after retry RPC after error@876804526) -> (continuation of Deferred@801247760 after retry RPC after error@1439024438) -> (continuation of Deferred@420213829 after retry RPC after error@984080707) -> (continuation of Deferred@88749717 after retry RPC after error@2120068991) -> (continuation of Deferred@942851373 after retry RPC after error@1025152657) -> (continuation of Deferred@1773199673 after retry RPC after error@2055572775) -> (continuation of Deferred@1412441335 after retry RPC after error@1039638270) -> (continuation of Deferred@1394608464 after retry RPC after error@85613222) -> (continuation of Deferred@1356382574 after retry RPC after error@1364829669) -> (continuation of Deferred@39869463 after retry RPC after error@1442376087) -> (continuation of Deferred@1136497143 after retry RPC after error@1607951080) -> (continuation of Deferred@1607929313 after retry RPC after error@1299313629) -> (continuation of Deferred@1659695533 after retry RPC after error@113778490) -> (continuation of Deferred@1628942855 after retry RPC after error@599415523) -> (continuation of Deferred@652129952 after retry RPC after error@1613323406) -> (continuation of Deferred@1022516486 after retry RPC after error@1307473209)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.12.253:45283
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:04:47.446 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:686) Can not open scanner
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=22, TimeoutTracker(timeout=29938, elapsed=27285), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [7ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [8ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [32ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x7a650031, L:/127.0.0.1:35118 - R:/127.23.12.252:42637], [36ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x7a650031, L:/127.0.0.1:35118 - R:/127.23.12.252:42637], [39ms] refreshing cache from master, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [43ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [45ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [45ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [45ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [58ms] refreshing cache from master, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [60ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [62ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [64ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [64ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [85ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [85ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [106ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [106ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [106ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [107ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [107ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [139ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [141ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [144ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [145ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [199ms] refreshing cache from master, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [201ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [202ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [202ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [203ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [239ms] refreshing cache from master, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [242ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [243ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [244ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [244ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [399ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [402ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [403ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [403ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [404ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [405ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [919ms] refreshing cache from master, [919ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [921ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [921ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [921ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [922ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1559ms] refreshing cache from master, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1563ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [3459ms] refreshing cache from master, [3460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [3464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [3465ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [3465ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [3471ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [3471ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [6299ms] refreshing cache from master, [6299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [6300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [6300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [6301ms] too many traces: truncated at 100 traces, deferred=Deferred@1088355108(state=PENDING, result=null, callback=(continuation of Deferred@508383247 after retry RPC after error@945120307) -> (continuation of Deferred@17037323 after retry RPC after error@909321428) -> (continuation of Deferred@1108002613 after retry RPC after error@1366120379) -> (continuation of Deferred@1336946237 after retry RPC after error@1611310747) -> (continuation of Deferred@1957557952 after retry RPC after error@1338423137) -> (continuation of Deferred@21608802 after retry RPC after error@876804526) -> (continuation of Deferred@801247760 after retry RPC after error@1439024438) -> (continuation of Deferred@420213829 after retry RPC after error@984080707) -> (continuation of Deferred@88749717 after retry RPC after error@2120068991) -> (continuation of Deferred@942851373 after retry RPC after error@1025152657) -> (continuation of Deferred@1773199673 after retry RPC after error@2055572775) -> (continuation of Deferred@1412441335 after retry RPC after error@1039638270) -> (continuation of Deferred@1394608464 after retry RPC after error@85613222) -> (continuation of Deferred@1356382574 after retry RPC after error@1364829669) -> (continuation of Deferred@39869463 after retry RPC after error@1442376087) -> (continuation of Deferred@1136497143 after retry RPC after error@1607951080) -> (continuation of Deferred@1607929313 after retry RPC after error@1299313629) -> (continuation of Deferred@1659695533 after retry RPC after error@113778490) -> (continuation of Deferred@1628942855 after retry RPC after error@599415523) -> (continuation of Deferred@652129952 after retry RPC after error@1613323406) -> (continuation of Deferred@1022516486 after retry RPC after error@1307473209), errback=(continuation of Deferred@508383247 after retry RPC after error@945120307) -> (continuation of Deferred@17037323 after retry RPC after error@909321428) -> (continuation of Deferred@1108002613 after retry RPC after error@1366120379) -> (continuation of Deferred@1336946237 after retry RPC after error@1611310747) -> (continuation of Deferred@1957557952 after retry RPC after error@1338423137) -> (continuation of Deferred@21608802 after retry RPC after error@876804526) -> (continuation of Deferred@801247760 after retry RPC after error@1439024438) -> (continuation of Deferred@420213829 after retry RPC after error@984080707) -> (continuation of Deferred@88749717 after retry RPC after error@2120068991) -> (continuation of Deferred@942851373 after retry RPC after error@1025152657) -> (continuation of Deferred@1773199673 after retry RPC after error@2055572775) -> (continuation of Deferred@1412441335 after retry RPC after error@1039638270) -> (continuation of Deferred@1394608464 after retry RPC after error@85613222) -> (continuation of Deferred@1356382574 after retry RPC after error@1364829669) -> (continuation of Deferred@39869463 after retry RPC after error@1442376087) -> (continuation of Deferred@1136497143 after retry RPC after error@1607951080) -> (continuation of Deferred@1607929313 after retry RPC after error@1299313629) -> (continuation of Deferred@1659695533 after retry RPC after error@113778490) -> (continuation of Deferred@1628942855 after retry RPC after error@599415523) -> (continuation of Deferred@652129952 after retry RPC after error@1613323406) -> (continuation of Deferred@1022516486 after retry RPC after error@1307473209)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.12.253:45283
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:04:47.451 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduScanner.java:862) Scanner null closed on null
08:04:47.451 [ERROR - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:190) Received uncaught exception.
java.lang.RuntimeException: SplitFetcher thread 1 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=22, TimeoutTracker(timeout=29938, elapsed=27285), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [7ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [8ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [32ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x7a650031, L:/127.0.0.1:35118 - R:/127.23.12.252:42637], [36ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x7a650031, L:/127.0.0.1:35118 - R:/127.23.12.252:42637], [39ms] refreshing cache from master, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [43ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [45ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [45ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [45ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [58ms] refreshing cache from master, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [60ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [62ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [64ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [64ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [85ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [85ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [106ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [106ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [106ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [107ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [107ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [139ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [141ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [144ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [145ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [199ms] refreshing cache from master, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [201ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [202ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [202ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [203ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [239ms] refreshing cache from master, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [242ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [243ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [244ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [244ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [399ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [402ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [403ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [403ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [404ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [405ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [919ms] refreshing cache from master, [919ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [921ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [921ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [921ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [922ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1559ms] refreshing cache from master, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1563ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [3459ms] refreshing cache from master, [3460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [3464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [3465ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [3465ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [3471ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [3471ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [6299ms] refreshing cache from master, [6299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [6300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [6300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [6301ms] too many traces: truncated at 100 traces, deferred=Deferred@1088355108(state=PENDING, result=null, callback=(continuation of Deferred@508383247 after retry RPC after error@945120307) -> (continuation of Deferred@17037323 after retry RPC after error@909321428) -> (continuation of Deferred@1108002613 after retry RPC after error@1366120379) -> (continuation of Deferred@1336946237 after retry RPC after error@1611310747) -> (continuation of Deferred@1957557952 after retry RPC after error@1338423137) -> (continuation of Deferred@21608802 after retry RPC after error@876804526) -> (continuation of Deferred@801247760 after retry RPC after error@1439024438) -> (continuation of Deferred@420213829 after retry RPC after error@984080707) -> (continuation of Deferred@88749717 after retry RPC after error@2120068991) -> (continuation of Deferred@942851373 after retry RPC after error@1025152657) -> (continuation of Deferred@1773199673 after retry RPC after error@2055572775) -> (continuation of Deferred@1412441335 after retry RPC after error@1039638270) -> (continuation of Deferred@1394608464 after retry RPC after error@85613222) -> (continuation of Deferred@1356382574 after retry RPC after error@1364829669) -> (continuation of Deferred@39869463 after retry RPC after error@1442376087) -> (continuation of Deferred@1136497143 after retry RPC after error@1607951080) -> (continuation of Deferred@1607929313 after retry RPC after error@1299313629) -> (continuation of Deferred@1659695533 after retry RPC after error@113778490) -> (continuation of Deferred@1628942855 after retry RPC after error@599415523) -> (continuation of Deferred@652129952 after retry RPC after error@1613323406) -> (continuation of Deferred@1022516486 after retry RPC after error@1307473209), errback=(continuation of Deferred@508383247 after retry RPC after error@945120307) -> (continuation of Deferred@17037323 after retry RPC after error@909321428) -> (continuation of Deferred@1108002613 after retry RPC after error@1366120379) -> (continuation of Deferred@1336946237 after retry RPC after error@1611310747) -> (continuation of Deferred@1957557952 after retry RPC after error@1338423137) -> (continuation of Deferred@21608802 after retry RPC after error@876804526) -> (continuation of Deferred@801247760 after retry RPC after error@1439024438) -> (continuation of Deferred@420213829 after retry RPC after error@984080707) -> (continuation of Deferred@88749717 after retry RPC after error@2120068991) -> (continuation of Deferred@942851373 after retry RPC after error@1025152657) -> (continuation of Deferred@1773199673 after retry RPC after error@2055572775) -> (continuation of Deferred@1412441335 after retry RPC after error@1039638270) -> (continuation of Deferred@1394608464 after retry RPC after error@85613222) -> (continuation of Deferred@1356382574 after retry RPC after error@1364829669) -> (continuation of Deferred@39869463 after retry RPC after error@1442376087) -> (continuation of Deferred@1136497143 after retry RPC after error@1607951080) -> (continuation of Deferred@1607929313 after retry RPC after error@1299313629) -> (continuation of Deferred@1659695533 after retry RPC after error@113778490) -> (continuation of Deferred@1628942855 after retry RPC after error@599415523) -> (continuation of Deferred@652129952 after retry RPC after error@1613323406) -> (continuation of Deferred@1022516486 after retry RPC after error@1307473209)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.12.253:45283
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:04:47.456 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.23.12.254:42055(127.23.12.254:42055)] disconnecting while in state TERMINATED
08:04:47.456 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)] disconnecting while in state TERMINATED
08:04:47.456 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.23.12.253:45283(127.23.12.253:45283)] disconnecting while in state TERMINATED
08:04:47.457 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809)] disconnecting while in state TERMINATED
08:04:47.457 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 28aa3d1914814f939e6cedae64740867(127.23.12.194:44439)] disconnecting while in state TERMINATED
08:04:47.457 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.23.12.252:42637(127.23.12.252:42637)] disconnecting while in state TERMINATED
08:04:47.457 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:04:47.459 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer a234e5e9c8f74f3bb92c0b83e703587e(127.23.194.65:37577)] disconnecting while in state TERMINATED
08:04:47.459 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 4 thread-local buffer(s) from thread: kudu-nio-3
08:04:47.459 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.23.194.124:38943(127.23.194.124:38943)] disconnecting while in state TERMINATED
08:04:47.459 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.23.194.125:38689(127.23.194.125:38689)] disconnecting while in state TERMINATED
08:04:47.459 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.23.194.126:38579(127.23.194.126:38579)] disconnecting while in state TERMINATED
08:04:47.460 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:04:47.460 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
08:04:47.460 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:04:47.460 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-2
08:04:47.461 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-1
08:04:47.467 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-3
08:04:47.469 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
08:04:47.471 [WARN - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#0 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to FAILED with failure cause:
java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: SplitFetcher thread 1 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=22, TimeoutTracker(timeout=29938, elapsed=27285), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [7ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [8ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [32ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x7a650031, L:/127.0.0.1:35118 - R:/127.23.12.252:42637], [36ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x7a650031, L:/127.0.0.1:35118 - R:/127.23.12.252:42637], [39ms] refreshing cache from master, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [43ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [45ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [45ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [45ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [58ms] refreshing cache from master, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [60ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [62ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [64ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [64ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [85ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [85ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [106ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [106ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [106ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [107ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [107ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [139ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [141ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [144ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [145ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [199ms] refreshing cache from master, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [201ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [202ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [202ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [203ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [239ms] refreshing cache from master, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [242ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [243ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [244ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [244ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [399ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [402ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [403ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [403ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [404ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [405ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [919ms] refreshing cache from master, [919ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [921ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [921ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [921ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [922ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1559ms] refreshing cache from master, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1563ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [3459ms] refreshing cache from master, [3460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [3464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [3465ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [3465ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [3471ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [3471ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [6299ms] refreshing cache from master, [6299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [6300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [6300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [6301ms] too many traces: truncated at 100 traces, deferred=Deferred@1088355108(state=PENDING, result=null, callback=(continuation of Deferred@508383247 after retry RPC after error@945120307) -> (continuation of Deferred@17037323 after retry RPC after error@909321428) -> (continuation of Deferred@1108002613 after retry RPC after error@1366120379) -> (continuation of Deferred@1336946237 after retry RPC after error@1611310747) -> (continuation of Deferred@1957557952 after retry RPC after error@1338423137) -> (continuation of Deferred@21608802 after retry RPC after error@876804526) -> (continuation of Deferred@801247760 after retry RPC after error@1439024438) -> (continuation of Deferred@420213829 after retry RPC after error@984080707) -> (continuation of Deferred@88749717 after retry RPC after error@2120068991) -> (continuation of Deferred@942851373 after retry RPC after error@1025152657) -> (continuation of Deferred@1773199673 after retry RPC after error@2055572775) -> (continuation of Deferred@1412441335 after retry RPC after error@1039638270) -> (continuation of Deferred@1394608464 after retry RPC after error@85613222) -> (continuation of Deferred@1356382574 after retry RPC after error@1364829669) -> (continuation of Deferred@39869463 after retry RPC after error@1442376087) -> (continuation of Deferred@1136497143 after retry RPC after error@1607951080) -> (continuation of Deferred@1607929313 after retry RPC after error@1299313629) -> (continuation of Deferred@1659695533 after retry RPC after error@113778490) -> (continuation of Deferred@1628942855 after retry RPC after error@599415523) -> (continuation of Deferred@652129952 after retry RPC after error@1613323406) -> (continuation of Deferred@1022516486 after retry RPC after error@1307473209), errback=(continuation of Deferred@508383247 after retry RPC after error@945120307) -> (continuation of Deferred@17037323 after retry RPC after error@909321428) -> (continuation of Deferred@1108002613 after retry RPC after error@1366120379) -> (continuation of Deferred@1336946237 after retry RPC after error@1611310747) -> (continuation of Deferred@1957557952 after retry RPC after error@1338423137) -> (continuation of Deferred@21608802 after retry RPC after error@876804526) -> (continuation of Deferred@801247760 after retry RPC after error@1439024438) -> (continuation of Deferred@420213829 after retry RPC after error@984080707) -> (continuation of Deferred@88749717 after retry RPC after error@2120068991) -> (continuation of Deferred@942851373 after retry RPC after error@1025152657) -> (continuation of Deferred@1773199673 after retry RPC after error@2055572775) -> (continuation of Deferred@1412441335 after retry RPC after error@1039638270) -> (continuation of Deferred@1394608464 after retry RPC after error@85613222) -> (continuation of Deferred@1356382574 after retry RPC after error@1364829669) -> (continuation of Deferred@39869463 after retry RPC after error@1442376087) -> (continuation of Deferred@1136497143 after retry RPC after error@1607951080) -> (continuation of Deferred@1607929313 after retry RPC after error@1299313629) -> (continuation of Deferred@1659695533 after retry RPC after error@113778490) -> (continuation of Deferred@1628942855 after retry RPC after error@599415523) -> (continuation of Deferred@652129952 after retry RPC after error@1613323406) -> (continuation of Deferred@1022516486 after retry RPC after error@1307473209)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.12.253:45283
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:04:47.479 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
08:04:47.591 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
08:04:47.602 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to FAILED on 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: SplitFetcher thread 1 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=22, TimeoutTracker(timeout=29938, elapsed=27285), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [7ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [8ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [32ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x7a650031, L:/127.0.0.1:35118 - R:/127.23.12.252:42637], [36ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x7a650031, L:/127.0.0.1:35118 - R:/127.23.12.252:42637], [39ms] refreshing cache from master, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [43ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [45ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [45ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [45ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [58ms] refreshing cache from master, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [60ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [62ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [64ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [64ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [85ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [85ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [106ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [106ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [106ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [107ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [107ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [139ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [141ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [144ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [145ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [199ms] refreshing cache from master, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [201ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [202ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [202ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [203ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [239ms] refreshing cache from master, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [242ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [243ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [244ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [244ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [399ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [402ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [403ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [403ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [404ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [405ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [919ms] refreshing cache from master, [919ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [921ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [921ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [921ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [922ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1559ms] refreshing cache from master, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1563ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [3459ms] refreshing cache from master, [3460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [3464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [3465ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [3465ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [3471ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [3471ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [6299ms] refreshing cache from master, [6299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [6300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [6300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [6301ms] too many traces: truncated at 100 traces, deferred=Deferred@1088355108(state=PENDING, result=null, callback=(continuation of Deferred@508383247 after retry RPC after error@945120307) -> (continuation of Deferred@17037323 after retry RPC after error@909321428) -> (continuation of Deferred@1108002613 after retry RPC after error@1366120379) -> (continuation of Deferred@1336946237 after retry RPC after error@1611310747) -> (continuation of Deferred@1957557952 after retry RPC after error@1338423137) -> (continuation of Deferred@21608802 after retry RPC after error@876804526) -> (continuation of Deferred@801247760 after retry RPC after error@1439024438) -> (continuation of Deferred@420213829 after retry RPC after error@984080707) -> (continuation of Deferred@88749717 after retry RPC after error@2120068991) -> (continuation of Deferred@942851373 after retry RPC after error@1025152657) -> (continuation of Deferred@1773199673 after retry RPC after error@2055572775) -> (continuation of Deferred@1412441335 after retry RPC after error@1039638270) -> (continuation of Deferred@1394608464 after retry RPC after error@85613222) -> (continuation of Deferred@1356382574 after retry RPC after error@1364829669) -> (continuation of Deferred@39869463 after retry RPC after error@1442376087) -> (continuation of Deferred@1136497143 after retry RPC after error@1607951080) -> (continuation of Deferred@1607929313 after retry RPC after error@1299313629) -> (continuation of Deferred@1659695533 after retry RPC after error@113778490) -> (continuation of Deferred@1628942855 after retry RPC after error@599415523) -> (continuation of Deferred@652129952 after retry RPC after error@1613323406) -> (continuation of Deferred@1022516486 after retry RPC after error@1307473209), errback=(continuation of Deferred@508383247 after retry RPC after error@945120307) -> (continuation of Deferred@17037323 after retry RPC after error@909321428) -> (continuation of Deferred@1108002613 after retry RPC after error@1366120379) -> (continuation of Deferred@1336946237 after retry RPC after error@1611310747) -> (continuation of Deferred@1957557952 after retry RPC after error@1338423137) -> (continuation of Deferred@21608802 after retry RPC after error@876804526) -> (continuation of Deferred@801247760 after retry RPC after error@1439024438) -> (continuation of Deferred@420213829 after retry RPC after error@984080707) -> (continuation of Deferred@88749717 after retry RPC after error@2120068991) -> (continuation of Deferred@942851373 after retry RPC after error@1025152657) -> (continuation of Deferred@1773199673 after retry RPC after error@2055572775) -> (continuation of Deferred@1412441335 after retry RPC after error@1039638270) -> (continuation of Deferred@1394608464 after retry RPC after error@85613222) -> (continuation of Deferred@1356382574 after retry RPC after error@1364829669) -> (continuation of Deferred@39869463 after retry RPC after error@1442376087) -> (continuation of Deferred@1136497143 after retry RPC after error@1607951080) -> (continuation of Deferred@1607929313 after retry RPC after error@1299313629) -> (continuation of Deferred@1659695533 after retry RPC after error@113778490) -> (continuation of Deferred@1628942855 after retry RPC after error@599415523) -> (continuation of Deferred@652129952 after retry RPC after error@1613323406) -> (continuation of Deferred@1022516486 after retry RPC after error@1307473209)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.12.253:45283
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:04:47.618 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:04:47.624 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
08:04:47.654 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
08:04:47.654 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (b42812d69c586178cf7556c3c92998f3) switched from state RUNNING to RESTARTING.
08:04:47.677 [WARN - flink-pekko.actor.default-dispatcher-8] (TaskManagerLocation.java:276) No hostname could be resolved for the IP address 127.0.0.1, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted.
08:04:48.075 [DEBUG - pool-12-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30014), Traces: [0ms] sending RPC to server master-127.23.12.252:42637, [5ms] received response from server master-127.23.12.252:42637: OK, deferred=null) with no deferred attached!
08:04:48.102 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.252:42637(127.23.12.252:42637)] connecting to peer
08:04:48.103 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.254:42055(127.23.12.254:42055)] connecting to peer
08:04:48.103 [DEBUG - pool-30-thread-1] (Connection.java:748) [peer master-127.23.12.253:45283(127.23.12.253:45283)] connecting to peer
08:04:48.108 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:48.108 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.12.252:42637(127.23.12.252:42637)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:48.108 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.252:42637: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637
08:04:48.109 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:48.109 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.12.254:42055(127.23.12.254:42055)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:48.109 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.254:42055: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055
08:04:48.110 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:48.110 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.12.253:45283(127.23.12.253:45283)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:48.110 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.12.253:45283: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
08:04:48.110 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283; will retry
08:04:48.112 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=25, TimeoutTracker(timeout=29933, elapsed=27968), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [5ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [6ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [39ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x526ec86c, L:/127.0.0.1:35106 - R:/127.23.12.252:42637], [41ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x526ec86c, L:/127.0.0.1:35106 - R:/127.23.12.252:42637], [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [63ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [65ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [66ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [66ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [79ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [84ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [104ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [105ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [105ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [123ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [124ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [125ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [144ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [145ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [146ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [222ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [224ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [224ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [225ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [259ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [262ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [262ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [263ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [264ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [419ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [421ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [422ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [422ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [422ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [461ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [462ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [463ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [463ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1380ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [1382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [1383ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1383ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [2440ms] refreshing cache from master, [2440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [2441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [2441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [2441ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [2442ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [2443ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [2443ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [4959ms] refreshing cache from master, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [4961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [4961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [4962ms] too many traces: truncated at 100 traces, deferred=Deferred@416433095(state=PENDING, result=null, callback=(continuation of Deferred@421512791 after retry RPC after error@1878420933) -> (continuation of Deferred@615127696 after retry RPC after error@778877369) -> (continuation of Deferred@1227292509 after retry RPC after error@367148025) -> (continuation of Deferred@1634258255 after retry RPC after error@704778666) -> (continuation of Deferred@1411436448 after retry RPC after error@1352207150) -> (continuation of Deferred@2008852167 after retry RPC after error@1300854491) -> (continuation of Deferred@528936197 after retry RPC after error@123622816) -> (continuation of Deferred@365314322 after retry RPC after error@335532767) -> (continuation of Deferred@993655648 after retry RPC after error@1312774898) -> (continuation of Deferred@1775656182 after retry RPC after error@72483385) -> (continuation of Deferred@1883511592 after retry RPC after error@1150822168) -> (continuation of Deferred@536011409 after retry RPC after error@187005084) -> (continuation of Deferred@1533591435 after retry RPC after error@1590551321) -> (continuation of Deferred@1445164091 after retry RPC after error@1994528763) -> (continuation of Deferred@1760066123 after retry RPC after error@1502382436) -> (continuation of Deferred@348372162 after retry RPC after error@1920478318) -> (continuation of Deferred@1500064328 after retry RPC after error@1678991272) -> (continuation of Deferred@1832901188 after retry RPC after error@1578602705) -> (continuation of Deferred@1320995377 after retry RPC after error@816587345) -> (continuation of Deferred@600978426 after retry RPC after error@1101114953) -> (continuation of Deferred@1768163598 after retry RPC after error@948637913) -> (continuation of Deferred@183810513 after retry RPC after error@1181453600) -> (continuation of Deferred@252629146 after retry RPC after error@1868760186) -> (continuation of Deferred@1089864310 after retry RPC after error@1525585349), errback=(continuation of Deferred@421512791 after retry RPC after error@1878420933) -> (continuation of Deferred@615127696 after retry RPC after error@778877369) -> (continuation of Deferred@1227292509 after retry RPC after error@367148025) -> (continuation of Deferred@1634258255 after retry RPC after error@704778666) -> (continuation of Deferred@1411436448 after retry RPC after error@1352207150) -> (continuation of Deferred@2008852167 after retry RPC after error@1300854491) -> (continuation of Deferred@528936197 after retry RPC after error@123622816) -> (continuation of Deferred@365314322 after retry RPC after error@335532767) -> (continuation of Deferred@993655648 after retry RPC after error@1312774898) -> (continuation of Deferred@1775656182 after retry RPC after error@72483385) -> (continuation of Deferred@1883511592 after retry RPC after error@1150822168) -> (continuation of Deferred@536011409 after retry RPC after error@187005084) -> (continuation of Deferred@1533591435 after retry RPC after error@1590551321) -> (continuation of Deferred@1445164091 after retry RPC after error@1994528763) -> (continuation of Deferred@1760066123 after retry RPC after error@1502382436) -> (continuation of Deferred@348372162 after retry RPC after error@1920478318) -> (continuation of Deferred@1500064328 after retry RPC after error@1678991272) -> (continuation of Deferred@1832901188 after retry RPC after error@1578602705) -> (continuation of Deferred@1320995377 after retry RPC after error@816587345) -> (continuation of Deferred@600978426 after retry RPC after error@1101114953) -> (continuation of Deferred@1768163598 after retry RPC after error@948637913) -> (continuation of Deferred@183810513 after retry RPC after error@1181453600) -> (continuation of Deferred@252629146 after retry RPC after error@1868760186) -> (continuation of Deferred@1089864310 after retry RPC after error@1525585349)))
08:04:48.117 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1523) Notify RPC ScanRequest(scannerId=null, state=OPENING, tablet=08fb1cfeee8e45528078bdd8935cfb8f, attempt=4, KuduRpc(method=Scan, tablet=08fb1cfeee8e45528078bdd8935cfb8f, attempt=4, TimeoutTracker(timeout=30000, elapsed=28041), Traces: [0ms] sending RPC to server aff3e5847231454bad66ef71cb36c4d3, [11ms] received response from server aff3e5847231454bad66ef71cb36c4d3: Network error: Failed to connect to peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809): Connection refused: /127.23.12.195:32809, [12ms] delaying RPC due to: Network error: Failed to connect to peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809): Connection refused: /127.23.12.195:32809, [21ms] sending RPC to server e5318a97a53d44a0ab8a000d860514ac, [31ms] received response from server e5318a97a53d44a0ab8a000d860514ac: Network error: Failed to connect to peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651): Connection refused: /127.23.12.193:35651, [32ms] delaying RPC due to: Network error: Failed to connect to peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651): Connection refused: /127.23.12.193:35651, [40ms] sending RPC to server 28aa3d1914814f939e6cedae64740867, [44ms] received response from server 28aa3d1914814f939e6cedae64740867: Network error: Failed to connect to peer 28aa3d1914814f939e6cedae64740867(127.23.12.194:44439): Connection refused: /127.23.12.194:44439, [45ms] delaying RPC due to: Network error: Failed to connect to peer 28aa3d1914814f939e6cedae64740867(127.23.12.194:44439): Connection refused: /127.23.12.194:44439, [60ms] refreshing cache from master, [60ms] Sub RPC GetTableLocations: refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [65ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [66ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [99ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x526ec86c, L:/127.0.0.1:35106 - R:/127.23.12.252:42637], [101ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x526ec86c, L:/127.0.0.1:35106 - R:/127.23.12.252:42637], [120ms] Sub RPC GetTableLocations: refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [123ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [125ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [126ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [126ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [139ms] Sub RPC GetTableLocations: refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [144ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [160ms] Sub RPC GetTableLocations: refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [162ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [164ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [165ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [165ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [180ms] Sub RPC GetTableLocations: refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [182ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [183ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [184ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [185ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [200ms] Sub RPC GetTableLocations: refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [203ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [204ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [204ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [205ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [206ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [280ms] Sub RPC GetTableLocations: refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [282ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [284ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [284ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [285ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [319ms] Sub RPC GetTableLocations: refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [322ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [322ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [323ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [324ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [479ms] Sub RPC GetTableLocations: refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [481ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [482ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [482ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [482ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [520ms] Sub RPC GetTableLocations: refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [521ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [522ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [523ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [523ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1440ms] Sub RPC GetTableLocations: refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1443ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [2500ms] Sub RPC GetTableLocations: refreshing cache from master, [2500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [2501ms] too many traces: truncated at 100 traces, deferred=Deferred@589104130(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0, errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0))) after lookup exception
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=25, TimeoutTracker(timeout=29933, elapsed=27968), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [5ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [6ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [39ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x526ec86c, L:/127.0.0.1:35106 - R:/127.23.12.252:42637], [41ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x526ec86c, L:/127.0.0.1:35106 - R:/127.23.12.252:42637], [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [63ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [65ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [66ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [66ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [79ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [84ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [104ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [105ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [105ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [123ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [124ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [125ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [144ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [145ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [146ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [222ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [224ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [224ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [225ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [259ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [262ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [262ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [263ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [264ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [419ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [421ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [422ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [422ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [422ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [461ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [462ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [463ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [463ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1380ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [1382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [1383ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1383ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [2440ms] refreshing cache from master, [2440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [2441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [2441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [2441ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [2442ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [2443ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [2443ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [4959ms] refreshing cache from master, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [4961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [4961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [4962ms] too many traces: truncated at 100 traces, deferred=Deferred@416433095(state=PENDING, result=null, callback=(continuation of Deferred@421512791 after retry RPC after error@1878420933) -> (continuation of Deferred@615127696 after retry RPC after error@778877369) -> (continuation of Deferred@1227292509 after retry RPC after error@367148025) -> (continuation of Deferred@1634258255 after retry RPC after error@704778666) -> (continuation of Deferred@1411436448 after retry RPC after error@1352207150) -> (continuation of Deferred@2008852167 after retry RPC after error@1300854491) -> (continuation of Deferred@528936197 after retry RPC after error@123622816) -> (continuation of Deferred@365314322 after retry RPC after error@335532767) -> (continuation of Deferred@993655648 after retry RPC after error@1312774898) -> (continuation of Deferred@1775656182 after retry RPC after error@72483385) -> (continuation of Deferred@1883511592 after retry RPC after error@1150822168) -> (continuation of Deferred@536011409 after retry RPC after error@187005084) -> (continuation of Deferred@1533591435 after retry RPC after error@1590551321) -> (continuation of Deferred@1445164091 after retry RPC after error@1994528763) -> (continuation of Deferred@1760066123 after retry RPC after error@1502382436) -> (continuation of Deferred@348372162 after retry RPC after error@1920478318) -> (continuation of Deferred@1500064328 after retry RPC after error@1678991272) -> (continuation of Deferred@1832901188 after retry RPC after error@1578602705) -> (continuation of Deferred@1320995377 after retry RPC after error@816587345) -> (continuation of Deferred@600978426 after retry RPC after error@1101114953) -> (continuation of Deferred@1768163598 after retry RPC after error@948637913) -> (continuation of Deferred@183810513 after retry RPC after error@1181453600) -> (continuation of Deferred@252629146 after retry RPC after error@1868760186) -> (continuation of Deferred@1089864310 after retry RPC after error@1525585349), errback=(continuation of Deferred@421512791 after retry RPC after error@1878420933) -> (continuation of Deferred@615127696 after retry RPC after error@778877369) -> (continuation of Deferred@1227292509 after retry RPC after error@367148025) -> (continuation of Deferred@1634258255 after retry RPC after error@704778666) -> (continuation of Deferred@1411436448 after retry RPC after error@1352207150) -> (continuation of Deferred@2008852167 after retry RPC after error@1300854491) -> (continuation of Deferred@528936197 after retry RPC after error@123622816) -> (continuation of Deferred@365314322 after retry RPC after error@335532767) -> (continuation of Deferred@993655648 after retry RPC after error@1312774898) -> (continuation of Deferred@1775656182 after retry RPC after error@72483385) -> (continuation of Deferred@1883511592 after retry RPC after error@1150822168) -> (continuation of Deferred@536011409 after retry RPC after error@187005084) -> (continuation of Deferred@1533591435 after retry RPC after error@1590551321) -> (continuation of Deferred@1445164091 after retry RPC after error@1994528763) -> (continuation of Deferred@1760066123 after retry RPC after error@1502382436) -> (continuation of Deferred@348372162 after retry RPC after error@1920478318) -> (continuation of Deferred@1500064328 after retry RPC after error@1678991272) -> (continuation of Deferred@1832901188 after retry RPC after error@1578602705) -> (continuation of Deferred@1320995377 after retry RPC after error@816587345) -> (continuation of Deferred@600978426 after retry RPC after error@1101114953) -> (continuation of Deferred@1768163598 after retry RPC after error@948637913) -> (continuation of Deferred@183810513 after retry RPC after error@1181453600) -> (continuation of Deferred@252629146 after retry RPC after error@1868760186) -> (continuation of Deferred@1089864310 after retry RPC after error@1525585349)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.12.253:45283
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:04:48.127 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:686) Can not open scanner
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=25, TimeoutTracker(timeout=29933, elapsed=27968), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [5ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [6ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [39ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x526ec86c, L:/127.0.0.1:35106 - R:/127.23.12.252:42637], [41ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x526ec86c, L:/127.0.0.1:35106 - R:/127.23.12.252:42637], [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [63ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [65ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [66ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [66ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [79ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [84ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [104ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [105ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [105ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [123ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [124ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [125ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [144ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [145ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [146ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [222ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [224ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [224ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [225ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [259ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [262ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [262ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [263ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [264ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [419ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [421ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [422ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [422ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [422ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [461ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [462ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [463ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [463ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1380ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [1382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [1383ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1383ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [2440ms] refreshing cache from master, [2440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [2441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [2441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [2441ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [2442ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [2443ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [2443ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [4959ms] refreshing cache from master, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [4961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [4961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [4962ms] too many traces: truncated at 100 traces, deferred=Deferred@416433095(state=PENDING, result=null, callback=(continuation of Deferred@421512791 after retry RPC after error@1878420933) -> (continuation of Deferred@615127696 after retry RPC after error@778877369) -> (continuation of Deferred@1227292509 after retry RPC after error@367148025) -> (continuation of Deferred@1634258255 after retry RPC after error@704778666) -> (continuation of Deferred@1411436448 after retry RPC after error@1352207150) -> (continuation of Deferred@2008852167 after retry RPC after error@1300854491) -> (continuation of Deferred@528936197 after retry RPC after error@123622816) -> (continuation of Deferred@365314322 after retry RPC after error@335532767) -> (continuation of Deferred@993655648 after retry RPC after error@1312774898) -> (continuation of Deferred@1775656182 after retry RPC after error@72483385) -> (continuation of Deferred@1883511592 after retry RPC after error@1150822168) -> (continuation of Deferred@536011409 after retry RPC after error@187005084) -> (continuation of Deferred@1533591435 after retry RPC after error@1590551321) -> (continuation of Deferred@1445164091 after retry RPC after error@1994528763) -> (continuation of Deferred@1760066123 after retry RPC after error@1502382436) -> (continuation of Deferred@348372162 after retry RPC after error@1920478318) -> (continuation of Deferred@1500064328 after retry RPC after error@1678991272) -> (continuation of Deferred@1832901188 after retry RPC after error@1578602705) -> (continuation of Deferred@1320995377 after retry RPC after error@816587345) -> (continuation of Deferred@600978426 after retry RPC after error@1101114953) -> (continuation of Deferred@1768163598 after retry RPC after error@948637913) -> (continuation of Deferred@183810513 after retry RPC after error@1181453600) -> (continuation of Deferred@252629146 after retry RPC after error@1868760186) -> (continuation of Deferred@1089864310 after retry RPC after error@1525585349), errback=(continuation of Deferred@421512791 after retry RPC after error@1878420933) -> (continuation of Deferred@615127696 after retry RPC after error@778877369) -> (continuation of Deferred@1227292509 after retry RPC after error@367148025) -> (continuation of Deferred@1634258255 after retry RPC after error@704778666) -> (continuation of Deferred@1411436448 after retry RPC after error@1352207150) -> (continuation of Deferred@2008852167 after retry RPC after error@1300854491) -> (continuation of Deferred@528936197 after retry RPC after error@123622816) -> (continuation of Deferred@365314322 after retry RPC after error@335532767) -> (continuation of Deferred@993655648 after retry RPC after error@1312774898) -> (continuation of Deferred@1775656182 after retry RPC after error@72483385) -> (continuation of Deferred@1883511592 after retry RPC after error@1150822168) -> (continuation of Deferred@536011409 after retry RPC after error@187005084) -> (continuation of Deferred@1533591435 after retry RPC after error@1590551321) -> (continuation of Deferred@1445164091 after retry RPC after error@1994528763) -> (continuation of Deferred@1760066123 after retry RPC after error@1502382436) -> (continuation of Deferred@348372162 after retry RPC after error@1920478318) -> (continuation of Deferred@1500064328 after retry RPC after error@1678991272) -> (continuation of Deferred@1832901188 after retry RPC after error@1578602705) -> (continuation of Deferred@1320995377 after retry RPC after error@816587345) -> (continuation of Deferred@600978426 after retry RPC after error@1101114953) -> (continuation of Deferred@1768163598 after retry RPC after error@948637913) -> (continuation of Deferred@183810513 after retry RPC after error@1181453600) -> (continuation of Deferred@252629146 after retry RPC after error@1868760186) -> (continuation of Deferred@1089864310 after retry RPC after error@1525585349)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.12.253:45283
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:04:48.138 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduScanner.java:862) Scanner null closed on null
08:04:48.138 [ERROR - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:190) Received uncaught exception.
java.lang.RuntimeException: SplitFetcher thread 1 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=25, TimeoutTracker(timeout=29933, elapsed=27968), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [5ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [6ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [39ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x526ec86c, L:/127.0.0.1:35106 - R:/127.23.12.252:42637], [41ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x526ec86c, L:/127.0.0.1:35106 - R:/127.23.12.252:42637], [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [63ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [65ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [66ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [66ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [79ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [84ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [104ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [105ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [105ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [123ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [124ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [125ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [144ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [145ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [146ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [222ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [224ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [224ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [225ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [259ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [262ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [262ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [263ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [264ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [419ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [421ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [422ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [422ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [422ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [461ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [462ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [463ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [463ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1380ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [1382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [1383ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1383ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [2440ms] refreshing cache from master, [2440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [2441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [2441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [2441ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [2442ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [2443ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [2443ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [4959ms] refreshing cache from master, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [4961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [4961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [4962ms] too many traces: truncated at 100 traces, deferred=Deferred@416433095(state=PENDING, result=null, callback=(continuation of Deferred@421512791 after retry RPC after error@1878420933) -> (continuation of Deferred@615127696 after retry RPC after error@778877369) -> (continuation of Deferred@1227292509 after retry RPC after error@367148025) -> (continuation of Deferred@1634258255 after retry RPC after error@704778666) -> (continuation of Deferred@1411436448 after retry RPC after error@1352207150) -> (continuation of Deferred@2008852167 after retry RPC after error@1300854491) -> (continuation of Deferred@528936197 after retry RPC after error@123622816) -> (continuation of Deferred@365314322 after retry RPC after error@335532767) -> (continuation of Deferred@993655648 after retry RPC after error@1312774898) -> (continuation of Deferred@1775656182 after retry RPC after error@72483385) -> (continuation of Deferred@1883511592 after retry RPC after error@1150822168) -> (continuation of Deferred@536011409 after retry RPC after error@187005084) -> (continuation of Deferred@1533591435 after retry RPC after error@1590551321) -> (continuation of Deferred@1445164091 after retry RPC after error@1994528763) -> (continuation of Deferred@1760066123 after retry RPC after error@1502382436) -> (continuation of Deferred@348372162 after retry RPC after error@1920478318) -> (continuation of Deferred@1500064328 after retry RPC after error@1678991272) -> (continuation of Deferred@1832901188 after retry RPC after error@1578602705) -> (continuation of Deferred@1320995377 after retry RPC after error@816587345) -> (continuation of Deferred@600978426 after retry RPC after error@1101114953) -> (continuation of Deferred@1768163598 after retry RPC after error@948637913) -> (continuation of Deferred@183810513 after retry RPC after error@1181453600) -> (continuation of Deferred@252629146 after retry RPC after error@1868760186) -> (continuation of Deferred@1089864310 after retry RPC after error@1525585349), errback=(continuation of Deferred@421512791 after retry RPC after error@1878420933) -> (continuation of Deferred@615127696 after retry RPC after error@778877369) -> (continuation of Deferred@1227292509 after retry RPC after error@367148025) -> (continuation of Deferred@1634258255 after retry RPC after error@704778666) -> (continuation of Deferred@1411436448 after retry RPC after error@1352207150) -> (continuation of Deferred@2008852167 after retry RPC after error@1300854491) -> (continuation of Deferred@528936197 after retry RPC after error@123622816) -> (continuation of Deferred@365314322 after retry RPC after error@335532767) -> (continuation of Deferred@993655648 after retry RPC after error@1312774898) -> (continuation of Deferred@1775656182 after retry RPC after error@72483385) -> (continuation of Deferred@1883511592 after retry RPC after error@1150822168) -> (continuation of Deferred@536011409 after retry RPC after error@187005084) -> (continuation of Deferred@1533591435 after retry RPC after error@1590551321) -> (continuation of Deferred@1445164091 after retry RPC after error@1994528763) -> (continuation of Deferred@1760066123 after retry RPC after error@1502382436) -> (continuation of Deferred@348372162 after retry RPC after error@1920478318) -> (continuation of Deferred@1500064328 after retry RPC after error@1678991272) -> (continuation of Deferred@1832901188 after retry RPC after error@1578602705) -> (continuation of Deferred@1320995377 after retry RPC after error@816587345) -> (continuation of Deferred@600978426 after retry RPC after error@1101114953) -> (continuation of Deferred@1768163598 after retry RPC after error@948637913) -> (continuation of Deferred@183810513 after retry RPC after error@1181453600) -> (continuation of Deferred@252629146 after retry RPC after error@1868760186) -> (continuation of Deferred@1089864310 after retry RPC after error@1525585349)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.12.253:45283
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:04:48.143 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.23.194.124:38943(127.23.194.124:38943)] disconnecting while in state TERMINATED
08:04:48.144 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.23.194.125:38689(127.23.194.125:38689)] disconnecting while in state TERMINATED
08:04:48.144 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.23.194.126:38579(127.23.194.126:38579)] disconnecting while in state TERMINATED
08:04:48.144 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 7eb69088ee284421ba9cfbd602fcb697(127.23.194.66:39487)] disconnecting while in state TERMINATED
08:04:48.144 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:04:48.149 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:04:48.149 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.23.12.254:42055(127.23.12.254:42055)] disconnecting while in state TERMINATED
08:04:48.150 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer e5318a97a53d44a0ab8a000d860514ac(127.23.12.193:35651)] disconnecting while in state TERMINATED
08:04:48.150 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.23.12.253:45283(127.23.12.253:45283)] disconnecting while in state TERMINATED
08:04:48.151 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer aff3e5847231454bad66ef71cb36c4d3(127.23.12.195:32809)] disconnecting while in state TERMINATED
08:04:48.151 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 28aa3d1914814f939e6cedae64740867(127.23.12.194:44439)] disconnecting while in state TERMINATED
08:04:48.151 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-1
08:04:48.152 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
08:04:48.152 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.23.12.252:42637(127.23.12.252:42637)] disconnecting while in state TERMINATED
08:04:48.155 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:04:48.158 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 4 thread-local buffer(s) from thread: kudu-nio-3
08:04:48.159 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
08:04:48.162 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-3
08:04:48.163 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
08:04:48.166 [WARN - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#0 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to FAILED with failure cause:
java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: SplitFetcher thread 1 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=25, TimeoutTracker(timeout=29933, elapsed=27968), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [5ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [6ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [39ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x526ec86c, L:/127.0.0.1:35106 - R:/127.23.12.252:42637], [41ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x526ec86c, L:/127.0.0.1:35106 - R:/127.23.12.252:42637], [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [63ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [65ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [66ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [66ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [79ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [84ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [104ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [105ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [105ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [123ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [124ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [125ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [144ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [145ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [146ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [222ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [224ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [224ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [225ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [259ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [262ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [262ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [263ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [264ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [419ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [421ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [422ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [422ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [422ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [461ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [462ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [463ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [463ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1380ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [1382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [1383ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1383ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [2440ms] refreshing cache from master, [2440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [2441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [2441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [2441ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [2442ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [2443ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [2443ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [4959ms] refreshing cache from master, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [4961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [4961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [4962ms] too many traces: truncated at 100 traces, deferred=Deferred@416433095(state=PENDING, result=null, callback=(continuation of Deferred@421512791 after retry RPC after error@1878420933) -> (continuation of Deferred@615127696 after retry RPC after error@778877369) -> (continuation of Deferred@1227292509 after retry RPC after error@367148025) -> (continuation of Deferred@1634258255 after retry RPC after error@704778666) -> (continuation of Deferred@1411436448 after retry RPC after error@1352207150) -> (continuation of Deferred@2008852167 after retry RPC after error@1300854491) -> (continuation of Deferred@528936197 after retry RPC after error@123622816) -> (continuation of Deferred@365314322 after retry RPC after error@335532767) -> (continuation of Deferred@993655648 after retry RPC after error@1312774898) -> (continuation of Deferred@1775656182 after retry RPC after error@72483385) -> (continuation of Deferred@1883511592 after retry RPC after error@1150822168) -> (continuation of Deferred@536011409 after retry RPC after error@187005084) -> (continuation of Deferred@1533591435 after retry RPC after error@1590551321) -> (continuation of Deferred@1445164091 after retry RPC after error@1994528763) -> (continuation of Deferred@1760066123 after retry RPC after error@1502382436) -> (continuation of Deferred@348372162 after retry RPC after error@1920478318) -> (continuation of Deferred@1500064328 after retry RPC after error@1678991272) -> (continuation of Deferred@1832901188 after retry RPC after error@1578602705) -> (continuation of Deferred@1320995377 after retry RPC after error@816587345) -> (continuation of Deferred@600978426 after retry RPC after error@1101114953) -> (continuation of Deferred@1768163598 after retry RPC after error@948637913) -> (continuation of Deferred@183810513 after retry RPC after error@1181453600) -> (continuation of Deferred@252629146 after retry RPC after error@1868760186) -> (continuation of Deferred@1089864310 after retry RPC after error@1525585349), errback=(continuation of Deferred@421512791 after retry RPC after error@1878420933) -> (continuation of Deferred@615127696 after retry RPC after error@778877369) -> (continuation of Deferred@1227292509 after retry RPC after error@367148025) -> (continuation of Deferred@1634258255 after retry RPC after error@704778666) -> (continuation of Deferred@1411436448 after retry RPC after error@1352207150) -> (continuation of Deferred@2008852167 after retry RPC after error@1300854491) -> (continuation of Deferred@528936197 after retry RPC after error@123622816) -> (continuation of Deferred@365314322 after retry RPC after error@335532767) -> (continuation of Deferred@993655648 after retry RPC after error@1312774898) -> (continuation of Deferred@1775656182 after retry RPC after error@72483385) -> (continuation of Deferred@1883511592 after retry RPC after error@1150822168) -> (continuation of Deferred@536011409 after retry RPC after error@187005084) -> (continuation of Deferred@1533591435 after retry RPC after error@1590551321) -> (continuation of Deferred@1445164091 after retry RPC after error@1994528763) -> (continuation of Deferred@1760066123 after retry RPC after error@1502382436) -> (continuation of Deferred@348372162 after retry RPC after error@1920478318) -> (continuation of Deferred@1500064328 after retry RPC after error@1678991272) -> (continuation of Deferred@1832901188 after retry RPC after error@1578602705) -> (continuation of Deferred@1320995377 after retry RPC after error@816587345) -> (continuation of Deferred@600978426 after retry RPC after error@1101114953) -> (continuation of Deferred@1768163598 after retry RPC after error@948637913) -> (continuation of Deferred@183810513 after retry RPC after error@1181453600) -> (continuation of Deferred@252629146 after retry RPC after error@1868760186) -> (continuation of Deferred@1089864310 after retry RPC after error@1525585349)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.12.253:45283
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:04:48.173 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#0 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
08:04:48.189 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#0 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_0.
08:04:48.195 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to FAILED on 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: SplitFetcher thread 1 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=25, TimeoutTracker(timeout=29933, elapsed=27968), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [5ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [6ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [39ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x526ec86c, L:/127.0.0.1:35106 - R:/127.23.12.252:42637], [41ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: [peer master-127.23.12.252:42637(127.23.12.252:42637)] unexpected exception from downstream on [id: 0x526ec86c, L:/127.0.0.1:35106 - R:/127.23.12.252:42637], [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [63ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [65ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [66ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [66ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [79ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [84ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [104ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [105ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [105ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [123ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [124ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [125ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [144ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [145ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [146ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [222ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [224ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [224ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [225ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [259ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [262ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [262ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [263ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [264ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [419ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [421ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [422ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [422ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [422ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [461ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [462ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [463ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [463ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1380ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [1382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [1383ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [1383ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [2440ms] refreshing cache from master, [2440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [2441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [2441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [2441ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.252:42637: Network error: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637, [2442ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.253:45283: Network error: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283, [2443ms] Sub RPC ConnectToMaster: received response from server master-127.23.12.254:42055: Network error: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [2443ms] delaying RPC due to: Service unavailable: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055, [4959ms] refreshing cache from master, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.252:42637, [4961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.254:42055, [4961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.12.253:45283, [4962ms] too many traces: truncated at 100 traces, deferred=Deferred@416433095(state=PENDING, result=null, callback=(continuation of Deferred@421512791 after retry RPC after error@1878420933) -> (continuation of Deferred@615127696 after retry RPC after error@778877369) -> (continuation of Deferred@1227292509 after retry RPC after error@367148025) -> (continuation of Deferred@1634258255 after retry RPC after error@704778666) -> (continuation of Deferred@1411436448 after retry RPC after error@1352207150) -> (continuation of Deferred@2008852167 after retry RPC after error@1300854491) -> (continuation of Deferred@528936197 after retry RPC after error@123622816) -> (continuation of Deferred@365314322 after retry RPC after error@335532767) -> (continuation of Deferred@993655648 after retry RPC after error@1312774898) -> (continuation of Deferred@1775656182 after retry RPC after error@72483385) -> (continuation of Deferred@1883511592 after retry RPC after error@1150822168) -> (continuation of Deferred@536011409 after retry RPC after error@187005084) -> (continuation of Deferred@1533591435 after retry RPC after error@1590551321) -> (continuation of Deferred@1445164091 after retry RPC after error@1994528763) -> (continuation of Deferred@1760066123 after retry RPC after error@1502382436) -> (continuation of Deferred@348372162 after retry RPC after error@1920478318) -> (continuation of Deferred@1500064328 after retry RPC after error@1678991272) -> (continuation of Deferred@1832901188 after retry RPC after error@1578602705) -> (continuation of Deferred@1320995377 after retry RPC after error@816587345) -> (continuation of Deferred@600978426 after retry RPC after error@1101114953) -> (continuation of Deferred@1768163598 after retry RPC after error@948637913) -> (continuation of Deferred@183810513 after retry RPC after error@1181453600) -> (continuation of Deferred@252629146 after retry RPC after error@1868760186) -> (continuation of Deferred@1089864310 after retry RPC after error@1525585349), errback=(continuation of Deferred@421512791 after retry RPC after error@1878420933) -> (continuation of Deferred@615127696 after retry RPC after error@778877369) -> (continuation of Deferred@1227292509 after retry RPC after error@367148025) -> (continuation of Deferred@1634258255 after retry RPC after error@704778666) -> (continuation of Deferred@1411436448 after retry RPC after error@1352207150) -> (continuation of Deferred@2008852167 after retry RPC after error@1300854491) -> (continuation of Deferred@528936197 after retry RPC after error@123622816) -> (continuation of Deferred@365314322 after retry RPC after error@335532767) -> (continuation of Deferred@993655648 after retry RPC after error@1312774898) -> (continuation of Deferred@1775656182 after retry RPC after error@72483385) -> (continuation of Deferred@1883511592 after retry RPC after error@1150822168) -> (continuation of Deferred@536011409 after retry RPC after error@187005084) -> (continuation of Deferred@1533591435 after retry RPC after error@1590551321) -> (continuation of Deferred@1445164091 after retry RPC after error@1994528763) -> (continuation of Deferred@1760066123 after retry RPC after error@1502382436) -> (continuation of Deferred@348372162 after retry RPC after error@1920478318) -> (continuation of Deferred@1500064328 after retry RPC after error@1678991272) -> (continuation of Deferred@1832901188 after retry RPC after error@1578602705) -> (continuation of Deferred@1320995377 after retry RPC after error@816587345) -> (continuation of Deferred@600978426 after retry RPC after error@1101114953) -> (continuation of Deferred@1768163598 after retry RPC after error@948637913) -> (continuation of Deferred@183810513 after retry RPC after error@1181453600) -> (continuation of Deferred@252629146 after retry RPC after error@1868760186) -> (continuation of Deferred@1089864310 after retry RPC after error@1525585349)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.12.252:42637,127.23.12.254:42055,127.23.12.253:45283) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.252:42637(127.23.12.252:42637): Connection refused: /127.23.12.252:42637,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.254:42055(127.23.12.254:42055): Connection refused: /127.23.12.254:42055,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.12.253:45283(127.23.12.253:45283): Connection refused: /127.23.12.253:45283
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.12.253:45283
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:04:48.202 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:04:48.202 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#0) of source Source: KuduSource.
08:04:48.203 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_0.
08:04:48.660 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job b42812d69c586178cf7556c3c92998f3 from Checkpoint 65 @ 1779091487380 for b42812d69c586178cf7556c3c92998f3 located at file:/tmp/junit1738461414297871817/checkpoints/b42812d69c586178cf7556c3c92998f3/chk-65.
08:04:48.707 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
08:04:48.730 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 3 to checkpoint 65 for source Source: KuduSource to checkpoint.
08:04:48.733 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to SCHEDULED.
08:04:48.744 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:04:48.749 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from SCHEDULED to DEPLOYING.
08:04:48.749 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #1) with attempt id 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1) with allocation id 2f9a5ebd231a465571d2109e36591407
08:04:48.751 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (b42812d69c586178cf7556c3c92998f3) switched from state RESTARTING to RUNNING.
08:04:48.752 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 2f9a5ebd231a465571d2109e36591407.
08:04:48.753 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#1 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_1), deploy into slot with allocation id 2f9a5ebd231a465571d2109e36591407.
08:04:48.757 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to DEPLOYING.
08:04:48.757 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#1 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_1) [DEPLOYING].
08:04:48.759 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5a01ac5c
08:04:48.759 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:04:48.760 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit1738461414297871817/checkpoints")
08:04:48.760 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
08:04:48.768 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job b42812d69c586178cf7556c3c92998f3 from Checkpoint 65 @ 1779091487380 for b42812d69c586178cf7556c3c92998f3 located at file:/tmp/junit1738461414297871817/checkpoints/b42812d69c586178cf7556c3c92998f3/chk-65.
08:04:48.769 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
08:04:48.769 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 0 to checkpoint 65 for source Source: KuduSource to checkpoint.
08:04:48.770 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to SCHEDULED.
08:04:48.776 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:04:48.778 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING.
08:04:48.778 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #1) with attempt id 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1) with allocation id 4c78869737ef27e21dadfe7d1a23010d
08:04:48.780 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 4c78869737ef27e21dadfe7d1a23010d.
08:04:48.782 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#1 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id 4c78869737ef27e21dadfe7d1a23010d.
08:04:48.787 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
08:04:48.787 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#1 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
08:04:48.788 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3885c37b
08:04:48.788 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:04:48.788 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit1738461414297871817/checkpoints")
08:04:48.789 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
08:04:48.794 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
08:04:48.796 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
08:04:48.804 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@9fb2ccb
08:04:48.814 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2ac38f7f
08:04:48.820 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:04:48.833 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:04:48.834 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:48.840 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:48.849 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:48.852 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.852 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.852 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.853 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:48.854 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:48.855 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:48.856 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.857 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.857 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.858 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.859 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.859 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.859 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.860 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.862 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.862 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.862 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.863 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.863 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:48.868 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.868 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.868 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.868 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:48.874 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:48.875 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:48.877 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.877 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.877 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.879 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:48.880 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:48.881 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:48.882 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:48.883 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.884 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.884 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.884 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.884 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.884 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.885 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.885 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.885 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.885 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.886 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.886 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.886 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:48.887 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.887 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.887 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.887 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:48.892 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:48.893 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:48.893 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:48.894 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.894 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.894 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.895 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.895 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.896 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.896 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.897 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.897 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.897 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:48.900 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:48.901 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:48.901 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:48.902 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.902 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.902 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.903 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.904 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.904 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.905 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.905 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.905 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.905 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:48.908 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:04:48.912 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:48.913 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:48.913 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:48.914 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.914 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.914 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.915 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.915 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.915 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.916 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.916 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.916 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.916 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:48.920 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:48.921 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:48.921 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:48.921 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.922 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.922 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.922 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.922 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.922 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.923 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.923 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.923 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.923 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:48.932 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:48.933 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:48.933 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:48.935 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.935 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.935 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.935 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.936 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.936 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.936 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.936 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.937 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.937 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:48.941 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:48.941 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:48.941 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:48.942 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.942 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.942 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.943 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.943 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.943 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.944 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.944 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.944 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.944 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:48.960 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:48.961 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:48.962 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.962 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.962 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.963 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.963 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.963 [INFO - pool-38-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.964 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:48.964 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.965 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.965 [INFO - pool-38-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.965 [WARN - pool-38-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:48.972 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:48.973 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:48.974 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.974 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.974 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.975 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.975 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.975 [INFO - pool-36-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.976 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:48.976 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.976 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.977 [INFO - pool-36-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.977 [WARN - pool-36-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:48.980 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:48.981 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:48.982 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.982 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.982 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:48.983 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.983 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.983 [INFO - pool-38-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:48.983 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:48.984 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.984 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.984 [INFO - pool-38-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:48.984 [WARN - pool-38-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:49.000 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:49.001 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:49.002 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:49.002 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:49.002 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:49.003 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:49.004 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:49.004 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:49.004 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:49.004 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:49.005 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:49.005 [INFO - pool-38-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:49.005 [WARN - pool-38-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:49.053 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:49.053 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:49.054 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:49.055 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:49.055 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:49.055 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:49.056 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:49.056 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:49.056 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:49.057 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:49.057 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:49.057 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:49.057 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:49.130 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:49.131 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:49.131 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:49.132 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:49.132 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:49.132 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:49.139 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:49.139 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:49.139 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:49.139 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:49.139 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:49.140 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:49.140 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:49.192 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:49.192 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:49.193 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:49.194 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:49.194 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:49.194 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:49.194 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:49.194 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:49.194 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:49.195 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:49.195 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:49.195 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:49.195 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:49.220 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:49.221 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:49.222 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:49.223 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:49.223 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:49.223 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:49.224 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:49.224 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:49.225 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:49.225 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:49.226 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:49.226 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:49.226 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:49.241 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:49.242 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:49.242 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:49.243 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:49.243 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:49.243 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:49.243 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:49.243 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:49.243 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:49.243 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:49.243 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:49.244 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:49.244 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:49.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:48.377494 26551 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 26543
08:04:49.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:49.397297 26551 kernel_stack_watchdog.cc:198] Thread 26543 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 379ms:
08:04:49.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:04:49.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:04:49.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:04:49.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:04:49.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:46.998510 26552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:49.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:49.400372 26554 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2401 milliseconds
08:04:49.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:49.400635 26543 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.405s	user 0.499s	sys 0.603s
08:04:49.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:49.400871 26555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:49.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:49.401212 26543 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.405s	user 0.499s	sys 0.603s
08:04:49.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:49.402868 26543 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:04:49.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:49.406858 26543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:04:49.408 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:04:49.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:49.419090 26543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:04:49.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:49.429939 26543 hybrid_clock.cc:648] HybridClock initialized: now 1779091489429858 us; error 73 us; skew 500 ppm
08:04:49.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:49.431429 26543 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:04:49.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:49.458696 26543 webserver.cc:533] Webserver started at http://127.25.158.129:37977/ using document root <none> and password file <none>
08:04:49.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:49.460677 26543 fs_manager.cc:362] Metadata directory not provided
08:04:49.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:49.461177 26543 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:04:49.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:49.461942 26543 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:04:49.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:49.469190 26543 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-0/data/instance:
08:04:49.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "98e5872971c641b5973668f07f50cf2e"
08:04:49.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:49 on dist-test-slave-1jss"
08:04:49.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:49.478703 26543 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-0/wal/instance:
08:04:49.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "98e5872971c641b5973668f07f50cf2e"
08:04:49.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:49 on dist-test-slave-1jss"
08:04:49.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:49.510633 26543 fs_manager.cc:696] Time spent creating directory manager: real 0.030s	user 0.004s	sys 0.009s
08:04:49.520 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:49.521 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:49.521 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:49.521 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:49.521 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:49.521 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:49.522 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:49.522 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:49.522 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:49.522 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:49.522 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:49.522 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:49.522 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:49.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:49.535018 26593 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:04:49.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:49.538586 26543 fs_manager.cc:730] Time spent opening block manager: real 0.023s	user 0.005s	sys 0.004s
08:04:49.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:49.539225 26543 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-0/wal
08:04:49.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "98e5872971c641b5973668f07f50cf2e"
08:04:49.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:49 on dist-test-slave-1jss"
08:04:49.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:49.539932 26543 fs_report.cc:389] FS layout report
08:04:49.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:04:49.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-0/wal
08:04:49.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-0/wal
08:04:49.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-0/data/data
08:04:49.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:04:49.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:04:49.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:04:49.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:04:49.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:04:49.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:04:49.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:04:49.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:04:49.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:04:49.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:04:49.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:04:49.573 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:49.574 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:49.574 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:49.574 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:49.574 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:49.574 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:49.575 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:49.575 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:49.575 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:49.576 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:49.576 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:49.577 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:49.577 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:49.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:49.692442 26543 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:04:49.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:49.694554 26543 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:04:49.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:49.695149 26543 kserver.cc:163] Server-wide thread pool size limit: 3276
08:04:49.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:49.729430 26543 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:04:49.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:49.741855 26543 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:04:49.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:49.742177 26543 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:04:49.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:49.742504 26543 ts_tablet_manager.cc:616] Registered 0 tablets
08:04:49.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:49.742728 26543 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:04:49.907 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:04:50.077 [DEBUG - pool-12-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30019), Traces: [0ms] sending RPC to server master-127.23.12.252:42637, [5ms] received response from server master-127.23.12.252:42637: OK, deferred=null) with no deferred attached!
08:04:50.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:50.386466 26543 rpc_server.cc:307] RPC server started. Bound to: 127.25.158.129:33363
08:04:50.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:50.386574 26707 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.158.129:33363 every 8 connection(s)
08:04:50.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:50.390077 26543 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-0/data/info.pb
08:04:50.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:50.398566 26234 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 26543
08:04:50.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:50.399458 26234 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-0/wal/instance
08:04:50.408 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:04:50.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:50.413365 26234 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:50.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:50.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-1/wal
08:04:50.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-1/data
08:04:50.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-1/logs
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-1/data/info.pb
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.158.130:0
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.25.158.130
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.158.130
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.25.158.190:44627,127.25.158.189:46677,127.25.158.188:41049
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.158.148:40175
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:04:50.453 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:50.454 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:50.454 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:50.455 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:50.455 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:50.455 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:50.454 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:50.456 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:50.456 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:50.458 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:50.458 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:50.458 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:50.458 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:50.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:50.487248 26709 heartbeater.cc:344] Connected to a master server at 127.25.158.189:46677
08:04:50.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:50.488744 26708 heartbeater.cc:344] Connected to a master server at 127.25.158.188:41049
08:04:50.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:50.489179 26708 heartbeater.cc:461] Registering TS with master...
08:04:50.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:50.490662 26708 heartbeater.cc:507] Master 127.25.158.188:41049 requested a full tablet report, sending...
08:04:50.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:50.487877 26709 heartbeater.cc:461] Registering TS with master...
08:04:50.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:50.492645 26709 heartbeater.cc:507] Master 127.25.158.189:46677 requested a full tablet report, sending...
08:04:50.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:50.496030 26359 ts_manager.cc:194] Registered new tserver with Master: 98e5872971c641b5973668f07f50cf2e (127.25.158.129:33363)
08:04:50.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:50.496675 26442 ts_manager.cc:194] Registered new tserver with Master: 98e5872971c641b5973668f07f50cf2e (127.25.158.129:33363)
08:04:50.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:50.500733 26442 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.25.158.129:42073
08:04:50.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:50.512637 26713 heartbeater.cc:344] Connected to a master server at 127.25.158.190:44627
08:04:50.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:50.513044 26713 heartbeater.cc:461] Registering TS with master...
08:04:50.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:50.513710 26713 heartbeater.cc:507] Master 127.25.158.190:44627 requested a full tablet report, sending...
08:04:50.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:50.516880 26280 ts_manager.cc:194] Registered new tserver with Master: 98e5872971c641b5973668f07f50cf2e (127.25.158.129:33363)
08:04:50.760 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:50.761 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:50.761 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:50.762 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:50.762 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:50.762 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:50.763 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:50.763 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:50.763 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:50.763 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:50.763 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:50.764 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:50.764 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:50.908 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:04:50.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:50.911772 26712 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:04:50.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:50.912436 26712 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:04:50.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:50.913177 26712 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:04:50.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:50.975827 26712 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:04:50.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:50.977172 26712 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.158.130
08:04:51.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:51.045253 26712 tablet_server_runner.cc:78] Tablet server non-default flags:
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.158.148:40175
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-1/data
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-1/wal
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.158.130:0
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-1/data/info.pb
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.158.130
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.25.158.190:44627,127.25.158.189:46677,127.25.158.188:41049
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.25.158.130
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-1/logs
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:04:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:04:51.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:04:51.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:04:51.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:04:51.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:51.047144 26712 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:04:51.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:51.049410 26712 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:04:51.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:51.068754 26724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:51.408 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:04:51.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:51.505235 26708 heartbeater.cc:499] Master 127.25.158.188:41049 was elected leader, sending a full tablet report...
08:04:51.593 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:51.594 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:51.594 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:51.594 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:51.594 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:51.594 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:51.595 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:51.595 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:51.595 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:51.595 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:51.595 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:51.595 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:51.595 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:51.908 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:04:52.409 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:04:52.908 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:04:53.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:51.070590 26725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:53.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:53.053045 26712 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.985s	user 0.560s	sys 1.075s
08:04:53.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:53.053472 26712 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.986s	user 0.560s	sys 1.075s
08:04:53.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:52.470928 26723 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 26712
08:04:53.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:53.055809 26727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:53.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:53.059571 26726 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1985 milliseconds
08:04:53.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.059616 26712 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:04:53.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.061270 26712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:04:53.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.064303 26712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:04:53.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.066015 26712 hybrid_clock.cc:648] HybridClock initialized: now 1779091493065962 us; error 46 us; skew 500 ppm
08:04:53.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.066916 26712 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:04:53.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.073519 26712 webserver.cc:533] Webserver started at http://127.25.158.130:41863/ using document root <none> and password file <none>
08:04:53.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.075121 26712 fs_manager.cc:362] Metadata directory not provided
08:04:53.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.075423 26712 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:04:53.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.076048 26712 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:04:53.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.080812 26712 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-1/data/instance:
08:04:53.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c43299aa669648b7a17043222c5796c1"
08:04:53.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:53 on dist-test-slave-1jss"
08:04:53.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.082235 26712 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-1/wal/instance:
08:04:53.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c43299aa669648b7a17043222c5796c1"
08:04:53.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:53 on dist-test-slave-1jss"
08:04:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.090026 26712 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
08:04:53.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.096395 26737 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:04:53.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.097618 26712 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.004s
08:04:53.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.098034 26712 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-1/wal
08:04:53.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c43299aa669648b7a17043222c5796c1"
08:04:53.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:53 on dist-test-slave-1jss"
08:04:53.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.098347 26712 fs_report.cc:389] FS layout report
08:04:53.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:04:53.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-1/wal
08:04:53.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-1/wal
08:04:53.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-1/data/data
08:04:53.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:04:53.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:04:53.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:04:53.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:04:53.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:04:53.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:04:53.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:04:53.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:04:53.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:04:53.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:04:53.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:04:53.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.150564 26712 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:04:53.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.152176 26712 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:04:53.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.152726 26712 kserver.cc:163] Server-wide thread pool size limit: 3276
08:04:53.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.155931 26712 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:04:53.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.160548 26712 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:04:53.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.160801 26712 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:04:53.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.161142 26712 ts_tablet_manager.cc:616] Registered 0 tablets
08:04:53.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.161332 26712 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:04:53.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.315274 26712 rpc_server.cc:307] RPC server started. Bound to: 127.25.158.130:45041
08:04:53.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.315371 26851 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.158.130:45041 every 8 connection(s)
08:04:53.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.317988 26712 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-1/data/info.pb
08:04:53.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.320778 26234 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 26712
08:04:53.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.321269 26234 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-1/wal/instance
08:04:53.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.350522 26234 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:53.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:04:53.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-2/wal
08:04:53.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-2/data
08:04:53.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-2/logs
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-2/data/info.pb
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.158.131:0
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.25.158.131
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.158.131
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.25.158.190:44627,127.25.158.189:46677,127.25.158.188:41049
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.158.148:40175
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:04:53.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.381088 26853 heartbeater.cc:344] Connected to a master server at 127.25.158.189:46677
08:04:53.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.381369 26852 heartbeater.cc:344] Connected to a master server at 127.25.158.188:41049
08:04:53.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.382314 26852 heartbeater.cc:461] Registering TS with master...
08:04:53.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.384838 26853 heartbeater.cc:461] Registering TS with master...
08:04:53.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.385918 26853 heartbeater.cc:507] Master 127.25.158.189:46677 requested a full tablet report, sending...
08:04:53.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.384114 26852 heartbeater.cc:507] Master 127.25.158.188:41049 requested a full tablet report, sending...
08:04:53.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.390429 26442 ts_manager.cc:194] Registered new tserver with Master: c43299aa669648b7a17043222c5796c1 (127.25.158.130:45041)
08:04:53.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.390481 26359 ts_manager.cc:194] Registered new tserver with Master: c43299aa669648b7a17043222c5796c1 (127.25.158.130:45041)
08:04:53.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.392179 26442 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.25.158.130:60677
08:04:53.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.396842 26854 heartbeater.cc:344] Connected to a master server at 127.25.158.190:44627
08:04:53.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.397205 26854 heartbeater.cc:461] Registering TS with master...
08:04:53.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.397972 26854 heartbeater.cc:507] Master 127.25.158.190:44627 requested a full tablet report, sending...
08:04:53.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.401146 26280 ts_manager.cc:194] Registered new tserver with Master: c43299aa669648b7a17043222c5796c1 (127.25.158.130:45041)
08:04:53.408 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:04:53.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:53.538543 25733 debug-util.cc:398] Leaking SignalData structure 0x7b08000b1980 after lost signal to thread 25663
08:04:53.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:53.539386 25733 debug-util.cc:398] Leaking SignalData structure 0x7b080008bfe0 after lost signal to thread 25736
08:04:53.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:53.774192 26862 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:04:53.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:53.775329 26862 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:04:53.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:53.776242 26862 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:04:53.800 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:53.801 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:53.802 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:53.803 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:53.803 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:53.803 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:53.803 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:53.804 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:53.804 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:53.805 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:53.805 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:53.805 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:53.805 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:53.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:53.834291 26862 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:04:53.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:53.835835 26862 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.158.131
08:04:53.908 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:04:53.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.914976 26862 tablet_server_runner.cc:78] Tablet server non-default flags:
08:04:53.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:04:53.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.158.148:40175
08:04:53.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:04:53.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:04:53.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-2/data
08:04:53.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-2/wal
08:04:53.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:04:53.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:04:53.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.158.131:0
08:04:53.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:04:53.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:04:53.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:04:53.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-2/data/info.pb
08:04:53.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.158.131
08:04:53.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:04:53.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.25.158.190:44627,127.25.158.189:46677,127.25.158.188:41049
08:04:53.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:04:53.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:04:53.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:04:53.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:04:53.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:04:53.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.25.158.131
08:04:53.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-2/logs
08:04:53.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:04:53.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:04:53.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:04:53.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:04:53.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:04:53.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:04:53.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:04:53.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:04:53.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:04:53.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:04:53.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.917021 26862 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:04:53.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:53.919409 26862 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:04:53.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:53.936251 26870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:54.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:54.025506 26704 debug-util.cc:398] Leaking SignalData structure 0x7b08000ac540 after lost signal to thread 26545
08:04:54.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:54.027290 26704 debug-util.cc:398] Leaking SignalData structure 0x7b08000acd60 after lost signal to thread 26707
08:04:54.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:54.397670 26852 heartbeater.cc:499] Master 127.25.158.188:41049 was elected leader, sending a full tablet report...
08:04:54.408 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:04:54.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:54.725852 26848 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad060 after lost signal to thread 26719
08:04:54.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:54.727192 26848 debug-util.cc:398] Leaking SignalData structure 0x7b08000adf40 after lost signal to thread 26851
08:04:54.908 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:04:54.933 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:54.933 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:54.934 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:54.935 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:54.935 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:54.935 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:54.936 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:54.936 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:54.936 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:54.937 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:54.937 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:54.937 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:54.937 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:55.410 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:04:55.908 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:04:56.300 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:56.301 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:56.302 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:56.302 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:56.302 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:56.302 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:56.302 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:56.302 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:56.303 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:56.306 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:56.306 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:56.306 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:56.306 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:56.417 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:04:56.653 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:56.654 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:56.654 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:56.655 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:56.655 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:56.655 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:56.655 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:56.655 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:56.656 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:56.656 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:56.656 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:56.656 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:56.657 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:56.908 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:04:57.408 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:04:57.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:53.953259 26871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:57.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:55.338089 26869 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 26862
08:04:57.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:57.718997 26869 kernel_stack_watchdog.cc:198] Thread 26862 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 385ms:
08:04:57.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:04:57.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:04:57.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:04:57.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:04:57.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:57.720243 26862 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 3.770s	user 0.729s	sys 1.214s
08:04:57.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:57.720767 26862 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 3.770s	user 0.729s	sys 1.214s
08:04:57.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:57.722666 26872 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 3770 milliseconds
08:04:57.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:57.723752 26873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:04:57.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:57.723816 26862 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:04:57.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:57.725548 26862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:04:57.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:57.739488 26862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:04:57.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:57.743520 26862 hybrid_clock.cc:648] HybridClock initialized: now 1779091497743409 us; error 129 us; skew 500 ppm
08:04:57.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:57.744902 26862 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:04:57.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:57.773475 26862 webserver.cc:533] Webserver started at http://127.25.158.131:41647/ using document root <none> and password file <none>
08:04:57.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:57.775264 26862 fs_manager.cc:362] Metadata directory not provided
08:04:57.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:57.775585 26862 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:04:57.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:57.776284 26862 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:04:57.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:57.785269 26862 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-2/data/instance:
08:04:57.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9ae9aa4067a84876910d8ee905ea9e80"
08:04:57.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:57 on dist-test-slave-1jss"
08:04:57.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:57.788072 26862 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-2/wal/instance:
08:04:57.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9ae9aa4067a84876910d8ee905ea9e80"
08:04:57.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:57 on dist-test-slave-1jss"
08:04:57.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:57.801192 26862 fs_manager.cc:696] Time spent creating directory manager: real 0.012s	user 0.007s	sys 0.003s
08:04:57.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:57.821195 26887 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:04:57.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:57.823400 26862 fs_manager.cc:730] Time spent opening block manager: real 0.017s	user 0.004s	sys 0.010s
08:04:57.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:57.824072 26862 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-2/wal
08:04:57.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9ae9aa4067a84876910d8ee905ea9e80"
08:04:57.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:04:57 on dist-test-slave-1jss"
08:04:57.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:57.824805 26862 fs_report.cc:389] FS layout report
08:04:57.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:04:57.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-2/wal
08:04:57.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-2/wal
08:04:57.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-2/data/data
08:04:57.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:04:57.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:04:57.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:04:57.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:04:57.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:04:57.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:04:57.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:04:57.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:04:57.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:04:57.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:04:57.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:04:57.840 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:57.841 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:57.842 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:57.843 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:57.843 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:57.843 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:57.844 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:57.844 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:57.844 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:57.845 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:57.845 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:57.845 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:57.845 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:57.909 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:04:57.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:57.932586 26862 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:04:57.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:57.935701 26862 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:04:57.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:57.937095 26862 kserver.cc:163] Server-wide thread pool size limit: 3276
08:04:57.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:57.948060 26862 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:04:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:57.956950 26862 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:04:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:57.957592 26862 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.001s	sys 0.000s
08:04:57.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:57.958334 26862 ts_tablet_manager.cc:616] Registered 0 tablets
08:04:57.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:57.958746 26862 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:04:58.052 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:58.053 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:58.054 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:58.054 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:58.054 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:58.054 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:58.055 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:58.055 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:58.055 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:58.056 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:58.056 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:58.056 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:58.056 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:58.408 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:04:58.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:58.468231 26862 rpc_server.cc:307] RPC server started. Bound to: 127.25.158.131:36181
08:04:58.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:58.468441 27000 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.158.131:36181 every 8 connection(s)
08:04:58.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:58.473948 26862 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-2/data/info.pb
08:04:58.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:58.484661 26234 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 26862
08:04:58.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:58.485212 26234 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster14818590360074753247/ts-2/wal/instance
08:04:58.640 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:58.641 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:58.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:58.638866 27001 heartbeater.cc:344] Connected to a master server at 127.25.158.188:41049
08:04:58.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:58.639559 27001 heartbeater.cc:461] Registering TS with master...
08:04:58.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:58.641206 27001 heartbeater.cc:507] Master 127.25.158.188:41049 requested a full tablet report, sending...
08:04:58.642 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:58.642 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:58.642 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:58.643 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:58.644 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:58.644 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:58.644 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:58.645 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:58.645 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:58.645 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:58.646 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:58.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:58.649009 26442 ts_manager.cc:194] Registered new tserver with Master: 9ae9aa4067a84876910d8ee905ea9e80 (127.25.158.131:36181)
08:04:58.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:58.651264 26442 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.25.158.131:52559
08:04:58.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:58.666878 27005 heartbeater.cc:344] Connected to a master server at 127.25.158.190:44627
08:04:58.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:58.668165 27005 heartbeater.cc:461] Registering TS with master...
08:04:58.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:58.668946 27005 heartbeater.cc:507] Master 127.25.158.190:44627 requested a full tablet report, sending...
08:04:58.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:58.669188 27002 heartbeater.cc:344] Connected to a master server at 127.25.158.189:46677
08:04:58.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:58.669585 27002 heartbeater.cc:461] Registering TS with master...
08:04:58.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:58.670363 27002 heartbeater.cc:507] Master 127.25.158.189:46677 requested a full tablet report, sending...
08:04:58.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:58.671912 26280 ts_manager.cc:194] Registered new tserver with Master: 9ae9aa4067a84876910d8ee905ea9e80 (127.25.158.131:36181)
08:04:58.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:58.673009 26359 ts_manager.cc:194] Registered new tserver with Master: 9ae9aa4067a84876910d8ee905ea9e80 (127.25.158.131:36181)
08:04:58.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:58.686779 26234 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
08:04:58.702 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:04:58.703 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

08:04:58.705 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.25.158.190"
      port: 44627
    }
    bound_http_address {
      host: "127.25.158.190"
      port: 43483
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.25.158.189"
      port: 46677
    }
    bound_http_address {
      host: "127.25.158.189"
      port: 38549
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.25.158.188"
      port: 41049
    }
    bound_http_address {
      host: "127.25.158.188"
      port: 39989
    }
  }
}

08:04:58.705 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

08:04:58.712 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.25.158.129"
      port: 33363
    }
    bound_http_address {
      host: "127.25.158.129"
      port: 37977
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.25.158.130"
      port: 45041
    }
    bound_http_address {
      host: "127.25.158.130"
      port: 41863
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.25.158.131"
      port: 36181
    }
    bound_http_address {
      host: "127.25.158.131"
      port: 41647
    }
  }
}

08:04:58.712 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
08:04:58.715 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:04:58.735 [DEBUG - main] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:04:58.737 [DEBUG - main] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:04:58.746 [DEBUG - main] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:04:58.749 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.24.230.254:40685(127.24.230.254:40685)] Successfully connected to peer
08:04:58.750 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.24.230.252:40255(127.24.230.252:40255)] Successfully connected to peer
08:04:58.775 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.24.230.253:39511(127.24.230.253:39511)] Successfully connected to peer
08:04:58.790 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.252
08:04:58.790 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.254
08:04:58.805 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.253
08:04:58.830 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:58.833 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:58.841 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xbdb3f63a, L:/127.0.0.1:54562 - R:/127.24.230.254:40685] using SASL/PLAIN
08:04:58.852 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x884be71b, L:/127.0.0.1:33058 - R:/127.24.230.252:40255] using SASL/PLAIN
08:04:58.858 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:04:58.859 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=130), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [123ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: OK, deferred=null) after lookup
08:04:58.869 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:04:58.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:58.862902 25702 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33058:
08:04:58.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
08:04:58.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
08:04:58.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:04:58.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
08:04:58.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:04:58.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:04:58.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:04:58.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:04:58.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:04:58.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:04:58.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:04:58.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:04:58.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
08:04:58.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:04:58.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:04:58.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:04:58.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:04:58.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:04:58.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:04:58.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:04:58.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:04:58.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
08:04:58.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:04:58.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:04:58.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:04:58.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:04:58.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:04:58.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:04:58.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:04:58.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:04:58.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
08:04:58.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:04:58.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:04:58.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:04:58.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:04:58.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:04:58.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:04:58.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:04:58.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:04:58.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
08:04:58.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
08:04:58.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
08:04:58.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
08:04:58.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:04:58.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
08:04:58.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
08:04:58.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:04:58.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
08:04:58.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
08:04:58.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
08:04:58.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:04:58.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:04:58.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   custom_hash_schema_ranges {
08:04:58.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     range_bounds {
08:04:58.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       rows: "<redacted>""\006\001d\000\000\000\007\001\310\000\000\000"
08:04:58.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:04:58.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     hash_schema {
08:04:58.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       columns {
08:04:58.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)         name: "key1"
08:04:58.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       }
08:04:58.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       num_buckets: 5
08:04:58.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       seed: 123
08:04:58.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:04:58.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:04:58.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:04:58.890 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xc6c3c7e9, L:/127.0.0.1:57922 - R:/127.24.230.253:39511] using SASL/PLAIN
08:04:58.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:58.881757 25702 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
08:04:58.908 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:04:59.056 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 657359905549407fbbf9cdc201e47d49
08:04:59.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.270072 25872 tablet_service.cc:1511] Processing CreateTablet for tablet 4b90e75a8ecf45b4b24d00c51d885ffa (DEFAULT_TABLE table=replication_test_table [id=657359905549407fbbf9cdc201e47d49]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
08:04:59.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.287581 26154 tablet_service.cc:1511] Processing CreateTablet for tablet 4be0df9f650f41e59a6c52d0160ab38d (DEFAULT_TABLE table=replication_test_table [id=657359905549407fbbf9cdc201e47d49]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
08:04:59.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.291441 26154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4be0df9f650f41e59a6c52d0160ab38d. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:59.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.294533 26155 tablet_service.cc:1511] Processing CreateTablet for tablet c02ccf07c7dd4bd8bd988bc91473ed95 (DEFAULT_TABLE table=replication_test_table [id=657359905549407fbbf9cdc201e47d49]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
08:04:59.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.298338 26013 tablet_service.cc:1511] Processing CreateTablet for tablet 4be0df9f650f41e59a6c52d0160ab38d (DEFAULT_TABLE table=replication_test_table [id=657359905549407fbbf9cdc201e47d49]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
08:04:59.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.302019 26014 tablet_service.cc:1511] Processing CreateTablet for tablet c02ccf07c7dd4bd8bd988bc91473ed95 (DEFAULT_TABLE table=replication_test_table [id=657359905549407fbbf9cdc201e47d49]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
08:04:59.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.303879 26015 tablet_service.cc:1511] Processing CreateTablet for tablet dd533e1ae3024cc396ad8921413c2eaa (DEFAULT_TABLE table=replication_test_table [id=657359905549407fbbf9cdc201e47d49]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
08:04:59.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.304754 25869 tablet_service.cc:1511] Processing CreateTablet for tablet 4be0df9f650f41e59a6c52d0160ab38d (DEFAULT_TABLE table=replication_test_table [id=657359905549407fbbf9cdc201e47d49]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
08:04:59.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.307003 25869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4be0df9f650f41e59a6c52d0160ab38d. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:59.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.307940 26016 tablet_service.cc:1511] Processing CreateTablet for tablet 4b90e75a8ecf45b4b24d00c51d885ffa (DEFAULT_TABLE table=replication_test_table [id=657359905549407fbbf9cdc201e47d49]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
08:04:59.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.309103 25870 tablet_service.cc:1511] Processing CreateTablet for tablet c02ccf07c7dd4bd8bd988bc91473ed95 (DEFAULT_TABLE table=replication_test_table [id=657359905549407fbbf9cdc201e47d49]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
08:04:59.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.310672 25871 tablet_service.cc:1511] Processing CreateTablet for tablet dd533e1ae3024cc396ad8921413c2eaa (DEFAULT_TABLE table=replication_test_table [id=657359905549407fbbf9cdc201e47d49]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
08:04:59.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.311977 26013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4be0df9f650f41e59a6c52d0160ab38d. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:59.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.312219 25871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd533e1ae3024cc396ad8921413c2eaa. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:59.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.298243 26157 tablet_service.cc:1511] Processing CreateTablet for tablet 4b90e75a8ecf45b4b24d00c51d885ffa (DEFAULT_TABLE table=replication_test_table [id=657359905549407fbbf9cdc201e47d49]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
08:04:59.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.318198 26014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c02ccf07c7dd4bd8bd988bc91473ed95. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:59.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.319823 25870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c02ccf07c7dd4bd8bd988bc91473ed95. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:59.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.321101 26015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd533e1ae3024cc396ad8921413c2eaa. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:59.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.322273 26155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c02ccf07c7dd4bd8bd988bc91473ed95. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:59.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.323511 26016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b90e75a8ecf45b4b24d00c51d885ffa. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:59.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.312711 26017 tablet_service.cc:1511] Processing CreateTablet for tablet e08529d853844e528843b6dcec7868e5 (DEFAULT_TABLE table=replication_test_table [id=657359905549407fbbf9cdc201e47d49]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
08:04:59.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.326126 26156 tablet_service.cc:1511] Processing CreateTablet for tablet dd533e1ae3024cc396ad8921413c2eaa (DEFAULT_TABLE table=replication_test_table [id=657359905549407fbbf9cdc201e47d49]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
08:04:59.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.327469 26017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08529d853844e528843b6dcec7868e5. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:59.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.327642 26156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd533e1ae3024cc396ad8921413c2eaa. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:59.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.329646 26157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b90e75a8ecf45b4b24d00c51d885ffa. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:59.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.332432 26158 tablet_service.cc:1511] Processing CreateTablet for tablet e08529d853844e528843b6dcec7868e5 (DEFAULT_TABLE table=replication_test_table [id=657359905549407fbbf9cdc201e47d49]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
08:04:59.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.333940 26158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08529d853844e528843b6dcec7868e5. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:59.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.338012 25873 tablet_service.cc:1511] Processing CreateTablet for tablet e08529d853844e528843b6dcec7868e5 (DEFAULT_TABLE table=replication_test_table [id=657359905549407fbbf9cdc201e47d49]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
08:04:59.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.339516 25873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08529d853844e528843b6dcec7868e5. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.351833 25872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b90e75a8ecf45b4b24d00c51d885ffa. 1 dirs total, 0 dirs full, 0 dirs failed
08:04:59.409 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:04:59.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.467224 27041 tablet_bootstrap.cc:492] T e08529d853844e528843b6dcec7868e5 P 37d338f6c5db4cc4bace5615d0b1421a: Bootstrap starting.
08:04:59.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.480144 27041 tablet_bootstrap.cc:654] T e08529d853844e528843b6dcec7868e5 P 37d338f6c5db4cc4bace5615d0b1421a: Neither blocks nor log segments found. Creating new log.
08:04:59.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.483642 27041 log.cc:826] T e08529d853844e528843b6dcec7868e5 P 37d338f6c5db4cc4bace5615d0b1421a: Log is configured to *not* fsync() on all Append() calls
08:04:59.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.500545 27040 tablet_bootstrap.cc:492] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff: Bootstrap starting.
08:04:59.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.533556 27040 tablet_bootstrap.cc:654] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff: Neither blocks nor log segments found. Creating new log.
08:04:59.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.538002 27040 log.cc:826] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff: Log is configured to *not* fsync() on all Append() calls
08:04:59.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.555896 27041 tablet_bootstrap.cc:492] T e08529d853844e528843b6dcec7868e5 P 37d338f6c5db4cc4bace5615d0b1421a: No bootstrap required, opened a new log
08:04:59.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.556643 27041 ts_tablet_manager.cc:1403] T e08529d853844e528843b6dcec7868e5 P 37d338f6c5db4cc4bace5615d0b1421a: Time spent bootstrapping tablet: real 0.094s	user 0.031s	sys 0.031s
08:04:59.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.597863 27040 tablet_bootstrap.cc:492] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff: No bootstrap required, opened a new log
08:04:59.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.601912 27041 raft_consensus.cc:359] T e08529d853844e528843b6dcec7868e5 P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } } peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } }
08:04:59.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.603374 27041 raft_consensus.cc:385] T e08529d853844e528843b6dcec7868e5 P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:59.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.603715 27041 raft_consensus.cc:740] T e08529d853844e528843b6dcec7868e5 P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37d338f6c5db4cc4bace5615d0b1421a, State: Initialized, Role: FOLLOWER
08:04:59.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.604720 27041 consensus_queue.cc:260] T e08529d853844e528843b6dcec7868e5 P 37d338f6c5db4cc4bace5615d0b1421a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } } peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } }
08:04:59.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.607342 27046 tablet_bootstrap.cc:492] T e08529d853844e528843b6dcec7868e5 P 97ad2967f56a4511a42f5f0981fb24d5: Bootstrap starting.
08:04:59.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.598536 27040 ts_tablet_manager.cc:1403] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff: Time spent bootstrapping tablet: real 0.099s	user 0.017s	sys 0.035s
08:04:59.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.622347 27041 ts_tablet_manager.cc:1434] T e08529d853844e528843b6dcec7868e5 P 37d338f6c5db4cc4bace5615d0b1421a: Time spent starting tablet: real 0.065s	user 0.028s	sys 0.012s
08:04:59.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.630568 27046 tablet_bootstrap.cc:654] T e08529d853844e528843b6dcec7868e5 P 97ad2967f56a4511a42f5f0981fb24d5: Neither blocks nor log segments found. Creating new log.
08:04:59.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.632885 27041 tablet_bootstrap.cc:492] T 4b90e75a8ecf45b4b24d00c51d885ffa P 37d338f6c5db4cc4bace5615d0b1421a: Bootstrap starting.
08:04:59.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.633579 27046 log.cc:826] T e08529d853844e528843b6dcec7868e5 P 97ad2967f56a4511a42f5f0981fb24d5: Log is configured to *not* fsync() on all Append() calls
08:04:59.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.647159 27046 tablet_bootstrap.cc:492] T e08529d853844e528843b6dcec7868e5 P 97ad2967f56a4511a42f5f0981fb24d5: No bootstrap required, opened a new log
08:04:59.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.648231 27041 tablet_bootstrap.cc:654] T 4b90e75a8ecf45b4b24d00c51d885ffa P 37d338f6c5db4cc4bace5615d0b1421a: Neither blocks nor log segments found. Creating new log.
08:04:59.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.648232 27046 ts_tablet_manager.cc:1403] T e08529d853844e528843b6dcec7868e5 P 97ad2967f56a4511a42f5f0981fb24d5: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.016s
08:04:59.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.654151 27040 raft_consensus.cc:359] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:04:59.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.655264 27040 raft_consensus.cc:385] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:59.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.655669 27040 raft_consensus.cc:740] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bda994622fa49ac9fabfbf40edba4ff, State: Initialized, Role: FOLLOWER
08:04:59.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.656704 27040 consensus_queue.cc:260] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:04:59.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.661957 27001 heartbeater.cc:499] Master 127.25.158.188:41049 was elected leader, sending a full tablet report...
08:04:59.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.675608 27041 tablet_bootstrap.cc:492] T 4b90e75a8ecf45b4b24d00c51d885ffa P 37d338f6c5db4cc4bace5615d0b1421a: No bootstrap required, opened a new log
08:04:59.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.676177 27041 ts_tablet_manager.cc:1403] T 4b90e75a8ecf45b4b24d00c51d885ffa P 37d338f6c5db4cc4bace5615d0b1421a: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.005s
08:04:59.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.680368 27041 raft_consensus.cc:359] T 4b90e75a8ecf45b4b24d00c51d885ffa P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:04:59.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.681123 27041 raft_consensus.cc:385] T 4b90e75a8ecf45b4b24d00c51d885ffa P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:59.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.681421 27041 raft_consensus.cc:740] T 4b90e75a8ecf45b4b24d00c51d885ffa P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37d338f6c5db4cc4bace5615d0b1421a, State: Initialized, Role: FOLLOWER
08:04:59.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.684415 27041 consensus_queue.cc:260] T 4b90e75a8ecf45b4b24d00c51d885ffa P 37d338f6c5db4cc4bace5615d0b1421a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:04:59.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.687151 27040 ts_tablet_manager.cc:1434] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff: Time spent starting tablet: real 0.078s	user 0.039s	sys 0.003s
08:04:59.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.694918 27040 tablet_bootstrap.cc:492] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff: Bootstrap starting.
08:04:59.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.695062 27041 ts_tablet_manager.cc:1434] T 4b90e75a8ecf45b4b24d00c51d885ffa P 37d338f6c5db4cc4bace5615d0b1421a: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.004s
08:04:59.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.703536 27041 tablet_bootstrap.cc:492] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a: Bootstrap starting.
08:04:59.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.705160 27040 tablet_bootstrap.cc:654] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff: Neither blocks nor log segments found. Creating new log.
08:04:59.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.721855 27040 tablet_bootstrap.cc:492] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff: No bootstrap required, opened a new log
08:04:59.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.722345 27040 ts_tablet_manager.cc:1403] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.009s
08:04:59.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.726634 27040 raft_consensus.cc:359] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } } peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } }
08:04:59.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.727466 27040 raft_consensus.cc:385] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:59.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.727819 27040 raft_consensus.cc:740] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bda994622fa49ac9fabfbf40edba4ff, State: Initialized, Role: FOLLOWER
08:04:59.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.728770 27040 consensus_queue.cc:260] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } } peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } }
08:04:59.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.737972 27041 tablet_bootstrap.cc:654] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a: Neither blocks nor log segments found. Creating new log.
08:04:59.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:59.738632 26088 tablet.cc:2404] T 4b90e75a8ecf45b4b24d00c51d885ffa P 37d338f6c5db4cc4bace5615d0b1421a: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:04:59.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.737313 27046 raft_consensus.cc:359] T e08529d853844e528843b6dcec7868e5 P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } } peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } }
08:04:59.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.741902 27040 ts_tablet_manager.cc:1434] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
08:04:59.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.741560 27046 raft_consensus.cc:385] T e08529d853844e528843b6dcec7868e5 P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:59.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.743511 27046 raft_consensus.cc:740] T e08529d853844e528843b6dcec7868e5 P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ad2967f56a4511a42f5f0981fb24d5, State: Initialized, Role: FOLLOWER
08:04:59.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.744999 27046 consensus_queue.cc:260] T e08529d853844e528843b6dcec7868e5 P 97ad2967f56a4511a42f5f0981fb24d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } } peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } }
08:04:59.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:59.748294 26227 tablet.cc:2404] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:04:59.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.754725 27040 tablet_bootstrap.cc:492] T c02ccf07c7dd4bd8bd988bc91473ed95 P 9bda994622fa49ac9fabfbf40edba4ff: Bootstrap starting.
08:04:59.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.761708 27040 tablet_bootstrap.cc:654] T c02ccf07c7dd4bd8bd988bc91473ed95 P 9bda994622fa49ac9fabfbf40edba4ff: Neither blocks nor log segments found. Creating new log.
08:04:59.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.766039 27046 ts_tablet_manager.cc:1434] T e08529d853844e528843b6dcec7868e5 P 97ad2967f56a4511a42f5f0981fb24d5: Time spent starting tablet: real 0.117s	user 0.039s	sys 0.009s
08:04:59.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.781987 27046 tablet_bootstrap.cc:492] T 4be0df9f650f41e59a6c52d0160ab38d P 97ad2967f56a4511a42f5f0981fb24d5: Bootstrap starting.
08:04:59.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.779731 27041 tablet_bootstrap.cc:492] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a: No bootstrap required, opened a new log
08:04:59.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.789212 27041 ts_tablet_manager.cc:1403] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a: Time spent bootstrapping tablet: real 0.087s	user 0.001s	sys 0.015s
08:04:59.792 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:04:59.793 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:04:59.794 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:04:59.796 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:59.796 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:59.797 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:04:59.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.796948 27046 tablet_bootstrap.cc:654] T 4be0df9f650f41e59a6c52d0160ab38d P 97ad2967f56a4511a42f5f0981fb24d5: Neither blocks nor log segments found. Creating new log.
08:04:59.798 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:59.798 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:59.798 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:04:59.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:04:59.802570 25943 tablet.cc:2404] T e08529d853844e528843b6dcec7868e5 P 97ad2967f56a4511a42f5f0981fb24d5: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:04:59.805 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:59.805 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:59.805 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:04:59.805 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:04:59.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.812147 27046 tablet_bootstrap.cc:492] T 4be0df9f650f41e59a6c52d0160ab38d P 97ad2967f56a4511a42f5f0981fb24d5: No bootstrap required, opened a new log
08:04:59.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.812726 27046 ts_tablet_manager.cc:1403] T 4be0df9f650f41e59a6c52d0160ab38d P 97ad2967f56a4511a42f5f0981fb24d5: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.011s
08:04:59.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.817462 27046 raft_consensus.cc:359] T 4be0df9f650f41e59a6c52d0160ab38d P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:04:59.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.818257 27046 raft_consensus.cc:385] T 4be0df9f650f41e59a6c52d0160ab38d P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:59.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.818558 27046 raft_consensus.cc:740] T 4be0df9f650f41e59a6c52d0160ab38d P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ad2967f56a4511a42f5f0981fb24d5, State: Initialized, Role: FOLLOWER
08:04:59.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.821164 27046 consensus_queue.cc:260] T 4be0df9f650f41e59a6c52d0160ab38d P 97ad2967f56a4511a42f5f0981fb24d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:04:59.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.823336 27046 ts_tablet_manager.cc:1434] T 4be0df9f650f41e59a6c52d0160ab38d P 97ad2967f56a4511a42f5f0981fb24d5: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
08:04:59.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.828079 27046 tablet_bootstrap.cc:492] T c02ccf07c7dd4bd8bd988bc91473ed95 P 97ad2967f56a4511a42f5f0981fb24d5: Bootstrap starting.
08:04:59.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.820278 27041 raft_consensus.cc:359] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:04:59.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.837558 27041 raft_consensus.cc:385] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:59.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.838994 27041 raft_consensus.cc:740] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37d338f6c5db4cc4bace5615d0b1421a, State: Initialized, Role: FOLLOWER
08:04:59.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.842157 27041 consensus_queue.cc:260] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:04:59.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.859824 27050 raft_consensus.cc:493] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:04:59.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.860858 27041 ts_tablet_manager.cc:1434] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.000s
08:04:59.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.860544 27050 raft_consensus.cc:515] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } } peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } }
08:04:59.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.867307 27050 leader_election.cc:290] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37d338f6c5db4cc4bace5615d0b1421a (127.24.230.194:36057), 97ad2967f56a4511a42f5f0981fb24d5 (127.24.230.193:33195)
08:04:59.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.880769 27047 raft_consensus.cc:493] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:04:59.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.881538 27047 raft_consensus.cc:515] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:04:59.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.885247 27046 tablet_bootstrap.cc:654] T c02ccf07c7dd4bd8bd988bc91473ed95 P 97ad2967f56a4511a42f5f0981fb24d5: Neither blocks nor log segments found. Creating new log.
08:04:59.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.886718 27041 tablet_bootstrap.cc:492] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a: Bootstrap starting.
08:04:59.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.891232 27047 leader_election.cc:290] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97ad2967f56a4511a42f5f0981fb24d5 (127.24.230.193:33195), 9bda994622fa49ac9fabfbf40edba4ff (127.24.230.195:45755)
08:04:59.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.893378 27050 raft_consensus.cc:493] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:04:59.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.895686 27050 raft_consensus.cc:515] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:04:59.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.897701 27050 leader_election.cc:290] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97ad2967f56a4511a42f5f0981fb24d5 (127.24.230.193:33195), 37d338f6c5db4cc4bace5615d0b1421a (127.24.230.194:36057)
08:04:59.908 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:04:59.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.911715 27040 tablet_bootstrap.cc:492] T c02ccf07c7dd4bd8bd988bc91473ed95 P 9bda994622fa49ac9fabfbf40edba4ff: No bootstrap required, opened a new log
08:04:59.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.912272 27040 ts_tablet_manager.cc:1403] T c02ccf07c7dd4bd8bd988bc91473ed95 P 9bda994622fa49ac9fabfbf40edba4ff: Time spent bootstrapping tablet: real 0.158s	user 0.030s	sys 0.047s
08:04:59.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.920902 27046 tablet_bootstrap.cc:492] T c02ccf07c7dd4bd8bd988bc91473ed95 P 97ad2967f56a4511a42f5f0981fb24d5: No bootstrap required, opened a new log
08:04:59.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.921635 27046 ts_tablet_manager.cc:1403] T c02ccf07c7dd4bd8bd988bc91473ed95 P 97ad2967f56a4511a42f5f0981fb24d5: Time spent bootstrapping tablet: real 0.094s	user 0.008s	sys 0.008s
08:04:59.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.924592 27046 raft_consensus.cc:359] T c02ccf07c7dd4bd8bd988bc91473ed95 P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:04:59.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.929056 27046 raft_consensus.cc:385] T c02ccf07c7dd4bd8bd988bc91473ed95 P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:59.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.929490 27046 raft_consensus.cc:740] T c02ccf07c7dd4bd8bd988bc91473ed95 P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ad2967f56a4511a42f5f0981fb24d5, State: Initialized, Role: FOLLOWER
08:04:59.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.930846 27046 consensus_queue.cc:260] T c02ccf07c7dd4bd8bd988bc91473ed95 P 97ad2967f56a4511a42f5f0981fb24d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:04:59.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.918296 27040 raft_consensus.cc:359] T c02ccf07c7dd4bd8bd988bc91473ed95 P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:04:59.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.934182 27040 raft_consensus.cc:385] T c02ccf07c7dd4bd8bd988bc91473ed95 P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:59.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.934532 27040 raft_consensus.cc:740] T c02ccf07c7dd4bd8bd988bc91473ed95 P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bda994622fa49ac9fabfbf40edba4ff, State: Initialized, Role: FOLLOWER
08:04:59.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.936445 27041 tablet_bootstrap.cc:654] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a: Neither blocks nor log segments found. Creating new log.
08:04:59.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.941057 27040 consensus_queue.cc:260] T c02ccf07c7dd4bd8bd988bc91473ed95 P 9bda994622fa49ac9fabfbf40edba4ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:04:59.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.956681 27040 ts_tablet_manager.cc:1434] T c02ccf07c7dd4bd8bd988bc91473ed95 P 9bda994622fa49ac9fabfbf40edba4ff: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
08:04:59.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.957870 27040 tablet_bootstrap.cc:492] T 4be0df9f650f41e59a6c52d0160ab38d P 9bda994622fa49ac9fabfbf40edba4ff: Bootstrap starting.
08:04:59.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.963805 27047 raft_consensus.cc:493] T e08529d853844e528843b6dcec7868e5 P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:04:59.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.964527 27047 raft_consensus.cc:515] T e08529d853844e528843b6dcec7868e5 P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } } peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } }
08:04:59.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.966480 27046 ts_tablet_manager.cc:1434] T c02ccf07c7dd4bd8bd988bc91473ed95 P 97ad2967f56a4511a42f5f0981fb24d5: Time spent starting tablet: real 0.044s	user 0.003s	sys 0.004s
08:04:59.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.971271 27047 leader_election.cc:290] T e08529d853844e528843b6dcec7868e5 P 37d338f6c5db4cc4bace5615d0b1421a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bda994622fa49ac9fabfbf40edba4ff (127.24.230.195:45755), 97ad2967f56a4511a42f5f0981fb24d5 (127.24.230.193:33195)
08:04:59.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.974313 27053 raft_consensus.cc:493] T 4be0df9f650f41e59a6c52d0160ab38d P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:04:59.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.975230 27053 raft_consensus.cc:515] T 4be0df9f650f41e59a6c52d0160ab38d P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:04:59.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.977212 27041 tablet_bootstrap.cc:492] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a: No bootstrap required, opened a new log
08:04:59.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.977738 27041 ts_tablet_manager.cc:1403] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a: Time spent bootstrapping tablet: real 0.091s	user 0.007s	sys 0.005s
08:04:59.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.987928 27041 raft_consensus.cc:359] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:04:59.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.988879 27041 raft_consensus.cc:385] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:04:59.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.989275 27041 raft_consensus.cc:740] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37d338f6c5db4cc4bace5615d0b1421a, State: Initialized, Role: FOLLOWER
08:04:59.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.991679 27053 leader_election.cc:290] T 4be0df9f650f41e59a6c52d0160ab38d P 97ad2967f56a4511a42f5f0981fb24d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37d338f6c5db4cc4bace5615d0b1421a (127.24.230.194:36057), 9bda994622fa49ac9fabfbf40edba4ff (127.24.230.195:45755)
08:05:00.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:04:59.995675 27041 consensus_queue.cc:260] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:05:00.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.001266 27040 tablet_bootstrap.cc:654] T 4be0df9f650f41e59a6c52d0160ab38d P 9bda994622fa49ac9fabfbf40edba4ff: Neither blocks nor log segments found. Creating new log.
08:05:00.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.001336 27041 ts_tablet_manager.cc:1434] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
08:05:00.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.003048 27041 tablet_bootstrap.cc:492] T 4be0df9f650f41e59a6c52d0160ab38d P 37d338f6c5db4cc4bace5615d0b1421a: Bootstrap starting.
08:05:00.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.010905 27041 tablet_bootstrap.cc:654] T 4be0df9f650f41e59a6c52d0160ab38d P 37d338f6c5db4cc4bace5615d0b1421a: Neither blocks nor log segments found. Creating new log.
08:05:00.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.015142 27046 tablet_bootstrap.cc:492] T 4b90e75a8ecf45b4b24d00c51d885ffa P 97ad2967f56a4511a42f5f0981fb24d5: Bootstrap starting.
08:05:00.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.016887 27053 raft_consensus.cc:493] T e08529d853844e528843b6dcec7868e5 P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:05:00.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.017427 27053 raft_consensus.cc:515] T e08529d853844e528843b6dcec7868e5 P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } } peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } }
08:05:00.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.032588 27053 leader_election.cc:290] T e08529d853844e528843b6dcec7868e5 P 97ad2967f56a4511a42f5f0981fb24d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37d338f6c5db4cc4bace5615d0b1421a (127.24.230.194:36057), 9bda994622fa49ac9fabfbf40edba4ff (127.24.230.195:45755)
08:05:00.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.056169 27050 raft_consensus.cc:493] T c02ccf07c7dd4bd8bd988bc91473ed95 P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:05:00.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.056917 27050 raft_consensus.cc:515] T c02ccf07c7dd4bd8bd988bc91473ed95 P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:05:00.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.059475 27046 tablet_bootstrap.cc:654] T 4b90e75a8ecf45b4b24d00c51d885ffa P 97ad2967f56a4511a42f5f0981fb24d5: Neither blocks nor log segments found. Creating new log.
08:05:00.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.059755 27050 leader_election.cc:290] T c02ccf07c7dd4bd8bd988bc91473ed95 P 9bda994622fa49ac9fabfbf40edba4ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97ad2967f56a4511a42f5f0981fb24d5 (127.24.230.193:33195), 37d338f6c5db4cc4bace5615d0b1421a (127.24.230.194:36057)
08:05:00.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.072314 27040 tablet_bootstrap.cc:492] T 4be0df9f650f41e59a6c52d0160ab38d P 9bda994622fa49ac9fabfbf40edba4ff: No bootstrap required, opened a new log
08:05:00.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.072901 27040 ts_tablet_manager.cc:1403] T 4be0df9f650f41e59a6c52d0160ab38d P 9bda994622fa49ac9fabfbf40edba4ff: Time spent bootstrapping tablet: real 0.115s	user 0.012s	sys 0.002s
08:05:00.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.084100 27041 tablet_bootstrap.cc:492] T 4be0df9f650f41e59a6c52d0160ab38d P 37d338f6c5db4cc4bace5615d0b1421a: No bootstrap required, opened a new log
08:05:00.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.087607 25893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ccf07c7dd4bd8bd988bc91473ed95" candidate_uuid: "37d338f6c5db4cc4bace5615d0b1421a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ad2967f56a4511a42f5f0981fb24d5" is_pre_election: true
08:05:00.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.088749 25893 raft_consensus.cc:2468] T c02ccf07c7dd4bd8bd988bc91473ed95 P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37d338f6c5db4cc4bace5615d0b1421a in term 0.
08:05:00.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.088778 26037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08529d853844e528843b6dcec7868e5" candidate_uuid: "9bda994622fa49ac9fabfbf40edba4ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37d338f6c5db4cc4bace5615d0b1421a" is_pre_election: true
08:05:00.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.089653 26037 raft_consensus.cc:2468] T e08529d853844e528843b6dcec7868e5 P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bda994622fa49ac9fabfbf40edba4ff in term 0.
08:05:00.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.090673 25892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08529d853844e528843b6dcec7868e5" candidate_uuid: "37d338f6c5db4cc4bace5615d0b1421a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ad2967f56a4511a42f5f0981fb24d5" is_pre_election: true
08:05:00.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.091573 25892 raft_consensus.cc:2468] T e08529d853844e528843b6dcec7868e5 P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37d338f6c5db4cc4bace5615d0b1421a in term 0.
08:05:00.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.091657 26037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90e75a8ecf45b4b24d00c51d885ffa" candidate_uuid: "9bda994622fa49ac9fabfbf40edba4ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37d338f6c5db4cc4bace5615d0b1421a" is_pre_election: true
08:05:00.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.092252 26037 raft_consensus.cc:2468] T 4b90e75a8ecf45b4b24d00c51d885ffa P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bda994622fa49ac9fabfbf40edba4ff in term 0.
08:05:00.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.084637 27041 ts_tablet_manager.cc:1403] T 4be0df9f650f41e59a6c52d0160ab38d P 37d338f6c5db4cc4bace5615d0b1421a: Time spent bootstrapping tablet: real 0.082s	user 0.043s	sys 0.031s
08:05:00.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.095584 26037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ccf07c7dd4bd8bd988bc91473ed95" candidate_uuid: "9bda994622fa49ac9fabfbf40edba4ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37d338f6c5db4cc4bace5615d0b1421a" is_pre_election: true
08:05:00.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.096537 26037 raft_consensus.cc:2468] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bda994622fa49ac9fabfbf40edba4ff in term 0.
08:05:00.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.098587 26111 leader_election.cc:304] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37d338f6c5db4cc4bace5615d0b1421a, 9bda994622fa49ac9fabfbf40edba4ff; no voters: 
08:05:00.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.099321 27041 raft_consensus.cc:359] T 4be0df9f650f41e59a6c52d0160ab38d P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:05:00.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.101979 27050 raft_consensus.cc:2804] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Leader pre-election won for term 1
08:05:00.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.102370 27050 raft_consensus.cc:493] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:05:00.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.102260 26111 leader_election.cc:304] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37d338f6c5db4cc4bace5615d0b1421a, 9bda994622fa49ac9fabfbf40edba4ff; no voters: 
08:05:00.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.102748 27050 raft_consensus.cc:3060] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Advancing to term 1
08:05:00.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.110081 25893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08529d853844e528843b6dcec7868e5" candidate_uuid: "9bda994622fa49ac9fabfbf40edba4ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ad2967f56a4511a42f5f0981fb24d5" is_pre_election: true
08:05:00.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.110853 25893 raft_consensus.cc:2468] T e08529d853844e528843b6dcec7868e5 P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bda994622fa49ac9fabfbf40edba4ff in term 0.
08:05:00.113 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:00.114 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:00.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.113679 25891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ccf07c7dd4bd8bd988bc91473ed95" candidate_uuid: "9bda994622fa49ac9fabfbf40edba4ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ad2967f56a4511a42f5f0981fb24d5" is_pre_election: true
08:05:00.114 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:00.114 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:00.115 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:00.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.114846 25891 raft_consensus.cc:2468] T c02ccf07c7dd4bd8bd988bc91473ed95 P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bda994622fa49ac9fabfbf40edba4ff in term 0.
08:05:00.116 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:00.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.116173 25892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90e75a8ecf45b4b24d00c51d885ffa" candidate_uuid: "9bda994622fa49ac9fabfbf40edba4ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ad2967f56a4511a42f5f0981fb24d5" is_pre_election: true
08:05:00.117 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:00.117 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:00.119 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:00.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.119338 26113 leader_election.cc:304] T c02ccf07c7dd4bd8bd988bc91473ed95 P 9bda994622fa49ac9fabfbf40edba4ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97ad2967f56a4511a42f5f0981fb24d5, 9bda994622fa49ac9fabfbf40edba4ff; no voters: 
08:05:00.120 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:00.120 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:00.121 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:00.122 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:00.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.115916 27050 raft_consensus.cc:515] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } } peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } }
08:05:00.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.125582 27046 tablet_bootstrap.cc:492] T 4b90e75a8ecf45b4b24d00c51d885ffa P 97ad2967f56a4511a42f5f0981fb24d5: No bootstrap required, opened a new log
08:05:00.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.126153 27046 ts_tablet_manager.cc:1403] T 4b90e75a8ecf45b4b24d00c51d885ffa P 97ad2967f56a4511a42f5f0981fb24d5: Time spent bootstrapping tablet: real 0.111s	user 0.012s	sys 0.007s
08:05:00.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.127177 27050 leader_election.cc:290] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff [CANDIDATE]: Term 1 election: Requested vote from peers 37d338f6c5db4cc4bace5615d0b1421a (127.24.230.194:36057), 97ad2967f56a4511a42f5f0981fb24d5 (127.24.230.193:33195)
08:05:00.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.127830 27050 raft_consensus.cc:2804] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Leader pre-election won for term 1
08:05:00.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.128194 27050 raft_consensus.cc:493] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:05:00.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.128515 27050 raft_consensus.cc:3060] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Advancing to term 1
08:05:00.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.129246 27040 raft_consensus.cc:359] T 4be0df9f650f41e59a6c52d0160ab38d P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:05:00.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.135589 27040 raft_consensus.cc:385] T 4be0df9f650f41e59a6c52d0160ab38d P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:00.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.136071 27040 raft_consensus.cc:740] T 4be0df9f650f41e59a6c52d0160ab38d P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bda994622fa49ac9fabfbf40edba4ff, State: Initialized, Role: FOLLOWER
08:05:00.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.136878 27040 consensus_queue.cc:260] T 4be0df9f650f41e59a6c52d0160ab38d P 9bda994622fa49ac9fabfbf40edba4ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:05:00.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.100052 27041 raft_consensus.cc:385] T 4be0df9f650f41e59a6c52d0160ab38d P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:00.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.101212 25972 leader_election.cc:304] T e08529d853844e528843b6dcec7868e5 P 37d338f6c5db4cc4bace5615d0b1421a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37d338f6c5db4cc4bace5615d0b1421a, 97ad2967f56a4511a42f5f0981fb24d5; no voters: 
08:05:00.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.140750 27041 raft_consensus.cc:740] T 4be0df9f650f41e59a6c52d0160ab38d P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37d338f6c5db4cc4bace5615d0b1421a, State: Initialized, Role: FOLLOWER
08:05:00.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.141424 27047 raft_consensus.cc:2804] T e08529d853844e528843b6dcec7868e5 P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Leader pre-election won for term 1
08:05:00.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.141551 25972 leader_election.cc:304] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37d338f6c5db4cc4bace5615d0b1421a, 97ad2967f56a4511a42f5f0981fb24d5; no voters: 
08:05:00.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.141888 27047 raft_consensus.cc:493] T e08529d853844e528843b6dcec7868e5 P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:05:00.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.141629 27041 consensus_queue.cc:260] T 4be0df9f650f41e59a6c52d0160ab38d P 37d338f6c5db4cc4bace5615d0b1421a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:05:00.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.142234 27047 raft_consensus.cc:3060] T e08529d853844e528843b6dcec7868e5 P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Advancing to term 1
08:05:00.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.136461 26037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08529d853844e528843b6dcec7868e5" candidate_uuid: "9bda994622fa49ac9fabfbf40edba4ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37d338f6c5db4cc4bace5615d0b1421a"
08:05:00.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.150101 27040 ts_tablet_manager.cc:1434] T 4be0df9f650f41e59a6c52d0160ab38d P 9bda994622fa49ac9fabfbf40edba4ff: Time spent starting tablet: real 0.077s	user 0.010s	sys 0.000s
08:05:00.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.151271 27040 tablet_bootstrap.cc:492] T dd533e1ae3024cc396ad8921413c2eaa P 9bda994622fa49ac9fabfbf40edba4ff: Bootstrap starting.
08:05:00.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.154255 27047 raft_consensus.cc:515] T e08529d853844e528843b6dcec7868e5 P 37d338f6c5db4cc4bace5615d0b1421a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } } peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } }
08:05:00.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.156701 26037 raft_consensus.cc:2393] T e08529d853844e528843b6dcec7868e5 P 37d338f6c5db4cc4bace5615d0b1421a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bda994622fa49ac9fabfbf40edba4ff in current term 1: Already voted for candidate 37d338f6c5db4cc4bace5615d0b1421a in this term.
08:05:00.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.157696 27047 leader_election.cc:290] T e08529d853844e528843b6dcec7868e5 P 37d338f6c5db4cc4bace5615d0b1421a [CANDIDATE]: Term 1 election: Requested vote from peers 9bda994622fa49ac9fabfbf40edba4ff (127.24.230.195:45755), 97ad2967f56a4511a42f5f0981fb24d5 (127.24.230.193:33195)
08:05:00.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.133216 27074 raft_consensus.cc:2804] T c02ccf07c7dd4bd8bd988bc91473ed95 P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Leader pre-election won for term 1
08:05:00.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.160511 27079 raft_consensus.cc:2804] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Leader pre-election won for term 1
08:05:00.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.166253 27079 raft_consensus.cc:493] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:05:00.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.166671 27079 raft_consensus.cc:3060] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Advancing to term 1
08:05:00.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.168535 27074 raft_consensus.cc:493] T c02ccf07c7dd4bd8bd988bc91473ed95 P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:05:00.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.169046 27074 raft_consensus.cc:3060] T c02ccf07c7dd4bd8bd988bc91473ed95 P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Advancing to term 1
08:05:00.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.175349 27041 ts_tablet_manager.cc:1434] T 4be0df9f650f41e59a6c52d0160ab38d P 37d338f6c5db4cc4bace5615d0b1421a: Time spent starting tablet: real 0.079s	user 0.004s	sys 0.004s
08:05:00.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:00.186281 25972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.230.193:33195, user_credentials={real_user=slave}} blocked reactor thread for 44775.8us
08:05:00.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:00.185406 26113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.230.193:33195, user_credentials={real_user=slave}} blocked reactor thread for 66490.1us
08:05:00.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:00.194337 26113 leader_election.cc:343] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97ad2967f56a4511a42f5f0981fb24d5 (127.24.230.193:33195): Illegal state: must be running to vote when last-logged opid is not known
08:05:00.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.192032 27050 raft_consensus.cc:515] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:05:00.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.201519 25892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08529d853844e528843b6dcec7868e5" candidate_uuid: "9bda994622fa49ac9fabfbf40edba4ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ad2967f56a4511a42f5f0981fb24d5"
08:05:00.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.201560 27050 leader_election.cc:290] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff [CANDIDATE]: Term 1 election: Requested vote from peers 97ad2967f56a4511a42f5f0981fb24d5 (127.24.230.193:33195), 37d338f6c5db4cc4bace5615d0b1421a (127.24.230.194:36057)
08:05:00.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.202229 25892 raft_consensus.cc:3060] T e08529d853844e528843b6dcec7868e5 P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Advancing to term 1
08:05:00.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.202462 27046 raft_consensus.cc:359] T 4b90e75a8ecf45b4b24d00c51d885ffa P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:05:00.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.198909 27040 tablet_bootstrap.cc:654] T dd533e1ae3024cc396ad8921413c2eaa P 9bda994622fa49ac9fabfbf40edba4ff: Neither blocks nor log segments found. Creating new log.
08:05:00.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.203240 27046 raft_consensus.cc:385] T 4b90e75a8ecf45b4b24d00c51d885ffa P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:00.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.203560 27046 raft_consensus.cc:740] T 4b90e75a8ecf45b4b24d00c51d885ffa P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ad2967f56a4511a42f5f0981fb24d5, State: Initialized, Role: FOLLOWER
08:05:00.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.204545 27046 consensus_queue.cc:260] T 4b90e75a8ecf45b4b24d00c51d885ffa P 97ad2967f56a4511a42f5f0981fb24d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:05:00.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.207444 27046 ts_tablet_manager.cc:1434] T 4b90e75a8ecf45b4b24d00c51d885ffa P 97ad2967f56a4511a42f5f0981fb24d5: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.000s
08:05:00.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.228669 26179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be0df9f650f41e59a6c52d0160ab38d" candidate_uuid: "97ad2967f56a4511a42f5f0981fb24d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bda994622fa49ac9fabfbf40edba4ff" is_pre_election: true
08:05:00.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.229736 26179 raft_consensus.cc:2468] T 4be0df9f650f41e59a6c52d0160ab38d P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97ad2967f56a4511a42f5f0981fb24d5 in term 0.
08:05:00.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.231462 26178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08529d853844e528843b6dcec7868e5" candidate_uuid: "97ad2967f56a4511a42f5f0981fb24d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bda994622fa49ac9fabfbf40edba4ff" is_pre_election: true
08:05:00.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.232564 26178 raft_consensus.cc:2393] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 97ad2967f56a4511a42f5f0981fb24d5 in current term 1: Already voted for candidate 9bda994622fa49ac9fabfbf40edba4ff in this term.
08:05:00.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.234181 26176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ccf07c7dd4bd8bd988bc91473ed95" candidate_uuid: "37d338f6c5db4cc4bace5615d0b1421a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bda994622fa49ac9fabfbf40edba4ff" is_pre_election: true
08:05:00.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.235561 26175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08529d853844e528843b6dcec7868e5" candidate_uuid: "37d338f6c5db4cc4bace5615d0b1421a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bda994622fa49ac9fabfbf40edba4ff" is_pre_election: true
08:05:00.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.236532 26175 raft_consensus.cc:2393] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37d338f6c5db4cc4bace5615d0b1421a in current term 1: Already voted for candidate 9bda994622fa49ac9fabfbf40edba4ff in this term.
08:05:00.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.238466 26037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90e75a8ecf45b4b24d00c51d885ffa" candidate_uuid: "9bda994622fa49ac9fabfbf40edba4ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37d338f6c5db4cc4bace5615d0b1421a"
08:05:00.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.239121 26037 raft_consensus.cc:3060] T 4b90e75a8ecf45b4b24d00c51d885ffa P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Advancing to term 1
08:05:00.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.245112 27078 raft_consensus.cc:493] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:05:00.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.221534 27079 raft_consensus.cc:515] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:05:00.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.253746 27079 leader_election.cc:290] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a [CANDIDATE]: Term 1 election: Requested vote from peers 97ad2967f56a4511a42f5f0981fb24d5 (127.24.230.193:33195), 9bda994622fa49ac9fabfbf40edba4ff (127.24.230.195:45755)
08:05:00.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.254560 26174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08529d853844e528843b6dcec7868e5" candidate_uuid: "37d338f6c5db4cc4bace5615d0b1421a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bda994622fa49ac9fabfbf40edba4ff"
08:05:00.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.255509 26174 raft_consensus.cc:2393] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 37d338f6c5db4cc4bace5615d0b1421a in current term 1: Already voted for candidate 9bda994622fa49ac9fabfbf40edba4ff in this term.
08:05:00.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.245678 27078 raft_consensus.cc:515] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:05:00.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.259684 27078 leader_election.cc:290] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97ad2967f56a4511a42f5f0981fb24d5 (127.24.230.193:33195), 9bda994622fa49ac9fabfbf40edba4ff (127.24.230.195:45755)
08:05:00.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.208554 27046 tablet_bootstrap.cc:492] T dd533e1ae3024cc396ad8921413c2eaa P 97ad2967f56a4511a42f5f0981fb24d5: Bootstrap starting.
08:05:00.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.215596 25891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08529d853844e528843b6dcec7868e5" candidate_uuid: "37d338f6c5db4cc4bace5615d0b1421a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ad2967f56a4511a42f5f0981fb24d5"
08:05:00.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.216952 25893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b90e75a8ecf45b4b24d00c51d885ffa" candidate_uuid: "9bda994622fa49ac9fabfbf40edba4ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ad2967f56a4511a42f5f0981fb24d5"
08:05:00.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.262449 25893 raft_consensus.cc:3060] T 4b90e75a8ecf45b4b24d00c51d885ffa P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Advancing to term 1
08:05:00.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.262902 27040 tablet_bootstrap.cc:492] T dd533e1ae3024cc396ad8921413c2eaa P 9bda994622fa49ac9fabfbf40edba4ff: No bootstrap required, opened a new log
08:05:00.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.263365 27040 ts_tablet_manager.cc:1403] T dd533e1ae3024cc396ad8921413c2eaa P 9bda994622fa49ac9fabfbf40edba4ff: Time spent bootstrapping tablet: real 0.112s	user 0.014s	sys 0.000s
08:05:00.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.258033 25826 leader_election.cc:304] T 4be0df9f650f41e59a6c52d0160ab38d P 97ad2967f56a4511a42f5f0981fb24d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97ad2967f56a4511a42f5f0981fb24d5, 9bda994622fa49ac9fabfbf40edba4ff; no voters: 
08:05:00.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.266862 27053 raft_consensus.cc:2804] T 4be0df9f650f41e59a6c52d0160ab38d P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:05:00.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.266613 27040 raft_consensus.cc:359] T dd533e1ae3024cc396ad8921413c2eaa P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:05:00.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.267207 27053 raft_consensus.cc:493] T 4be0df9f650f41e59a6c52d0160ab38d P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:05:00.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.267411 27040 raft_consensus.cc:385] T dd533e1ae3024cc396ad8921413c2eaa P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:00.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.267526 27053 raft_consensus.cc:3060] T 4be0df9f650f41e59a6c52d0160ab38d P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Advancing to term 1
08:05:00.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.211163 25892 raft_consensus.cc:2468] T e08529d853844e528843b6dcec7868e5 P 97ad2967f56a4511a42f5f0981fb24d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bda994622fa49ac9fabfbf40edba4ff in term 1.
08:05:00.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.281236 26037 raft_consensus.cc:2468] T 4b90e75a8ecf45b4b24d00c51d885ffa P 37d338f6c5db4cc4bace5615d0b1421a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bda994622fa49ac9fabfbf40edba4ff in term 1.
08:05:00.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.236330 27074 raft_consensus.cc:515] T c02ccf07c7dd4bd8bd988bc91473ed95 P 9bda994622fa49ac9fabfbf40edba4ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:05:00.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.267688 27040 raft_consensus.cc:740] T dd533e1ae3024cc396ad8921413c2eaa P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bda994622fa49ac9fabfbf40edba4ff, State: Initialized, Role: FOLLOWER
08:05:00.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.286140 26176 raft_consensus.cc:2393] T c02ccf07c7dd4bd8bd988bc91473ed95 P 9bda994622fa49ac9fabfbf40edba4ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37d338f6c5db4cc4bace5615d0b1421a in current term 1: Already voted for candidate 9bda994622fa49ac9fabfbf40edba4ff in this term.
08:05:00.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.286355 25893 raft_consensus.cc:2468] T 4b90e75a8ecf45b4b24d00c51d885ffa P 97ad2967f56a4511a42f5f0981fb24d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bda994622fa49ac9fabfbf40edba4ff in term 1.
08:05:00.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.286900 27053 raft_consensus.cc:515] T 4be0df9f650f41e59a6c52d0160ab38d P 97ad2967f56a4511a42f5f0981fb24d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:05:00.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.290820 27074 leader_election.cc:290] T c02ccf07c7dd4bd8bd988bc91473ed95 P 9bda994622fa49ac9fabfbf40edba4ff [CANDIDATE]: Term 1 election: Requested vote from peers 97ad2967f56a4511a42f5f0981fb24d5 (127.24.230.193:33195), 37d338f6c5db4cc4bace5615d0b1421a (127.24.230.194:36057)
08:05:00.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.291669 27040 consensus_queue.cc:260] T dd533e1ae3024cc396ad8921413c2eaa P 9bda994622fa49ac9fabfbf40edba4ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:05:00.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.293100 27053 leader_election.cc:290] T 4be0df9f650f41e59a6c52d0160ab38d P 97ad2967f56a4511a42f5f0981fb24d5 [CANDIDATE]: Term 1 election: Requested vote from peers 37d338f6c5db4cc4bace5615d0b1421a (127.24.230.194:36057), 9bda994622fa49ac9fabfbf40edba4ff (127.24.230.195:45755)
08:05:00.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.297425 27040 ts_tablet_manager.cc:1434] T dd533e1ae3024cc396ad8921413c2eaa P 9bda994622fa49ac9fabfbf40edba4ff: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
08:05:00.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.294130 26113 leader_election.cc:304] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 97ad2967f56a4511a42f5f0981fb24d5, 9bda994622fa49ac9fabfbf40edba4ff; no voters: 37d338f6c5db4cc4bace5615d0b1421a
08:05:00.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:00.305315 26429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.158.189:46677, user_credentials={real_user=slave}} blocked reactor thread for 129237us
08:05:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.299356 27050 raft_consensus.cc:2804] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff [term 1 FOLLOWER]: Leader election won for term 1
08:05:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.299651 26113 leader_election.cc:304] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97ad2967f56a4511a42f5f0981fb24d5, 9bda994622fa49ac9fabfbf40edba4ff; no voters: 
08:05:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.299892 27050 raft_consensus.cc:697] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff [term 1 LEADER]: Becoming Leader. State: Replica: 9bda994622fa49ac9fabfbf40edba4ff, State: Running, Role: LEADER
08:05:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.301013 27050 consensus_queue.cc:237] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } } peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } }
08:05:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.302263 26176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ccf07c7dd4bd8bd988bc91473ed95" candidate_uuid: "37d338f6c5db4cc4bace5615d0b1421a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bda994622fa49ac9fabfbf40edba4ff"
08:05:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.302992 26176 raft_consensus.cc:2393] T c02ccf07c7dd4bd8bd988bc91473ed95 P 9bda994622fa49ac9fabfbf40edba4ff [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 37d338f6c5db4cc4bace5615d0b1421a in current term 1: Already voted for candidate 9bda994622fa49ac9fabfbf40edba4ff in this term.
08:05:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.304395 27077 raft_consensus.cc:2804] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff [term 1 FOLLOWER]: Leader election won for term 1
08:05:00.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.292495 26036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ccf07c7dd4bd8bd988bc91473ed95" candidate_uuid: "9bda994622fa49ac9fabfbf40edba4ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37d338f6c5db4cc4bace5615d0b1421a"
08:05:00.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.307387 26036 raft_consensus.cc:2393] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bda994622fa49ac9fabfbf40edba4ff in current term 1: Already voted for candidate 37d338f6c5db4cc4bace5615d0b1421a in this term.
08:05:00.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.309559 26035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be0df9f650f41e59a6c52d0160ab38d" candidate_uuid: "97ad2967f56a4511a42f5f0981fb24d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37d338f6c5db4cc4bace5615d0b1421a" is_pre_election: true
08:05:00.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.310333 26035 raft_consensus.cc:2468] T 4be0df9f650f41e59a6c52d0160ab38d P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97ad2967f56a4511a42f5f0981fb24d5 in term 0.
08:05:00.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.312034 27077 raft_consensus.cc:697] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff [term 1 LEADER]: Becoming Leader. State: Replica: 9bda994622fa49ac9fabfbf40edba4ff, State: Running, Role: LEADER
08:05:00.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.312969 27077 consensus_queue.cc:237] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:05:00.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.314165 25892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd533e1ae3024cc396ad8921413c2eaa" candidate_uuid: "37d338f6c5db4cc4bace5615d0b1421a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ad2967f56a4511a42f5f0981fb24d5" is_pre_election: true
08:05:00.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.318877 25893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ccf07c7dd4bd8bd988bc91473ed95" candidate_uuid: "37d338f6c5db4cc4bace5615d0b1421a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ad2967f56a4511a42f5f0981fb24d5"
08:05:00.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.319660 25893 raft_consensus.cc:3060] T c02ccf07c7dd4bd8bd988bc91473ed95 P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Advancing to term 1
08:05:00.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.326531 26174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd533e1ae3024cc396ad8921413c2eaa" candidate_uuid: "37d338f6c5db4cc4bace5615d0b1421a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bda994622fa49ac9fabfbf40edba4ff" is_pre_election: true
08:05:00.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.327310 26174 raft_consensus.cc:2468] T dd533e1ae3024cc396ad8921413c2eaa P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37d338f6c5db4cc4bace5615d0b1421a in term 0.
08:05:00.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.329954 26035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08529d853844e528843b6dcec7868e5" candidate_uuid: "97ad2967f56a4511a42f5f0981fb24d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37d338f6c5db4cc4bace5615d0b1421a" is_pre_election: true
08:05:00.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.330796 26035 raft_consensus.cc:2393] T e08529d853844e528843b6dcec7868e5 P 37d338f6c5db4cc4bace5615d0b1421a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 97ad2967f56a4511a42f5f0981fb24d5 in current term 1: Already voted for candidate 37d338f6c5db4cc4bace5615d0b1421a in this term.
08:05:00.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.342375 26035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be0df9f650f41e59a6c52d0160ab38d" candidate_uuid: "97ad2967f56a4511a42f5f0981fb24d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37d338f6c5db4cc4bace5615d0b1421a"
08:05:00.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.342979 26035 raft_consensus.cc:3060] T 4be0df9f650f41e59a6c52d0160ab38d P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Advancing to term 1
08:05:00.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.352999 25970 leader_election.cc:304] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37d338f6c5db4cc4bace5615d0b1421a, 9bda994622fa49ac9fabfbf40edba4ff; no voters: 
08:05:00.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.354005 27078 raft_consensus.cc:2804] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Leader pre-election won for term 1
08:05:00.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.354343 27078 raft_consensus.cc:493] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:05:00.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.354504 25972 leader_election.cc:304] T e08529d853844e528843b6dcec7868e5 P 37d338f6c5db4cc4bace5615d0b1421a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37d338f6c5db4cc4bace5615d0b1421a; no voters: 97ad2967f56a4511a42f5f0981fb24d5, 9bda994622fa49ac9fabfbf40edba4ff
08:05:00.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.354835 27078 raft_consensus.cc:3060] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a [term 0 FOLLOWER]: Advancing to term 1
08:05:00.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.355334 27079 raft_consensus.cc:2749] T e08529d853844e528843b6dcec7868e5 P 37d338f6c5db4cc4bace5615d0b1421a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
08:05:00.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:00.355916 25972 leader_election.cc:343] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97ad2967f56a4511a42f5f0981fb24d5 (127.24.230.193:33195): Illegal state: must be running to vote when last-logged opid is not known
08:05:00.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.362269 26035 raft_consensus.cc:2468] T 4be0df9f650f41e59a6c52d0160ab38d P 37d338f6c5db4cc4bace5615d0b1421a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97ad2967f56a4511a42f5f0981fb24d5 in term 1.
08:05:00.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.362777 27078 raft_consensus.cc:515] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:05:00.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.365381 27078 leader_election.cc:290] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a [CANDIDATE]: Term 1 election: Requested vote from peers 97ad2967f56a4511a42f5f0981fb24d5 (127.24.230.193:33195), 9bda994622fa49ac9fabfbf40edba4ff (127.24.230.195:45755)
08:05:00.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.373116 26174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be0df9f650f41e59a6c52d0160ab38d" candidate_uuid: "97ad2967f56a4511a42f5f0981fb24d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bda994622fa49ac9fabfbf40edba4ff"
08:05:00.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.373701 26174 raft_consensus.cc:3060] T 4be0df9f650f41e59a6c52d0160ab38d P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Advancing to term 1
08:05:00.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.378402 25892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd533e1ae3024cc396ad8921413c2eaa" candidate_uuid: "37d338f6c5db4cc4bace5615d0b1421a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ad2967f56a4511a42f5f0981fb24d5"
08:05:00.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.378814 25826 leader_election.cc:304] T e08529d853844e528843b6dcec7868e5 P 97ad2967f56a4511a42f5f0981fb24d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97ad2967f56a4511a42f5f0981fb24d5; no voters: 37d338f6c5db4cc4bace5615d0b1421a, 9bda994622fa49ac9fabfbf40edba4ff
08:05:00.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.380017 25826 leader_election.cc:304] T 4be0df9f650f41e59a6c52d0160ab38d P 97ad2967f56a4511a42f5f0981fb24d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37d338f6c5db4cc4bace5615d0b1421a, 97ad2967f56a4511a42f5f0981fb24d5; no voters: 
08:05:00.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.380311 25891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ccf07c7dd4bd8bd988bc91473ed95" candidate_uuid: "9bda994622fa49ac9fabfbf40edba4ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ad2967f56a4511a42f5f0981fb24d5"
08:05:00.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.381160 27046 tablet_bootstrap.cc:654] T dd533e1ae3024cc396ad8921413c2eaa P 97ad2967f56a4511a42f5f0981fb24d5: Neither blocks nor log segments found. Creating new log.
08:05:00.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.381242 27053 raft_consensus.cc:2749] T e08529d853844e528843b6dcec7868e5 P 97ad2967f56a4511a42f5f0981fb24d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
08:05:00.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.382159 27053 raft_consensus.cc:2804] T 4be0df9f650f41e59a6c52d0160ab38d P 97ad2967f56a4511a42f5f0981fb24d5 [term 1 FOLLOWER]: Leader election won for term 1
08:05:00.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:00.382932 25972 leader_election.cc:343] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 97ad2967f56a4511a42f5f0981fb24d5 (127.24.230.193:33195): Illegal state: must be running to vote when last-logged opid is not known
08:05:00.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.384222 27053 raft_consensus.cc:697] T 4be0df9f650f41e59a6c52d0160ab38d P 97ad2967f56a4511a42f5f0981fb24d5 [term 1 LEADER]: Becoming Leader. State: Replica: 97ad2967f56a4511a42f5f0981fb24d5, State: Running, Role: LEADER
08:05:00.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.382042 25701 catalog_manager.cc:5696] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bda994622fa49ac9fabfbf40edba4ff (127.24.230.195). New cstate: current_term: 1 leader_uuid: "9bda994622fa49ac9fabfbf40edba4ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } health_report { overall_health: UNKNOWN } } }
08:05:00.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.385968 27053 consensus_queue.cc:237] T 4be0df9f650f41e59a6c52d0160ab38d P 97ad2967f56a4511a42f5f0981fb24d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:05:00.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.386566 25701 catalog_manager.cc:5696] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bda994622fa49ac9fabfbf40edba4ff (127.24.230.195). New cstate: current_term: 1 leader_uuid: "9bda994622fa49ac9fabfbf40edba4ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } health_report { overall_health: HEALTHY } } }
08:05:00.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.388409 26176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd533e1ae3024cc396ad8921413c2eaa" candidate_uuid: "37d338f6c5db4cc4bace5615d0b1421a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bda994622fa49ac9fabfbf40edba4ff"
08:05:00.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.389194 26176 raft_consensus.cc:3060] T dd533e1ae3024cc396ad8921413c2eaa P 9bda994622fa49ac9fabfbf40edba4ff [term 0 FOLLOWER]: Advancing to term 1
08:05:00.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.402920 26176 raft_consensus.cc:2468] T dd533e1ae3024cc396ad8921413c2eaa P 9bda994622fa49ac9fabfbf40edba4ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37d338f6c5db4cc4bace5615d0b1421a in term 1.
08:05:00.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.407411 25970 leader_election.cc:304] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37d338f6c5db4cc4bace5615d0b1421a, 9bda994622fa49ac9fabfbf40edba4ff; no voters: 97ad2967f56a4511a42f5f0981fb24d5
08:05:00.408 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:00.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.414142 27078 raft_consensus.cc:2804] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a [term 1 FOLLOWER]: Leader election won for term 1
08:05:00.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.416316 27078 raft_consensus.cc:697] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a [term 1 LEADER]: Becoming Leader. State: Replica: 37d338f6c5db4cc4bace5615d0b1421a, State: Running, Role: LEADER
08:05:00.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.417655 27078 consensus_queue.cc:237] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:05:00.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.427016 26174 raft_consensus.cc:2468] T 4be0df9f650f41e59a6c52d0160ab38d P 9bda994622fa49ac9fabfbf40edba4ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97ad2967f56a4511a42f5f0981fb24d5 in term 1.
08:05:00.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.531116 27046 tablet_bootstrap.cc:492] T dd533e1ae3024cc396ad8921413c2eaa P 97ad2967f56a4511a42f5f0981fb24d5: No bootstrap required, opened a new log
08:05:00.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.508044 25893 raft_consensus.cc:2468] T c02ccf07c7dd4bd8bd988bc91473ed95 P 97ad2967f56a4511a42f5f0981fb24d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37d338f6c5db4cc4bace5615d0b1421a in term 1.
08:05:00.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.532584 27046 ts_tablet_manager.cc:1403] T dd533e1ae3024cc396ad8921413c2eaa P 97ad2967f56a4511a42f5f0981fb24d5: Time spent bootstrapping tablet: real 0.324s	user 0.008s	sys 0.012s
08:05:00.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.536141 25972 leader_election.cc:304] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37d338f6c5db4cc4bace5615d0b1421a, 97ad2967f56a4511a42f5f0981fb24d5; no voters: 9bda994622fa49ac9fabfbf40edba4ff
08:05:00.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.538843 27078 raft_consensus.cc:2804] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a [term 1 FOLLOWER]: Leader election won for term 1
08:05:00.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.540989 27078 raft_consensus.cc:697] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a [term 1 LEADER]: Becoming Leader. State: Replica: 37d338f6c5db4cc4bace5615d0b1421a, State: Running, Role: LEADER
08:05:00.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:00.550323 25826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.24.230.194:36057, user_credentials={real_user=slave}} blocked reactor thread for 170196us
08:05:00.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.552163 26113 leader_election.cc:304] T c02ccf07c7dd4bd8bd988bc91473ed95 P 9bda994622fa49ac9fabfbf40edba4ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bda994622fa49ac9fabfbf40edba4ff; no voters: 37d338f6c5db4cc4bace5615d0b1421a, 97ad2967f56a4511a42f5f0981fb24d5
08:05:00.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.553632 27077 raft_consensus.cc:2749] T c02ccf07c7dd4bd8bd988bc91473ed95 P 9bda994622fa49ac9fabfbf40edba4ff [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
08:05:00.560 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:00.561 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:00.562 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:00.562 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:00.562 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:00.562 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:00.562 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:00.562 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:00.562 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:00.563 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:00.562 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:00.563 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:00.563 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:00.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.558888 27078 consensus_queue.cc:237] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:05:00.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.568989 27046 raft_consensus.cc:359] T dd533e1ae3024cc396ad8921413c2eaa P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:05:00.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.601976 27046 raft_consensus.cc:385] T dd533e1ae3024cc396ad8921413c2eaa P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:00.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.602820 27046 raft_consensus.cc:740] T dd533e1ae3024cc396ad8921413c2eaa P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ad2967f56a4511a42f5f0981fb24d5, State: Initialized, Role: FOLLOWER
08:05:00.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.603804 27046 consensus_queue.cc:260] T dd533e1ae3024cc396ad8921413c2eaa P 97ad2967f56a4511a42f5f0981fb24d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } }
08:05:00.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.601974 25700 catalog_manager.cc:5696] T 4be0df9f650f41e59a6c52d0160ab38d P 97ad2967f56a4511a42f5f0981fb24d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 97ad2967f56a4511a42f5f0981fb24d5 (127.24.230.193). New cstate: current_term: 1 leader_uuid: "97ad2967f56a4511a42f5f0981fb24d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } health_report { overall_health: UNKNOWN } } }
08:05:00.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.618265 25702 catalog_manager.cc:5696] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a reported cstate change: term changed from 0 to 1, leader changed from <none> to 37d338f6c5db4cc4bace5615d0b1421a (127.24.230.194). New cstate: current_term: 1 leader_uuid: "37d338f6c5db4cc4bace5615d0b1421a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } health_report { overall_health: UNKNOWN } } }
08:05:00.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.679263 27046 ts_tablet_manager.cc:1434] T dd533e1ae3024cc396ad8921413c2eaa P 97ad2967f56a4511a42f5f0981fb24d5: Time spent starting tablet: real 0.146s	user 0.005s	sys 0.005s
08:05:00.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.701625 27077 consensus_queue.cc:1048] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:05:00.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.705268 25700 catalog_manager.cc:5696] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a reported cstate change: term changed from 0 to 1, leader changed from <none> to 37d338f6c5db4cc4bace5615d0b1421a (127.24.230.194). New cstate: current_term: 1 leader_uuid: "37d338f6c5db4cc4bace5615d0b1421a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 } health_report { overall_health: UNKNOWN } } }
08:05:00.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.739677 27077 consensus_queue.cc:1048] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:05:00.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.804720 27050 consensus_queue.cc:1048] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:05:00.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.810884 25891 raft_consensus.cc:3060] T dd533e1ae3024cc396ad8921413c2eaa P 97ad2967f56a4511a42f5f0981fb24d5 [term 0 FOLLOWER]: Advancing to term 1
08:05:00.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.820580 27078 consensus_queue.cc:1048] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a [LEADER]: Connected to new peer: Peer: permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:05:00.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.853899 27074 consensus_queue.cc:1048] T e08529d853844e528843b6dcec7868e5 P 9bda994622fa49ac9fabfbf40edba4ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:05:00.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.884141 27079 consensus_queue.cc:1048] T dd533e1ae3024cc396ad8921413c2eaa P 37d338f6c5db4cc4bace5615d0b1421a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:05:00.908 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:00.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.918233 27086 consensus_queue.cc:1048] T 4be0df9f650f41e59a6c52d0160ab38d P 97ad2967f56a4511a42f5f0981fb24d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
08:05:00.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.976712 27053 consensus_queue.cc:1048] T 4be0df9f650f41e59a6c52d0160ab38d P 97ad2967f56a4511a42f5f0981fb24d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37d338f6c5db4cc4bace5615d0b1421a" member_type: VOTER last_known_addr { host: "127.24.230.194" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:05:00.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:00.980181 27079 consensus_queue.cc:1048] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bda994622fa49ac9fabfbf40edba4ff" member_type: VOTER last_known_addr { host: "127.24.230.195" port: 45755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:05:01.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:01.044703 27078 consensus_queue.cc:1048] T c02ccf07c7dd4bd8bd988bc91473ed95 P 37d338f6c5db4cc4bace5615d0b1421a [LEADER]: Connected to new peer: Peer: permanent_uuid: "97ad2967f56a4511a42f5f0981fb24d5" member_type: VOTER last_known_addr { host: "127.24.230.193" port: 33195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:05:01.213 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:01.214 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:01.214 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:01.215 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:01.215 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:01.216 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:01.216 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:01.216 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:01.216 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:01.217 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:01.217 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:01.217 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:01.217 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:01.408 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:01.908 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:02.213 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:02.214 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:02.214 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:02.214 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:02.214 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:02.214 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:02.214 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:02.215 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:02.215 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:02.215 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:02.215 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:02.216 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:02.216 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:02.408 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:02.624 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 657359905549407fbbf9cdc201e47d49
08:05:02.633 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4b90e75a8ecf45b4b24d00c51d885ffa for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
08:05:02.633 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet dd533e1ae3024cc396ad8921413c2eaa for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
08:05:02.633 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c02ccf07c7dd4bd8bd988bc91473ed95 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
08:05:02.633 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4be0df9f650f41e59a6c52d0160ab38d for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
08:05:02.634 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=4b90e75a8ecf45b4b24d00c51d885ffa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=dd533e1ae3024cc396ad8921413c2eaa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)[L],97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=c02ccf07c7dd4bd8bd988bc91473ed95@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)[L],97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=4be0df9f650f41e59a6c52d0160ab38d@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)[L],9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:05:02.634 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=9), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.24.230.252:40255, [6ms] Sub RPC GetTableLocations: received response from server master-127.24.230.252:40255: OK, deferred=null) after lookup
08:05:02.635 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:02.637 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:02.657 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:02.662 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xc91e1524, L:/127.0.0.1:44420 - R:/127.24.230.195:45755] using TOKEN/null
08:05:02.713 [DEBUG - main] (Connection.java:748) [peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)] connecting to peer
08:05:02.719 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)] Successfully connected to peer
08:05:02.740 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:02.745 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0xaa199ad0, L:/127.0.0.1:51208 - R:/127.24.230.194:36057] using TOKEN/null
08:05:02.784 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e08529d853844e528843b6dcec7868e5 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
08:05:02.785 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4b90e75a8ecf45b4b24d00c51d885ffa for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
08:05:02.786 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet dd533e1ae3024cc396ad8921413c2eaa for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
08:05:02.786 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c02ccf07c7dd4bd8bd988bc91473ed95 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
08:05:02.786 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4be0df9f650f41e59a6c52d0160ab38d for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
08:05:02.787 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=e08529d853844e528843b6dcec7868e5@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=4b90e75a8ecf45b4b24d00c51d885ffa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=dd533e1ae3024cc396ad8921413c2eaa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)[L],97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=c02ccf07c7dd4bd8bd988bc91473ed95@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)[L],97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=4be0df9f650f41e59a6c52d0160ab38d@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)[L],9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:05:02.788 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=9), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.24.230.252:40255, [6ms] Sub RPC GetTableLocations: received response from server master-127.24.230.252:40255: OK, deferred=null) after lookup
08:05:02.909 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:02.966 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:02.969 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:02.970 [DEBUG - main] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:02.977 [DEBUG - main] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:02.978 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.25.158.188:41049(127.25.158.188:41049)] Successfully connected to peer
08:05:02.979 [DEBUG - main] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:02.986 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.25.158.190:44627(127.25.158.190:44627)] Successfully connected to peer
08:05:02.993 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.25.158.188
08:05:02.996 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.25.158.190
08:05:03.000 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.25.158.189:46677(127.25.158.189:46677)] Successfully connected to peer
08:05:03.009 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.25.158.189
08:05:03.021 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:03.022 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:03.022 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:03.022 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:03.022 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:03.022 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:03.023 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:03.023 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:03.023 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:03.023 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:03.023 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:03.023 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:03.023 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:03.025 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:03.027 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:03.029 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:03.036 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x9439fb6b, L:/127.0.0.1:40546 - R:/127.25.158.188:41049] using SASL/PLAIN
08:05:03.037 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x85dd5947, L:/127.0.0.1:52568 - R:/127.25.158.190:44627] using SASL/PLAIN
08:05:03.040 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x0bebe983, L:/127.0.0.1:38696 - R:/127.25.158.189:46677] using SASL/PLAIN
08:05:03.041 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:05:03.041 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=71), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [70ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: OK, deferred=null) after lookup
08:05:03.047 [DEBUG - main] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:03.048 [DEBUG - main] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:03.050 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.24.230.254:40685(127.24.230.254:40685)] Successfully connected to peer
08:05:03.053 [DEBUG - main] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:03.054 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.254
08:05:03.064 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.24.230.252:40255(127.24.230.252:40255)] Successfully connected to peer
08:05:03.068 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:03.072 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe96ed3a0, L:/127.0.0.1:54572 - R:/127.24.230.254:40685] using SASL/PLAIN
08:05:03.075 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.252
08:05:03.082 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.24.230.253:39511(127.24.230.253:39511)] Successfully connected to peer
08:05:03.091 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:03.098 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.253
08:05:03.100 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xcd4f19a7, L:/127.0.0.1:33062 - R:/127.24.230.252:40255] using SASL/PLAIN
08:05:03.104 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:05:03.104 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=58), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [29ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: OK, [56ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: OK, deferred=null) after lookup
08:05:03.109 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 657359905549407fbbf9cdc201e47d49
08:05:03.113 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:03.116 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e08529d853844e528843b6dcec7868e5 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
08:05:03.116 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4b90e75a8ecf45b4b24d00c51d885ffa for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
08:05:03.116 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet dd533e1ae3024cc396ad8921413c2eaa for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
08:05:03.116 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c02ccf07c7dd4bd8bd988bc91473ed95 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
08:05:03.117 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4be0df9f650f41e59a6c52d0160ab38d for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
08:05:03.117 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=e08529d853844e528843b6dcec7868e5@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=4b90e75a8ecf45b4b24d00c51d885ffa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=dd533e1ae3024cc396ad8921413c2eaa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)[L],97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=c02ccf07c7dd4bd8bd988bc91473ed95@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)[L],97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=4be0df9f650f41e59a6c52d0160ab38d@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)[L],9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:05:03.118 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xb4ee40e7, L:/127.0.0.1:57938 - R:/127.24.230.253:39511] using SASL/PLAIN
08:05:03.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.125973 26442 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40546:
08:05:03.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
08:05:03.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
08:05:03.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:05:03.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
08:05:03.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:05:03.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:05:03.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:05:03.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:05:03.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:05:03.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:05:03.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:05:03.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:05:03.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:05:03.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:05:03.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
08:05:03.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:05:03.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:05:03.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:05:03.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:05:03.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:05:03.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
08:05:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
08:05:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
08:05:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
08:05:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:05:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
08:05:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
08:05:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:05:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
08:05:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
08:05:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
08:05:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:05:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:05:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   custom_hash_schema_ranges {
08:05:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     range_bounds {
08:05:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       rows: "<redacted>""\006\001d\000\000\000\007\001\310\000\000\000"
08:05:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:05:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     hash_schema {
08:05:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       columns {
08:05:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)         name: "key1"
08:05:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       }
08:05:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       num_buckets: 5
08:05:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       seed: 123
08:05:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:05:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:05:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:05:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
08:05:03.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:03.132427 26442 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
08:05:03.203 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c7314f5e88224070b4e8179ac50f6270
08:05:03.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:03.235827 26428 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.158.190:44627, user_credentials={real_user=slave}} blocked reactor thread for 53739us
08:05:03.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.383785 26783 tablet_service.cc:1511] Processing CreateTablet for tablet 2839bd0409e24473ba578762df5878f0 (DEFAULT_TABLE table=replication_test_table [id=c7314f5e88224070b4e8179ac50f6270]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
08:05:03.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.398108 26783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2839bd0409e24473ba578762df5878f0. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:03.408 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:03.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.387183 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 241e59a8661d45e2857131e50188da72 (DEFAULT_TABLE table=replication_test_table [id=c7314f5e88224070b4e8179ac50f6270]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
08:05:03.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.403048 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 241e59a8661d45e2857131e50188da72. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:03.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.395135 26784 tablet_service.cc:1511] Processing CreateTablet for tablet 9a313a89cbf04383ae23ba29dda807e2 (DEFAULT_TABLE table=replication_test_table [id=c7314f5e88224070b4e8179ac50f6270]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
08:05:03.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.404843 26784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a313a89cbf04383ae23ba29dda807e2. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:03.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.381652 26785 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd7a40107c14c879e8432b2c815ab1f (DEFAULT_TABLE table=replication_test_table [id=c7314f5e88224070b4e8179ac50f6270]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
08:05:03.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.407351 26786 tablet_service.cc:1511] Processing CreateTablet for tablet 1c288af976f6413ca7ed58b161999eb4 (DEFAULT_TABLE table=replication_test_table [id=c7314f5e88224070b4e8179ac50f6270]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
08:05:03.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.409102 26785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd7a40107c14c879e8432b2c815ab1f. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:03.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.410061 26786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c288af976f6413ca7ed58b161999eb4. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:03.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.417649 26933 tablet_service.cc:1511] Processing CreateTablet for tablet 2839bd0409e24473ba578762df5878f0 (DEFAULT_TABLE table=replication_test_table [id=c7314f5e88224070b4e8179ac50f6270]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
08:05:03.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.423053 26935 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd7a40107c14c879e8432b2c815ab1f (DEFAULT_TABLE table=replication_test_table [id=c7314f5e88224070b4e8179ac50f6270]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
08:05:03.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.426177 26932 tablet_service.cc:1511] Processing CreateTablet for tablet 241e59a8661d45e2857131e50188da72 (DEFAULT_TABLE table=replication_test_table [id=c7314f5e88224070b4e8179ac50f6270]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
08:05:03.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.428238 26933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2839bd0409e24473ba578762df5878f0. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:03.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.430711 26932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 241e59a8661d45e2857131e50188da72. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:03.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.434338 26934 tablet_service.cc:1511] Processing CreateTablet for tablet 9a313a89cbf04383ae23ba29dda807e2 (DEFAULT_TABLE table=replication_test_table [id=c7314f5e88224070b4e8179ac50f6270]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
08:05:03.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.435817 26934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a313a89cbf04383ae23ba29dda807e2. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:03.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.438098 26935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd7a40107c14c879e8432b2c815ab1f. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:03.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.395792 26640 tablet_service.cc:1511] Processing CreateTablet for tablet 9a313a89cbf04383ae23ba29dda807e2 (DEFAULT_TABLE table=replication_test_table [id=c7314f5e88224070b4e8179ac50f6270]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
08:05:03.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.442217 26640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a313a89cbf04383ae23ba29dda807e2. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:03.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.399344 26638 tablet_service.cc:1511] Processing CreateTablet for tablet 241e59a8661d45e2857131e50188da72 (DEFAULT_TABLE table=replication_test_table [id=c7314f5e88224070b4e8179ac50f6270]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
08:05:03.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.444621 26638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 241e59a8661d45e2857131e50188da72. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:03.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.401647 26641 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd7a40107c14c879e8432b2c815ab1f (DEFAULT_TABLE table=replication_test_table [id=c7314f5e88224070b4e8179ac50f6270]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
08:05:03.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.447000 26641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd7a40107c14c879e8432b2c815ab1f. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:03.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.409209 26639 tablet_service.cc:1511] Processing CreateTablet for tablet 2839bd0409e24473ba578762df5878f0 (DEFAULT_TABLE table=replication_test_table [id=c7314f5e88224070b4e8179ac50f6270]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
08:05:03.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.450881 26639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2839bd0409e24473ba578762df5878f0. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:03.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.410218 26642 tablet_service.cc:1511] Processing CreateTablet for tablet 1c288af976f6413ca7ed58b161999eb4 (DEFAULT_TABLE table=replication_test_table [id=c7314f5e88224070b4e8179ac50f6270]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
08:05:03.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.453943 26642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c288af976f6413ca7ed58b161999eb4. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:03.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.456854 26936 tablet_service.cc:1511] Processing CreateTablet for tablet 1c288af976f6413ca7ed58b161999eb4 (DEFAULT_TABLE table=replication_test_table [id=c7314f5e88224070b4e8179ac50f6270]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
08:05:03.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.460326 26936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c288af976f6413ca7ed58b161999eb4. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:03.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.536608 27182 tablet_bootstrap.cc:492] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1: Bootstrap starting.
08:05:03.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.567764 27183 tablet_bootstrap.cc:492] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80: Bootstrap starting.
08:05:03.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.596909 27182 tablet_bootstrap.cc:654] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1: Neither blocks nor log segments found. Creating new log.
08:05:03.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.619223 27182 log.cc:826] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1: Log is configured to *not* fsync() on all Append() calls
08:05:03.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.633337 27185 tablet_bootstrap.cc:492] T 4fd7a40107c14c879e8432b2c815ab1f P 98e5872971c641b5973668f07f50cf2e: Bootstrap starting.
08:05:03.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.634765 27182 tablet_bootstrap.cc:492] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1: No bootstrap required, opened a new log
08:05:03.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.635388 27182 ts_tablet_manager.cc:1403] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1: Time spent bootstrapping tablet: real 0.100s	user 0.010s	sys 0.012s
08:05:03.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.644107 27185 tablet_bootstrap.cc:654] T 4fd7a40107c14c879e8432b2c815ab1f P 98e5872971c641b5973668f07f50cf2e: Neither blocks nor log segments found. Creating new log.
08:05:03.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.653149 27185 log.cc:826] T 4fd7a40107c14c879e8432b2c815ab1f P 98e5872971c641b5973668f07f50cf2e: Log is configured to *not* fsync() on all Append() calls
08:05:03.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.667189 27183 tablet_bootstrap.cc:654] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80: Neither blocks nor log segments found. Creating new log.
08:05:03.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.672428 27183 log.cc:826] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80: Log is configured to *not* fsync() on all Append() calls
08:05:03.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.676100 27185 tablet_bootstrap.cc:492] T 4fd7a40107c14c879e8432b2c815ab1f P 98e5872971c641b5973668f07f50cf2e: No bootstrap required, opened a new log
08:05:03.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.676865 27185 ts_tablet_manager.cc:1403] T 4fd7a40107c14c879e8432b2c815ab1f P 98e5872971c641b5973668f07f50cf2e: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.018s
08:05:03.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.684362 27183 tablet_bootstrap.cc:492] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80: No bootstrap required, opened a new log
08:05:03.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.685189 27183 ts_tablet_manager.cc:1403] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80: Time spent bootstrapping tablet: real 0.118s	user 0.012s	sys 0.010s
08:05:03.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.685421 27182 raft_consensus.cc:359] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:03.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.686596 27182 raft_consensus.cc:385] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:03.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.686934 27182 raft_consensus.cc:740] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c43299aa669648b7a17043222c5796c1, State: Initialized, Role: FOLLOWER
08:05:03.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.687964 27182 consensus_queue.cc:260] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:03.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.720546 27182 ts_tablet_manager.cc:1434] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1: Time spent starting tablet: real 0.085s	user 0.058s	sys 0.000s
08:05:03.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.721904 27182 tablet_bootstrap.cc:492] T 241e59a8661d45e2857131e50188da72 P c43299aa669648b7a17043222c5796c1: Bootstrap starting.
08:05:03.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.730895 27185 raft_consensus.cc:359] T 4fd7a40107c14c879e8432b2c815ab1f P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:03.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.732412 27185 raft_consensus.cc:385] T 4fd7a40107c14c879e8432b2c815ab1f P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:03.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.732844 27185 raft_consensus.cc:740] T 4fd7a40107c14c879e8432b2c815ab1f P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98e5872971c641b5973668f07f50cf2e, State: Initialized, Role: FOLLOWER
08:05:03.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.734071 27185 consensus_queue.cc:260] T 4fd7a40107c14c879e8432b2c815ab1f P 98e5872971c641b5973668f07f50cf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:03.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.733122 27183 raft_consensus.cc:359] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:03.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.737970 27183 raft_consensus.cc:385] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:03.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.738323 27183 raft_consensus.cc:740] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae9aa4067a84876910d8ee905ea9e80, State: Initialized, Role: FOLLOWER
08:05:03.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.739355 27183 consensus_queue.cc:260] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:03.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.729391 27182 tablet_bootstrap.cc:654] T 241e59a8661d45e2857131e50188da72 P c43299aa669648b7a17043222c5796c1: Neither blocks nor log segments found. Creating new log.
08:05:03.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.747150 27185 ts_tablet_manager.cc:1434] T 4fd7a40107c14c879e8432b2c815ab1f P 98e5872971c641b5973668f07f50cf2e: Time spent starting tablet: real 0.070s	user 0.023s	sys 0.019s
08:05:03.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.750982 27183 ts_tablet_manager.cc:1434] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80: Time spent starting tablet: real 0.065s	user 0.032s	sys 0.012s
08:05:03.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.752501 27183 tablet_bootstrap.cc:492] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80: Bootstrap starting.
08:05:03.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.767266 27183 tablet_bootstrap.cc:654] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80: Neither blocks nor log segments found. Creating new log.
08:05:03.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.780378 27185 tablet_bootstrap.cc:492] T 9a313a89cbf04383ae23ba29dda807e2 P 98e5872971c641b5973668f07f50cf2e: Bootstrap starting.
08:05:03.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.791275 27182 tablet_bootstrap.cc:492] T 241e59a8661d45e2857131e50188da72 P c43299aa669648b7a17043222c5796c1: No bootstrap required, opened a new log
08:05:03.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.791705 27182 ts_tablet_manager.cc:1403] T 241e59a8661d45e2857131e50188da72 P c43299aa669648b7a17043222c5796c1: Time spent bootstrapping tablet: real 0.070s	user 0.015s	sys 0.012s
08:05:03.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.792778 27185 tablet_bootstrap.cc:654] T 9a313a89cbf04383ae23ba29dda807e2 P 98e5872971c641b5973668f07f50cf2e: Neither blocks nor log segments found. Creating new log.
08:05:03.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.794065 27182 raft_consensus.cc:359] T 241e59a8661d45e2857131e50188da72 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:03.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.794750 27182 raft_consensus.cc:385] T 241e59a8661d45e2857131e50188da72 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:03.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.798033 27182 raft_consensus.cc:740] T 241e59a8661d45e2857131e50188da72 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c43299aa669648b7a17043222c5796c1, State: Initialized, Role: FOLLOWER
08:05:03.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.798735 27182 consensus_queue.cc:260] T 241e59a8661d45e2857131e50188da72 P c43299aa669648b7a17043222c5796c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:03.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.801370 27182 ts_tablet_manager.cc:1434] T 241e59a8661d45e2857131e50188da72 P c43299aa669648b7a17043222c5796c1: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
08:05:03.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.811517 27182 tablet_bootstrap.cc:492] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1: Bootstrap starting.
08:05:03.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:03.814345 26716 tablet.cc:2404] T 4fd7a40107c14c879e8432b2c815ab1f P 98e5872971c641b5973668f07f50cf2e: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:05:03.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.825574 27182 tablet_bootstrap.cc:654] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1: Neither blocks nor log segments found. Creating new log.
08:05:03.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.834167 27185 tablet_bootstrap.cc:492] T 9a313a89cbf04383ae23ba29dda807e2 P 98e5872971c641b5973668f07f50cf2e: No bootstrap required, opened a new log
08:05:03.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.834702 27185 ts_tablet_manager.cc:1403] T 9a313a89cbf04383ae23ba29dda807e2 P 98e5872971c641b5973668f07f50cf2e: Time spent bootstrapping tablet: real 0.055s	user 0.007s	sys 0.009s
08:05:03.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.836280 27183 tablet_bootstrap.cc:492] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80: No bootstrap required, opened a new log
08:05:03.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.837189 27182 tablet_bootstrap.cc:492] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1: No bootstrap required, opened a new log
08:05:03.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.837762 27182 ts_tablet_manager.cc:1403] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.000s
08:05:03.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.837996 27185 raft_consensus.cc:359] T 9a313a89cbf04383ae23ba29dda807e2 P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:03.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.838732 27185 raft_consensus.cc:385] T 9a313a89cbf04383ae23ba29dda807e2 P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:03.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.839043 27185 raft_consensus.cc:740] T 9a313a89cbf04383ae23ba29dda807e2 P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98e5872971c641b5973668f07f50cf2e, State: Initialized, Role: FOLLOWER
08:05:03.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.840026 27183 ts_tablet_manager.cc:1403] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80: Time spent bootstrapping tablet: real 0.088s	user 0.020s	sys 0.003s
08:05:03.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.839749 27185 consensus_queue.cc:260] T 9a313a89cbf04383ae23ba29dda807e2 P 98e5872971c641b5973668f07f50cf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:03.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.842542 27182 raft_consensus.cc:359] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } } peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } }
08:05:03.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.843384 27182 raft_consensus.cc:385] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:03.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.843773 27182 raft_consensus.cc:740] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c43299aa669648b7a17043222c5796c1, State: Initialized, Role: FOLLOWER
08:05:03.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.844681 27182 consensus_queue.cc:260] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } } peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } }
08:05:03.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.846436 27183 raft_consensus.cc:359] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:03.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.847515 27183 raft_consensus.cc:385] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:03.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.847824 27183 raft_consensus.cc:740] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae9aa4067a84876910d8ee905ea9e80, State: Initialized, Role: FOLLOWER
08:05:03.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.848639 27183 consensus_queue.cc:260] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:03.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.852216 27182 ts_tablet_manager.cc:1434] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
08:05:03.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.853392 27182 tablet_bootstrap.cc:492] T 2839bd0409e24473ba578762df5878f0 P c43299aa669648b7a17043222c5796c1: Bootstrap starting.
08:05:03.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.854784 27185 ts_tablet_manager.cc:1434] T 9a313a89cbf04383ae23ba29dda807e2 P 98e5872971c641b5973668f07f50cf2e: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.003s
08:05:03.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.862619 27183 ts_tablet_manager.cc:1434] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.001s
08:05:03.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.869656 27183 tablet_bootstrap.cc:492] T 1c288af976f6413ca7ed58b161999eb4 P 9ae9aa4067a84876910d8ee905ea9e80: Bootstrap starting.
08:05:03.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.877859 27182 tablet_bootstrap.cc:654] T 2839bd0409e24473ba578762df5878f0 P c43299aa669648b7a17043222c5796c1: Neither blocks nor log segments found. Creating new log.
08:05:03.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.878472 27185 tablet_bootstrap.cc:492] T 2839bd0409e24473ba578762df5878f0 P 98e5872971c641b5973668f07f50cf2e: Bootstrap starting.
08:05:03.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.880650 27194 raft_consensus.cc:493] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:05:03.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.881381 27194 raft_consensus.cc:515] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:03.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.891088 27194 leader_election.cc:290] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98e5872971c641b5973668f07f50cf2e (127.25.158.129:33363), c43299aa669648b7a17043222c5796c1 (127.25.158.130:45041)
08:05:03.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.893610 27182 tablet_bootstrap.cc:492] T 2839bd0409e24473ba578762df5878f0 P c43299aa669648b7a17043222c5796c1: No bootstrap required, opened a new log
08:05:03.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.894158 27182 ts_tablet_manager.cc:1403] T 2839bd0409e24473ba578762df5878f0 P c43299aa669648b7a17043222c5796c1: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.000s
08:05:03.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.896992 27185 tablet_bootstrap.cc:654] T 2839bd0409e24473ba578762df5878f0 P 98e5872971c641b5973668f07f50cf2e: Neither blocks nor log segments found. Creating new log.
08:05:03.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.898396 27191 raft_consensus.cc:493] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:05:03.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.898658 27182 raft_consensus.cc:359] T 2839bd0409e24473ba578762df5878f0 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:03.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.899470 27182 raft_consensus.cc:385] T 2839bd0409e24473ba578762df5878f0 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:03.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.899117 27191 raft_consensus.cc:515] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.899780 27182 raft_consensus.cc:740] T 2839bd0409e24473ba578762df5878f0 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c43299aa669648b7a17043222c5796c1, State: Initialized, Role: FOLLOWER
08:05:03.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.900599 27182 consensus_queue.cc:260] T 2839bd0409e24473ba578762df5878f0 P c43299aa669648b7a17043222c5796c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:03.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:03.906414 26859 tablet.cc:2404] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:05:03.909 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:03.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.913733 27191 leader_election.cc:290] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98e5872971c641b5973668f07f50cf2e (127.25.158.129:33363), 9ae9aa4067a84876910d8ee905ea9e80 (127.25.158.131:36181)
08:05:03.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:03.918566 27009 tablet.cc:2404] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:05:03.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.936785 27193 raft_consensus.cc:493] T 4fd7a40107c14c879e8432b2c815ab1f P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:05:03.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.937510 27193 raft_consensus.cc:515] T 4fd7a40107c14c879e8432b2c815ab1f P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:03.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.944792 27193 leader_election.cc:290] T 4fd7a40107c14c879e8432b2c815ab1f P 98e5872971c641b5973668f07f50cf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c43299aa669648b7a17043222c5796c1 (127.25.158.130:45041), 9ae9aa4067a84876910d8ee905ea9e80 (127.25.158.131:36181)
08:05:03.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.946120 27183 tablet_bootstrap.cc:654] T 1c288af976f6413ca7ed58b161999eb4 P 9ae9aa4067a84876910d8ee905ea9e80: Neither blocks nor log segments found. Creating new log.
08:05:03.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.982946 27185 tablet_bootstrap.cc:492] T 2839bd0409e24473ba578762df5878f0 P 98e5872971c641b5973668f07f50cf2e: No bootstrap required, opened a new log
08:05:03.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.983487 27185 ts_tablet_manager.cc:1403] T 2839bd0409e24473ba578762df5878f0 P 98e5872971c641b5973668f07f50cf2e: Time spent bootstrapping tablet: real 0.105s	user 0.018s	sys 0.004s
08:05:03.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.988157 26956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a313a89cbf04383ae23ba29dda807e2" candidate_uuid: "c43299aa669648b7a17043222c5796c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae9aa4067a84876910d8ee905ea9e80" is_pre_election: true
08:05:03.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.986879 27185 raft_consensus.cc:359] T 2839bd0409e24473ba578762df5878f0 P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:03.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.988902 27185 raft_consensus.cc:385] T 2839bd0409e24473ba578762df5878f0 P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:03.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.989203 27185 raft_consensus.cc:740] T 2839bd0409e24473ba578762df5878f0 P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98e5872971c641b5973668f07f50cf2e, State: Initialized, Role: FOLLOWER
08:05:03.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:03.992354 26741 leader_election.cc:343] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ae9aa4067a84876910d8ee905ea9e80 (127.25.158.131:36181): Illegal state: must be running to vote when last-logged opid is not known
08:05:04.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.000747 27182 ts_tablet_manager.cc:1434] T 2839bd0409e24473ba578762df5878f0 P c43299aa669648b7a17043222c5796c1: Time spent starting tablet: real 0.106s	user 0.008s	sys 0.007s
08:05:04.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.002260 27182 tablet_bootstrap.cc:492] T 4fd7a40107c14c879e8432b2c815ab1f P c43299aa669648b7a17043222c5796c1: Bootstrap starting.
08:05:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.005164 26663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2839bd0409e24473ba578762df5878f0" candidate_uuid: "9ae9aa4067a84876910d8ee905ea9e80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98e5872971c641b5973668f07f50cf2e" is_pre_election: true
08:05:04.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.019455 26806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd7a40107c14c879e8432b2c815ab1f" candidate_uuid: "98e5872971c641b5973668f07f50cf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c43299aa669648b7a17043222c5796c1" is_pre_election: true
08:05:04.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:03.989935 27185 consensus_queue.cc:260] T 2839bd0409e24473ba578762df5878f0 P 98e5872971c641b5973668f07f50cf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:04.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:04.022750 26594 leader_election.cc:343] T 4fd7a40107c14c879e8432b2c815ab1f P 98e5872971c641b5973668f07f50cf2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c43299aa669648b7a17043222c5796c1 (127.25.158.130:45041): Illegal state: must be running to vote when last-logged opid is not known
08:05:04.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.023227 26663 raft_consensus.cc:2468] T 2839bd0409e24473ba578762df5878f0 P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae9aa4067a84876910d8ee905ea9e80 in term 0.
08:05:04.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.026209 26662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a313a89cbf04383ae23ba29dda807e2" candidate_uuid: "c43299aa669648b7a17043222c5796c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98e5872971c641b5973668f07f50cf2e" is_pre_election: true
08:05:04.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.027099 26662 raft_consensus.cc:2468] T 9a313a89cbf04383ae23ba29dda807e2 P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c43299aa669648b7a17043222c5796c1 in term 0.
08:05:04.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.029295 26738 leader_election.cc:304] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98e5872971c641b5973668f07f50cf2e, c43299aa669648b7a17043222c5796c1; no voters: 9ae9aa4067a84876910d8ee905ea9e80
08:05:04.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.030336 26888 leader_election.cc:304] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98e5872971c641b5973668f07f50cf2e, 9ae9aa4067a84876910d8ee905ea9e80; no voters: 
08:05:04.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.031368 27194 raft_consensus.cc:2804] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:05:04.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.031731 27194 raft_consensus.cc:493] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:05:04.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.032059 27194 raft_consensus.cc:3060] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Advancing to term 1
08:05:04.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.040321 27194 raft_consensus.cc:515] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:04.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.042407 27201 raft_consensus.cc:2804] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:05:04.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.042892 27201 raft_consensus.cc:493] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:05:04.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.043236 27201 raft_consensus.cc:3060] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Advancing to term 1
08:05:04.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.049913 27185 ts_tablet_manager.cc:1434] T 2839bd0409e24473ba578762df5878f0 P 98e5872971c641b5973668f07f50cf2e: Time spent starting tablet: real 0.066s	user 0.010s	sys 0.000s
08:05:04.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.051050 27182 tablet_bootstrap.cc:654] T 4fd7a40107c14c879e8432b2c815ab1f P c43299aa669648b7a17043222c5796c1: Neither blocks nor log segments found. Creating new log.
08:05:04.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.057925 27183 tablet_bootstrap.cc:492] T 1c288af976f6413ca7ed58b161999eb4 P 9ae9aa4067a84876910d8ee905ea9e80: No bootstrap required, opened a new log
08:05:04.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.058465 27183 ts_tablet_manager.cc:1403] T 1c288af976f6413ca7ed58b161999eb4 P 9ae9aa4067a84876910d8ee905ea9e80: Time spent bootstrapping tablet: real 0.189s	user 0.010s	sys 0.006s
08:05:04.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.062819 26806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2839bd0409e24473ba578762df5878f0" candidate_uuid: "9ae9aa4067a84876910d8ee905ea9e80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c43299aa669648b7a17043222c5796c1" is_pre_election: true
08:05:04.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.063612 26806 raft_consensus.cc:2468] T 2839bd0409e24473ba578762df5878f0 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae9aa4067a84876910d8ee905ea9e80 in term 0.
08:05:04.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.070564 26663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2839bd0409e24473ba578762df5878f0" candidate_uuid: "9ae9aa4067a84876910d8ee905ea9e80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98e5872971c641b5973668f07f50cf2e"
08:05:04.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.071574 26663 raft_consensus.cc:3060] T 2839bd0409e24473ba578762df5878f0 P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Advancing to term 1
08:05:04.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.075157 27185 tablet_bootstrap.cc:492] T 1c288af976f6413ca7ed58b161999eb4 P 98e5872971c641b5973668f07f50cf2e: Bootstrap starting.
08:05:04.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.079214 27194 leader_election.cc:290] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80 [CANDIDATE]: Term 1 election: Requested vote from peers 98e5872971c641b5973668f07f50cf2e (127.25.158.129:33363), c43299aa669648b7a17043222c5796c1 (127.25.158.130:45041)
08:05:04.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.081045 26806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2839bd0409e24473ba578762df5878f0" candidate_uuid: "9ae9aa4067a84876910d8ee905ea9e80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c43299aa669648b7a17043222c5796c1"
08:05:04.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.081704 26806 raft_consensus.cc:3060] T 2839bd0409e24473ba578762df5878f0 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Advancing to term 1
08:05:04.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.083341 26956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd7a40107c14c879e8432b2c815ab1f" candidate_uuid: "98e5872971c641b5973668f07f50cf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae9aa4067a84876910d8ee905ea9e80" is_pre_election: true
08:05:04.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.084229 26956 raft_consensus.cc:2468] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98e5872971c641b5973668f07f50cf2e in term 0.
08:05:04.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.086633 27194 raft_consensus.cc:493] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:05:04.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.087520 27194 raft_consensus.cc:515] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:04.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.088855 27182 tablet_bootstrap.cc:492] T 4fd7a40107c14c879e8432b2c815ab1f P c43299aa669648b7a17043222c5796c1: No bootstrap required, opened a new log
08:05:04.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.089355 27182 ts_tablet_manager.cc:1403] T 4fd7a40107c14c879e8432b2c815ab1f P c43299aa669648b7a17043222c5796c1: Time spent bootstrapping tablet: real 0.087s	user 0.014s	sys 0.000s
08:05:04.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.089689 26806 raft_consensus.cc:2468] T 2839bd0409e24473ba578762df5878f0 P c43299aa669648b7a17043222c5796c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae9aa4067a84876910d8ee905ea9e80 in term 1.
08:05:04.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.091367 26888 leader_election.cc:304] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae9aa4067a84876910d8ee905ea9e80, c43299aa669648b7a17043222c5796c1; no voters: 
08:05:04.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.092093 27183 raft_consensus.cc:359] T 1c288af976f6413ca7ed58b161999eb4 P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } } peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } }
08:05:04.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.092311 27182 raft_consensus.cc:359] T 4fd7a40107c14c879e8432b2c815ab1f P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:04.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.092675 27194 leader_election.cc:290] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98e5872971c641b5973668f07f50cf2e (127.25.158.129:33363), c43299aa669648b7a17043222c5796c1 (127.25.158.130:45041)
08:05:04.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.092831 27183 raft_consensus.cc:385] T 1c288af976f6413ca7ed58b161999eb4 P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:04.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.092983 27182 raft_consensus.cc:385] T 4fd7a40107c14c879e8432b2c815ab1f P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:04.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.093114 27183 raft_consensus.cc:740] T 1c288af976f6413ca7ed58b161999eb4 P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae9aa4067a84876910d8ee905ea9e80, State: Initialized, Role: FOLLOWER
08:05:04.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.093214 27194 raft_consensus.cc:2804] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80 [term 1 FOLLOWER]: Leader election won for term 1
08:05:04.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.093312 27182 raft_consensus.cc:740] T 4fd7a40107c14c879e8432b2c815ab1f P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c43299aa669648b7a17043222c5796c1, State: Initialized, Role: FOLLOWER
08:05:04.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.094043 27182 consensus_queue.cc:260] T 4fd7a40107c14c879e8432b2c815ab1f P c43299aa669648b7a17043222c5796c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:04.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.097244 27201 raft_consensus.cc:515] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:04.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.101191 27194 raft_consensus.cc:697] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80 [term 1 LEADER]: Becoming Leader. State: Replica: 9ae9aa4067a84876910d8ee905ea9e80, State: Running, Role: LEADER
08:05:04.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.100801 27183 consensus_queue.cc:260] T 1c288af976f6413ca7ed58b161999eb4 P 9ae9aa4067a84876910d8ee905ea9e80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } } peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } }
08:05:04.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.099522 27201 leader_election.cc:290] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1 [CANDIDATE]: Term 1 election: Requested vote from peers 98e5872971c641b5973668f07f50cf2e (127.25.158.129:33363), 9ae9aa4067a84876910d8ee905ea9e80 (127.25.158.131:36181)
08:05:04.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.104182 27194 consensus_queue.cc:237] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:04.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.110695 26597 leader_election.cc:304] T 4fd7a40107c14c879e8432b2c815ab1f P 98e5872971c641b5973668f07f50cf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98e5872971c641b5973668f07f50cf2e, 9ae9aa4067a84876910d8ee905ea9e80; no voters: c43299aa669648b7a17043222c5796c1
08:05:04.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.111433 26662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a313a89cbf04383ae23ba29dda807e2" candidate_uuid: "c43299aa669648b7a17043222c5796c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98e5872971c641b5973668f07f50cf2e"
08:05:04.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.112207 27183 ts_tablet_manager.cc:1434] T 1c288af976f6413ca7ed58b161999eb4 P 9ae9aa4067a84876910d8ee905ea9e80: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.003s
08:05:04.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.112540 26956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a313a89cbf04383ae23ba29dda807e2" candidate_uuid: "c43299aa669648b7a17043222c5796c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae9aa4067a84876910d8ee905ea9e80"
08:05:04.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.112927 27182 ts_tablet_manager.cc:1434] T 4fd7a40107c14c879e8432b2c815ab1f P c43299aa669648b7a17043222c5796c1: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.003s
08:05:04.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:04.114123 26741 leader_election.cc:343] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ae9aa4067a84876910d8ee905ea9e80 (127.25.158.131:36181): Illegal state: must be running to vote when last-logged opid is not known
08:05:04.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.114941 27193 raft_consensus.cc:2804] T 4fd7a40107c14c879e8432b2c815ab1f P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
08:05:04.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.117480 27183 tablet_bootstrap.cc:492] T 9a313a89cbf04383ae23ba29dda807e2 P 9ae9aa4067a84876910d8ee905ea9e80: Bootstrap starting.
08:05:04.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.118089 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd7a40107c14c879e8432b2c815ab1f" candidate_uuid: "9ae9aa4067a84876910d8ee905ea9e80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98e5872971c641b5973668f07f50cf2e" is_pre_election: true
08:05:04.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.115366 27193 raft_consensus.cc:493] T 4fd7a40107c14c879e8432b2c815ab1f P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:05:04.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.119865 27193 raft_consensus.cc:3060] T 4fd7a40107c14c879e8432b2c815ab1f P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Advancing to term 1
08:05:04.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.097136 26806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd7a40107c14c879e8432b2c815ab1f" candidate_uuid: "9ae9aa4067a84876910d8ee905ea9e80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c43299aa669648b7a17043222c5796c1" is_pre_election: true
08:05:04.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.127278 26806 raft_consensus.cc:2468] T 4fd7a40107c14c879e8432b2c815ab1f P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae9aa4067a84876910d8ee905ea9e80 in term 0.
08:05:04.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.128715 26888 leader_election.cc:304] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae9aa4067a84876910d8ee905ea9e80, c43299aa669648b7a17043222c5796c1; no voters: 
08:05:04.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.130285 27216 raft_consensus.cc:2804] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:05:04.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.130775 27216 raft_consensus.cc:493] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:05:04.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.131156 27216 raft_consensus.cc:3060] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Advancing to term 1
08:05:04.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.118824 26662 raft_consensus.cc:3060] T 9a313a89cbf04383ae23ba29dda807e2 P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Advancing to term 1
08:05:04.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.144006 27201 raft_consensus.cc:493] T 241e59a8661d45e2857131e50188da72 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:05:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.145134 27201 raft_consensus.cc:515] T 241e59a8661d45e2857131e50188da72 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:04.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.147464 27201 leader_election.cc:290] T 241e59a8661d45e2857131e50188da72 P c43299aa669648b7a17043222c5796c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98e5872971c641b5973668f07f50cf2e (127.25.158.129:33363), 9ae9aa4067a84876910d8ee905ea9e80 (127.25.158.131:36181)
08:05:04.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.149369 27183 tablet_bootstrap.cc:654] T 9a313a89cbf04383ae23ba29dda807e2 P 9ae9aa4067a84876910d8ee905ea9e80: Neither blocks nor log segments found. Creating new log.
08:05:04.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.150068 26956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "241e59a8661d45e2857131e50188da72" candidate_uuid: "c43299aa669648b7a17043222c5796c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae9aa4067a84876910d8ee905ea9e80" is_pre_election: true
08:05:04.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.150337 27216 raft_consensus.cc:515] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:04.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:04.151744 26741 leader_election.cc:343] T 241e59a8661d45e2857131e50188da72 P c43299aa669648b7a17043222c5796c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ae9aa4067a84876910d8ee905ea9e80 (127.25.158.131:36181): Illegal state: must be running to vote when last-logged opid is not known
08:05:04.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.153430 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "241e59a8661d45e2857131e50188da72" candidate_uuid: "c43299aa669648b7a17043222c5796c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98e5872971c641b5973668f07f50cf2e" is_pre_election: true
08:05:04.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:04.156080 26738 leader_election.cc:343] T 241e59a8661d45e2857131e50188da72 P c43299aa669648b7a17043222c5796c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98e5872971c641b5973668f07f50cf2e (127.25.158.129:33363): Illegal state: must be running to vote when last-logged opid is not known
08:05:04.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.156507 26738 leader_election.cc:304] T 241e59a8661d45e2857131e50188da72 P c43299aa669648b7a17043222c5796c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c43299aa669648b7a17043222c5796c1; no voters: 98e5872971c641b5973668f07f50cf2e, 9ae9aa4067a84876910d8ee905ea9e80
08:05:04.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.157277 27201 raft_consensus.cc:2749] T 241e59a8661d45e2857131e50188da72 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
08:05:04.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.158792 27201 raft_consensus.cc:493] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:05:04.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.159227 27201 raft_consensus.cc:515] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } } peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } }
08:05:04.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.161131 27201 leader_election.cc:290] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae9aa4067a84876910d8ee905ea9e80 (127.25.158.131:36181), 98e5872971c641b5973668f07f50cf2e (127.25.158.129:33363)
08:05:04.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.165328 27216 leader_election.cc:290] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80 [CANDIDATE]: Term 1 election: Requested vote from peers 98e5872971c641b5973668f07f50cf2e (127.25.158.129:33363), c43299aa669648b7a17043222c5796c1 (127.25.158.130:45041)
08:05:04.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.166069 26956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c288af976f6413ca7ed58b161999eb4" candidate_uuid: "c43299aa669648b7a17043222c5796c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae9aa4067a84876910d8ee905ea9e80" is_pre_election: true
08:05:04.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.166738 26806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd7a40107c14c879e8432b2c815ab1f" candidate_uuid: "9ae9aa4067a84876910d8ee905ea9e80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c43299aa669648b7a17043222c5796c1"
08:05:04.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.166831 26956 raft_consensus.cc:2468] T 1c288af976f6413ca7ed58b161999eb4 P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c43299aa669648b7a17043222c5796c1 in term 0.
08:05:04.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.167339 26806 raft_consensus.cc:3060] T 4fd7a40107c14c879e8432b2c815ab1f P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Advancing to term 1
08:05:04.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.168637 26741 leader_election.cc:304] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae9aa4067a84876910d8ee905ea9e80, c43299aa669648b7a17043222c5796c1; no voters: 
08:05:04.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.169504 27201 raft_consensus.cc:2804] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:05:04.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.169894 27201 raft_consensus.cc:493] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:05:04.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.170220 27201 raft_consensus.cc:3060] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Advancing to term 1
08:05:04.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.174687 26806 raft_consensus.cc:2468] T 4fd7a40107c14c879e8432b2c815ab1f P c43299aa669648b7a17043222c5796c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae9aa4067a84876910d8ee905ea9e80 in term 1.
08:05:04.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.175370 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c288af976f6413ca7ed58b161999eb4" candidate_uuid: "c43299aa669648b7a17043222c5796c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98e5872971c641b5973668f07f50cf2e" is_pre_election: true
08:05:04.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:04.177445 26738 leader_election.cc:343] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98e5872971c641b5973668f07f50cf2e (127.25.158.129:33363): Illegal state: must be running to vote when last-logged opid is not known
08:05:04.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.178017 27201 raft_consensus.cc:515] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } } peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } }
08:05:04.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.179523 27183 tablet_bootstrap.cc:492] T 9a313a89cbf04383ae23ba29dda807e2 P 9ae9aa4067a84876910d8ee905ea9e80: No bootstrap required, opened a new log
08:05:04.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.180065 27183 ts_tablet_manager.cc:1403] T 9a313a89cbf04383ae23ba29dda807e2 P 9ae9aa4067a84876910d8ee905ea9e80: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.002s
08:05:04.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.180962 26888 leader_election.cc:304] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae9aa4067a84876910d8ee905ea9e80, c43299aa669648b7a17043222c5796c1; no voters: 
08:05:04.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.182060 27215 raft_consensus.cc:2804] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80 [term 1 FOLLOWER]: Leader election won for term 1
08:05:04.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.182626 27215 raft_consensus.cc:697] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80 [term 1 LEADER]: Becoming Leader. State: Replica: 9ae9aa4067a84876910d8ee905ea9e80, State: Running, Role: LEADER
08:05:04.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.179701 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd7a40107c14c879e8432b2c815ab1f" candidate_uuid: "9ae9aa4067a84876910d8ee905ea9e80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98e5872971c641b5973668f07f50cf2e"
08:05:04.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.183537 27215 consensus_queue.cc:237] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:04.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.185945 27201 leader_election.cc:290] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1 [CANDIDATE]: Term 1 election: Requested vote from peers 9ae9aa4067a84876910d8ee905ea9e80 (127.25.158.131:36181), 98e5872971c641b5973668f07f50cf2e (127.25.158.129:33363)
08:05:04.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.184497 27183 raft_consensus.cc:359] T 9a313a89cbf04383ae23ba29dda807e2 P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:04.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.187108 27183 raft_consensus.cc:385] T 9a313a89cbf04383ae23ba29dda807e2 P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:04.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.187463 27183 raft_consensus.cc:740] T 9a313a89cbf04383ae23ba29dda807e2 P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae9aa4067a84876910d8ee905ea9e80, State: Initialized, Role: FOLLOWER
08:05:04.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.188457 27183 consensus_queue.cc:260] T 9a313a89cbf04383ae23ba29dda807e2 P 9ae9aa4067a84876910d8ee905ea9e80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:04.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.191210 26956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c288af976f6413ca7ed58b161999eb4" candidate_uuid: "c43299aa669648b7a17043222c5796c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae9aa4067a84876910d8ee905ea9e80"
08:05:04.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.191560 26660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c288af976f6413ca7ed58b161999eb4" candidate_uuid: "c43299aa669648b7a17043222c5796c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98e5872971c641b5973668f07f50cf2e"
08:05:04.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.191910 26956 raft_consensus.cc:3060] T 1c288af976f6413ca7ed58b161999eb4 P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Advancing to term 1
08:05:04.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:04.193150 26738 leader_election.cc:343] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98e5872971c641b5973668f07f50cf2e (127.25.158.129:33363): Illegal state: must be running to vote when last-logged opid is not known
08:05:04.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.195330 27183 ts_tablet_manager.cc:1434] T 9a313a89cbf04383ae23ba29dda807e2 P 9ae9aa4067a84876910d8ee905ea9e80: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
08:05:04.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.195199 26663 raft_consensus.cc:2468] T 2839bd0409e24473ba578762df5878f0 P 98e5872971c641b5973668f07f50cf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae9aa4067a84876910d8ee905ea9e80 in term 1.
08:05:04.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.199506 27183 tablet_bootstrap.cc:492] T 241e59a8661d45e2857131e50188da72 P 9ae9aa4067a84876910d8ee905ea9e80: Bootstrap starting.
08:05:04.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.200069 26956 raft_consensus.cc:2468] T 1c288af976f6413ca7ed58b161999eb4 P 9ae9aa4067a84876910d8ee905ea9e80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c43299aa669648b7a17043222c5796c1 in term 1.
08:05:04.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.201501 26741 leader_election.cc:304] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae9aa4067a84876910d8ee905ea9e80, c43299aa669648b7a17043222c5796c1; no voters: 98e5872971c641b5973668f07f50cf2e
08:05:04.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.202566 27201 raft_consensus.cc:2804] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1 [term 1 FOLLOWER]: Leader election won for term 1
08:05:04.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.203155 27201 raft_consensus.cc:697] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1 [term 1 LEADER]: Becoming Leader. State: Replica: c43299aa669648b7a17043222c5796c1, State: Running, Role: LEADER
08:05:04.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.204912 26662 raft_consensus.cc:2468] T 9a313a89cbf04383ae23ba29dda807e2 P 98e5872971c641b5973668f07f50cf2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c43299aa669648b7a17043222c5796c1 in term 1.
08:05:04.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.206246 26738 leader_election.cc:304] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98e5872971c641b5973668f07f50cf2e, c43299aa669648b7a17043222c5796c1; no voters: 9ae9aa4067a84876910d8ee905ea9e80
08:05:04.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.208637 27191 raft_consensus.cc:2804] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1 [term 1 FOLLOWER]: Leader election won for term 1
08:05:04.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.209084 27191 raft_consensus.cc:697] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1 [term 1 LEADER]: Becoming Leader. State: Replica: c43299aa669648b7a17043222c5796c1, State: Running, Role: LEADER
08:05:04.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.209926 27191 consensus_queue.cc:237] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:04.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.204198 27201 consensus_queue.cc:237] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } } peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } }
08:05:04.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.215982 27193 raft_consensus.cc:515] T 4fd7a40107c14c879e8432b2c815ab1f P 98e5872971c641b5973668f07f50cf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:04.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.222389 26661 raft_consensus.cc:2393] T 4fd7a40107c14c879e8432b2c815ab1f P 98e5872971c641b5973668f07f50cf2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae9aa4067a84876910d8ee905ea9e80 in current term 1: Already voted for candidate 98e5872971c641b5973668f07f50cf2e in this term.
08:05:04.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.216624 26441 catalog_manager.cc:5696] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ae9aa4067a84876910d8ee905ea9e80 (127.25.158.131). New cstate: current_term: 1 leader_uuid: "9ae9aa4067a84876910d8ee905ea9e80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } health_report { overall_health: HEALTHY } } }
08:05:04.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.230963 27185 tablet_bootstrap.cc:654] T 1c288af976f6413ca7ed58b161999eb4 P 98e5872971c641b5973668f07f50cf2e: Neither blocks nor log segments found. Creating new log.
08:05:04.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.236228 26806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd7a40107c14c879e8432b2c815ab1f" candidate_uuid: "98e5872971c641b5973668f07f50cf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c43299aa669648b7a17043222c5796c1"
08:05:04.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.237193 26806 raft_consensus.cc:2393] T 4fd7a40107c14c879e8432b2c815ab1f P c43299aa669648b7a17043222c5796c1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 98e5872971c641b5973668f07f50cf2e in current term 1: Already voted for candidate 9ae9aa4067a84876910d8ee905ea9e80 in this term.
08:05:04.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.249027 26956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd7a40107c14c879e8432b2c815ab1f" candidate_uuid: "98e5872971c641b5973668f07f50cf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae9aa4067a84876910d8ee905ea9e80"
08:05:04.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.255686 26597 leader_election.cc:304] T 4fd7a40107c14c879e8432b2c815ab1f P 98e5872971c641b5973668f07f50cf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98e5872971c641b5973668f07f50cf2e; no voters: 9ae9aa4067a84876910d8ee905ea9e80, c43299aa669648b7a17043222c5796c1
08:05:04.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.267704 27183 tablet_bootstrap.cc:654] T 241e59a8661d45e2857131e50188da72 P 9ae9aa4067a84876910d8ee905ea9e80: Neither blocks nor log segments found. Creating new log.
08:05:04.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.274791 27225 raft_consensus.cc:2749] T 4fd7a40107c14c879e8432b2c815ab1f P 98e5872971c641b5973668f07f50cf2e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
08:05:04.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.249920 27193 leader_election.cc:290] T 4fd7a40107c14c879e8432b2c815ab1f P 98e5872971c641b5973668f07f50cf2e [CANDIDATE]: Term 1 election: Requested vote from peers c43299aa669648b7a17043222c5796c1 (127.25.158.130:45041), 9ae9aa4067a84876910d8ee905ea9e80 (127.25.158.131:36181)
08:05:04.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.317850 27183 tablet_bootstrap.cc:492] T 241e59a8661d45e2857131e50188da72 P 9ae9aa4067a84876910d8ee905ea9e80: No bootstrap required, opened a new log
08:05:04.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.318411 27183 ts_tablet_manager.cc:1403] T 241e59a8661d45e2857131e50188da72 P 9ae9aa4067a84876910d8ee905ea9e80: Time spent bootstrapping tablet: real 0.119s	user 0.006s	sys 0.009s
08:05:04.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.336231 27185 tablet_bootstrap.cc:492] T 1c288af976f6413ca7ed58b161999eb4 P 98e5872971c641b5973668f07f50cf2e: No bootstrap required, opened a new log
08:05:04.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.337248 27185 ts_tablet_manager.cc:1403] T 1c288af976f6413ca7ed58b161999eb4 P 98e5872971c641b5973668f07f50cf2e: Time spent bootstrapping tablet: real 0.262s	user 0.010s	sys 0.005s
08:05:04.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.348474 27185 raft_consensus.cc:359] T 1c288af976f6413ca7ed58b161999eb4 P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } } peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } }
08:05:04.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.355794 27185 raft_consensus.cc:385] T 1c288af976f6413ca7ed58b161999eb4 P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:04.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.356307 27185 raft_consensus.cc:740] T 1c288af976f6413ca7ed58b161999eb4 P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98e5872971c641b5973668f07f50cf2e, State: Initialized, Role: FOLLOWER
08:05:04.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.356801 27183 raft_consensus.cc:359] T 241e59a8661d45e2857131e50188da72 P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:04.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.357543 27183 raft_consensus.cc:385] T 241e59a8661d45e2857131e50188da72 P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:04.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.357879 27183 raft_consensus.cc:740] T 241e59a8661d45e2857131e50188da72 P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae9aa4067a84876910d8ee905ea9e80, State: Initialized, Role: FOLLOWER
08:05:04.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.357235 27185 consensus_queue.cc:260] T 1c288af976f6413ca7ed58b161999eb4 P 98e5872971c641b5973668f07f50cf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } } peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } }
08:05:04.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.358502 26440 catalog_manager.cc:5696] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c43299aa669648b7a17043222c5796c1 (127.25.158.130). New cstate: current_term: 1 leader_uuid: "c43299aa669648b7a17043222c5796c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } health_report { overall_health: UNKNOWN } } }
08:05:04.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.359961 27183 consensus_queue.cc:260] T 241e59a8661d45e2857131e50188da72 P 9ae9aa4067a84876910d8ee905ea9e80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:04.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.380035 27185 ts_tablet_manager.cc:1434] T 1c288af976f6413ca7ed58b161999eb4 P 98e5872971c641b5973668f07f50cf2e: Time spent starting tablet: real 0.042s	user 0.003s	sys 0.003s
08:05:04.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.385443 27185 tablet_bootstrap.cc:492] T 241e59a8661d45e2857131e50188da72 P 98e5872971c641b5973668f07f50cf2e: Bootstrap starting.
08:05:04.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.390885 27183 ts_tablet_manager.cc:1434] T 241e59a8661d45e2857131e50188da72 P 9ae9aa4067a84876910d8ee905ea9e80: Time spent starting tablet: real 0.072s	user 0.003s	sys 0.005s
08:05:04.408 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:04.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.428846 27185 tablet_bootstrap.cc:654] T 241e59a8661d45e2857131e50188da72 P 98e5872971c641b5973668f07f50cf2e: Neither blocks nor log segments found. Creating new log.
08:05:04.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.453259 26442 catalog_manager.cc:5696] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ae9aa4067a84876910d8ee905ea9e80 (127.25.158.131). New cstate: current_term: 1 leader_uuid: "9ae9aa4067a84876910d8ee905ea9e80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } health_report { overall_health: HEALTHY } } }
08:05:04.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.470712 27185 tablet_bootstrap.cc:492] T 241e59a8661d45e2857131e50188da72 P 98e5872971c641b5973668f07f50cf2e: No bootstrap required, opened a new log
08:05:04.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.471706 27185 ts_tablet_manager.cc:1403] T 241e59a8661d45e2857131e50188da72 P 98e5872971c641b5973668f07f50cf2e: Time spent bootstrapping tablet: real 0.087s	user 0.008s	sys 0.018s
08:05:04.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.477526 27185 raft_consensus.cc:359] T 241e59a8661d45e2857131e50188da72 P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:04.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.486862 27185 raft_consensus.cc:385] T 241e59a8661d45e2857131e50188da72 P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:04.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.487543 27185 raft_consensus.cc:740] T 241e59a8661d45e2857131e50188da72 P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98e5872971c641b5973668f07f50cf2e, State: Initialized, Role: FOLLOWER
08:05:04.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.488484 27185 consensus_queue.cc:260] T 241e59a8661d45e2857131e50188da72 P 98e5872971c641b5973668f07f50cf2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:04.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.508527 27185 ts_tablet_manager.cc:1434] T 241e59a8661d45e2857131e50188da72 P 98e5872971c641b5973668f07f50cf2e: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.004s
08:05:04.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.528573 26440 catalog_manager.cc:5696] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c43299aa669648b7a17043222c5796c1 (127.25.158.130). New cstate: current_term: 1 leader_uuid: "c43299aa669648b7a17043222c5796c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } health_report { overall_health: UNKNOWN } } }
08:05:04.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.527809 27215 raft_consensus.cc:493] T 9a313a89cbf04383ae23ba29dda807e2 P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:05:04.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.530495 27215 raft_consensus.cc:515] T 9a313a89cbf04383ae23ba29dda807e2 P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:04.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.533432 27215 leader_election.cc:290] T 9a313a89cbf04383ae23ba29dda807e2 P 9ae9aa4067a84876910d8ee905ea9e80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98e5872971c641b5973668f07f50cf2e (127.25.158.129:33363), c43299aa669648b7a17043222c5796c1 (127.25.158.130:45041)
08:05:04.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.537101 26661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a313a89cbf04383ae23ba29dda807e2" candidate_uuid: "9ae9aa4067a84876910d8ee905ea9e80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98e5872971c641b5973668f07f50cf2e" is_pre_election: true
08:05:04.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.538599 26806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a313a89cbf04383ae23ba29dda807e2" candidate_uuid: "9ae9aa4067a84876910d8ee905ea9e80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c43299aa669648b7a17043222c5796c1" is_pre_election: true
08:05:04.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.551453 26661 raft_consensus.cc:2393] T 9a313a89cbf04383ae23ba29dda807e2 P 98e5872971c641b5973668f07f50cf2e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae9aa4067a84876910d8ee905ea9e80 in current term 1: Already voted for candidate c43299aa669648b7a17043222c5796c1 in this term.
08:05:04.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.556989 26888 leader_election.cc:304] T 9a313a89cbf04383ae23ba29dda807e2 P 9ae9aa4067a84876910d8ee905ea9e80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae9aa4067a84876910d8ee905ea9e80; no voters: 98e5872971c641b5973668f07f50cf2e, c43299aa669648b7a17043222c5796c1
08:05:04.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.571870 27215 raft_consensus.cc:3060] T 9a313a89cbf04383ae23ba29dda807e2 P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Advancing to term 1
08:05:04.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.592074 27193 raft_consensus.cc:493] T 241e59a8661d45e2857131e50188da72 P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:05:04.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.593109 27193 raft_consensus.cc:515] T 241e59a8661d45e2857131e50188da72 P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:04.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.598558 27215 raft_consensus.cc:2749] T 9a313a89cbf04383ae23ba29dda807e2 P 9ae9aa4067a84876910d8ee905ea9e80 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
08:05:04.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.602247 27193 leader_election.cc:290] T 241e59a8661d45e2857131e50188da72 P 98e5872971c641b5973668f07f50cf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c43299aa669648b7a17043222c5796c1 (127.25.158.130:45041), 9ae9aa4067a84876910d8ee905ea9e80 (127.25.158.131:36181)
08:05:04.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.602097 26806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "241e59a8661d45e2857131e50188da72" candidate_uuid: "98e5872971c641b5973668f07f50cf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c43299aa669648b7a17043222c5796c1" is_pre_election: true
08:05:04.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.603027 26806 raft_consensus.cc:2468] T 241e59a8661d45e2857131e50188da72 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98e5872971c641b5973668f07f50cf2e in term 0.
08:05:04.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.604326 26956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "241e59a8661d45e2857131e50188da72" candidate_uuid: "98e5872971c641b5973668f07f50cf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae9aa4067a84876910d8ee905ea9e80" is_pre_election: true
08:05:04.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.604909 26594 leader_election.cc:304] T 241e59a8661d45e2857131e50188da72 P 98e5872971c641b5973668f07f50cf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98e5872971c641b5973668f07f50cf2e, c43299aa669648b7a17043222c5796c1; no voters: 
08:05:04.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.605437 26956 raft_consensus.cc:2468] T 241e59a8661d45e2857131e50188da72 P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98e5872971c641b5973668f07f50cf2e in term 0.
08:05:04.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.607859 27193 raft_consensus.cc:2804] T 241e59a8661d45e2857131e50188da72 P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Leader pre-election won for term 1
08:05:04.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.608690 27193 raft_consensus.cc:493] T 241e59a8661d45e2857131e50188da72 P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:05:04.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.609239 27193 raft_consensus.cc:3060] T 241e59a8661d45e2857131e50188da72 P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Advancing to term 1
08:05:04.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.630718 27193 raft_consensus.cc:515] T 241e59a8661d45e2857131e50188da72 P 98e5872971c641b5973668f07f50cf2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:04.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.638119 26806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "241e59a8661d45e2857131e50188da72" candidate_uuid: "98e5872971c641b5973668f07f50cf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c43299aa669648b7a17043222c5796c1"
08:05:04.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.639501 26806 raft_consensus.cc:3060] T 241e59a8661d45e2857131e50188da72 P c43299aa669648b7a17043222c5796c1 [term 0 FOLLOWER]: Advancing to term 1
08:05:04.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.641242 26956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "241e59a8661d45e2857131e50188da72" candidate_uuid: "98e5872971c641b5973668f07f50cf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae9aa4067a84876910d8ee905ea9e80"
08:05:04.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.642529 26956 raft_consensus.cc:3060] T 241e59a8661d45e2857131e50188da72 P 9ae9aa4067a84876910d8ee905ea9e80 [term 0 FOLLOWER]: Advancing to term 1
08:05:04.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.649530 27193 leader_election.cc:290] T 241e59a8661d45e2857131e50188da72 P 98e5872971c641b5973668f07f50cf2e [CANDIDATE]: Term 1 election: Requested vote from peers c43299aa669648b7a17043222c5796c1 (127.25.158.130:45041), 9ae9aa4067a84876910d8ee905ea9e80 (127.25.158.131:36181)
08:05:04.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.657236 27193 raft_consensus.cc:493] T 1c288af976f6413ca7ed58b161999eb4 P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:05:04.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.657868 27193 raft_consensus.cc:515] T 1c288af976f6413ca7ed58b161999eb4 P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } } peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } }
08:05:04.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.663343 26805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c288af976f6413ca7ed58b161999eb4" candidate_uuid: "98e5872971c641b5973668f07f50cf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c43299aa669648b7a17043222c5796c1" is_pre_election: true
08:05:04.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.667018 26955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c288af976f6413ca7ed58b161999eb4" candidate_uuid: "98e5872971c641b5973668f07f50cf2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae9aa4067a84876910d8ee905ea9e80" is_pre_election: true
08:05:04.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.668296 26955 raft_consensus.cc:2393] T 1c288af976f6413ca7ed58b161999eb4 P 9ae9aa4067a84876910d8ee905ea9e80 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98e5872971c641b5973668f07f50cf2e in current term 1: Already voted for candidate c43299aa669648b7a17043222c5796c1 in this term.
08:05:04.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.664808 27215 consensus_queue.cc:1048] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
08:05:04.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.671860 26597 leader_election.cc:304] T 1c288af976f6413ca7ed58b161999eb4 P 98e5872971c641b5973668f07f50cf2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98e5872971c641b5973668f07f50cf2e; no voters: 9ae9aa4067a84876910d8ee905ea9e80, c43299aa669648b7a17043222c5796c1
08:05:04.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.671908 27215 consensus_queue.cc:1048] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:05:04.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.672902 27225 raft_consensus.cc:3060] T 1c288af976f6413ca7ed58b161999eb4 P 98e5872971c641b5973668f07f50cf2e [term 0 FOLLOWER]: Advancing to term 1
08:05:04.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.681564 27191 consensus_queue.cc:1048] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:05:04.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.692622 27225 raft_consensus.cc:2749] T 1c288af976f6413ca7ed58b161999eb4 P 98e5872971c641b5973668f07f50cf2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
08:05:04.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.707335 27193 leader_election.cc:290] T 1c288af976f6413ca7ed58b161999eb4 P 98e5872971c641b5973668f07f50cf2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c43299aa669648b7a17043222c5796c1 (127.25.158.130:45041), 9ae9aa4067a84876910d8ee905ea9e80 (127.25.158.131:36181)
08:05:04.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.721660 26806 raft_consensus.cc:2468] T 241e59a8661d45e2857131e50188da72 P c43299aa669648b7a17043222c5796c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98e5872971c641b5973668f07f50cf2e in term 1.
08:05:04.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.724604 26594 leader_election.cc:304] T 241e59a8661d45e2857131e50188da72 P 98e5872971c641b5973668f07f50cf2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98e5872971c641b5973668f07f50cf2e, c43299aa669648b7a17043222c5796c1; no voters: 
08:05:04.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.727149 27193 raft_consensus.cc:2804] T 241e59a8661d45e2857131e50188da72 P 98e5872971c641b5973668f07f50cf2e [term 1 FOLLOWER]: Leader election won for term 1
08:05:04.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.728708 27193 raft_consensus.cc:697] T 241e59a8661d45e2857131e50188da72 P 98e5872971c641b5973668f07f50cf2e [term 1 LEADER]: Becoming Leader. State: Replica: 98e5872971c641b5973668f07f50cf2e, State: Running, Role: LEADER
08:05:04.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.733237 27193 consensus_queue.cc:237] T 241e59a8661d45e2857131e50188da72 P 98e5872971c641b5973668f07f50cf2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:04.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.736361 26956 raft_consensus.cc:2468] T 241e59a8661d45e2857131e50188da72 P 9ae9aa4067a84876910d8ee905ea9e80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98e5872971c641b5973668f07f50cf2e in term 1.
08:05:04.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.736477 27215 consensus_queue.cc:1048] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:05:04.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.780419 27220 consensus_queue.cc:1048] T 1c288af976f6413ca7ed58b161999eb4 P c43299aa669648b7a17043222c5796c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
08:05:04.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.801841 27191 consensus_queue.cc:1048] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
08:05:04.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.847934 27191 consensus_queue.cc:1048] T 9a313a89cbf04383ae23ba29dda807e2 P c43299aa669648b7a17043222c5796c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:05:04.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.845904 26442 catalog_manager.cc:5696] T 241e59a8661d45e2857131e50188da72 P 98e5872971c641b5973668f07f50cf2e reported cstate change: term changed from 0 to 1, leader changed from <none> to 98e5872971c641b5973668f07f50cf2e (127.25.158.129). New cstate: current_term: 1 leader_uuid: "98e5872971c641b5973668f07f50cf2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } health_report { overall_health: UNKNOWN } } }
08:05:04.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:04.879268 26888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.158.129:33363, user_credentials={real_user=slave}} blocked reactor thread for 86534.7us
08:05:04.884 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:04.885 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:04.886 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:04.887 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:04.887 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:04.888 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:04.888 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:04.889 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:04.889 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:04.890 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:04.890 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:04.890 [INFO - pool-36-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:04.890 [WARN - pool-36-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:04.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:04.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:04.896129 27215 consensus_queue.cc:1048] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
08:05:05.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:05.319762 27193 consensus_queue.cc:1048] T 241e59a8661d45e2857131e50188da72 P 98e5872971c641b5973668f07f50cf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:05:05.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:05.362253 27262 consensus_queue.cc:1048] T 241e59a8661d45e2857131e50188da72 P 98e5872971c641b5973668f07f50cf2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:05:05.408 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:05.908 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:05.997 [DEBUG - main] (Connection.java:575) [peer master-127.24.230.254:40685(127.24.230.254:40685)] disconnecting while in state READY
08:05:05.998 [DEBUG - main] (Connection.java:575) [peer master-127.24.230.252:40255(127.24.230.252:40255)] disconnecting while in state READY
08:05:05.998 [DEBUG - main] (Connection.java:575) [peer master-127.24.230.253:39511(127.24.230.253:39511)] disconnecting while in state READY
08:05:05.999 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.24.230.252:40255(127.24.230.252:40255)] handling channelInactive
08:05:05.999 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.24.230.254:40685(127.24.230.254:40685)] handling channelInactive
08:05:05.999 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state READY due to: connection closed
08:05:05.999 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state READY due to: connection closed
08:05:06.000 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:06.002 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-1
08:05:06.002 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:05:06.003 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.24.230.253:39511(127.24.230.253:39511)] handling channelInactive
08:05:06.003 [DEBUG - main] (Connection.java:575) [peer master-127.25.158.189:46677(127.25.158.189:46677)] disconnecting while in state READY
08:05:06.003 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state READY due to: connection closed
08:05:06.003 [DEBUG - main] (Connection.java:575) [peer master-127.25.158.190:44627(127.25.158.190:44627)] disconnecting while in state READY
08:05:06.004 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.25.158.189:46677(127.25.158.189:46677)] handling channelInactive
08:05:06.004 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state READY due to: connection closed
08:05:06.004 [DEBUG - main] (Connection.java:575) [peer master-127.25.158.188:41049(127.25.158.188:41049)] disconnecting while in state READY
08:05:06.004 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-2
08:05:06.005 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.25.158.190:44627(127.25.158.190:44627)] handling channelInactive
08:05:06.005 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state READY due to: connection closed
08:05:06.005 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:06.007 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
08:05:06.007 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-2
08:05:06.010 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.25.158.188:41049(127.25.158.188:41049)] handling channelInactive
08:05:06.010 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state READY due to: connection closed
08:05:06.011 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
08:05:06.014 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:05:06.014 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
08:05:06.015 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
08:05:06.015 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:05:06.015 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:05:06.015 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:05:06.024 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
08:05:06.025 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
08:05:06.025 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
08:05:06.025 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
08:05:06.025 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
08:05:06.025 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
08:05:06.025 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
08:05:06.332 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
08:05:06.409 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:06.413 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
08:05:06.413 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
08:05:06.413 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
08:05:06.432 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
08:05:06.720 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:06.721 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:06.722 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:06.722 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:06.723 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:06.723 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:06.723 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:06.723 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:06.724 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:06.724 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:06.724 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:06.724 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:06.725 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:06.812 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:06.813 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:06.814 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:06.815 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:06.815 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:06.815 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:06.815 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:06.815 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:06.815 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:06.816 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:06.816 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:06.816 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:06.816 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:06.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:07.312 [INFO - flink-pekko.actor.default-dispatcher-6] (Slf4jLogger.scala:117) Slf4jLogger started
08:05:07.408 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:07.513 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
08:05:07.542 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
08:05:07.564 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
08:05:07.579 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
08:05:07.595 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
08:05:07.610 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
08:05:07.612 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
08:05:07.612 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
08:05:07.612 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
08:05:07.613 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
08:05:07.613 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
08:05:07.613 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
08:05:07.613 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
08:05:07.614 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
08:05:07.614 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
08:05:07.615 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
08:05:07.615 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
08:05:07.615 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
08:05:07.615 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
08:05:07.615 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
08:05:07.615 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
08:05:07.615 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
08:05:07.616 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
08:05:07.616 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
08:05:07.616 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
08:05:07.616 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
08:05:07.617 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
08:05:07.617 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
08:05:07.617 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
08:05:07.617 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_4d8ad4a5bbcda5160eada5c947327c84/blobStorage
08:05:07.618 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:36103 - max concurrent requests: 50 - max backlog: 1000
08:05:07.619 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_4d8ad4a5bbcda5160eada5c947327c84/blobStorage
08:05:07.620 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_4d8ad4a5bbcda5160eada5c947327c84/blobStorage
08:05:07.621 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
08:05:07.621 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: 845ae898-e62b-48b1-b30d-b2afd2a7ff61
08:05:07.624 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 37 GB (77.08% usable)
08:05:07.624 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-1167f551-409e-4bc1-86c6-2d8371c521fe
08:05:07.632 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-5603e891-5155-4345-acf0-2fa50d9dc5bc
08:05:07.836 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
08:05:07.837 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
08:05:07.837 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
08:05:07.837 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
08:05:07.839 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
08:05:07.841 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_4 .
08:05:07.852 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultJobLeaderService.java:127) Start job leader service.
08:05:07.855 [INFO - flink-pekko.actor.default-dispatcher-6] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-e1e56be2-dae9-4ac3-a6af-367e8ce8e59c
08:05:07.857 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
08:05:07.858 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
08:05:07.867 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
08:05:07.867 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
08:05:07.873 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:37417
08:05:07.873 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
08:05:07.877 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
08:05:07.877 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:37417 was granted leadership with leaderSessionID=e9f4ed04-71ae-4e2e-b3e4-d4b2195b1ecc
08:05:07.877 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:37417 , session=e9f4ed04-71ae-4e2e-b3e4-d4b2195b1ecc
08:05:07.879 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
08:05:07.879 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
08:05:07.882 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
08:05:07.882 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id 1ee8b166-6f27-43b4-82e9-bbbe7b33a3f1. Creating new DispatcherLeaderProcess.
08:05:07.882 [INFO - pool-47-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id 17c2fb4f-c135-483a-8982-ef5be9cb533d.
08:05:07.883 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
08:05:07.883 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
08:05:07.883 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
08:05:07.886 [INFO - mini-cluster-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_5 .
08:05:07.888 [INFO - pool-47-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_6 .
08:05:07.894 [INFO - flink-pekko.actor.default-dispatcher-6] (ResourceManager.java:253) Starting the resource manager.
08:05:07.894 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_5 , session=1ee8b166-6f27-43b4-82e9-bbbe7b33a3f1
08:05:07.898 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:212) Starting the slot manager.
08:05:07.899 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultDelegationTokenManager.java:308) Starting tokens update task
08:05:07.899 [WARN - flink-pekko.actor.default-dispatcher-6] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
08:05:07.899 [WARN - flink-pekko.actor.default-dispatcher-6] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
08:05:07.900 [INFO - mini-cluster-io-thread-2] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_6 , session=17c2fb4f-c135-483a-8982-ef5be9cb533d
08:05:07.900 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_6(8982ef5be9cb533d17c2fb4fc135483a).
08:05:07.913 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:07.961 [INFO - flink-pekko.actor.default-dispatcher-9] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
08:05:07.964 [INFO - flink-pekko.actor.default-dispatcher-8] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (e26b904229418d0e047d5d94c5b9f905).
08:05:07.965 [INFO - flink-pekko.actor.default-dispatcher-8] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (e26b904229418d0e047d5d94c5b9f905).
08:05:07.965 [INFO - flink-pekko.actor.default-dispatcher-8] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-e26b904229418d0e047d5d94c5b9f905'.
08:05:07.966 [INFO - mini-cluster-io-thread-3] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job e26b904229418d0e047d5d94c5b9f905 was granted leadership with leader id 46ede17b-acc6-45e6-8fda-393967c0298e. Creating new JobMasterServiceProcess.
08:05:07.979 [INFO - flink-pekko.actor.default-dispatcher-8] (ResourceManager.java:1080) Registering TaskManager with ResourceID 845ae898-e62b-48b1-b30d-b2afd2a7ff61 (pekko://flink/user/rpc/taskmanager_4) at ResourceManager
08:05:07.980 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_6 under registration id f791e40297c9333d4b95487adb5386fb.
08:05:07.981 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:344) Registering task executor 845ae898-e62b-48b1-b30d-b2afd2a7ff61 under f791e40297c9333d4b95487adb5386fb at the slot manager.
08:05:07.984 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_7 .
08:05:07.991 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (e26b904229418d0e047d5d94c5b9f905).
08:05:07.992 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (e26b904229418d0e047d5d94c5b9f905).
08:05:07.993 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph 3f201711463feaa87f92da6fcf850b18 for job e26b904229418d0e047d5d94c5b9f905.
08:05:07.993 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (e26b904229418d0e047d5d94c5b9f905).
08:05:07.993 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
08:05:08.004 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
08:05:08.004 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@e4fcafe
08:05:08.005 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:05:08.005 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16937918701930502306/checkpoints")
08:05:08.010 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
08:05:08.011 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@12b150bf for Flink Streaming Job (e26b904229418d0e047d5d94c5b9f905).
08:05:08.013 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_7 , session=46ede17b-acc6-45e6-8fda-393967c0298e
08:05:08.014 [INFO - flink-pekko.actor.default-dispatcher-6] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (e26b904229418d0e047d5d94c5b9f905) under job master id 8fda393967c0298e46ede17bacc645e6.
08:05:08.014 [INFO - flink-pekko.actor.default-dispatcher-6] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
08:05:08.017 [DEBUG - flink-pekko.actor.default-dispatcher-6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:08.023 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
08:05:08.023 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (e26b904229418d0e047d5d94c5b9f905) switched from state CREATED to RUNNING.
08:05:08.026 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
08:05:08.027 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
08:05:08.027 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
08:05:08.027 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
08:05:08.028 [INFO - flink-pekko.actor.default-dispatcher-6] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_6(8982ef5be9cb533d17c2fb4fc135483a)
08:05:08.030 [INFO - flink-pekko.actor.default-dispatcher-9] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
08:05:08.031 [INFO - flink-pekko.actor.default-dispatcher-9] (ResourceManager.java:390) Registering job manager 8fda393967c0298e46ede17bacc645e6@pekko://flink/user/rpc/jobmanager_7 for job e26b904229418d0e047d5d94c5b9f905.
08:05:08.039 [INFO - flink-pekko.actor.default-dispatcher-9] (ResourceManager.java:1015) Registered job manager 8fda393967c0298e46ede17bacc645e6@pekko://flink/user/rpc/jobmanager_7 for job e26b904229418d0e047d5d94c5b9f905.
08:05:08.042 [DEBUG - main] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:08.042 [INFO - flink-pekko.actor.default-dispatcher-6] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: 8982ef5be9cb533d17c2fb4fc135483a.
08:05:08.043 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:05:08.043 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:08.045 [DEBUG - main] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:08.045 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:08.045 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.25.158.188:41049(127.25.158.188:41049)] Successfully connected to peer
08:05:08.048 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job e26b904229418d0e047d5d94c5b9f905
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager 845ae898-e62b-48b1-b30d-b2afd2a7ff61
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
08:05:08.050 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot bc35714883422bae5e4de5056d4b8678 from 845ae898-e62b-48b1-b30d-b2afd2a7ff61 for job e26b904229418d0e047d5d94c5b9f905 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:05:08.051 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 76e2953e2c0e6c617cb95a41595a0a79 from 845ae898-e62b-48b1-b30d-b2afd2a7ff61 for job e26b904229418d0e047d5d94c5b9f905 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:05:08.051 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:1149) Receive slot request bc35714883422bae5e4de5056d4b8678 for job e26b904229418d0e047d5d94c5b9f905 from resource manager with leader id 8982ef5be9cb533d17c2fb4fc135483a.
08:05:08.051 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:321) Allocated slot for bc35714883422bae5e4de5056d4b8678 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:05:08.052 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 0f1066b174fb1f271b9fbb4939140659 from 845ae898-e62b-48b1-b30d-b2afd2a7ff61 for job e26b904229418d0e047d5d94c5b9f905 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:05:08.052 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot ff737a6e39bf70dd9fd78bd925e3132c from 845ae898-e62b-48b1-b30d-b2afd2a7ff61 for job e26b904229418d0e047d5d94c5b9f905 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:05:08.054 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.24.230.254:40685(127.24.230.254:40685)] Successfully connected to peer
08:05:08.062 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:08.066 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.25.158.188
08:05:08.066 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.254
08:05:08.067 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.24.230.252:40255(127.24.230.252:40255)] Successfully connected to peer
08:05:08.074 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.24.230.253:39511(127.24.230.253:39511)] Successfully connected to peer
08:05:08.089 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:08.102 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultJobLeaderService.java:192) Add job e26b904229418d0e047d5d94c5b9f905 for job leader monitoring.
08:05:08.103 [INFO - mini-cluster-io-thread-3] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_7 with leader id 46ede17b-acc6-45e6-8fda-393967c0298e.
08:05:08.104 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x0f25ef47, L:/127.0.0.1:45884 - R:/127.25.158.188:41049] using SASL/PLAIN
08:05:08.105 [DEBUG - main] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:08.110 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:1149) Receive slot request 76e2953e2c0e6c617cb95a41595a0a79 for job e26b904229418d0e047d5d94c5b9f905 from resource manager with leader id 8982ef5be9cb533d17c2fb4fc135483a.
08:05:08.111 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:321) Allocated slot for 76e2953e2c0e6c617cb95a41595a0a79 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:05:08.111 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:1149) Receive slot request 0f1066b174fb1f271b9fbb4939140659 for job e26b904229418d0e047d5d94c5b9f905 from resource manager with leader id 8982ef5be9cb533d17c2fb4fc135483a.
08:05:08.111 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:321) Allocated slot for 0f1066b174fb1f271b9fbb4939140659 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:05:08.112 [INFO - flink-pekko.actor.default-dispatcher-10] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
08:05:08.112 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:1149) Receive slot request ff737a6e39bf70dd9fd78bd925e3132c for job e26b904229418d0e047d5d94c5b9f905 from resource manager with leader id 8982ef5be9cb533d17c2fb4fc135483a.
08:05:08.112 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:321) Allocated slot for ff737a6e39bf70dd9fd78bd925e3132c with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:05:08.114 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_7 for job e26b904229418d0e047d5d94c5b9f905.
08:05:08.115 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1783) Establish JobManager connection for job e26b904229418d0e047d5d94c5b9f905.
08:05:08.115 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1633) Offer reserved slots to the leader of job e26b904229418d0e047d5d94c5b9f905.
08:05:08.116 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
08:05:08.116 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1) with allocation id 76e2953e2c0e6c617cb95a41595a0a79
08:05:08.108 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.25.158.190:44627(127.25.158.190:44627)] Successfully connected to peer
08:05:08.122 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 76e2953e2c0e6c617cb95a41595a0a79.
08:05:08.124 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job e26b904229418d0e047d5d94c5b9f905.
08:05:08.124 [INFO - flink-pekko.actor.default-dispatcher-8] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
08:05:08.124 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id e26b904229418d0e047d5d94c5b9f905
08:05:08.125 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 76e2953e2c0e6c617cb95a41595a0a79.
08:05:08.131 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:05:08.131 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=98), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [89ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: OK, deferred=null) after lookup
08:05:08.139 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.253
08:05:08.146 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c7314f5e88224070b4e8179ac50f6270
08:05:08.151 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
08:05:08.151 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
08:05:08.153 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.25.158.189:46677(127.25.158.189:46677)] Successfully connected to peer
08:05:08.159 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@60fc8635
08:05:08.159 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:05:08.159 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16937918701930502306/checkpoints")
08:05:08.161 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.25.158.190
08:05:08.162 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.252
08:05:08.163 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:08.166 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:08.177 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
08:05:08.180 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x10d34958, L:/127.0.0.1:40240 - R:/127.24.230.253:39511] using SASL/PLAIN
08:05:08.186 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 1c288af976f6413ca7ed58b161999eb4 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
08:05:08.187 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 4fd7a40107c14c879e8432b2c815ab1f for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
08:05:08.187 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 9a313a89cbf04383ae23ba29dda807e2 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
08:05:08.187 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 2839bd0409e24473ba578762df5878f0 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
08:05:08.187 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 241e59a8661d45e2857131e50188da72 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
08:05:08.187 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
08:05:08.187 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1) with allocation id bc35714883422bae5e4de5056d4b8678
08:05:08.187 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=1c288af976f6413ca7ed58b161999eb4@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=4fd7a40107c14c879e8432b2c815ab1f@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)[L],c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=9a313a89cbf04383ae23ba29dda807e2@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=2839bd0409e24473ba578762df5878f0@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)[L],c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=241e59a8661d45e2857131e50188da72@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363)[L],9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:05:08.188 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=40), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.158.188:41049, [38ms] Sub RPC GetTableLocations: received response from server master-127.25.158.188:41049: OK, deferred=null)) after lookup
08:05:08.187 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe46acd6c, L:/127.0.0.1:45244 - R:/127.24.230.254:40685] using SASL/PLAIN
08:05:08.188 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:08.189 [DEBUG - kudu-nio-0] (Connection.java:748) [peer c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)] connecting to peer
08:05:08.189 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot bc35714883422bae5e4de5056d4b8678.
08:05:08.191 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id bc35714883422bae5e4de5056d4b8678.
08:05:08.194 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
08:05:08.194 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1) with allocation id 0f1066b174fb1f271b9fbb4939140659
08:05:08.206 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xd510203e, L:/127.0.0.1:39298 - R:/127.24.230.252:40255] using SASL/PLAIN
08:05:08.208 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:08.221 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@52a2a768
08:05:08.223 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:05:08.223 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=185), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [151ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: OK, [152ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: OK, [179ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: OK, deferred=null) after lookup
08:05:08.232 [DEBUG - kudu-nio-3] (Connection.java:757) [peer c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)] Successfully connected to peer
08:05:08.232 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 657359905549407fbbf9cdc201e47d49
08:05:08.234 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 0f1066b174fb1f271b9fbb4939140659.
08:05:08.237 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id 0f1066b174fb1f271b9fbb4939140659.
08:05:08.246 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
08:05:08.247 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
08:05:08.250 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e08529d853844e528843b6dcec7868e5 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
08:05:08.250 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4b90e75a8ecf45b4b24d00c51d885ffa for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
08:05:08.250 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet dd533e1ae3024cc396ad8921413c2eaa for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
08:05:08.250 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c02ccf07c7dd4bd8bd988bc91473ed95 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
08:05:08.250 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4be0df9f650f41e59a6c52d0160ab38d for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
08:05:08.250 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=e08529d853844e528843b6dcec7868e5@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=4b90e75a8ecf45b4b24d00c51d885ffa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=dd533e1ae3024cc396ad8921413c2eaa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)[L],97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=c02ccf07c7dd4bd8bd988bc91473ed95@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)[L],97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=4be0df9f650f41e59a6c52d0160ab38d@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)[L],9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:05:08.255 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
08:05:08.256 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
08:05:08.257 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@46d6965e
08:05:08.257 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:05:08.257 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16937918701930502306/checkpoints")
08:05:08.257 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
08:05:08.260 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x49abc670, L:/127.0.0.1:34412 - R:/127.25.158.190:44627] using SASL/PLAIN
08:05:08.263 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@18121aff
08:05:08.265 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
08:05:08.265 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:08.275 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1) with allocation id ff737a6e39bf70dd9fd78bd925e3132c
08:05:08.275 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@300ea800
08:05:08.276 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
08:05:08.276 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot ff737a6e39bf70dd9fd78bd925e3132c.
08:05:08.277 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
08:05:08.278 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id ff737a6e39bf70dd9fd78bd925e3132c.
08:05:08.279 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:05:08.279 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16937918701930502306/checkpoints")
08:05:08.280 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
08:05:08.282 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:08.284 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
08:05:08.289 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:08.297 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 76e2953e2c0e6c617cb95a41595a0a79.
08:05:08.297 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot bc35714883422bae5e4de5056d4b8678.
08:05:08.297 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 0f1066b174fb1f271b9fbb4939140659.
08:05:08.297 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot ff737a6e39bf70dd9fd78bd925e3132c.
08:05:08.302 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x5294ca49, L:/127.0.0.1:49198 - R:/127.25.158.189:46677] using TOKEN/null
08:05:08.305 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
08:05:08.305 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
08:05:08.313 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1491c3cb
08:05:08.318 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@a3f1b9f
08:05:08.318 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:05:08.319 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16937918701930502306/checkpoints")
08:05:08.319 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
08:05:08.326 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:08.327 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:08.332 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x526db299, L:/127.0.0.1:55180 - R:/127.25.158.130:45041] using TOKEN/null
08:05:08.335 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
08:05:08.352 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1c288af976f6413ca7ed58b161999eb4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:08.353 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1c288af976f6413ca7ed58b161999eb4 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
08:05:08.354 [DEBUG - main] (Connection.java:748) [peer 9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)] connecting to peer
08:05:08.366 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:08.366 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:08.375 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:08.380 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@27afe587
08:05:08.383 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:08.394 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:08.396 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:08.398 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)] Successfully connected to peer
08:05:08.400 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.25.158.188:41049(127.25.158.188:41049)] Successfully connected to peer
08:05:08.406 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:08.411 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:08.413 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:08.423 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.25.158.188
08:05:08.446 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.25.158.190:44627(127.25.158.190:44627)] Successfully connected to peer
08:05:08.432 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.25.158.190:44627(127.25.158.190:44627)] Successfully connected to peer
08:05:08.431 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:08.430 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.25.158.188:41049(127.25.158.188:41049)] Successfully connected to peer
08:05:08.471 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:08.483 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.25.158.190
08:05:08.489 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.25.158.190
08:05:08.498 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.25.158.188
08:05:08.500 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:08.507 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:08.515 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:08.520 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0xc228453d, L:/127.0.0.1:60502 - R:/127.25.158.131:36181] using TOKEN/null
08:05:08.532 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:08.548 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.25.158.188:41049(127.25.158.188:41049)] Successfully connected to peer
08:05:08.551 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.25.158.189:46677(127.25.158.189:46677)] Successfully connected to peer
08:05:08.556 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:08.557 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.25.158.189
08:05:08.559 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:08.581 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:08.581 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.25.158.188
08:05:08.583 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd7a40107c14c879e8432b2c815ab1f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:08.583 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4fd7a40107c14c879e8432b2c815ab1f for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
08:05:08.585 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.25.158.189:46677(127.25.158.189:46677)] Successfully connected to peer
08:05:08.586 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.25.158.190:44627(127.25.158.190:44627)] Successfully connected to peer
08:05:08.591 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xed0673ef, L:/127.0.0.1:45898 - R:/127.25.158.188:41049] using SASL/PLAIN
08:05:08.592 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x7cff7a66, L:/127.0.0.1:34414 - R:/127.25.158.190:44627] using SASL/PLAIN
08:05:08.597 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9a313a89cbf04383ae23ba29dda807e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:08.598 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9a313a89cbf04383ae23ba29dda807e2 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
08:05:08.631 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.25.158.190
08:05:08.631 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.25.158.189:46677(127.25.158.189:46677)] Successfully connected to peer
08:05:08.633 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.25.158.189
08:05:08.634 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.25.158.188:41049(127.25.158.188:41049)] Successfully connected to peer
08:05:08.652 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:05:08.653 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=326), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [269ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: OK, deferred=null) after lookup
08:05:08.674 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2839bd0409e24473ba578762df5878f0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:08.675 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2839bd0409e24473ba578762df5878f0 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
08:05:08.675 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:08.676 [DEBUG - main] (Connection.java:748) [peer 98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363)] connecting to peer
08:05:08.676 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.25.158.190:44627(127.25.158.190:44627)] Successfully connected to peer
08:05:08.680 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:08.683 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:08.686 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7257332c, L:/127.0.0.1:45910 - R:/127.25.158.188:41049] using SASL/PLAIN
08:05:08.689 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.25.158.188
08:05:08.694 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.25.158.190
08:05:08.699 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:05:08.700 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=302), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [194ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: OK, deferred=null) after lookup
08:05:08.704 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x47d80a1f, L:/127.0.0.1:49206 - R:/127.25.158.189:46677] using SASL/PLAIN
08:05:08.710 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c7314f5e88224070b4e8179ac50f6270
08:05:08.713 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c7314f5e88224070b4e8179ac50f6270
08:05:08.723 [DEBUG - kudu-nio-5] (Connection.java:757) [peer 98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363)] Successfully connected to peer
08:05:08.734 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.25.158.189:46677(127.25.158.189:46677)] Successfully connected to peer
08:05:08.744 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x81c75aac, L:/127.0.0.1:34422 - R:/127.25.158.190:44627] using SASL/PLAIN
08:05:08.745 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:08.748 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.25.158.189
08:05:08.752 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:08.769 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c7314f5e88224070b4e8179ac50f6270
08:05:08.770 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2cedd24a
08:05:08.773 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
08:05:08.773 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
08:05:08.775 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.25.158.189
08:05:08.792 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x0ef0dad5, L:/127.0.0.1:34416 - R:/127.25.158.190:44627] using SASL/PLAIN
08:05:08.807 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c7314f5e88224070b4e8179ac50f6270
08:05:08.808 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7fec5df4
08:05:08.811 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
08:05:08.811 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
08:05:08.830 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:08.831 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x36e8076c, L:/127.0.0.1:45894 - R:/127.25.158.188:41049] using SASL/PLAIN
08:05:08.847 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:08.850 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:05:08.851 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=567), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [285ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: OK, [476ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: OK, deferred=null) after lookup
08:05:08.870 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:08.870 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xf8866c48, L:/127.0.0.1:34430 - R:/127.25.158.190:44627] using SASL/PLAIN
08:05:08.873 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:08.875 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c7314f5e88224070b4e8179ac50f6270
08:05:08.876 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:08.885 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7792cc92, L:/127.0.0.1:45922 - R:/127.25.158.188:41049] using SASL/PLAIN
08:05:08.894 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x5c5105bb, L:/127.0.0.1:49212 - R:/127.25.158.189:46677] using SASL/PLAIN
08:05:08.900 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
08:05:08.902 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='12973bbf11785c18d6a7d53608bd0eb0850050050ca3af4b3c1a5aa520c4a07d'}]
08:05:08.905 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
08:05:08.906 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:08.908 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
08:05:08.908 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='0d3e6dadab32c0fa7c53052e6ec73d3951705fcfc27dbf5f9fa32883bd5bd222'}]
08:05:08.911 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:08.911 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:08.912 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
08:05:08.921 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c7314f5e88224070b4e8179ac50f6270
08:05:08.922 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4d8d0639
08:05:08.924 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
08:05:08.924 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
08:05:08.937 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x0840bcb7, L:/127.0.0.1:49218 - R:/127.25.158.189:46677] using SASL/PLAIN
08:05:08.938 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:05:08.938 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=648), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [133ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [520ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: OK, [563ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: OK, deferred=null) after lookup
08:05:08.940 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:08.943 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:05:08.945 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299998, tablet=e08529d853844e528843b6dcec7868e5@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}]
08:05:08.947 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c7314f5e88224070b4e8179ac50f6270
08:05:08.967 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xbde9a8ae, L:/127.0.0.1:49234 - R:/127.25.158.189:46677] using SASL/PLAIN
08:05:08.972 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c7314f5e88224070b4e8179ac50f6270
08:05:08.973 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@362137a8
08:05:08.975 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
08:05:08.975 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
08:05:08.995 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:09.010 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
08:05:09.011 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='5b1e2cfddbb3bcb8524644aaf27082496da933c052a3041c021b325a748fcbf6'}]
08:05:09.021 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0x6c4d10bd, L:/127.0.0.1:34560 - R:/127.25.158.129:33363] using TOKEN/null
08:05:09.032 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:09.036 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:09.060 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:09.063 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:05:09.079 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299998, tablet=4b90e75a8ecf45b4b24d00c51d885ffa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)[L],9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}]
08:05:09.082 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.195
08:05:09.095 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=241e59a8661d45e2857131e50188da72, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.102 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:05:09.107 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299997, tablet=dd533e1ae3024cc396ad8921413c2eaa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}]
08:05:09.116 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:09.131 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:09.143 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x17731b53, L:/127.0.0.1:47450 - R:/127.24.230.195:45755] using SASL/PLAIN
08:05:09.179 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1c288af976f6413ca7ed58b161999eb4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.180 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1c288af976f6413ca7ed58b161999eb4 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
08:05:09.190 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd7a40107c14c879e8432b2c815ab1f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.191 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4fd7a40107c14c879e8432b2c815ab1f for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
08:05:09.209 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
08:05:09.227 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:09.236 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9a313a89cbf04383ae23ba29dda807e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.237 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9a313a89cbf04383ae23ba29dda807e2 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
08:05:09.239 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:09.242 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.195
08:05:09.244 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2839bd0409e24473ba578762df5878f0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.245 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2839bd0409e24473ba578762df5878f0 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
08:05:09.250 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
08:05:09.251 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='50ff3b41ada99d07b517ad3aefa774944303c082beb498b2e24b19557e4c4a8a'}]
08:05:09.254 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
08:05:09.255 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=241e59a8661d45e2857131e50188da72, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.264 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:09.272 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:09.286 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:05:09.303 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false, responseScanTimestamp = 7287158816923648001) for scanner KuduScanner(table=replication_test_table, tablet=e08529d853844e528843b6dcec7868e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.304 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [12973bbf11785c18d6a7d53608bd0eb0850050050ca3af4b3c1a5aa520c4a07d]
08:05:09.305 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
08:05:09.317 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [12973bbf11785c18d6a7d53608bd0eb0850050050ca3af4b3c1a5aa520c4a07d]
08:05:09.319 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 12973bbf11785c18d6a7d53608bd0eb0850050050ca3af4b3c1a5aa520c4a07d finished by subtask 1; deferring removal (restored in pending)
08:05:09.322 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
08:05:09.322 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
08:05:09.323 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state READY
08:05:09.324 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1c288af976f6413ca7ed58b161999eb4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.324 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:09.324 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1c288af976f6413ca7ed58b161999eb4 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
08:05:09.325 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='4d0ae028537c68f52926e36bf4232ddc17254b7f7d23dc582943d4bd0ad8a30a'}]
08:05:09.327 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:09.329 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299997, tablet=c02ccf07c7dd4bd8bd988bc91473ed95@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}]
08:05:09.331 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 1c288af976f6413ca7ed58b161999eb4 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
08:05:09.331 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 4fd7a40107c14c879e8432b2c815ab1f for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
08:05:09.331 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 9a313a89cbf04383ae23ba29dda807e2 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
08:05:09.331 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 2839bd0409e24473ba578762df5878f0 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
08:05:09.333 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 241e59a8661d45e2857131e50188da72 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
08:05:09.335 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd7a40107c14c879e8432b2c815ab1f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.334 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=1c288af976f6413ca7ed58b161999eb4@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=4fd7a40107c14c879e8432b2c815ab1f@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)[L],c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=9a313a89cbf04383ae23ba29dda807e2@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=2839bd0409e24473ba578762df5878f0@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)[L],c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=241e59a8661d45e2857131e50188da72@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363)[L],9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:05:09.339 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 1c288af976f6413ca7ed58b161999eb4 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
08:05:09.339 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 4fd7a40107c14c879e8432b2c815ab1f for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
08:05:09.339 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 9a313a89cbf04383ae23ba29dda807e2 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
08:05:09.340 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 2839bd0409e24473ba578762df5878f0 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
08:05:09.340 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 241e59a8661d45e2857131e50188da72 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
08:05:09.345 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.195
08:05:09.359 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:09.359 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4fd7a40107c14c879e8432b2c815ab1f for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
08:05:09.361 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299979, tablet=1c288af976f6413ca7ed58b161999eb4@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299979}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299979, tablet=4fd7a40107c14c879e8432b2c815ab1f@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)[L],c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299979}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299979, tablet=9a313a89cbf04383ae23ba29dda807e2@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299979}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299979, tablet=2839bd0409e24473ba578762df5878f0@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)[L],c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299979}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299979, tablet=241e59a8661d45e2857131e50188da72@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363)[L],9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299979}]
08:05:09.367 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091509365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:09.367 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9a313a89cbf04383ae23ba29dda807e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.368 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9a313a89cbf04383ae23ba29dda807e2 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
08:05:09.378 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2839bd0409e24473ba578762df5878f0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.379 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2839bd0409e24473ba578762df5878f0 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
08:05:09.383 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xfebf8624, L:/127.0.0.1:47456 - R:/127.24.230.195:45755] using SASL/PLAIN
08:05:09.386 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=241e59a8661d45e2857131e50188da72, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.408 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:09.411 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false, responseScanTimestamp = 7287158816923648001) for scanner KuduScanner(table=replication_test_table, tablet=4b90e75a8ecf45b4b24d00c51d885ffa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.412 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [0d3e6dadab32c0fa7c53052e6ec73d3951705fcfc27dbf5f9fa32883bd5bd222]
08:05:09.420 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:09.426 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:09.426 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state READY due to: connection closed
08:05:09.427 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:05:09.427 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
08:05:09.437 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:09.442 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=2, operationSize=130, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@1f0a61a6, flushNotification=Deferred@1666988449(state=PENDING, result=null, callback=<none>, errback=<none>)}
08:05:09.443 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)] connecting to peer
08:05:09.445 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
08:05:09.445 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1c288af976f6413ca7ed58b161999eb4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.445 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1c288af976f6413ca7ed58b161999eb4 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
08:05:09.446 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299997, tablet=4be0df9f650f41e59a6c52d0160ab38d@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)[L],97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}]
08:05:09.454 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd7a40107c14c879e8432b2c815ab1f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.454 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4fd7a40107c14c879e8432b2c815ab1f for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
08:05:09.467 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9a313a89cbf04383ae23ba29dda807e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.468 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9a313a89cbf04383ae23ba29dda807e2 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
08:05:09.473 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x803881b3, L:/127.0.0.1:47466 - R:/127.24.230.195:45755] using SASL/PLAIN
08:05:09.484 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2839bd0409e24473ba578762df5878f0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.485 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2839bd0409e24473ba578762df5878f0 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
08:05:09.492 [DEBUG - kudu-nio-3] (Connection.java:757) [peer c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)] Successfully connected to peer
08:05:09.504 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=241e59a8661d45e2857131e50188da72, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.519 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false, responseScanTimestamp = 7287158816923648001) for scanner KuduScanner(table=replication_test_table, tablet=dd533e1ae3024cc396ad8921413c2eaa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.524 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
08:05:09.525 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [5b1e2cfddbb3bcb8524644aaf27082496da933c052a3041c021b325a748fcbf6]
08:05:09.526 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
08:05:09.529 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [5b1e2cfddbb3bcb8524644aaf27082496da933c052a3041c021b325a748fcbf6]
08:05:09.529 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [0d3e6dadab32c0fa7c53052e6ec73d3951705fcfc27dbf5f9fa32883bd5bd222]
08:05:09.529 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
08:05:09.529 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
08:05:09.530 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state READY
08:05:09.531 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 5b1e2cfddbb3bcb8524644aaf27082496da933c052a3041c021b325a748fcbf6 finished by subtask 0; deferring removal (restored in pending)
08:05:09.532 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 0d3e6dadab32c0fa7c53052e6ec73d3951705fcfc27dbf5f9fa32883bd5bd222 finished by subtask 3; deferring removal (restored in pending)
08:05:09.532 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
08:05:09.532 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
08:05:09.533 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state READY
08:05:09.533 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:09.539 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:09.545 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 9a313a89cbf04383ae23ba29dda807e2 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
08:05:09.545 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 2839bd0409e24473ba578762df5878f0 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
08:05:09.546 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 241e59a8661d45e2857131e50188da72 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
08:05:09.546 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=9a313a89cbf04383ae23ba29dda807e2@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=2839bd0409e24473ba578762df5878f0@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)[L],c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=241e59a8661d45e2857131e50188da72@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363)[L],9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:05:09.547 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 9a313a89cbf04383ae23ba29dda807e2 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
08:05:09.547 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 2839bd0409e24473ba578762df5878f0 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
08:05:09.547 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 241e59a8661d45e2857131e50188da72 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
08:05:09.548 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=9a313a89cbf04383ae23ba29dda807e2@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=2839bd0409e24473ba578762df5878f0@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)[L],c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=241e59a8661d45e2857131e50188da72@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363)[L],9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:05:09.548 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 4fd7a40107c14c879e8432b2c815ab1f for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
08:05:09.548 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 9a313a89cbf04383ae23ba29dda807e2 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
08:05:09.548 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 2839bd0409e24473ba578762df5878f0 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
08:05:09.548 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 241e59a8661d45e2857131e50188da72 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
08:05:09.548 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=4fd7a40107c14c879e8432b2c815ab1f@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)[L],c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=9a313a89cbf04383ae23ba29dda807e2@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=2839bd0409e24473ba578762df5878f0@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)[L],c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=241e59a8661d45e2857131e50188da72@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363)[L],9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:05:09.552 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:09.556 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 9a313a89cbf04383ae23ba29dda807e2 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
08:05:09.556 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 2839bd0409e24473ba578762df5878f0 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
08:05:09.556 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 241e59a8661d45e2857131e50188da72 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
08:05:09.556 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=9a313a89cbf04383ae23ba29dda807e2@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=2839bd0409e24473ba578762df5878f0@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)[L],c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=241e59a8661d45e2857131e50188da72@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363)[L],9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:05:09.562 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1c288af976f6413ca7ed58b161999eb4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.562 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1c288af976f6413ca7ed58b161999eb4 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
08:05:09.569 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd7a40107c14c879e8432b2c815ab1f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.569 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4fd7a40107c14c879e8432b2c815ab1f for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
08:05:09.575 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9a313a89cbf04383ae23ba29dda807e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.576 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:09.576 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9a313a89cbf04383ae23ba29dda807e2 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
08:05:09.577 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.195
08:05:09.584 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2839bd0409e24473ba578762df5878f0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.590 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2839bd0409e24473ba578762df5878f0 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
08:05:09.598 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=241e59a8661d45e2857131e50188da72, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.617 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:09.621 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:09.622 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state READY due to: connection closed
08:05:09.622 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:05:09.622 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
08:05:09.624 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:09.650 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xe22a3e94, L:/127.0.0.1:55192 - R:/127.25.158.130:45041] using TOKEN/null
08:05:09.651 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.195
08:05:09.656 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:09.656 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:09.657 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:09.658 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:09.658 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:09.658 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:09.659 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:09.659 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:09.659 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:09.660 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:09.660 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:09.660 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:09.660 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:09.680 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:09.685 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1c288af976f6413ca7ed58b161999eb4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.686 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1c288af976f6413ca7ed58b161999eb4 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
08:05:09.696 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd7a40107c14c879e8432b2c815ab1f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.696 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4fd7a40107c14c879e8432b2c815ab1f for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
08:05:09.709 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7e9a4fdb, L:/127.0.0.1:47482 - R:/127.24.230.195:45755] using SASL/PLAIN
08:05:09.723 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:09.739 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa135022c, L:/127.0.0.1:47490 - R:/127.24.230.195:45755] using SASL/PLAIN
08:05:09.754 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287158816923648001) for scanner KuduScanner(table=replication_test_table, tablet=4be0df9f650f41e59a6c52d0160ab38d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.755 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [4d0ae028537c68f52926e36bf4232ddc17254b7f7d23dc582943d4bd0ad8a30a]
08:05:09.828 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9a313a89cbf04383ae23ba29dda807e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.828 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9a313a89cbf04383ae23ba29dda807e2 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
08:05:09.844 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2839bd0409e24473ba578762df5878f0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.845 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2839bd0409e24473ba578762df5878f0 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
08:05:09.855 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=241e59a8661d45e2857131e50188da72, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.892 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false, responseScanTimestamp = 7287158816923648001) for scanner KuduScanner(table=replication_test_table, tablet=c02ccf07c7dd4bd8bd988bc91473ed95, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.894 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [50ff3b41ada99d07b517ad3aefa774944303c082beb498b2e24b19557e4c4a8a]
08:05:09.894 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
08:05:09.904 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 2839bd0409e24473ba578762df5878f0 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
08:05:09.905 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 241e59a8661d45e2857131e50188da72 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
08:05:09.905 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=2839bd0409e24473ba578762df5878f0@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)[L],c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=241e59a8661d45e2857131e50188da72@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363)[L],9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:05:09.908 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 2839bd0409e24473ba578762df5878f0 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
08:05:09.908 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 241e59a8661d45e2857131e50188da72 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
08:05:09.909 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=2839bd0409e24473ba578762df5878f0@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)[L],c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=241e59a8661d45e2857131e50188da72@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363)[L],9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:05:09.916 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:09.922 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [50ff3b41ada99d07b517ad3aefa774944303c082beb498b2e24b19557e4c4a8a]
08:05:09.923 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1c288af976f6413ca7ed58b161999eb4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.923 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1c288af976f6413ca7ed58b161999eb4 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
08:05:09.926 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 2839bd0409e24473ba578762df5878f0 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
08:05:09.927 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 241e59a8661d45e2857131e50188da72 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
08:05:09.927 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=2839bd0409e24473ba578762df5878f0@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)[L],c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=241e59a8661d45e2857131e50188da72@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363)[L],9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:05:09.934 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd7a40107c14c879e8432b2c815ab1f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:09.935 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4fd7a40107c14c879e8432b2c815ab1f for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
08:05:09.940 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 50ff3b41ada99d07b517ad3aefa774944303c082beb498b2e24b19557e4c4a8a finished by subtask 2; deferring removal (restored in pending)
08:05:09.941 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
08:05:09.941 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
08:05:09.941 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state READY
08:05:09.942 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:10.000 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:10.002 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:10.002 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:10.003 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:10.004 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:10.005 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:10.007 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:10.007 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:10.007 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:10.008 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:10.009 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:10.009 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:10.009 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:10.046 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:10.047 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state READY due to: connection closed
08:05:10.047 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:05:10.048 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
08:05:10.054 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9a313a89cbf04383ae23ba29dda807e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:10.055 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9a313a89cbf04383ae23ba29dda807e2 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
08:05:10.067 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2839bd0409e24473ba578762df5878f0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:10.068 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2839bd0409e24473ba578762df5878f0 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
08:05:10.080 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=241e59a8661d45e2857131e50188da72, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:10.091 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:10.091 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state READY due to: connection closed
08:05:10.092 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:05:10.092 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
08:05:10.098 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [4d0ae028537c68f52926e36bf4232ddc17254b7f7d23dc582943d4bd0ad8a30a]
08:05:10.099 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
08:05:10.099 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
08:05:10.102 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state READY
08:05:10.103 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 4d0ae028537c68f52926e36bf4232ddc17254b7f7d23dc582943d4bd0ad8a30a finished by subtask 1; deferring removal (restored in pending)
08:05:10.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:10.102433 25970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.230.195:45755, user_credentials={real_user=slave}} blocked reactor thread for 423584us
08:05:10.104 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:10.118 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job e26b904229418d0e047d5d94c5b9f905 (4464 bytes, checkpointDuration=752 ms, finalizationTime=1 ms).
08:05:10.119 [INFO - Checkpoint Timer] (CheckpointRequestDecider.java:220) checkpoint request time in queue: 254
08:05:10.122 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
08:05:10.122 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 0d3e6dadab32c0fa7c53052e6ec73d3951705fcfc27dbf5f9fa32883bd5bd222 from pending
08:05:10.122 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 12973bbf11785c18d6a7d53608bd0eb0850050050ca3af4b3c1a5aa520c4a07d from pending
08:05:10.122 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 5b1e2cfddbb3bcb8524644aaf27082496da933c052a3041c021b325a748fcbf6 from pending
08:05:10.122 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 4d0ae028537c68f52926e36bf4232ddc17254b7f7d23dc582943d4bd0ad8a30a from pending
08:05:10.122 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 50ff3b41ada99d07b517ad3aefa774944303c082beb498b2e24b19557e4c4a8a from pending
08:05:10.122 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 5 finished splits from enumerator state
08:05:10.123 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091510119 for job e26b904229418d0e047d5d94c5b9f905.
08:05:10.127 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=4, operationSize=260, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@6fdd5791, flushNotification=Deferred@2079075210(state=PENDING, result=null, callback=<none>, errback=<none>)}
08:05:10.129 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)] connecting to peer
08:05:10.130 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=1, operationSize=65, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@5bfc3647, flushNotification=Deferred@1622375869(state=PENDING, result=null, callback=<none>, errback=<none>)}
08:05:10.130 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)] connecting to peer
08:05:10.137 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=3, operationSize=195, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@1e03c19d, flushNotification=Deferred@994364831(state=PENDING, result=null, callback=<none>, errback=<none>)}
08:05:10.138 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)] connecting to peer
08:05:10.155 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:10.156 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state READY due to: connection closed
08:05:10.156 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:05:10.156 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
08:05:10.173 [DEBUG - kudu-nio-3] (Connection.java:757) [peer c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)] Successfully connected to peer
08:05:10.189 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)] Successfully connected to peer
08:05:10.203 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1c288af976f6413ca7ed58b161999eb4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:10.203 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1c288af976f6413ca7ed58b161999eb4 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
08:05:10.218 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd7a40107c14c879e8432b2c815ab1f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:10.219 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4fd7a40107c14c879e8432b2c815ab1f for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
08:05:10.223 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)] Successfully connected to peer
08:05:10.257 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:10.271 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9a313a89cbf04383ae23ba29dda807e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:10.272 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9a313a89cbf04383ae23ba29dda807e2 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
08:05:10.289 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2839bd0409e24473ba578762df5878f0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:10.289 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2839bd0409e24473ba578762df5878f0 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
08:05:10.300 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=241e59a8661d45e2857131e50188da72, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:10.300 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:10.305 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:10.308 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x2f776540, L:/127.0.0.1:55204 - R:/127.25.158.130:45041] using TOKEN/null
08:05:10.325 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x669a6d0f, L:/127.0.0.1:60514 - R:/127.25.158.131:36181] using TOKEN/null
08:05:10.367 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x7b973827, L:/127.0.0.1:60530 - R:/127.25.158.131:36181] using TOKEN/null
08:05:10.409 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:10.570 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job e26b904229418d0e047d5d94c5b9f905 (964 bytes, checkpointDuration=449 ms, finalizationTime=1 ms).
08:05:10.572 [INFO - Checkpoint Timer] (CheckpointRequestDecider.java:220) checkpoint request time in queue: 207
08:05:10.573 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
08:05:10.574 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091510572 for job e26b904229418d0e047d5d94c5b9f905.
08:05:10.591 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job e26b904229418d0e047d5d94c5b9f905 (964 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
08:05:10.594 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
08:05:10.605 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1c288af976f6413ca7ed58b161999eb4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:10.605 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1c288af976f6413ca7ed58b161999eb4 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
08:05:10.630 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd7a40107c14c879e8432b2c815ab1f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:10.631 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4fd7a40107c14c879e8432b2c815ab1f for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
08:05:10.646 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9a313a89cbf04383ae23ba29dda807e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:10.647 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9a313a89cbf04383ae23ba29dda807e2 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
08:05:10.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:10.651484 25826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.230.195:45755, user_credentials={real_user=slave}} blocked reactor thread for 59345.5us
08:05:10.746 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2839bd0409e24473ba578762df5878f0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:10.747 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2839bd0409e24473ba578762df5878f0 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
08:05:10.758 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=241e59a8661d45e2857131e50188da72, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:10.765 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 657359905549407fbbf9cdc201e47d49
08:05:10.770 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c7314f5e88224070b4e8179ac50f6270
08:05:10.791 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 657359905549407fbbf9cdc201e47d49
08:05:10.796 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c7314f5e88224070b4e8179ac50f6270
08:05:10.802 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e08529d853844e528843b6dcec7868e5 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
08:05:10.803 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4b90e75a8ecf45b4b24d00c51d885ffa for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
08:05:10.803 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet dd533e1ae3024cc396ad8921413c2eaa for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
08:05:10.803 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c02ccf07c7dd4bd8bd988bc91473ed95 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
08:05:10.803 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4be0df9f650f41e59a6c52d0160ab38d for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
08:05:10.803 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=e08529d853844e528843b6dcec7868e5@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=4b90e75a8ecf45b4b24d00c51d885ffa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=dd533e1ae3024cc396ad8921413c2eaa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)[L],97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=c02ccf07c7dd4bd8bd988bc91473ed95@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)[L],97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=4be0df9f650f41e59a6c52d0160ab38d@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)[L],9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:05:10.815 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 1c288af976f6413ca7ed58b161999eb4 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
08:05:10.816 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 4fd7a40107c14c879e8432b2c815ab1f for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
08:05:10.816 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 9a313a89cbf04383ae23ba29dda807e2 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
08:05:10.816 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 2839bd0409e24473ba578762df5878f0 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
08:05:10.816 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 241e59a8661d45e2857131e50188da72 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
08:05:10.816 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=1c288af976f6413ca7ed58b161999eb4@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=4fd7a40107c14c879e8432b2c815ab1f@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)[L],c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=9a313a89cbf04383ae23ba29dda807e2@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=2839bd0409e24473ba578762df5878f0@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)[L],c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=241e59a8661d45e2857131e50188da72@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363)[L],9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:05:10.829 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 657359905549407fbbf9cdc201e47d49
08:05:10.833 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table c7314f5e88224070b4e8179ac50f6270
08:05:10.839 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e08529d853844e528843b6dcec7868e5 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
08:05:10.840 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4b90e75a8ecf45b4b24d00c51d885ffa for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
08:05:10.840 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet dd533e1ae3024cc396ad8921413c2eaa for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
08:05:10.840 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c02ccf07c7dd4bd8bd988bc91473ed95 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
08:05:10.840 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4be0df9f650f41e59a6c52d0160ab38d for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
08:05:10.841 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=e08529d853844e528843b6dcec7868e5@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=4b90e75a8ecf45b4b24d00c51d885ffa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=dd533e1ae3024cc396ad8921413c2eaa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)[L],97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=c02ccf07c7dd4bd8bd988bc91473ed95@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)[L],97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=4be0df9f650f41e59a6c52d0160ab38d@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)[L],9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:05:10.841 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=7), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.24.230.252:40255, [5ms] Sub RPC GetTableLocations: received response from server master-127.24.230.252:40255: OK, deferred=null)) after lookup
08:05:10.854 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e08529d853844e528843b6dcec7868e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:10.854 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet e08529d853844e528843b6dcec7868e5 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
08:05:10.866 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091510865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:10.899 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job e26b904229418d0e047d5d94c5b9f905 (964 bytes, checkpointDuration=34 ms, finalizationTime=0 ms).
08:05:10.904 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
08:05:10.908 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:10.909 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4b90e75a8ecf45b4b24d00c51d885ffa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:10.909 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4b90e75a8ecf45b4b24d00c51d885ffa for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
08:05:10.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:10.905915 25934 debug-util.cc:398] Leaking SignalData structure 0x7b08000e07a0 after lost signal to thread 25804
08:05:10.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:10.907932 25934 debug-util.cc:398] Leaking SignalData structure 0x7b080003cb80 after lost signal to thread 25937
08:05:10.952 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=dd533e1ae3024cc396ad8921413c2eaa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:10.953 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet dd533e1ae3024cc396ad8921413c2eaa for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
08:05:10.965 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=c02ccf07c7dd4bd8bd988bc91473ed95, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:10.966 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet c02ccf07c7dd4bd8bd988bc91473ed95 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
08:05:10.966 [DEBUG - main] (Connection.java:748) [peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)] connecting to peer
08:05:11.022 [DEBUG - kudu-nio-5] (Connection.java:757) [peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)] Successfully connected to peer
08:05:11.120 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:11.121 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:11.122 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:11.123 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:11.123 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:11.123 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:11.124 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:11.124 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:11.124 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:11.124 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:11.124 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:11.124 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:11.125 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:11.141 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:11.161 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0x770aa8b2, L:/127.0.0.1:53692 - R:/127.24.230.193:33195] using TOKEN/null
08:05:11.173 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4be0df9f650f41e59a6c52d0160ab38d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:11.181 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 1c288af976f6413ca7ed58b161999eb4 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
08:05:11.182 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 4fd7a40107c14c879e8432b2c815ab1f for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
08:05:11.182 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 9a313a89cbf04383ae23ba29dda807e2 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
08:05:11.182 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 2839bd0409e24473ba578762df5878f0 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
08:05:11.182 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 241e59a8661d45e2857131e50188da72 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
08:05:11.183 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=1c288af976f6413ca7ed58b161999eb4@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=4fd7a40107c14c879e8432b2c815ab1f@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)[L],c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=9a313a89cbf04383ae23ba29dda807e2@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=2839bd0409e24473ba578762df5878f0@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363),9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)[L],c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=241e59a8661d45e2857131e50188da72@[98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363)[L],9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181),c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:05:11.183 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=9), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.158.188:41049, [8ms] Sub RPC GetTableLocations: received response from server master-127.25.158.188:41049: OK, deferred=null)) after lookup
08:05:11.290 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1c288af976f6413ca7ed58b161999eb4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:11.291 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1c288af976f6413ca7ed58b161999eb4 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
08:05:11.312 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd7a40107c14c879e8432b2c815ab1f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:11.313 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4fd7a40107c14c879e8432b2c815ab1f for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
08:05:11.330 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9a313a89cbf04383ae23ba29dda807e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:11.330 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9a313a89cbf04383ae23ba29dda807e2 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
08:05:11.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:11.389083 25972 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.230.193:33195, user_credentials={real_user=slave}} blocked reactor thread for 83804.6us
08:05:11.391 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2839bd0409e24473ba578762df5878f0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:11.391 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2839bd0409e24473ba578762df5878f0 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
08:05:11.396 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091511390 for job e26b904229418d0e047d5d94c5b9f905.
08:05:11.403 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=241e59a8661d45e2857131e50188da72, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:11.408 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:11.429 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job e26b904229418d0e047d5d94c5b9f905 (964 bytes, checkpointDuration=38 ms, finalizationTime=1 ms).
08:05:11.433 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
08:05:11.462 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e08529d853844e528843b6dcec7868e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:11.462 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet e08529d853844e528843b6dcec7868e5 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
08:05:11.490 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4b90e75a8ecf45b4b24d00c51d885ffa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:11.490 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4b90e75a8ecf45b4b24d00c51d885ffa for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
08:05:11.509 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=dd533e1ae3024cc396ad8921413c2eaa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:11.510 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet dd533e1ae3024cc396ad8921413c2eaa for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
08:05:11.532 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=c02ccf07c7dd4bd8bd988bc91473ed95, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:11.533 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet c02ccf07c7dd4bd8bd988bc91473ed95 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
08:05:11.543 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4be0df9f650f41e59a6c52d0160ab38d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:11.559 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1c288af976f6413ca7ed58b161999eb4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:11.560 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1c288af976f6413ca7ed58b161999eb4 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
08:05:11.580 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:11.581 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:11.582 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:11.582 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:11.582 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:11.582 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:11.582 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:11.583 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:11.583 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:11.583 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:11.583 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:11.583 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:11.583 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:11.588 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4fd7a40107c14c879e8432b2c815ab1f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:11.589 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4fd7a40107c14c879e8432b2c815ab1f for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
08:05:11.605 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9a313a89cbf04383ae23ba29dda807e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:11.605 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9a313a89cbf04383ae23ba29dda807e2 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
08:05:11.619 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2839bd0409e24473ba578762df5878f0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:11.619 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2839bd0409e24473ba578762df5878f0 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
08:05:11.629 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=241e59a8661d45e2857131e50188da72, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:11.630 [DEBUG - main] (Connection.java:575) [peer 9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)] disconnecting while in state READY
08:05:11.630 [DEBUG - main] (Connection.java:575) [peer master-127.25.158.189:46677(127.25.158.189:46677)] disconnecting while in state READY
08:05:11.630 [DEBUG - main] (Connection.java:575) [peer c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)] disconnecting while in state READY
08:05:11.630 [DEBUG - main] (Connection.java:575) [peer master-127.25.158.190:44627(127.25.158.190:44627)] disconnecting while in state READY
08:05:11.630 [DEBUG - main] (Connection.java:575) [peer 98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363)] disconnecting while in state READY
08:05:11.631 [DEBUG - main] (Connection.java:575) [peer master-127.25.158.188:41049(127.25.158.188:41049)] disconnecting while in state READY
08:05:11.631 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)] handling channelInactive
08:05:11.632 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)] cleaning up while in state READY due to: connection closed
08:05:11.632 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.25.158.189:46677(127.25.158.189:46677)] handling channelInactive
08:05:11.632 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state READY due to: connection closed
08:05:11.633 [DEBUG - kudu-nio-3] (Connection.java:239) [peer c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)] handling channelInactive
08:05:11.633 [DEBUG - kudu-nio-3] (Connection.java:709) [peer c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)] cleaning up while in state READY due to: connection closed
08:05:11.634 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.25.158.190:44627(127.25.158.190:44627)] handling channelInactive
08:05:11.634 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state READY due to: connection closed
08:05:11.634 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.25.158.188:41049(127.25.158.188:41049)] handling channelInactive
08:05:11.634 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state READY due to: connection closed
08:05:11.637 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:11.639 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-1
08:05:11.640 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
08:05:11.640 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-0
08:05:11.640 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-3
08:05:11.641 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-4
08:05:11.657 [DEBUG - kudu-nio-5] (Connection.java:239) [peer 98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363)] handling channelInactive
08:05:11.657 [DEBUG - kudu-nio-5] (Connection.java:709) [peer 98e5872971c641b5973668f07f50cf2e(127.25.158.129:33363)] cleaning up while in state READY due to: connection closed
08:05:11.658 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-5
08:05:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:11.659250 26234 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 26543
08:05:11.868 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091511865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:11.884 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job e26b904229418d0e047d5d94c5b9f905 (964 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
08:05:11.887 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
08:05:11.909 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:12.032 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 657359905549407fbbf9cdc201e47d49
08:05:12.041 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e08529d853844e528843b6dcec7868e5 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
08:05:12.041 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4b90e75a8ecf45b4b24d00c51d885ffa for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
08:05:12.041 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet dd533e1ae3024cc396ad8921413c2eaa for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
08:05:12.041 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c02ccf07c7dd4bd8bd988bc91473ed95 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
08:05:12.041 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4be0df9f650f41e59a6c52d0160ab38d for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
08:05:12.042 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=e08529d853844e528843b6dcec7868e5@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=4b90e75a8ecf45b4b24d00c51d885ffa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=dd533e1ae3024cc396ad8921413c2eaa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)[L],97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=c02ccf07c7dd4bd8bd988bc91473ed95@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)[L],97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=4be0df9f650f41e59a6c52d0160ab38d@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)[L],9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:05:12.047 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='0abb05a48535e439f200fb0aefbf7603eb6edb8c9f43b43fc0c0e62c96a07a2f'}]
08:05:12.050 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='1f18f580dba226d9ebb96df8d2a3e09b6c976166b271b04696ff196f1c31190a'}]
08:05:12.051 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='ef5b686f59a3a3f9dacd8b69fe05832138197f11f2752dddd33c312e10a9925d'}]
08:05:12.057 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:12.059 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:12.059 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
08:05:12.060 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299997, tablet=dd533e1ae3024cc396ad8921413c2eaa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}]
08:05:12.061 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
08:05:12.062 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='4c2d885b352301af33cc13ba1427266ee31fcb46bf7959b97cd6ef6f6bddb7ef'}]
08:05:12.063 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:12.065 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
08:05:12.068 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:12.069 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299997, tablet=e08529d853844e528843b6dcec7868e5@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}]
08:05:12.069 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
08:05:12.070 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299997, tablet=c02ccf07c7dd4bd8bd988bc91473ed95@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}]
08:05:12.070 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299997, tablet=4b90e75a8ecf45b4b24d00c51d885ffa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)[L],9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}]
08:05:12.104 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:12.109 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:12.119 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:12.132 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:12.152 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:12.153 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:12.153 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:12.154 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:12.154 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:12.154 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:12.154 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:12.154 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:12.154 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:12.155 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:12.155 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:12.155 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:12.145 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:12.155 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:12.158 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.195
08:05:12.207 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:12.222 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x89e4253a, L:/127.0.0.1:47492 - R:/127.24.230.195:45755] using SASL/PLAIN
08:05:12.235 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287158833254400001) for scanner KuduScanner(table=replication_test_table, tablet=dd533e1ae3024cc396ad8921413c2eaa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:12.237 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [ef5b686f59a3a3f9dacd8b69fe05832138197f11f2752dddd33c312e10a9925d]
08:05:12.237 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [ef5b686f59a3a3f9dacd8b69fe05832138197f11f2752dddd33c312e10a9925d]
08:05:12.238 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
08:05:12.238 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
08:05:12.239 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state READY
08:05:12.239 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split ef5b686f59a3a3f9dacd8b69fe05832138197f11f2752dddd33c312e10a9925d finished by subtask 2; deferring removal (restored in pending)
08:05:12.246 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='f169e02aab5ea6ffc6ad194c32e6079b3da60a84f63330a87c3080df629de0b5'}]
08:05:12.252 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:12.254 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:12.259 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:12.303 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.195
08:05:12.326 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:12.342 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:12.347 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
08:05:12.354 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299997, tablet=4be0df9f650f41e59a6c52d0160ab38d@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)[L],97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}]
08:05:12.359 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.195
08:05:12.365 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.195
08:05:12.366 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091512365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:12.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:12.374075 26738 connection.cc:582] client connection to 127.25.158.129:33363 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:05:12.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:12.374665 26738 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:05:12.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:12.385390 26888 connection.cc:582] client connection to 127.25.158.129:33363 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:05:12.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:12.385973 26888 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:05:12.387 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job e26b904229418d0e047d5d94c5b9f905 (4514 bytes, checkpointDuration=20 ms, finalizationTime=2 ms).
08:05:12.392 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
08:05:12.392 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 7 complete: removed split ef5b686f59a3a3f9dacd8b69fe05832138197f11f2752dddd33c312e10a9925d from pending
08:05:12.392 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 7 complete: removed 1 finished splits from enumerator state
08:05:12.408 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:12.420 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:12.421 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state READY due to: connection closed
08:05:12.421 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:05:12.422 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
08:05:12.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:12.420359 26234 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 26712
08:05:12.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:12.434198 26888 consensus_peers.cc:597] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80 -> Peer 98e5872971c641b5973668f07f50cf2e (127.25.158.129:33363): Couldn't send request to peer 98e5872971c641b5973668f07f50cf2e. Status: Network error: Client connection negotiation failed: client connection to 127.25.158.129:33363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
08:05:12.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:12.434978 26888 consensus_peers.cc:597] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80 -> Peer 98e5872971c641b5973668f07f50cf2e (127.25.158.129:33363): Couldn't send request to peer 98e5872971c641b5973668f07f50cf2e. Status: Network error: Client connection negotiation failed: client connection to 127.25.158.129:33363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
08:05:12.493 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:12.525 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:12.526 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:12.533 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:12.544 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.195
08:05:12.553 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7ac91fba, L:/127.0.0.1:47494 - R:/127.24.230.195:45755] using SASL/PLAIN
08:05:12.565 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:12.571 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:12.575 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf2dbd038, L:/127.0.0.1:47512 - R:/127.24.230.195:45755] using SASL/PLAIN
08:05:12.591 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287158833254400001) for scanner KuduScanner(table=replication_test_table, tablet=4be0df9f650f41e59a6c52d0160ab38d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:12.592 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [f169e02aab5ea6ffc6ad194c32e6079b3da60a84f63330a87c3080df629de0b5]
08:05:12.592 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [f169e02aab5ea6ffc6ad194c32e6079b3da60a84f63330a87c3080df629de0b5]
08:05:12.593 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
08:05:12.593 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
08:05:12.595 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split f169e02aab5ea6ffc6ad194c32e6079b3da60a84f63330a87c3080df629de0b5 finished by subtask 2; deferring removal (restored in pending)
08:05:12.595 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state READY
08:05:12.596 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:12.598 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287158833254400001) for scanner KuduScanner(table=replication_test_table, tablet=e08529d853844e528843b6dcec7868e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:12.598 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [0abb05a48535e439f200fb0aefbf7603eb6edb8c9f43b43fc0c0e62c96a07a2f]
08:05:12.598 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [0abb05a48535e439f200fb0aefbf7603eb6edb8c9f43b43fc0c0e62c96a07a2f]
08:05:12.599 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
08:05:12.599 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
08:05:12.601 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 0abb05a48535e439f200fb0aefbf7603eb6edb8c9f43b43fc0c0e62c96a07a2f finished by subtask 0; deferring removal (restored in pending)
08:05:12.601 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state READY
08:05:12.601 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:12.603 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x3a53b831, L:/127.0.0.1:47504 - R:/127.24.230.195:45755] using SASL/PLAIN
08:05:12.622 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa96ec9cc, L:/127.0.0.1:47510 - R:/127.24.230.195:45755] using SASL/PLAIN
08:05:12.669 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287158833254400001) for scanner KuduScanner(table=replication_test_table, tablet=c02ccf07c7dd4bd8bd988bc91473ed95, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:12.669 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [4c2d885b352301af33cc13ba1427266ee31fcb46bf7959b97cd6ef6f6bddb7ef]
08:05:12.671 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [4c2d885b352301af33cc13ba1427266ee31fcb46bf7959b97cd6ef6f6bddb7ef]
08:05:12.671 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
08:05:12.671 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
08:05:12.672 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state READY
08:05:12.672 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 4c2d885b352301af33cc13ba1427266ee31fcb46bf7959b97cd6ef6f6bddb7ef finished by subtask 1; deferring removal (restored in pending)
08:05:12.673 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:12.675 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:12.675 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state READY due to: connection closed
08:05:12.675 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
08:05:12.676 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
08:05:12.694 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287158833254400001) for scanner KuduScanner(table=replication_test_table, tablet=4b90e75a8ecf45b4b24d00c51d885ffa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:12.695 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [1f18f580dba226d9ebb96df8d2a3e09b6c976166b271b04696ff196f1c31190a]
08:05:12.695 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [1f18f580dba226d9ebb96df8d2a3e09b6c976166b271b04696ff196f1c31190a]
08:05:12.696 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
08:05:12.696 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
08:05:12.697 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 1f18f580dba226d9ebb96df8d2a3e09b6c976166b271b04696ff196f1c31190a finished by subtask 3; deferring removal (restored in pending)
08:05:12.699 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state READY
08:05:12.703 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:12.786 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:12.786 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state READY due to: connection closed
08:05:12.787 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:05:12.786 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
08:05:12.803 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:12.803 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state READY due to: connection closed
08:05:12.803 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
08:05:12.804 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:05:12.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:12.840250 27523 raft_consensus.cc:493] T 241e59a8661d45e2857131e50188da72 P 9ae9aa4067a84876910d8ee905ea9e80 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98e5872971c641b5973668f07f50cf2e)
08:05:12.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:12.840909 27523 raft_consensus.cc:515] T 241e59a8661d45e2857131e50188da72 P 9ae9aa4067a84876910d8ee905ea9e80 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e5872971c641b5973668f07f50cf2e" member_type: VOTER last_known_addr { host: "127.25.158.129" port: 33363 } } peers { permanent_uuid: "c43299aa669648b7a17043222c5796c1" member_type: VOTER last_known_addr { host: "127.25.158.130" port: 45041 } } peers { permanent_uuid: "9ae9aa4067a84876910d8ee905ea9e80" member_type: VOTER last_known_addr { host: "127.25.158.131" port: 36181 } }
08:05:12.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:12.843108 27523 leader_election.cc:290] T 241e59a8661d45e2857131e50188da72 P 9ae9aa4067a84876910d8ee905ea9e80 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98e5872971c641b5973668f07f50cf2e (127.25.158.129:33363), c43299aa669648b7a17043222c5796c1 (127.25.158.130:45041)
08:05:12.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:12.849545 26888 leader_election.cc:336] T 241e59a8661d45e2857131e50188da72 P 9ae9aa4067a84876910d8ee905ea9e80 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 98e5872971c641b5973668f07f50cf2e (127.25.158.129:33363): Network error: Client connection negotiation failed: client connection to 127.25.158.129:33363: connect: Connection refused (error 111)
08:05:12.866 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091512865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:12.901 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job e26b904229418d0e047d5d94c5b9f905 (3804 bytes, checkpointDuration=35 ms, finalizationTime=1 ms).
08:05:12.916 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:12.923 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
08:05:12.924 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 1f18f580dba226d9ebb96df8d2a3e09b6c976166b271b04696ff196f1c31190a from pending
08:05:12.924 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split f169e02aab5ea6ffc6ad194c32e6079b3da60a84f63330a87c3080df629de0b5 from pending
08:05:12.924 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 4c2d885b352301af33cc13ba1427266ee31fcb46bf7959b97cd6ef6f6bddb7ef from pending
08:05:12.924 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 0abb05a48535e439f200fb0aefbf7603eb6edb8c9f43b43fc0c0e62c96a07a2f from pending
08:05:12.924 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 8 complete: removed 4 finished splits from enumerator state
08:05:12.948 [DEBUG - kudu-nio-3] (Connection.java:239) [peer c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)] handling channelInactive
08:05:12.948 [DEBUG - kudu-nio-3] (Connection.java:709) [peer c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)] cleaning up while in state READY due to: connection closed
08:05:12.970 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:12.970 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state READY due to: connection closed
08:05:12.971 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:05:12.971 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
08:05:12.982 [DEBUG - kudu-nio-3] (Connection.java:239) [peer c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)] handling channelInactive
08:05:12.982 [DEBUG - kudu-nio-3] (Connection.java:709) [peer c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)] cleaning up while in state READY due to: connection closed
08:05:12.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:12.986812 26888 connection.cc:582] client connection to 127.25.158.130:45041 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:05:12.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:12.993347 27513 negotiation.cc:336] Failed RPC negotiation. Trace:
08:05:12.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 08:05:12.989553 (+     0us) reactor.cc:678] Submitting negotiation task for client connection to 127.25.158.130:45041 (local address 127.25.158.131:50707)
08:05:12.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 08:05:12.990335 (+   782us) negotiation.cc:107] Waiting for socket to connect
08:05:12.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 08:05:12.990394 (+    59us) client_negotiation.cc:175] Beginning negotiation
08:05:12.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 08:05:12.990712 (+   318us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
08:05:12.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 08:05:12.991967 (+  1255us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.158.130:45041: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:05:12.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"client-negotiator.queue_time_us":92}
08:05:12.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:12.994233 26888 consensus_peers.cc:597] T 2839bd0409e24473ba578762df5878f0 P 9ae9aa4067a84876910d8ee905ea9e80 -> Peer c43299aa669648b7a17043222c5796c1 (127.25.158.130:45041): Couldn't send request to peer c43299aa669648b7a17043222c5796c1. Status: Network error: Client connection negotiation failed: client connection to 127.25.158.130:45041: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
08:05:12.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:12.994922 26888 consensus_peers.cc:597] T 4fd7a40107c14c879e8432b2c815ab1f P 9ae9aa4067a84876910d8ee905ea9e80 -> Peer c43299aa669648b7a17043222c5796c1 (127.25.158.130:45041): Couldn't send request to peer c43299aa669648b7a17043222c5796c1. Status: Network error: Client connection negotiation failed: client connection to 127.25.158.130:45041: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
08:05:12.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:12.995365 26888 leader_election.cc:336] T 241e59a8661d45e2857131e50188da72 P 9ae9aa4067a84876910d8ee905ea9e80 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c43299aa669648b7a17043222c5796c1 (127.25.158.130:45041): Network error: Client connection negotiation failed: client connection to 127.25.158.130:45041: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:05:12.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:12.995777 26888 leader_election.cc:304] T 241e59a8661d45e2857131e50188da72 P 9ae9aa4067a84876910d8ee905ea9e80 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae9aa4067a84876910d8ee905ea9e80; no voters: 98e5872971c641b5973668f07f50cf2e, c43299aa669648b7a17043222c5796c1
08:05:12.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:12.996532 26234 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 26862
08:05:12.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:12.996795 27523 raft_consensus.cc:2749] T 241e59a8661d45e2857131e50188da72 P 9ae9aa4067a84876910d8ee905ea9e80 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
08:05:13.075 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)] handling channelInactive
08:05:13.075 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)] cleaning up while in state READY due to: connection closed
08:05:13.078 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)] handling channelInactive
08:05:13.078 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)] cleaning up while in state READY due to: connection closed
08:05:13.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:13.092859 26234 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 26246
08:05:13.190 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.25.158.190:44627(127.25.158.190:44627)] handling channelInactive
08:05:13.190 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state READY due to: connection closed
08:05:13.192 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.25.158.190:44627(127.25.158.190:44627)] handling channelInactive
08:05:13.192 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state READY due to: connection closed
08:05:13.198 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.25.158.190:44627(127.25.158.190:44627)] handling channelInactive
08:05:13.198 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state READY due to: connection closed
08:05:13.198 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.25.158.190:44627(127.25.158.190:44627)] handling channelInactive
08:05:13.198 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state READY due to: connection closed
08:05:13.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:13.203558 26234 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 26318
08:05:13.320 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.25.158.189:46677(127.25.158.189:46677)] handling channelInactive
08:05:13.320 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state READY due to: connection closed
08:05:13.323 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.25.158.189:46677(127.25.158.189:46677)] handling channelInactive
08:05:13.323 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.25.158.189:46677(127.25.158.189:46677)] handling channelInactive
08:05:13.323 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state READY due to: connection closed
08:05:13.323 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state READY due to: connection closed
08:05:13.324 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.25.158.189:46677(127.25.158.189:46677)] handling channelInactive
08:05:13.324 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state READY due to: connection closed
08:05:13.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:13.332969 26234 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 26397
08:05:13.367 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091513366 for job e26b904229418d0e047d5d94c5b9f905.
08:05:13.381 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job e26b904229418d0e047d5d94c5b9f905 (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
08:05:13.384 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
08:05:13.408 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:13.453 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.25.158.188:41049(127.25.158.188:41049)] handling channelInactive
08:05:13.453 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.25.158.188:41049(127.25.158.188:41049)] handling channelInactive
08:05:13.453 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state READY due to: connection closed
08:05:13.453 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state READY due to: connection closed
08:05:13.454 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.25.158.188:41049(127.25.158.188:41049)] handling channelInactive
08:05:13.454 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state READY due to: connection closed
08:05:13.454 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.25.158.188:41049(127.25.158.188:41049)] handling channelInactive
08:05:13.454 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state READY due to: connection closed
08:05:13.866 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091513865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:13.889 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job e26b904229418d0e047d5d94c5b9f905 (964 bytes, checkpointDuration=23 ms, finalizationTime=1 ms).
08:05:13.892 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
08:05:13.908 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:14.036 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 657359905549407fbbf9cdc201e47d49
08:05:14.045 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e08529d853844e528843b6dcec7868e5 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
08:05:14.045 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4b90e75a8ecf45b4b24d00c51d885ffa for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
08:05:14.045 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet dd533e1ae3024cc396ad8921413c2eaa for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
08:05:14.045 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c02ccf07c7dd4bd8bd988bc91473ed95 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
08:05:14.047 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4be0df9f650f41e59a6c52d0160ab38d for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
08:05:14.050 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299998, tablet=e08529d853844e528843b6dcec7868e5@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299998}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299998, tablet=4b90e75a8ecf45b4b24d00c51d885ffa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299998}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299998, tablet=dd533e1ae3024cc396ad8921413c2eaa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)[L],97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299998}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299998, tablet=c02ccf07c7dd4bd8bd988bc91473ed95@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)[L],97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299998}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299997, tablet=4be0df9f650f41e59a6c52d0160ab38d@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)[L],9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299997}]
08:05:14.055 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='156349c0e340e1c64cf5c6858bb96f00e26ebe427359c8a122051f29117bdb41'}]
08:05:14.058 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='66f43602645e05b39e2123a26483df0cde7aba101c3782babf0b53a490509cff'}]
08:05:14.060 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='a4823a733cdf707789df21336c56209d32efdb1e34559dd88e9b84f34e93469e'}]
08:05:14.062 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='09d83e64759c60f5af5acfc2d0b1e01e516b35dcebcc08a6002859ebe38fb510'}]
08:05:14.066 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:14.067 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:14.068 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
08:05:14.068 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:14.069 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
08:05:14.069 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299995, tablet=c02ccf07c7dd4bd8bd988bc91473ed95@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}]
08:05:14.070 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299995, tablet=dd533e1ae3024cc396ad8921413c2eaa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}]
08:05:14.079 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:14.087 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:14.088 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
08:05:14.089 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299995, tablet=4b90e75a8ecf45b4b24d00c51d885ffa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)[L],9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}]
08:05:14.090 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
08:05:14.091 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299995, tablet=e08529d853844e528843b6dcec7868e5@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}]
08:05:14.103 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:14.111 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:14.121 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:14.130 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:14.134 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.195
08:05:14.163 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:14.210 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:14.214 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.195
08:05:14.216 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:14.240 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:14.245 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.195
08:05:14.247 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x481adf50, L:/127.0.0.1:47520 - R:/127.24.230.195:45755] using SASL/PLAIN
08:05:14.251 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.195
08:05:14.275 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:14.292 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:14.316 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x3ef0caed, L:/127.0.0.1:47552 - R:/127.24.230.195:45755] using SASL/PLAIN
08:05:14.318 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x6a0d2b6a, L:/127.0.0.1:47526 - R:/127.24.230.195:45755] using SASL/PLAIN
08:05:14.334 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287158841446400001) for scanner KuduScanner(table=replication_test_table, tablet=e08529d853844e528843b6dcec7868e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:14.335 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [156349c0e340e1c64cf5c6858bb96f00e26ebe427359c8a122051f29117bdb41]
08:05:14.335 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [156349c0e340e1c64cf5c6858bb96f00e26ebe427359c8a122051f29117bdb41]
08:05:14.336 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
08:05:14.336 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
08:05:14.340 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 156349c0e340e1c64cf5c6858bb96f00e26ebe427359c8a122051f29117bdb41 finished by subtask 2; deferring removal (restored in pending)
08:05:14.341 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state READY
08:05:14.342 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='48b4f36f22f30fd921e17a49190a80d7d32a282d515a83c265fea1c70770e7a6'}]
08:05:14.346 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:14.347 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
08:05:14.347 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:14.348 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299995, tablet=4be0df9f650f41e59a6c52d0160ab38d@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)[L],97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}]
08:05:14.360 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287158841446400001) for scanner KuduScanner(table=replication_test_table, tablet=dd533e1ae3024cc396ad8921413c2eaa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:14.361 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [a4823a733cdf707789df21336c56209d32efdb1e34559dd88e9b84f34e93469e]
08:05:14.361 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:14.361 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [a4823a733cdf707789df21336c56209d32efdb1e34559dd88e9b84f34e93469e]
08:05:14.362 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
08:05:14.362 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
08:05:14.362 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state READY
08:05:14.363 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:14.375 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:14.383 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x960a5f39, L:/127.0.0.1:47540 - R:/127.24.230.195:45755] using SASL/PLAIN
08:05:14.391 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split a4823a733cdf707789df21336c56209d32efdb1e34559dd88e9b84f34e93469e finished by subtask 1; deferring removal (restored in pending)
08:05:14.391 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:14.391 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state READY due to: connection closed
08:05:14.391 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091514365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:14.391 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:05:14.391 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
08:05:14.394 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287158841446400001) for scanner KuduScanner(table=replication_test_table, tablet=c02ccf07c7dd4bd8bd988bc91473ed95, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:14.395 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [09d83e64759c60f5af5acfc2d0b1e01e516b35dcebcc08a6002859ebe38fb510]
08:05:14.395 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [09d83e64759c60f5af5acfc2d0b1e01e516b35dcebcc08a6002859ebe38fb510]
08:05:14.395 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
08:05:14.395 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
08:05:14.401 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 09d83e64759c60f5af5acfc2d0b1e01e516b35dcebcc08a6002859ebe38fb510 finished by subtask 3; deferring removal (restored in pending)
08:05:14.402 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state READY
08:05:14.403 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:14.408 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:14.411 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job e26b904229418d0e047d5d94c5b9f905 (4514 bytes, checkpointDuration=45 ms, finalizationTime=1 ms).
08:05:14.414 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
08:05:14.415 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 11 complete: removed split 156349c0e340e1c64cf5c6858bb96f00e26ebe427359c8a122051f29117bdb41 from pending
08:05:14.415 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 11 complete: removed split 09d83e64759c60f5af5acfc2d0b1e01e516b35dcebcc08a6002859ebe38fb510 from pending
08:05:14.415 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 11 complete: removed split a4823a733cdf707789df21336c56209d32efdb1e34559dd88e9b84f34e93469e from pending
08:05:14.415 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 11 complete: removed 3 finished splits from enumerator state
08:05:14.446 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287158841446400001) for scanner KuduScanner(table=replication_test_table, tablet=4b90e75a8ecf45b4b24d00c51d885ffa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:14.447 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [66f43602645e05b39e2123a26483df0cde7aba101c3782babf0b53a490509cff]
08:05:14.447 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [66f43602645e05b39e2123a26483df0cde7aba101c3782babf0b53a490509cff]
08:05:14.448 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
08:05:14.448 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
08:05:14.450 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 66f43602645e05b39e2123a26483df0cde7aba101c3782babf0b53a490509cff finished by subtask 0; deferring removal (restored in pending)
08:05:14.450 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state READY
08:05:14.451 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:14.458 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:14.474 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.195
08:05:14.482 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:14.482 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state READY due to: connection closed
08:05:14.483 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:05:14.483 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
08:05:14.534 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:14.545 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:14.546 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state READY due to: connection closed
08:05:14.546 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:05:14.547 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
08:05:14.563 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xbf565585, L:/127.0.0.1:47566 - R:/127.24.230.195:45755] using SASL/PLAIN
08:05:14.602 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287158841446400001) for scanner KuduScanner(table=replication_test_table, tablet=4be0df9f650f41e59a6c52d0160ab38d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:14.603 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [48b4f36f22f30fd921e17a49190a80d7d32a282d515a83c265fea1c70770e7a6]
08:05:14.603 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [48b4f36f22f30fd921e17a49190a80d7d32a282d515a83c265fea1c70770e7a6]
08:05:14.604 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
08:05:14.604 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
08:05:14.606 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 48b4f36f22f30fd921e17a49190a80d7d32a282d515a83c265fea1c70770e7a6 finished by subtask 2; deferring removal (restored in pending)
08:05:14.607 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state READY
08:05:14.627 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:14.628 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:14.629 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state READY due to: connection closed
08:05:14.629 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:05:14.629 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
08:05:14.697 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:14.697 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state READY due to: connection closed
08:05:14.698 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:05:14.698 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
08:05:14.866 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091514865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:14.883 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
08:05:14.886 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
08:05:14.886 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split 66f43602645e05b39e2123a26483df0cde7aba101c3782babf0b53a490509cff from pending
08:05:14.886 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split 48b4f36f22f30fd921e17a49190a80d7d32a282d515a83c265fea1c70770e7a6 from pending
08:05:14.886 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 12 complete: removed 2 finished splits from enumerator state
08:05:14.911 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:15.366 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091515366 for job e26b904229418d0e047d5d94c5b9f905.
08:05:15.385 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job e26b904229418d0e047d5d94c5b9f905 (964 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
08:05:15.388 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
08:05:15.408 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:15.560 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:15.561 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:15.561 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:15.564 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:15.564 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:15.565 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:15.566 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:15.566 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:15.567 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:15.567 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:15.567 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:15.567 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:15.568 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:15.868 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091515867 for job e26b904229418d0e047d5d94c5b9f905.
08:05:15.883 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job e26b904229418d0e047d5d94c5b9f905 (964 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
08:05:15.885 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
08:05:15.892 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:15.893 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:15.893 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:15.894 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:15.894 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:15.894 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:15.894 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:15.894 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:15.894 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:15.895 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:15.895 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:15.895 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:15.895 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:15.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:16.030 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 657359905549407fbbf9cdc201e47d49
08:05:16.048 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e08529d853844e528843b6dcec7868e5 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
08:05:16.048 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4b90e75a8ecf45b4b24d00c51d885ffa for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
08:05:16.048 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet dd533e1ae3024cc396ad8921413c2eaa for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
08:05:16.048 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c02ccf07c7dd4bd8bd988bc91473ed95 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
08:05:16.048 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4be0df9f650f41e59a6c52d0160ab38d for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
08:05:16.049 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=e08529d853844e528843b6dcec7868e5@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=4b90e75a8ecf45b4b24d00c51d885ffa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=dd533e1ae3024cc396ad8921413c2eaa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)[L],97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=c02ccf07c7dd4bd8bd988bc91473ed95@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)[L],97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=4be0df9f650f41e59a6c52d0160ab38d@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)[L],9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:05:16.054 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='cd7adc998d107ac43c248ffa20b4df54e05eba9fbb6d9d2a4d2481f5084eb1dd'}]
08:05:16.056 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:16.057 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
08:05:16.058 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='c4f39d1c12010b91eebd57c8d7808005b28e16576353d92b65065acfd66df86b'}]
08:05:16.060 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:16.061 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='3d836188cbdc6d30f6428651ab3ee990fcfd9bf97558418bf5e3bc4f99d20a5f'}]
08:05:16.061 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='d2fa13d3b1adf550581ca0514434f26e78798d3a9fe6cfeb05867949e2fbcd2a'}]
08:05:16.063 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:16.064 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
08:05:16.065 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299997, tablet=dd533e1ae3024cc396ad8921413c2eaa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}]
08:05:16.067 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:16.067 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 5
08:05:16.068 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299997, tablet=c02ccf07c7dd4bd8bd988bc91473ed95@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}]
08:05:16.071 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299997, tablet=e08529d853844e528843b6dcec7868e5@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}]
08:05:16.073 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
08:05:16.074 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299997, tablet=4b90e75a8ecf45b4b24d00c51d885ffa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)[L],9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}]
08:05:16.079 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:16.086 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:16.095 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:16.099 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:16.115 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:16.127 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:16.131 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.195
08:05:16.142 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:16.155 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:16.156 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:16.158 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.195
08:05:16.160 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.195
08:05:16.168 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.195
08:05:16.171 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x314dffc4, L:/127.0.0.1:47574 - R:/127.24.230.195:45755] using SASL/PLAIN
08:05:16.183 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:16.199 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x548569ee, L:/127.0.0.1:47584 - R:/127.24.230.195:45755] using SASL/PLAIN
08:05:16.200 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:16.204 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:16.206 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x77097f86, L:/127.0.0.1:47602 - R:/127.24.230.195:45755] using SASL/PLAIN
08:05:16.213 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe5d22c36, L:/127.0.0.1:47590 - R:/127.24.230.195:45755] using SASL/PLAIN
08:05:16.226 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287158849638400001) for scanner KuduScanner(table=replication_test_table, tablet=e08529d853844e528843b6dcec7868e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:16.227 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [cd7adc998d107ac43c248ffa20b4df54e05eba9fbb6d9d2a4d2481f5084eb1dd]
08:05:16.227 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [cd7adc998d107ac43c248ffa20b4df54e05eba9fbb6d9d2a4d2481f5084eb1dd]
08:05:16.228 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
08:05:16.228 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
08:05:16.230 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split cd7adc998d107ac43c248ffa20b4df54e05eba9fbb6d9d2a4d2481f5084eb1dd finished by subtask 1; deferring removal (restored in pending)
08:05:16.231 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state READY
08:05:16.232 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='6269167f32a57660894dc8f9ae8f1ae9d3b1763c4c18f8f2699844435d4ab627'}]
08:05:16.234 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:16.235 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 5
08:05:16.236 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299997, tablet=4be0df9f650f41e59a6c52d0160ab38d@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)[L],97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}]
08:05:16.238 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:16.239 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287158849638400001) for scanner KuduScanner(table=replication_test_table, tablet=4b90e75a8ecf45b4b24d00c51d885ffa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:16.239 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [c4f39d1c12010b91eebd57c8d7808005b28e16576353d92b65065acfd66df86b]
08:05:16.240 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [c4f39d1c12010b91eebd57c8d7808005b28e16576353d92b65065acfd66df86b]
08:05:16.240 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
08:05:16.240 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
08:05:16.240 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state READY
08:05:16.241 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:16.241 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split c4f39d1c12010b91eebd57c8d7808005b28e16576353d92b65065acfd66df86b finished by subtask 3; deferring removal (restored in pending)
08:05:16.250 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:16.276 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:16.276 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state READY due to: connection closed
08:05:16.277 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:05:16.277 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
08:05:16.287 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:16.287 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state READY due to: connection closed
08:05:16.288 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
08:05:16.291 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
08:05:16.349 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:16.354 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.195
08:05:16.366 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091516365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:16.380 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job e26b904229418d0e047d5d94c5b9f905 (4514 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
08:05:16.382 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
08:05:16.383 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 15 complete: removed split cd7adc998d107ac43c248ffa20b4df54e05eba9fbb6d9d2a4d2481f5084eb1dd from pending
08:05:16.383 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 15 complete: removed split c4f39d1c12010b91eebd57c8d7808005b28e16576353d92b65065acfd66df86b from pending
08:05:16.383 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 15 complete: removed 2 finished splits from enumerator state
08:05:16.386 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287158849638400001) for scanner KuduScanner(table=replication_test_table, tablet=dd533e1ae3024cc396ad8921413c2eaa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:16.387 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [d2fa13d3b1adf550581ca0514434f26e78798d3a9fe6cfeb05867949e2fbcd2a]
08:05:16.387 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [d2fa13d3b1adf550581ca0514434f26e78798d3a9fe6cfeb05867949e2fbcd2a]
08:05:16.388 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
08:05:16.388 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
08:05:16.388 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state READY
08:05:16.388 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split d2fa13d3b1adf550581ca0514434f26e78798d3a9fe6cfeb05867949e2fbcd2a finished by subtask 0; deferring removal (restored in pending)
08:05:16.389 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:16.408 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:16.411 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:16.411 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state READY due to: connection closed
08:05:16.411 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:16.411 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
08:05:16.411 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
08:05:16.430 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xdef515f4, L:/127.0.0.1:47618 - R:/127.24.230.195:45755] using SASL/PLAIN
08:05:16.442 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287158849638400001) for scanner KuduScanner(table=replication_test_table, tablet=4be0df9f650f41e59a6c52d0160ab38d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:16.443 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [6269167f32a57660894dc8f9ae8f1ae9d3b1763c4c18f8f2699844435d4ab627]
08:05:16.443 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [6269167f32a57660894dc8f9ae8f1ae9d3b1763c4c18f8f2699844435d4ab627]
08:05:16.444 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 5 because it is idle.
08:05:16.444 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 5
08:05:16.445 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 6269167f32a57660894dc8f9ae8f1ae9d3b1763c4c18f8f2699844435d4ab627 finished by subtask 1; deferring removal (restored in pending)
08:05:16.445 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state READY
08:05:16.459 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:16.493 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287158849638400001) for scanner KuduScanner(table=replication_test_table, tablet=c02ccf07c7dd4bd8bd988bc91473ed95, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:16.494 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [3d836188cbdc6d30f6428651ab3ee990fcfd9bf97558418bf5e3bc4f99d20a5f]
08:05:16.494 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [3d836188cbdc6d30f6428651ab3ee990fcfd9bf97558418bf5e3bc4f99d20a5f]
08:05:16.494 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 5 because it is idle.
08:05:16.495 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 5
08:05:16.498 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 3d836188cbdc6d30f6428651ab3ee990fcfd9bf97558418bf5e3bc4f99d20a5f finished by subtask 2; deferring removal (restored in pending)
08:05:16.498 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state READY
08:05:16.500 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:16.524 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 5 exited.
08:05:16.524 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:16.524 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state READY due to: connection closed
08:05:16.525 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
08:05:16.541 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:16.541 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state READY due to: connection closed
08:05:16.541 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:05:16.542 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 5 exited.
08:05:16.866 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091516865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:16.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:05:16Z chronyd exiting
08:05:16.883 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job e26b904229418d0e047d5d94c5b9f905 (3094 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
08:05:16.886 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
08:05:16.886 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 16 complete: removed split d2fa13d3b1adf550581ca0514434f26e78798d3a9fe6cfeb05867949e2fbcd2a from pending
08:05:16.886 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 16 complete: removed split 6269167f32a57660894dc8f9ae8f1ae9d3b1763c4c18f8f2699844435d4ab627 from pending
08:05:16.886 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 16 complete: removed split 3d836188cbdc6d30f6428651ab3ee990fcfd9bf97558418bf5e3bc4f99d20a5f from pending
08:05:16.886 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 16 complete: removed 3 finished splits from enumerator state
08:05:16.911 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:16.980 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:16.981 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:16.981 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:16.982 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:16.983 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:16.983 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:16.984 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:16.984 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:16.984 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:16.984 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:16.984 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:16.985 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:16.985 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:16.987 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28151), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [13ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [20ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [29ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [29ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [45ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [46ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [47ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [47ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [63ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [65ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [66ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [66ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [84ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [84ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [103ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [104ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [105ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [105ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [123ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [124ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [126ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [126ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [144ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [145ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [145ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [163ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [165ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [166ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [166ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [384ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [385ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [387ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [387ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [403ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [404ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [404ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [404ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [405ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [680ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [682ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [683ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [683ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [683ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1920ms] refreshing cache from master, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1923ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1924ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1925ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1925ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [4961ms] refreshing cache from master, [4961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [4962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [4963ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [4964ms] too many traces: truncated at 100 traces, deferred=Deferred@679594301(state=PENDING, result=null, callback=(continuation of Deferred@2119867990 after retry RPC after error@1731765553) -> (continuation of Deferred@220283466 after retry RPC after error@735030002) -> (continuation of Deferred@21834227 after retry RPC after error@595465670) -> (continuation of Deferred@608841969 after retry RPC after error@1921291952) -> (continuation of Deferred@451816354 after retry RPC after error@1240325404) -> (continuation of Deferred@1012248936 after retry RPC after error@1781694788) -> (continuation of Deferred@32117915 after retry RPC after error@642268295) -> (continuation of Deferred@931600343 after retry RPC after error@1237420226) -> (continuation of Deferred@408814509 after retry RPC after error@2140518437) -> (continuation of Deferred@1889743279 after retry RPC after error@895561953) -> (continuation of Deferred@1565134475 after retry RPC after error@256692631) -> (continuation of Deferred@1720428440 after retry RPC after error@1523676560) -> (continuation of Deferred@1466041879 after retry RPC after error@1045144837) -> (continuation of Deferred@96952883 after retry RPC after error@1424751342) -> (continuation of Deferred@335416538 after retry RPC after error@1887367213) -> (continuation of Deferred@1310118635 after retry RPC after error@1168211277) -> (continuation of Deferred@643445247 after retry RPC after error@555897473) -> (continuation of Deferred@1507544516 after retry RPC after error@400427175) -> (continuation of Deferred@1627129450 after retry RPC after error@1408886446) -> (continuation of Deferred@1347363960 after retry RPC after error@934516198) -> (continuation of Deferred@939268652 after retry RPC after error@724322027) -> (continuation of Deferred@48876306 after retry RPC after error@702439948) -> (continuation of Deferred@2116296801 after retry RPC after error@930490960), errback=(continuation of Deferred@2119867990 after retry RPC after error@1731765553) -> (continuation of Deferred@220283466 after retry RPC after error@735030002) -> (continuation of Deferred@21834227 after retry RPC after error@595465670) -> (continuation of Deferred@608841969 after retry RPC after error@1921291952) -> (continuation of Deferred@451816354 after retry RPC after error@1240325404) -> (continuation of Deferred@1012248936 after retry RPC after error@1781694788) -> (continuation of Deferred@32117915 after retry RPC after error@642268295) -> (continuation of Deferred@931600343 after retry RPC after error@1237420226) -> (continuation of Deferred@408814509 after retry RPC after error@2140518437) -> (continuation of Deferred@1889743279 after retry RPC after error@895561953) -> (continuation of Deferred@1565134475 after retry RPC after error@256692631) -> (continuation of Deferred@1720428440 after retry RPC after error@1523676560) -> (continuation of Deferred@1466041879 after retry RPC after error@1045144837) -> (continuation of Deferred@96952883 after retry RPC after error@1424751342) -> (continuation of Deferred@335416538 after retry RPC after error@1887367213) -> (continuation of Deferred@1310118635 after retry RPC after error@1168211277) -> (continuation of Deferred@643445247 after retry RPC after error@555897473) -> (continuation of Deferred@1507544516 after retry RPC after error@400427175) -> (continuation of Deferred@1627129450 after retry RPC after error@1408886446) -> (continuation of Deferred@1347363960 after retry RPC after error@934516198) -> (continuation of Deferred@939268652 after retry RPC after error@724322027) -> (continuation of Deferred@48876306 after retry RPC after error@702439948) -> (continuation of Deferred@2116296801 after retry RPC after error@930490960)))
08:05:16.989 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
08:05:16.990 [WARN - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#1 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28151), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [13ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [20ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [29ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [29ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [45ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [46ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [47ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [47ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [63ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [65ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [66ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [66ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [84ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [84ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [103ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [104ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [105ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [105ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [123ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [124ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [126ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [126ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [144ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [145ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [145ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [163ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [165ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [166ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [166ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [384ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [385ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [387ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [387ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [403ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [404ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [404ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [404ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [405ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [680ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [682ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [683ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [683ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [683ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1920ms] refreshing cache from master, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1923ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1924ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1925ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1925ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [4961ms] refreshing cache from master, [4961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [4962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [4963ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [4964ms] too many traces: truncated at 100 traces, deferred=Deferred@679594301(state=PENDING, result=null, callback=(continuation of Deferred@2119867990 after retry RPC after error@1731765553) -> (continuation of Deferred@220283466 after retry RPC after error@735030002) -> (continuation of Deferred@21834227 after retry RPC after error@595465670) -> (continuation of Deferred@608841969 after retry RPC after error@1921291952) -> (continuation of Deferred@451816354 after retry RPC after error@1240325404) -> (continuation of Deferred@1012248936 after retry RPC after error@1781694788) -> (continuation of Deferred@32117915 after retry RPC after error@642268295) -> (continuation of Deferred@931600343 after retry RPC after error@1237420226) -> (continuation of Deferred@408814509 after retry RPC after error@2140518437) -> (continuation of Deferred@1889743279 after retry RPC after error@895561953) -> (continuation of Deferred@1565134475 after retry RPC after error@256692631) -> (continuation of Deferred@1720428440 after retry RPC after error@1523676560) -> (continuation of Deferred@1466041879 after retry RPC after error@1045144837) -> (continuation of Deferred@96952883 after retry RPC after error@1424751342) -> (continuation of Deferred@335416538 after retry RPC after error@1887367213) -> (continuation of Deferred@1310118635 after retry RPC after error@1168211277) -> (continuation of Deferred@643445247 after retry RPC after error@555897473) -> (continuation of Deferred@1507544516 after retry RPC after error@400427175) -> (continuation of Deferred@1627129450 after retry RPC after error@1408886446) -> (continuation of Deferred@1347363960 after retry RPC after error@934516198) -> (continuation of Deferred@939268652 after retry RPC after error@724322027) -> (continuation of Deferred@48876306 after retry RPC after error@702439948) -> (continuation of Deferred@2116296801 after retry RPC after error@930490960), errback=(continuation of Deferred@2119867990 after retry RPC after error@1731765553) -> (continuation of Deferred@220283466 after retry RPC after error@735030002) -> (continuation of Deferred@21834227 after retry RPC after error@595465670) -> (continuation of Deferred@608841969 after retry RPC after error@1921291952) -> (continuation of Deferred@451816354 after retry RPC after error@1240325404) -> (continuation of Deferred@1012248936 after retry RPC after error@1781694788) -> (continuation of Deferred@32117915 after retry RPC after error@642268295) -> (continuation of Deferred@931600343 after retry RPC after error@1237420226) -> (continuation of Deferred@408814509 after retry RPC after error@2140518437) -> (continuation of Deferred@1889743279 after retry RPC after error@895561953) -> (continuation of Deferred@1565134475 after retry RPC after error@256692631) -> (continuation of Deferred@1720428440 after retry RPC after error@1523676560) -> (continuation of Deferred@1466041879 after retry RPC after error@1045144837) -> (continuation of Deferred@96952883 after retry RPC after error@1424751342) -> (continuation of Deferred@335416538 after retry RPC after error@1887367213) -> (continuation of Deferred@1310118635 after retry RPC after error@1168211277) -> (continuation of Deferred@643445247 after retry RPC after error@555897473) -> (continuation of Deferred@1507544516 after retry RPC after error@400427175) -> (continuation of Deferred@1627129450 after retry RPC after error@1408886446) -> (continuation of Deferred@1347363960 after retry RPC after error@934516198) -> (continuation of Deferred@939268652 after retry RPC after error@724322027) -> (continuation of Deferred@48876306 after retry RPC after error@702439948) -> (continuation of Deferred@2116296801 after retry RPC after error@930490960)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.125:38689
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:05:17.003 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#1 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
08:05:17.013 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#1 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
08:05:17.018 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to FAILED on 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28151), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [13ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [20ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [29ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [29ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [45ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [46ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [47ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [47ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [63ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [65ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [66ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [66ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [84ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [84ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [103ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [104ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [105ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [105ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [123ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [124ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [126ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [126ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [144ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [145ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [145ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [163ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [165ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [166ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [166ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [384ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [385ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [387ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [387ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [403ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [404ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [404ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [404ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [405ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [680ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [682ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [683ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [683ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [683ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1920ms] refreshing cache from master, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1923ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1924ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1925ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1925ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [4961ms] refreshing cache from master, [4961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [4962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [4963ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [4964ms] too many traces: truncated at 100 traces, deferred=Deferred@679594301(state=PENDING, result=null, callback=(continuation of Deferred@2119867990 after retry RPC after error@1731765553) -> (continuation of Deferred@220283466 after retry RPC after error@735030002) -> (continuation of Deferred@21834227 after retry RPC after error@595465670) -> (continuation of Deferred@608841969 after retry RPC after error@1921291952) -> (continuation of Deferred@451816354 after retry RPC after error@1240325404) -> (continuation of Deferred@1012248936 after retry RPC after error@1781694788) -> (continuation of Deferred@32117915 after retry RPC after error@642268295) -> (continuation of Deferred@931600343 after retry RPC after error@1237420226) -> (continuation of Deferred@408814509 after retry RPC after error@2140518437) -> (continuation of Deferred@1889743279 after retry RPC after error@895561953) -> (continuation of Deferred@1565134475 after retry RPC after error@256692631) -> (continuation of Deferred@1720428440 after retry RPC after error@1523676560) -> (continuation of Deferred@1466041879 after retry RPC after error@1045144837) -> (continuation of Deferred@96952883 after retry RPC after error@1424751342) -> (continuation of Deferred@335416538 after retry RPC after error@1887367213) -> (continuation of Deferred@1310118635 after retry RPC after error@1168211277) -> (continuation of Deferred@643445247 after retry RPC after error@555897473) -> (continuation of Deferred@1507544516 after retry RPC after error@400427175) -> (continuation of Deferred@1627129450 after retry RPC after error@1408886446) -> (continuation of Deferred@1347363960 after retry RPC after error@934516198) -> (continuation of Deferred@939268652 after retry RPC after error@724322027) -> (continuation of Deferred@48876306 after retry RPC after error@702439948) -> (continuation of Deferred@2116296801 after retry RPC after error@930490960), errback=(continuation of Deferred@2119867990 after retry RPC after error@1731765553) -> (continuation of Deferred@220283466 after retry RPC after error@735030002) -> (continuation of Deferred@21834227 after retry RPC after error@595465670) -> (continuation of Deferred@608841969 after retry RPC after error@1921291952) -> (continuation of Deferred@451816354 after retry RPC after error@1240325404) -> (continuation of Deferred@1012248936 after retry RPC after error@1781694788) -> (continuation of Deferred@32117915 after retry RPC after error@642268295) -> (continuation of Deferred@931600343 after retry RPC after error@1237420226) -> (continuation of Deferred@408814509 after retry RPC after error@2140518437) -> (continuation of Deferred@1889743279 after retry RPC after error@895561953) -> (continuation of Deferred@1565134475 after retry RPC after error@256692631) -> (continuation of Deferred@1720428440 after retry RPC after error@1523676560) -> (continuation of Deferred@1466041879 after retry RPC after error@1045144837) -> (continuation of Deferred@96952883 after retry RPC after error@1424751342) -> (continuation of Deferred@335416538 after retry RPC after error@1887367213) -> (continuation of Deferred@1310118635 after retry RPC after error@1168211277) -> (continuation of Deferred@643445247 after retry RPC after error@555897473) -> (continuation of Deferred@1507544516 after retry RPC after error@400427175) -> (continuation of Deferred@1627129450 after retry RPC after error@1408886446) -> (continuation of Deferred@1347363960 after retry RPC after error@934516198) -> (continuation of Deferred@939268652 after retry RPC after error@724322027) -> (continuation of Deferred@48876306 after retry RPC after error@702439948) -> (continuation of Deferred@2116296801 after retry RPC after error@930490960)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.125:38689
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:05:17.024 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:05:17.025 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#1) of source Source: KuduSource.
08:05:17.025 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
08:05:17.026 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (b42812d69c586178cf7556c3c92998f3) switched from state RUNNING to RESTARTING.
08:05:17.366 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091517365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:17.391 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job e26b904229418d0e047d5d94c5b9f905 (964 bytes, checkpointDuration=25 ms, finalizationTime=1 ms).
08:05:17.393 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
08:05:17.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:17.540822 25575 debug-util.cc:398] Leaking SignalData structure 0x7b08000a3aa0 after lost signal to thread 25512
08:05:17.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:17.541787 25575 debug-util.cc:398] Leaking SignalData structure 0x7b0800070480 after lost signal to thread 25578
08:05:17.866 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091517865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:17.885 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job e26b904229418d0e047d5d94c5b9f905 (964 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
08:05:17.886 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
08:05:17.993 [ERROR - main] (RetryRule.java:206) org.apache.kudu.replication.TestReplicationTableInitializer.testRangeWithCustomHashSchemas: failed attempt 1
org.apache.kudu.shaded.org.apache.commons.logging.LogConfigurationException: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl (Caused by java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1158)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory$2.run(LogFactory.java:960)
	at java.base/java.security.AccessController.doPrivileged(AccessController.java:318)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.newFactory(LogFactory.java:957)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getFactory(LogFactory.java:624)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getLog(LogFactory.java:655)
	at org.apache.kudu.shaded.org.apache.http.conn.ssl.DefaultHostnameVerifier.<init>(DefaultHostnameVerifier.java:82)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClientBuilder.build(HttpClientBuilder.java:970)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClients.createDefault(HttpClients.java:56)
	at org.apache.kudu.test.junit.ResultReporter.reportResult(ResultReporter.java:207)
	at org.apache.kudu.test.junit.ResultReporter.tryReportResult(ResultReporter.java:244)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.report(RetryRule.java:165)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:191)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
Caused by: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1020)
	... 42 more
08:05:18.039 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 657359905549407fbbf9cdc201e47d49
08:05:18.047 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e08529d853844e528843b6dcec7868e5 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
08:05:18.047 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4b90e75a8ecf45b4b24d00c51d885ffa for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
08:05:18.047 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet dd533e1ae3024cc396ad8921413c2eaa for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
08:05:18.047 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c02ccf07c7dd4bd8bd988bc91473ed95 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
08:05:18.047 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4be0df9f650f41e59a6c52d0160ab38d for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
08:05:18.048 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=e08529d853844e528843b6dcec7868e5@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=4b90e75a8ecf45b4b24d00c51d885ffa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=dd533e1ae3024cc396ad8921413c2eaa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)[L],97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=c02ccf07c7dd4bd8bd988bc91473ed95@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)[L],97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=4be0df9f650f41e59a6c52d0160ab38d@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)[L],9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:05:18.052 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='80aa787f4a6d0c92ca4bf7c986304e1dfe675d27f7afe04050407130e5925891'}]
08:05:18.054 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:18.055 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
08:05:18.055 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='383543f9a6574660b14798271fc0ea2daa9e7faa90449f8d7df42f5de733aa65'}]
08:05:18.056 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299997, tablet=e08529d853844e528843b6dcec7868e5@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}]
08:05:18.057 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:18.057 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='a3e9f13f1184eed8c02e7178b43a86be3b395c67fac05ba1b308c9c5b497885d'}]
08:05:18.059 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:18.060 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 6
08:05:18.060 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='11eb830f9fa80433dfc8fb8ca395a3f2042e899f38efdd96417d49e0d326dc11'}]
08:05:18.061 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299997, tablet=dd533e1ae3024cc396ad8921413c2eaa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}]
08:05:18.061 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:18.063 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
08:05:18.064 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299997, tablet=4b90e75a8ecf45b4b24d00c51d885ffa@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)[L],9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}]
08:05:18.065 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 6
08:05:18.066 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299997, tablet=c02ccf07c7dd4bd8bd988bc91473ed95@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)[L]]}]
08:05:18.066 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:18.074 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:18.079 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:18.088 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:18.129 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:18.168 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:18.168 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:18.169 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:18.193 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.195
08:05:18.201 [ERROR - main] (RetryRule.java:253) org.apache.kudu.replication.TestReplicationTableInitializer.testRangeWithCustomHashSchemas: giving up after 1 attempts
08:05:18.201 [DEBUG - main] (Connection.java:575) [peer master-127.24.230.254:40685(127.24.230.254:40685)] disconnecting while in state READY
08:05:18.202 [DEBUG - main] (Connection.java:575) [peer master-127.24.230.252:40255(127.24.230.252:40255)] disconnecting while in state READY
08:05:18.202 [DEBUG - main] (Connection.java:575) [peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)] disconnecting while in state READY
08:05:18.202 [DEBUG - main] (Connection.java:575) [peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)] disconnecting while in state READY
08:05:18.202 [DEBUG - main] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state READY
08:05:18.202 [DEBUG - main] (Connection.java:575) [peer master-127.24.230.253:39511(127.24.230.253:39511)] disconnecting while in state READY
08:05:18.203 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.24.230.254:40685(127.24.230.254:40685)] handling channelInactive
08:05:18.203 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state READY due to: connection closed
08:05:18.203 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.24.230.252:40255(127.24.230.252:40255)] handling channelInactive
08:05:18.204 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state READY due to: connection closed
08:05:18.204 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)] handling channelInactive
08:05:18.204 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.195
08:05:18.204 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)] cleaning up while in state READY due to: connection closed
08:05:18.205 [DEBUG - kudu-nio-5] (Connection.java:239) [peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)] handling channelInactive
08:05:18.205 [DEBUG - kudu-nio-5] (Connection.java:709) [peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)] cleaning up while in state READY due to: connection closed
08:05:18.205 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:18.206 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state READY due to: connection closed
08:05:18.206 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:18.208 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
08:05:18.210 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
08:05:18.211 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-4
08:05:18.211 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-5
08:05:18.211 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 29 thread-local buffer(s) from thread: kudu-nio-1
08:05:18.215 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.195
08:05:18.219 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.24.230.253:39511(127.24.230.253:39511)] handling channelInactive
08:05:18.219 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.195
08:05:18.219 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state READY due to: connection closed
08:05:18.220 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
08:05:18.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:18.220916 25499 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 25784
08:05:18.231 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:18.263 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:18.265 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:18.270 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:18.275 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x9f574817, L:/127.0.0.1:34030 - R:/127.24.230.195:45755] using SASL/PLAIN
08:05:18.276 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x6993a0dc, L:/127.0.0.1:34046 - R:/127.24.230.195:45755] using SASL/PLAIN
08:05:18.279 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa1015503, L:/127.0.0.1:34022 - R:/127.24.230.195:45755] using SASL/PLAIN
08:05:18.287 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xdb273ff3, L:/127.0.0.1:34062 - R:/127.24.230.195:45755] using SASL/PLAIN
08:05:18.298 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287158857830400001) for scanner KuduScanner(table=replication_test_table, tablet=c02ccf07c7dd4bd8bd988bc91473ed95, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:18.299 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [11eb830f9fa80433dfc8fb8ca395a3f2042e899f38efdd96417d49e0d326dc11]
08:05:18.299 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [11eb830f9fa80433dfc8fb8ca395a3f2042e899f38efdd96417d49e0d326dc11]
08:05:18.300 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 6 because it is idle.
08:05:18.300 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 6
08:05:18.301 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state READY
08:05:18.302 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 11eb830f9fa80433dfc8fb8ca395a3f2042e899f38efdd96417d49e0d326dc11 finished by subtask 2; deferring removal (restored in pending)
08:05:18.302 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:18.303 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='35a91d8c5e517ba73a26dd4880ffdc9566130123d1ece5d5b48d42faabb0d536'}]
08:05:18.306 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:18.306 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 7
08:05:18.307 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299997, tablet=4be0df9f650f41e59a6c52d0160ab38d@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)[L],97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195),9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}]
08:05:18.318 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287158857830400001) for scanner KuduScanner(table=replication_test_table, tablet=e08529d853844e528843b6dcec7868e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:18.319 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [80aa787f4a6d0c92ca4bf7c986304e1dfe675d27f7afe04050407130e5925891]
08:05:18.319 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [80aa787f4a6d0c92ca4bf7c986304e1dfe675d27f7afe04050407130e5925891]
08:05:18.320 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
08:05:18.320 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
08:05:18.320 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state READY
08:05:18.321 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 80aa787f4a6d0c92ca4bf7c986304e1dfe675d27f7afe04050407130e5925891 finished by subtask 3; deferring removal (restored in pending)
08:05:18.321 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:18.321 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287158857830400001) for scanner KuduScanner(table=replication_test_table, tablet=4b90e75a8ecf45b4b24d00c51d885ffa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:05:18.322 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [383543f9a6574660b14798271fc0ea2daa9e7faa90449f8d7df42f5de733aa65]
08:05:18.322 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [383543f9a6574660b14798271fc0ea2daa9e7faa90449f8d7df42f5de733aa65]
08:05:18.323 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
08:05:18.323 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
08:05:18.324 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state READY
08:05:18.324 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 383543f9a6574660b14798271fc0ea2daa9e7faa90449f8d7df42f5de733aa65 finished by subtask 0; deferring removal (restored in pending)
08:05:18.326 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:18.367 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091518365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:18.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:18.386997 26113 connection.cc:582] client connection to 127.24.230.193:33195 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:05:18.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:18.387607 26113 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:05:18.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:18.388263 25499 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 25949
08:05:18.390 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job e26b904229418d0e047d5d94c5b9f905 (4514 bytes, checkpointDuration=24 ms, finalizationTime=1 ms).
08:05:18.394 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
08:05:18.394 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 19 complete: removed split 11eb830f9fa80433dfc8fb8ca395a3f2042e899f38efdd96417d49e0d326dc11 from pending
08:05:18.394 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 19 complete: removed split 383543f9a6574660b14798271fc0ea2daa9e7faa90449f8d7df42f5de733aa65 from pending
08:05:18.394 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 19 complete: removed split 80aa787f4a6d0c92ca4bf7c986304e1dfe675d27f7afe04050407130e5925891 from pending
08:05:18.394 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 19 complete: removed 3 finished splits from enumerator state
08:05:18.415 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:18.416 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state READY due to: connection closed
08:05:18.417 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:05:18.417 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 6 exited.
08:05:18.422 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:18.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:18.434007 26113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.24.230.193:33195, user_credentials={real_user=slave}} blocked reactor thread for 46402.8us
08:05:18.450 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:18.450 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state READY due to: connection closed
08:05:18.451 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:05:18.452 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
08:05:18.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:18.462622 26113 consensus_peers.cc:597] T 4b90e75a8ecf45b4b24d00c51d885ffa P 9bda994622fa49ac9fabfbf40edba4ff -> Peer 97ad2967f56a4511a42f5f0981fb24d5 (127.24.230.193:33195): Couldn't send request to peer 97ad2967f56a4511a42f5f0981fb24d5. Status: Network error: Client connection negotiation failed: client connection to 127.24.230.193:33195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
08:05:18.470 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (b42812d69c586178cf7556c3c92998f3) switched from state RESTARTING to RUNNING.
08:05:18.471 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job b42812d69c586178cf7556c3c92998f3 from Checkpoint 65 @ 1779091487380 for b42812d69c586178cf7556c3c92998f3 located at file:/tmp/junit1738461414297871817/checkpoints/b42812d69c586178cf7556c3c92998f3/chk-65.
08:05:18.471 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
08:05:18.472 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to SCHEDULED.
08:05:18.473 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:05:18.474 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:18.474 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state READY due to: connection closed
08:05:18.474 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from SCHEDULED to DEPLOYING.
08:05:18.474 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #2) with attempt id 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1) with allocation id 4c78869737ef27e21dadfe7d1a23010d
08:05:18.475 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 0 to checkpoint 65 for source Source: KuduSource to checkpoint.
08:05:18.475 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
08:05:18.475 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
08:05:18.475 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 4c78869737ef27e21dadfe7d1a23010d.
08:05:18.477 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#2 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_2), deploy into slot with allocation id 4c78869737ef27e21dadfe7d1a23010d.
08:05:18.495 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] Successfully connected to peer
08:05:18.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:18.501247 25499 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 26093
08:05:18.503 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.195
08:05:18.507 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:18.508 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to DEPLOYING.
08:05:18.508 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#2 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_2) [DEPLOYING].
08:05:18.509 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2862ed9b
08:05:18.510 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:05:18.510 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit1738461414297871817/checkpoints")
08:05:18.510 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
08:05:18.511 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
08:05:18.516 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@139d188d
08:05:18.519 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:18.530 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:18.537 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:18.538 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.543 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.543 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.546 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:18.547 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.548 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.548 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.553 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.553 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.554 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.554 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:18.571 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:18.572 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:18.573 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:18.573 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:18.574 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.574 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.574 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.575 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.575 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.575 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.576 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.576 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.576 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.576 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:18.577 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29755), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [27ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [31ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [32ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [32ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [42ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [46ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [53ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [56ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [56ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [63ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [65ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [66ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [66ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [84ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [85ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [85ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [104ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [105ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [105ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [106ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [144ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [145ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [146ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [224ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [225ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [226ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [226ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [298ms] refreshing cache from master, [299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [301ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [308ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [309ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [309ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [360ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [363ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [363ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [364ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [364ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [742ms] refreshing cache from master, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [743ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [743ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [743ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [744ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [746ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [746ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1621ms] refreshing cache from master, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1623ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1623ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1624ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1625ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1627ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1627ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2761ms] refreshing cache from master, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2763ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [2763ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [2764ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [2764ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2764ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [6101ms] refreshing cache from master, [6102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [6102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [6103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [6104ms] too many traces: truncated at 100 traces, deferred=Deferred@1312606229(state=PENDING, result=null, callback=(continuation of Deferred@944983266 after retry RPC after error@340160584) -> (continuation of Deferred@349650109 after retry RPC after error@1006838354) -> (continuation of Deferred@504716652 after retry RPC after error@964082390) -> (continuation of Deferred@350837649 after retry RPC after error@828238572) -> (continuation of Deferred@93794198 after retry RPC after error@163284472) -> (continuation of Deferred@1464889997 after retry RPC after error@159709185) -> (continuation of Deferred@903060792 after retry RPC after error@1611811391) -> (continuation of Deferred@872585386 after retry RPC after error@451427035) -> (continuation of Deferred@863723235 after retry RPC after error@1103804673) -> (continuation of Deferred@1638776410 after retry RPC after error@986218070) -> (continuation of Deferred@1395499946 after retry RPC after error@1195051647) -> (continuation of Deferred@1273504684 after retry RPC after error@841735753) -> (continuation of Deferred@212142933 after retry RPC after error@332566604) -> (continuation of Deferred@422388953 after retry RPC after error@1964533795) -> (continuation of Deferred@1371744886 after retry RPC after error@1444188402) -> (continuation of Deferred@644840709 after retry RPC after error@268456091) -> (continuation of Deferred@1482184823 after retry RPC after error@708432014) -> (continuation of Deferred@2011367321 after retry RPC after error@1702167926) -> (continuation of Deferred@2146726479 after retry RPC after error@464347295) -> (continuation of Deferred@1948083132 after retry RPC after error@965646076) -> (continuation of Deferred@1697971592 after retry RPC after error@359518249) -> (continuation of Deferred@175264187 after retry RPC after error@1191583615) -> (continuation of Deferred@94139050 after retry RPC after error@2114651816) -> (continuation of Deferred@1718386523 after retry RPC after error@300316942), errback=(continuation of Deferred@944983266 after retry RPC after error@340160584) -> (continuation of Deferred@349650109 after retry RPC after error@1006838354) -> (continuation of Deferred@504716652 after retry RPC after error@964082390) -> (continuation of Deferred@350837649 after retry RPC after error@828238572) -> (continuation of Deferred@93794198 after retry RPC after error@163284472) -> (continuation of Deferred@1464889997 after retry RPC after error@159709185) -> (continuation of Deferred@903060792 after retry RPC after error@1611811391) -> (continuation of Deferred@872585386 after retry RPC after error@451427035) -> (continuation of Deferred@863723235 after retry RPC after error@1103804673) -> (continuation of Deferred@1638776410 after retry RPC after error@986218070) -> (continuation of Deferred@1395499946 after retry RPC after error@1195051647) -> (continuation of Deferred@1273504684 after retry RPC after error@841735753) -> (continuation of Deferred@212142933 after retry RPC after error@332566604) -> (continuation of Deferred@422388953 after retry RPC after error@1964533795) -> (continuation of Deferred@1371744886 after retry RPC after error@1444188402) -> (continuation of Deferred@644840709 after retry RPC after error@268456091) -> (continuation of Deferred@1482184823 after retry RPC after error@708432014) -> (continuation of Deferred@2011367321 after retry RPC after error@1702167926) -> (continuation of Deferred@2146726479 after retry RPC after error@464347295) -> (continuation of Deferred@1948083132 after retry RPC after error@965646076) -> (continuation of Deferred@1697971592 after retry RPC after error@359518249) -> (continuation of Deferred@175264187 after retry RPC after error@1191583615) -> (continuation of Deferred@94139050 after retry RPC after error@2114651816) -> (continuation of Deferred@1718386523 after retry RPC after error@300316942)))
08:05:18.580 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
08:05:18.580 [WARN - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#1 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29755), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [27ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [31ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [32ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [32ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [42ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [46ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [53ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [56ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [56ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [63ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [65ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [66ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [66ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [84ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [85ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [85ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [104ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [105ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [105ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [106ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [144ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [145ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [146ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [224ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [225ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [226ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [226ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [298ms] refreshing cache from master, [299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [301ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [308ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [309ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [309ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [360ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [363ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [363ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [364ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [364ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [742ms] refreshing cache from master, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [743ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [743ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [743ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [744ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [746ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [746ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1621ms] refreshing cache from master, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1623ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1623ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1624ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1625ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1627ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1627ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2761ms] refreshing cache from master, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2763ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [2763ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [2764ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [2764ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2764ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [6101ms] refreshing cache from master, [6102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [6102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [6103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [6104ms] too many traces: truncated at 100 traces, deferred=Deferred@1312606229(state=PENDING, result=null, callback=(continuation of Deferred@944983266 after retry RPC after error@340160584) -> (continuation of Deferred@349650109 after retry RPC after error@1006838354) -> (continuation of Deferred@504716652 after retry RPC after error@964082390) -> (continuation of Deferred@350837649 after retry RPC after error@828238572) -> (continuation of Deferred@93794198 after retry RPC after error@163284472) -> (continuation of Deferred@1464889997 after retry RPC after error@159709185) -> (continuation of Deferred@903060792 after retry RPC after error@1611811391) -> (continuation of Deferred@872585386 after retry RPC after error@451427035) -> (continuation of Deferred@863723235 after retry RPC after error@1103804673) -> (continuation of Deferred@1638776410 after retry RPC after error@986218070) -> (continuation of Deferred@1395499946 after retry RPC after error@1195051647) -> (continuation of Deferred@1273504684 after retry RPC after error@841735753) -> (continuation of Deferred@212142933 after retry RPC after error@332566604) -> (continuation of Deferred@422388953 after retry RPC after error@1964533795) -> (continuation of Deferred@1371744886 after retry RPC after error@1444188402) -> (continuation of Deferred@644840709 after retry RPC after error@268456091) -> (continuation of Deferred@1482184823 after retry RPC after error@708432014) -> (continuation of Deferred@2011367321 after retry RPC after error@1702167926) -> (continuation of Deferred@2146726479 after retry RPC after error@464347295) -> (continuation of Deferred@1948083132 after retry RPC after error@965646076) -> (continuation of Deferred@1697971592 after retry RPC after error@359518249) -> (continuation of Deferred@175264187 after retry RPC after error@1191583615) -> (continuation of Deferred@94139050 after retry RPC after error@2114651816) -> (continuation of Deferred@1718386523 after retry RPC after error@300316942), errback=(continuation of Deferred@944983266 after retry RPC after error@340160584) -> (continuation of Deferred@349650109 after retry RPC after error@1006838354) -> (continuation of Deferred@504716652 after retry RPC after error@964082390) -> (continuation of Deferred@350837649 after retry RPC after error@828238572) -> (continuation of Deferred@93794198 after retry RPC after error@163284472) -> (continuation of Deferred@1464889997 after retry RPC after error@159709185) -> (continuation of Deferred@903060792 after retry RPC after error@1611811391) -> (continuation of Deferred@872585386 after retry RPC after error@451427035) -> (continuation of Deferred@863723235 after retry RPC after error@1103804673) -> (continuation of Deferred@1638776410 after retry RPC after error@986218070) -> (continuation of Deferred@1395499946 after retry RPC after error@1195051647) -> (continuation of Deferred@1273504684 after retry RPC after error@841735753) -> (continuation of Deferred@212142933 after retry RPC after error@332566604) -> (continuation of Deferred@422388953 after retry RPC after error@1964533795) -> (continuation of Deferred@1371744886 after retry RPC after error@1444188402) -> (continuation of Deferred@644840709 after retry RPC after error@268456091) -> (continuation of Deferred@1482184823 after retry RPC after error@708432014) -> (continuation of Deferred@2011367321 after retry RPC after error@1702167926) -> (continuation of Deferred@2146726479 after retry RPC after error@464347295) -> (continuation of Deferred@1948083132 after retry RPC after error@965646076) -> (continuation of Deferred@1697971592 after retry RPC after error@359518249) -> (continuation of Deferred@175264187 after retry RPC after error@1191583615) -> (continuation of Deferred@94139050 after retry RPC after error@2114651816) -> (continuation of Deferred@1718386523 after retry RPC after error@300316942)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:05:18.584 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#1 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
08:05:18.587 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#1 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
08:05:18.591 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to FAILED on 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29755), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [27ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [31ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [32ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [32ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [42ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [46ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [53ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [56ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [56ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [63ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [65ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [66ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [66ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [84ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [85ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [85ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [104ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [105ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [105ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [106ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [144ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [145ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [146ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [224ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [225ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [226ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [226ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [298ms] refreshing cache from master, [299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [301ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [308ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [309ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [309ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [360ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [363ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [363ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [364ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [364ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [742ms] refreshing cache from master, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [743ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [743ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [743ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [744ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [746ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [746ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1621ms] refreshing cache from master, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1623ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1623ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1624ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1625ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1627ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1627ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2761ms] refreshing cache from master, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2763ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [2763ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [2764ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [2764ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2764ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [6101ms] refreshing cache from master, [6102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [6102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [6103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [6104ms] too many traces: truncated at 100 traces, deferred=Deferred@1312606229(state=PENDING, result=null, callback=(continuation of Deferred@944983266 after retry RPC after error@340160584) -> (continuation of Deferred@349650109 after retry RPC after error@1006838354) -> (continuation of Deferred@504716652 after retry RPC after error@964082390) -> (continuation of Deferred@350837649 after retry RPC after error@828238572) -> (continuation of Deferred@93794198 after retry RPC after error@163284472) -> (continuation of Deferred@1464889997 after retry RPC after error@159709185) -> (continuation of Deferred@903060792 after retry RPC after error@1611811391) -> (continuation of Deferred@872585386 after retry RPC after error@451427035) -> (continuation of Deferred@863723235 after retry RPC after error@1103804673) -> (continuation of Deferred@1638776410 after retry RPC after error@986218070) -> (continuation of Deferred@1395499946 after retry RPC after error@1195051647) -> (continuation of Deferred@1273504684 after retry RPC after error@841735753) -> (continuation of Deferred@212142933 after retry RPC after error@332566604) -> (continuation of Deferred@422388953 after retry RPC after error@1964533795) -> (continuation of Deferred@1371744886 after retry RPC after error@1444188402) -> (continuation of Deferred@644840709 after retry RPC after error@268456091) -> (continuation of Deferred@1482184823 after retry RPC after error@708432014) -> (continuation of Deferred@2011367321 after retry RPC after error@1702167926) -> (continuation of Deferred@2146726479 after retry RPC after error@464347295) -> (continuation of Deferred@1948083132 after retry RPC after error@965646076) -> (continuation of Deferred@1697971592 after retry RPC after error@359518249) -> (continuation of Deferred@175264187 after retry RPC after error@1191583615) -> (continuation of Deferred@94139050 after retry RPC after error@2114651816) -> (continuation of Deferred@1718386523 after retry RPC after error@300316942), errback=(continuation of Deferred@944983266 after retry RPC after error@340160584) -> (continuation of Deferred@349650109 after retry RPC after error@1006838354) -> (continuation of Deferred@504716652 after retry RPC after error@964082390) -> (continuation of Deferred@350837649 after retry RPC after error@828238572) -> (continuation of Deferred@93794198 after retry RPC after error@163284472) -> (continuation of Deferred@1464889997 after retry RPC after error@159709185) -> (continuation of Deferred@903060792 after retry RPC after error@1611811391) -> (continuation of Deferred@872585386 after retry RPC after error@451427035) -> (continuation of Deferred@863723235 after retry RPC after error@1103804673) -> (continuation of Deferred@1638776410 after retry RPC after error@986218070) -> (continuation of Deferred@1395499946 after retry RPC after error@1195051647) -> (continuation of Deferred@1273504684 after retry RPC after error@841735753) -> (continuation of Deferred@212142933 after retry RPC after error@332566604) -> (continuation of Deferred@422388953 after retry RPC after error@1964533795) -> (continuation of Deferred@1371744886 after retry RPC after error@1444188402) -> (continuation of Deferred@644840709 after retry RPC after error@268456091) -> (continuation of Deferred@1482184823 after retry RPC after error@708432014) -> (continuation of Deferred@2011367321 after retry RPC after error@1702167926) -> (continuation of Deferred@2146726479 after retry RPC after error@464347295) -> (continuation of Deferred@1948083132 after retry RPC after error@965646076) -> (continuation of Deferred@1697971592 after retry RPC after error@359518249) -> (continuation of Deferred@175264187 after retry RPC after error@1191583615) -> (continuation of Deferred@94139050 after retry RPC after error@2114651816) -> (continuation of Deferred@1718386523 after retry RPC after error@300316942)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:05:18.596 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:05:18.597 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#1) of source Source: KuduSource.
08:05:18.597 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
08:05:18.597 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (b42812d69c586178cf7556c3c92998f3) switched from state RUNNING to RESTARTING.
08:05:18.609 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:18.611 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.612 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.612 [ERROR - kudu-nio-0] (Connection.java:452) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] unexpected exception from downstream on [id: 0xe312c579, L:/127.0.0.1:34068 - R:/127.24.230.195:45755]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:05:18.612 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state NEGOTIATING due to: [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] unexpected exception from downstream on [id: 0xe312c579, L:/127.0.0.1:34068 - R:/127.24.230.195:45755]
08:05:18.612 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755) for tablet 4be0df9f650f41e59a6c52d0160ab38d: [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] unexpected exception from downstream on [id: 0xe312c579, L:/127.0.0.1:34068 - R:/127.24.230.195:45755]
08:05:18.613 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:18.614 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] handling channelInactive
08:05:18.614 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state READY due to: connection closed
08:05:18.614 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755) for tablet dd533e1ae3024cc396ad8921413c2eaa: connection closed
08:05:18.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:18.615891 25499 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 25511
08:05:18.617 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:18.619 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.619 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.619 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.621 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.621 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.621 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.622 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.622 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:18.624 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)] connecting to peer
08:05:18.631 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:18.631 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057): Connection refused: /127.24.230.194:36057
08:05:18.631 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)] cleaning up while in state CONNECTING due to: Failed to connect to peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057): Connection refused: /127.24.230.194:36057
08:05:18.631 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057) for tablet 4be0df9f650f41e59a6c52d0160ab38d: Failed to connect to peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057): Connection refused: /127.24.230.194:36057
08:05:18.633 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:18.634 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)] connecting to peer
08:05:18.635 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.635 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.636 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.636 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:18.637 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.637 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.637 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.638 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.638 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.638 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.638 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:18.641 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057): Connection refused: /127.24.230.194:36057
08:05:18.641 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)] cleaning up while in state CONNECTING due to: Failed to connect to peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057): Connection refused: /127.24.230.194:36057
08:05:18.641 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057) for tablet dd533e1ae3024cc396ad8921413c2eaa: Failed to connect to peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057): Connection refused: /127.24.230.194:36057
08:05:18.643 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)] connecting to peer
08:05:18.645 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195): Connection refused: /127.24.230.193:33195
08:05:18.645 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)] cleaning up while in state CONNECTING due to: Failed to connect to peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195): Connection refused: /127.24.230.193:33195
08:05:18.646 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195) for tablet 4be0df9f650f41e59a6c52d0160ab38d: Failed to connect to peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195): Connection refused: /127.24.230.193:33195
08:05:18.651 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:18.651 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:18.652 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.652 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.652 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.652 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.652 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:18.652 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.652 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.653 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.653 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.653 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.653 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:18.654 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)] connecting to peer
08:05:18.657 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195): Connection refused: /127.24.230.193:33195
08:05:18.657 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)] cleaning up while in state CONNECTING due to: Failed to connect to peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195): Connection refused: /127.24.230.193:33195
08:05:18.658 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195) for tablet dd533e1ae3024cc396ad8921413c2eaa: Failed to connect to peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195): Connection refused: /127.24.230.193:33195
08:05:18.663 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:18.664 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:18.664 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:18.665 [DEBUG - kudu-nio-3] (Connection.java:757) [peer master-127.24.230.254:40685(127.24.230.254:40685)] Successfully connected to peer
08:05:18.666 [DEBUG - kudu-nio-4] (Connection.java:757) [peer master-127.24.230.252:40255(127.24.230.252:40255)] Successfully connected to peer
08:05:18.671 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:18.671 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:18.671 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.671 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:18.671 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.672 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.672 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.672 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.672 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.673 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.673 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.673 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.673 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:18.675 [DEBUG - kudu-nio-4] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.252
08:05:18.676 [DEBUG - kudu-nio-5] (Connection.java:757) [peer master-127.24.230.253:39511(127.24.230.253:39511)] Successfully connected to peer
08:05:18.677 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:18.677 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.24.230.254:40685(127.24.230.254:40685)] handling channelInactive
08:05:18.677 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state READY due to: connection closed
08:05:18.680 [ERROR - kudu-nio-3] (Connection.java:452) [peer master-127.24.230.254:40685(127.24.230.254:40685)] unexpected exception from downstream on [id: 0x4878b077, L:/127.0.0.1:37506 - R:/127.24.230.254:40685]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:05:18.681 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state NEGOTIATING due to: [peer master-127.24.230.254:40685(127.24.230.254:40685)] unexpected exception from downstream on [id: 0x4878b077, L:/127.0.0.1:37506 - R:/127.24.230.254:40685]
08:05:18.681 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: [peer master-127.24.230.254:40685(127.24.230.254:40685)] unexpected exception from downstream on [id: 0x4878b077, L:/127.0.0.1:37506 - R:/127.24.230.254:40685]
08:05:18.682 [DEBUG - kudu-nio-3] (Connection.java:239) [peer master-127.24.230.254:40685(127.24.230.254:40685)] handling channelInactive
08:05:18.682 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:18.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:18.683378 25499 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 25581
08:05:18.685 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.685 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.685 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.698 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:18.708 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x67041c6b, L:/127.0.0.1:53616 - R:/127.24.230.252:40255] using SASL/PLAIN
08:05:18.710 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:18.710 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:18.713 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:18.713 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:18.714 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.714 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.714 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.715 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.715 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.715 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.716 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.716 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.716 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.716 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:18.721 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:05:18.721 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=null, attempt=1, TimeoutTracker(timeout=29646, elapsed=58), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [19ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: [peer master-127.24.230.254:40685(127.24.230.254:40685)] unexpected exception from downstream on [id: 0x4878b077, L:/127.0.0.1:37506 - R:/127.24.230.254:40685], [58ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: OK, deferred=null) after lookup
08:05:18.725 [DEBUG - kudu-nio-5] (Connection.java:757) [peer master-127.24.230.253:39511(127.24.230.253:39511)] Successfully connected to peer
08:05:18.727 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:2538) Learned about tablet 4be0df9f650f41e59a6c52d0160ab38d for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
08:05:18.727 [DEBUG - kudu-nio-4] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=4be0df9f650f41e59a6c52d0160ab38d@[37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057),97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)[L],9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
08:05:18.728 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=4be0df9f650f41e59a6c52d0160ab38d, attempt=4, KuduRpc(method=Scan, tablet=4be0df9f650f41e59a6c52d0160ab38d, attempt=4, TimeoutTracker(timeout=30000, elapsed=419), Traces: [0ms] sending RPC to server 9bda994622fa49ac9fabfbf40edba4ff, [190ms] received response from server 9bda994622fa49ac9fabfbf40edba4ff: Network error: [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] unexpected exception from downstream on [id: 0xe312c579, L:/127.0.0.1:34068 - R:/127.24.230.195:45755], [190ms] delaying RPC due to: Network error: [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] unexpected exception from downstream on [id: 0xe312c579, L:/127.0.0.1:34068 - R:/127.24.230.195:45755], [202ms] sending RPC to server 37d338f6c5db4cc4bace5615d0b1421a, [209ms] received response from server 37d338f6c5db4cc4bace5615d0b1421a: Network error: Failed to connect to peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057): Connection refused: /127.24.230.194:36057, [209ms] delaying RPC due to: Network error: Failed to connect to peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057): Connection refused: /127.24.230.194:36057, [221ms] sending RPC to server 97ad2967f56a4511a42f5f0981fb24d5, [223ms] received response from server 97ad2967f56a4511a42f5f0981fb24d5: Network error: Failed to connect to peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195): Connection refused: /127.24.230.193:33195, [224ms] delaying RPC due to: Network error: Failed to connect to peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195): Connection refused: /127.24.230.193:33195, [240ms] refreshing cache from master, [240ms] Sub RPC GetTableLocations: refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [259ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: [peer master-127.24.230.254:40685(127.24.230.254:40685)] unexpected exception from downstream on [id: 0x4878b077, L:/127.0.0.1:37506 - R:/127.24.230.254:40685], [298ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: OK, [299ms] Sub RPC GetTableLocations: sending RPC to server master-127.24.230.252:40255, [305ms] Sub RPC GetTableLocations: received response from server master-127.24.230.252:40255: OK, deferred=Deferred@317532512(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0, errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0))) after lookup
08:05:18.729 [DEBUG - kudu-nio-4] (Connection.java:748) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] connecting to peer
08:05:18.730 [DEBUG - kudu-nio-4] (Connection.java:757) [peer master-127.24.230.252:40255(127.24.230.252:40255)] Successfully connected to peer
08:05:18.733 [DEBUG - kudu-nio-4] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.230.252
08:05:18.741 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755): Connection refused: /127.24.230.195:45755
08:05:18.742 [DEBUG - kudu-nio-6] (Connection.java:709) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] cleaning up while in state CONNECTING due to: Failed to connect to peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755): Connection refused: /127.24.230.195:45755
08:05:18.742 [INFO - kudu-nio-6] (AsyncKuduClient.java:2355) Invalidating location 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755) for tablet 4be0df9f650f41e59a6c52d0160ab38d: Failed to connect to peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755): Connection refused: /127.24.230.195:45755
08:05:18.744 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.24.230.253:39511(127.24.230.253:39511)] handling channelInactive
08:05:18.745 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state READY due to: connection closed
08:05:18.745 [ERROR - kudu-nio-5] (Connection.java:452) [peer master-127.24.230.253:39511(127.24.230.253:39511)] unexpected exception from downstream on [id: 0x5ef29fbd, L:/127.0.0.1:36026 - R:/127.24.230.253:39511]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:05:18.746 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state NEGOTIATING due to: [peer master-127.24.230.253:39511(127.24.230.253:39511)] unexpected exception from downstream on [id: 0x5ef29fbd, L:/127.0.0.1:36026 - R:/127.24.230.253:39511]
08:05:18.746 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: [peer master-127.24.230.253:39511(127.24.230.253:39511)] unexpected exception from downstream on [id: 0x5ef29fbd, L:/127.0.0.1:36026 - R:/127.24.230.253:39511]
08:05:18.746 [ERROR - kudu-nio-5] (Connection.java:452) [peer master-127.24.230.253:39511(127.24.230.253:39511)] unexpected exception from downstream on [id: 0x1ac40f1c, L:/127.0.0.1:36038 - R:/127.24.230.253:39511]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:05:18.746 [DEBUG - kudu-nio-5] (Connection.java:239) [peer master-127.24.230.253:39511(127.24.230.253:39511)] handling channelInactive
08:05:18.746 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state NEGOTIATING due to: [peer master-127.24.230.253:39511(127.24.230.253:39511)] unexpected exception from downstream on [id: 0x1ac40f1c, L:/127.0.0.1:36038 - R:/127.24.230.253:39511]
08:05:18.747 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: [peer master-127.24.230.253:39511(127.24.230.253:39511)] unexpected exception from downstream on [id: 0x1ac40f1c, L:/127.0.0.1:36038 - R:/127.24.230.253:39511]
08:05:18.747 [DEBUG - kudu-nio-5] (Connection.java:239) [peer master-127.24.230.253:39511(127.24.230.253:39511)] handling channelInactive
08:05:18.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:18.748777 25499 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 25658
08:05:18.750 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:18.763 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)] connecting to peer
08:05:18.765 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057): Connection refused: /127.24.230.194:36057
08:05:18.765 [DEBUG - kudu-nio-7] (Connection.java:709) [peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)] cleaning up while in state CONNECTING due to: Failed to connect to peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057): Connection refused: /127.24.230.194:36057
08:05:18.765 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057) for tablet 4be0df9f650f41e59a6c52d0160ab38d: Failed to connect to peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057): Connection refused: /127.24.230.194:36057
08:05:18.783 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)] connecting to peer
08:05:18.784 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195): Connection refused: /127.24.230.193:33195
08:05:18.784 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)] cleaning up while in state CONNECTING due to: Failed to connect to peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195): Connection refused: /127.24.230.193:33195
08:05:18.784 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195) for tablet 4be0df9f650f41e59a6c52d0160ab38d: Failed to connect to peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195): Connection refused: /127.24.230.193:33195
08:05:18.791 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:18.792 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:18.792 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:18.793 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.793 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.793 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.794 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.794 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.794 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.795 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.795 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.795 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.795 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:18.797 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.24.230.252:40255(127.24.230.252:40255)] handling channelInactive
08:05:18.797 [DEBUG - kudu-nio-4] (Connection.java:239) [peer master-127.24.230.252:40255(127.24.230.252:40255)] handling channelInactive
08:05:18.797 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state READY due to: connection closed
08:05:18.797 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state READY due to: connection closed
08:05:18.798 [ERROR - kudu-nio-4] (Connection.java:452) [peer master-127.24.230.252:40255(127.24.230.252:40255)] unexpected exception from downstream on [id: 0xea1cc1c5, L:/127.0.0.1:53630 - R:/127.24.230.252:40255]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:05:18.799 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state NEGOTIATING due to: [peer master-127.24.230.252:40255(127.24.230.252:40255)] unexpected exception from downstream on [id: 0xea1cc1c5, L:/127.0.0.1:53630 - R:/127.24.230.252:40255]
08:05:18.799 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: [peer master-127.24.230.252:40255(127.24.230.252:40255)] unexpected exception from downstream on [id: 0xea1cc1c5, L:/127.0.0.1:53630 - R:/127.24.230.252:40255]
08:05:18.799 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:18.801 [DEBUG - kudu-nio-4] (Connection.java:239) [peer master-127.24.230.252:40255(127.24.230.252:40255)] handling channelInactive
08:05:18.811 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:18.812 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:18.812 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:18.812 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.812 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.812 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.813 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.813 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.813 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.813 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.813 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.813 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.813 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:18.815 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:18.815 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:18.817 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.817 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.817 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.817 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:18.818 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.818 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.818 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.819 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.819 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.819 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.819 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:18.823 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:18.823 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.823 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.823 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location master-127.24.230.252:40255(127.24.230.252:40255) for tablet Kudu Master: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.831 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:18.831 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:18.831 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:18.832 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.832 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.832 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:18.833 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.833 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.833 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:18.834 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.834 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.834 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:18.834 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:18.837 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:18.837 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:18.837 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.838 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.838 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:18.838 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.838 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.838 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.838 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.838 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.838 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.838 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.838 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:18.842 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:18.843 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:18.843 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.843 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.843 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:18.843 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.844 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.844 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.844 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.845 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.845 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.845 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.845 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:18.855 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:18.855 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:18.856 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:18.857 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.857 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.857 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.857 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.857 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.857 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.858 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.858 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.858 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.858 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:18.863 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:18.863 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:18.863 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.864 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.864 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.864 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:18.864 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.864 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.864 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.864 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.864 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.864 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.864 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:18.867 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091518865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:18.875 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:18.875 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:18.876 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:18.876 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.876 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.876 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.876 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.877 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.877 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.877 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.877 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.876 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.877 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:18.883 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:18.884 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:18.885 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.885 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.885 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.886 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:18.887 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.887 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.888 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.891 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.891 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.892 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.892 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:18.892 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=23 ms, finalizationTime=2 ms).
08:05:18.893 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
08:05:18.903 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:18.904 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.905 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.905 [INFO - pool-106-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.905 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:18.906 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.906 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.906 [INFO - pool-106-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.907 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:18.908 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.908 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.908 [INFO - pool-106-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.908 [WARN - pool-106-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:18.914 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:18.915 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:18.915 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:18.915 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.915 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.916 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.916 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.916 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.916 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.917 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.917 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.917 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.917 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:18.935 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:18.935 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:18.936 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:18.936 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.936 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.937 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.937 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.937 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.937 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.937 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.937 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.937 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.937 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:18.943 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:18.945 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.945 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.945 [INFO - pool-106-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:18.945 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:18.946 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.946 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.946 [INFO - pool-106-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:18.946 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:18.950 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.950 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.950 [INFO - pool-106-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:18.950 [WARN - pool-106-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:19.003 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:19.006 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:19.006 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:19.007 [INFO - pool-106-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:19.007 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:19.009 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:19.010 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:19.010 [INFO - pool-106-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:19.010 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:19.012 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:19.012 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:19.012 [INFO - pool-106-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:19.012 [WARN - pool-106-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:19.076 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:19.077 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:19.077 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:19.077 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:19.077 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:19.077 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:19.078 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:19.078 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:19.078 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:19.078 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:19.078 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:19.078 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:19.078 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:19.095 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:19.097 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:19.097 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:19.097 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:19.097 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:19.097 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:19.098 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:19.098 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:19.098 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:19.098 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:19.098 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:19.098 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:19.098 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:19.123 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:19.123 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:19.124 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:19.124 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:19.124 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:19.124 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:19.124 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:19.125 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:19.125 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:19.126 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:19.126 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:19.126 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:19.126 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:19.130 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:19.131 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:19.131 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:19.131 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:19.131 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:19.132 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:19.132 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:19.132 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:19.132 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:19.132 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:19.132 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:19.133 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:19.133 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:19.367 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091519366 for job e26b904229418d0e047d5d94c5b9f905.
08:05:19.381 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
08:05:19.382 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
08:05:19.383 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:19.384 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:19.384 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:19.384 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:19.384 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:19.385 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:19.385 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:19.385 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:19.385 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:19.386 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:19.386 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:19.387 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:19.387 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:19.535 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:19.536 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:19.536 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:19.536 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:19.537 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:19.537 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:19.537 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:19.537 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:19.537 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:19.537 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:19.537 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:19.538 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:19.538 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:19.590 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:19.591 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:19.591 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:19.592 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:19.592 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:19.592 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:19.592 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:19.592 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:19.592 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:19.592 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:19.592 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:19.592 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:19.593 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:19.695 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:19.696 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:19.696 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:19.696 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:19.697 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:19.697 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:19.697 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:19.697 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:19.697 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:19.697 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:19.697 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:19.697 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:19.697 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:19.866 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091519865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:19.878 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
08:05:19.880 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
08:05:19.903 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:19.904 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:19.904 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:19.904 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:19.905 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:19.905 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:19.905 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:19.905 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:19.905 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:19.906 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:19.905 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:19.906 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:19.906 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:20.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:05:20Z chronyd exiting
08:05:20.270 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:20.271 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:20.271 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:20.272 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.272 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.272 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.272 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.272 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.272 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.272 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.272 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.272 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.272 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:20.366 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091520365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:20.376 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:05:20.377 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
08:05:20.657 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (b42812d69c586178cf7556c3c92998f3) switched from state RESTARTING to RUNNING.
08:05:20.658 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job b42812d69c586178cf7556c3c92998f3 from Checkpoint 65 @ 1779091487380 for b42812d69c586178cf7556c3c92998f3 located at file:/tmp/junit1738461414297871817/checkpoints/b42812d69c586178cf7556c3c92998f3/chk-65.
08:05:20.659 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
08:05:20.659 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 3 to checkpoint 65 for source Source: KuduSource to checkpoint.
08:05:20.659 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to SCHEDULED.
08:05:20.660 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:05:20.661 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from SCHEDULED to DEPLOYING.
08:05:20.661 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #2) with attempt id 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1) with allocation id 2f9a5ebd231a465571d2109e36591407
08:05:20.661 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 2f9a5ebd231a465571d2109e36591407.
08:05:20.663 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#2 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_2), deploy into slot with allocation id 2f9a5ebd231a465571d2109e36591407.
08:05:20.663 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to DEPLOYING.
08:05:20.664 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#2 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_2) [DEPLOYING].
08:05:20.664 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6d4cd86a
08:05:20.664 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:05:20.665 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit1738461414297871817/checkpoints")
08:05:20.665 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
08:05:20.665 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
08:05:20.668 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@79fc4773
08:05:20.670 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:20.672 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:20.673 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:20.674 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:20.674 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.674 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.674 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.674 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.675 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.675 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.676 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.676 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.676 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.676 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:20.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:20.692 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:20.693 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:20.694 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:20.694 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.694 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.694 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.695 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.695 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.695 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.695 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.695 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.695 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.696 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:20.712 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:20.713 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:20.714 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:20.714 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.714 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.714 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.714 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.714 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.715 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.715 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.715 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.715 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.715 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:20.732 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:20.733 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:20.733 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:20.733 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.734 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.734 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.734 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.734 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.734 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.734 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.734 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.734 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.734 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:20.752 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:20.753 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:20.754 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:20.754 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.754 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.754 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.754 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.754 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.754 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.754 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.754 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.754 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.755 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:20.763 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:20.763 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:20.763 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:20.764 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:20.764 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:20.764 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:20.764 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:20.764 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:20.764 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:20.764 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:20.764 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:20.764 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:20.764 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:20.772 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:20.772 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:20.773 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:20.773 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.773 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.773 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.773 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.773 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.773 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.773 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.773 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.773 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.773 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:20.833 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:20.833 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:20.834 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:20.834 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.834 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.834 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.835 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.835 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.835 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.835 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.835 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.835 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.835 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:20.866 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091520865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:20.876 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:05:20.877 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
08:05:20.932 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:20.933 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:20.933 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:20.933 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.933 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.933 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:20.933 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.934 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.934 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.934 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.934 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:20.934 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:20.934 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:21.015 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:21.015 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:21.016 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:21.016 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:21.016 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:21.016 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:21.016 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:21.016 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:21.016 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:21.016 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:21.016 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:21.016 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:21.016 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:21.032 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:21.033 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:21.033 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:21.033 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:21.033 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:21.033 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:21.033 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:21.034 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:21.034 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:21.034 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:21.034 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:21.034 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:21.034 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:21.088 [ERROR - main] (RetryRule.java:206) org.apache.kudu.replication.TestReplicationTableInitializer.testRangeWithCustomHashSchemas: failed attempt 1
org.apache.kudu.shaded.org.apache.commons.logging.LogConfigurationException: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl (Caused by java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1158)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory$2.run(LogFactory.java:960)
	at java.base/java.security.AccessController.doPrivileged(AccessController.java:318)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.newFactory(LogFactory.java:957)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getFactory(LogFactory.java:624)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getLog(LogFactory.java:655)
	at org.apache.kudu.shaded.org.apache.http.conn.ssl.DefaultHostnameVerifier.<init>(DefaultHostnameVerifier.java:82)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClientBuilder.build(HttpClientBuilder.java:970)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClients.createDefault(HttpClients.java:56)
	at org.apache.kudu.test.junit.ResultReporter.reportResult(ResultReporter.java:207)
	at org.apache.kudu.test.junit.ResultReporter.tryReportResult(ResultReporter.java:244)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.report(RetryRule.java:165)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:216)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
Caused by: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1020)
	... 42 more
08:05:21.091 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:21.091 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:21.092 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:21.092 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:21.092 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:21.092 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:21.092 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:21.092 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:21.092 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:21.092 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:21.092 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:21.092 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:21.092 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:21.112 [ERROR - main] (RetryRule.java:253) org.apache.kudu.replication.TestReplicationTableInitializer.testRangeWithCustomHashSchemas: giving up after 1 attempts
E.08:05:21.113 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779091521113
08:05:21.113 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779091521113
08:05:21.117 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
08:05:21.121 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
08:05:21.121 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
08:05:21.122 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskk4_r_T/test-tmp
08:05:21.122 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
08:05:21.122 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskk4_r_T/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
08:05:21.125 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

08:05:21.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:21.312 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:21.313 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:21.313 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:21.313 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:21.314 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:21.314 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:21.314 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:21.314 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:21.314 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:21.314 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:21.314 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:21.314 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:21.314 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:21.366 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091521365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:21.376 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:05:21.377 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
08:05:21.516 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:05:21.516 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

08:05:21.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:21.520327 27719 mini_oidc.cc:150] Starting JWKS server
08:05:21.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:21.524488 27719 webserver.cc:533] Webserver started at http://127.0.0.1:40929/ using document root <none> and password file <none>
08:05:21.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:21.524957 27719 mini_oidc.cc:186] Starting OIDC Discovery server
08:05:21.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:21.527022 27719 webserver.cc:533] Webserver started at http://127.0.0.1:38629/ using document root <none> and password file <none>
08:05:21.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:05:21Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
08:05:21.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:05:21Z Disabled control of system clock
08:05:21.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:21.599395 27719 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-0/wal
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-0/data
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-0/logs
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-0/data/info.pb
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.17.254:45447
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.17.254
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.17.212:35685
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.27.17.254:45447,127.27.17.253:37621,127.27.17.252:43595
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:05:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40929/jwks.json with env {}
08:05:21.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:21.867 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091521866 for job e26b904229418d0e047d5d94c5b9f905.
08:05:21.877 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:05:21.877 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
08:05:21.933 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:21.933 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:21.934 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:21.934 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:21.934 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:21.934 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:21.934 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:21.934 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:21.934 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:21.935 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:21.935 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:21.935 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:21.935 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:21.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:21.963372 27731 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:05:21.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:21.964130 27731 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:05:21.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:21.964639 27731 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:05:22.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:22.002794 27731 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:05:22.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:22.003196 27731 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:05:22.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:22.003419 27731 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:05:22.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:22.003623 27731 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:05:22.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:22.003908 27731 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:05:22.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:22.004091 27731 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:40929/jwks.json
08:05:22.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:22.046903 27731 master_runner.cc:387] Master server non-default flags:
08:05:22.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:05:22.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.17.212:35685
08:05:22.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:05:22.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:05:22.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-0/data
08:05:22.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-0/wal
08:05:22.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:05:22.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.27.17.254:45447,127.27.17.253:37621,127.27.17.252:43595
08:05:22.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:05:22.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:05:22.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:05:22.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.17.254:45447
08:05:22.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:05:22.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:05:22.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:05:22.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40929/jwks.json
08:05:22.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:05:22.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:05:22.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-0/data/info.pb
08:05:22.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.17.254
08:05:22.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:05:22.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:05:22.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:05:22.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:05:22.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:05:22.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:05:22.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-0/logs
08:05:22.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:05:22.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:05:22.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:05:22.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:05:22.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:05:22.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:05:22.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:05:22.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:05:22.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:05:22.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:05:22.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:22.048758 27731 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:05:22.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:22.050915 27731 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:05:22.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:22.064867 27737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:22.183 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:22.331 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:22.332 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:22.333 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:22.334 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:22.334 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:22.334 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:22.335 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:22.335 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:22.335 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:22.336 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:22.336 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:22.336 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:22.336 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:22.366 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091522365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:22.389 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=22 ms, finalizationTime=2 ms).
08:05:22.391 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
08:05:22.443 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:22.444 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:22.445 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:22.446 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:22.446 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:22.447 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:22.447 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:22.447 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:22.448 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:22.449 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:22.449 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:22.449 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:22.449 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:22.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:22.867 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091522865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:22.887 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=20 ms, finalizationTime=2 ms).
08:05:22.889 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
08:05:23.186 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:23.366 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091523365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:23.384 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
08:05:23.386 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
08:05:23.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:22.064946 27738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:23.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:23.426002 27740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:23.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:23.429603 27739 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1356 milliseconds
08:05:23.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:23.430626 27731 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.366s	user 0.482s	sys 0.878s
08:05:23.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:23.431068 27731 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.367s	user 0.482s	sys 0.878s
08:05:23.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.431404 27731 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:05:23.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.433509 27731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:05:23.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.437741 27731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:05:23.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.439608 27731 hybrid_clock.cc:648] HybridClock initialized: now 1779091523439565 us; error 68 us; skew 500 ppm
08:05:23.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.441057 27731 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:05:23.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.452991 27731 webserver.cc:533] Webserver started at http://127.27.17.254:34795/ using document root <none> and password file <none>
08:05:23.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.454833 27731 fs_manager.cc:362] Metadata directory not provided
08:05:23.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.455184 27731 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:05:23.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.455904 27731 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:05:23.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.464486 27731 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-0/data/instance:
08:05:23.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "22ee02c6c90a4b10a49d4b8354285330"
08:05:23.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:23 on dist-test-slave-1jss"
08:05:23.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.466553 27731 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-0/wal/instance:
08:05:23.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "22ee02c6c90a4b10a49d4b8354285330"
08:05:23.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:23 on dist-test-slave-1jss"
08:05:23.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.479395 27731 fs_manager.cc:696] Time spent creating directory manager: real 0.012s	user 0.010s	sys 0.002s
08:05:23.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.489527 27747 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:05:23.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.491500 27731 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.004s	sys 0.003s
08:05:23.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.492015 27731 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-0/wal
08:05:23.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "22ee02c6c90a4b10a49d4b8354285330"
08:05:23.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:23 on dist-test-slave-1jss"
08:05:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.492419 27731 fs_report.cc:389] FS layout report
08:05:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:05:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-0/wal
08:05:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-0/wal
08:05:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-0/data/data
08:05:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:05:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:05:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:05:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:05:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:05:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:05:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:05:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:05:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:05:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:05:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:05:23.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.576822 27731 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:05:23.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.578739 27731 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:05:23.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.579305 27731 kserver.cc:163] Server-wide thread pool size limit: 3276
08:05:23.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.672402 27731 rpc_server.cc:307] RPC server started. Bound to: 127.27.17.254:45447
08:05:23.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.672479 27799 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.17.254:45447 every 8 connection(s)
08:05:23.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.675913 27731 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-0/data/info.pb
08:05:23.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.679450 27719 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 27731
08:05:23.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.680195 27719 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-0/wal/instance
08:05:23.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:23.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.684818 27800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.685665 27719 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-1/wal
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-1/data
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-1/logs
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-1/data/info.pb
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.17.253:37621
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.17.253
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.17.212:35685
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:05:23.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:05:23.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.27.17.254:45447,127.27.17.253:37621,127.27.17.252:43595
08:05:23.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:05:23.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40929/jwks.json with env {}
08:05:23.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.699492 27800 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.17.254" port: 45447 } has no permanent_uuid. Determining permanent_uuid...
08:05:23.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.736466 27800 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } has no permanent_uuid. Determining permanent_uuid...
08:05:23.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:23.739488 27751 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.17.253:37621: connect: Connection refused (error 111)
08:05:23.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:23.744788 27800 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.17.253:37621: Network error: Client connection negotiation failed: client connection to 127.27.17.253:37621: connect: Connection refused (error 111)
08:05:23.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.794385 27800 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } attempt: 1
08:05:23.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:23.800149 27800 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.17.253:37621: Network error: Client connection negotiation failed: client connection to 127.27.17.253:37621: connect: Connection refused (error 111)
08:05:23.867 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091523866 for job e26b904229418d0e047d5d94c5b9f905.
08:05:23.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.868664 27800 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } attempt: 2
08:05:23.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:23.877493 27800 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.17.253:37621: Network error: Client connection negotiation failed: client connection to 127.27.17.253:37621: connect: Connection refused (error 111)
08:05:23.879 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
08:05:23.879 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
08:05:23.913 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:23.913 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:23.914 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:23.914 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:23.914 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:23.914 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:23.914 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:23.914 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:23.914 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:23.914 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:23.914 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:23.914 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:23.915 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:23.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:23.969161 27800 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } attempt: 3
08:05:23.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:23.974182 27800 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.17.253:37621: Network error: Client connection negotiation failed: client connection to 127.27.17.253:37621: connect: Connection refused (error 111)
08:05:24.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:24.070608 27802 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:05:24.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:24.071287 27802 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:05:24.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:24.071785 27802 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:05:24.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:24.113013 27802 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:05:24.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:24.113371 27802 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:05:24.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:24.113584 27802 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:05:24.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:24.113869 27802 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:05:24.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:24.114127 27802 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:05:24.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:24.114286 27802 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:40929/jwks.json
08:05:24.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:24.117756 27800 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } attempt: 4
08:05:24.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:24.123402 27800 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.17.253:37621: Network error: Client connection negotiation failed: client connection to 127.27.17.253:37621: connect: Connection refused (error 111)
08:05:24.155 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:24.156 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:24.156 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:24.157 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:24.157 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:24.157 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:24.157 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:24.157 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:24.157 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:24.157 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:24.158 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:24.158 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:24.158 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:24.163782 27802 master_runner.cc:387] Master server non-default flags:
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.17.212:35685
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-1/data
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-1/wal
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.27.17.254:45447,127.27.17.253:37621,127.27.17.252:43595
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.17.253:37621
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40929/jwks.json
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-1/data/info.pb
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.17.253
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-1/logs
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:05:24.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:05:24.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:05:24.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:05:24.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:05:24.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:05:24.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:05:24.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:05:24.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:05:24.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:05:24.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:24.165889 27802 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:05:24.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:24.168036 27802 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:05:24.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:24.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:24.182583 27811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:24.366 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091524365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:24.381 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
08:05:24.382 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
08:05:24.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:24.422906 27800 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } attempt: 5
08:05:24.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:24.427634 27800 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.17.253:37621: Network error: Client connection negotiation failed: client connection to 127.27.17.253:37621: connect: Connection refused (error 111)
08:05:24.551 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:24.552 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:24.552 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:24.552 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:24.553 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:24.553 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:24.553 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:24.553 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:24.553 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:24.554 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:24.554 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:24.554 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:24.554 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:24.683 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:24.866 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091524865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:24.889 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=23 ms, finalizationTime=1 ms).
08:05:24.891 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
08:05:24.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:24.975212 27800 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } attempt: 6
08:05:24.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:24.987488 27800 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.17.253:37621: Network error: Client connection negotiation failed: client connection to 127.27.17.253:37621: connect: Connection refused (error 111)
08:05:25.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:25.366 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091525365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:25.379 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
08:05:25.380 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
08:05:25.453 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:25.454 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:25.454 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:25.454 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:25.454 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:25.455 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:25.455 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:25.455 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:25.455 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:25.455 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:25.455 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:25.455 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:25.456 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:25.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:24.183305 27812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:25.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:25.558017 27802 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.377s	user 0.554s	sys 0.820s
08:05:25.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:25.558380 27802 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.378s	user 0.554s	sys 0.820s
08:05:25.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:25.563127 27818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:25.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.563844 27802 server_base.cc:1061] running on GCE node
08:05:25.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.565224 27802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:05:25.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.568459 27802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:05:25.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.569921 27802 hybrid_clock.cc:648] HybridClock initialized: now 1779091525569887 us; error 43 us; skew 500 ppm
08:05:25.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.570946 27802 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:05:25.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.583148 27802 webserver.cc:533] Webserver started at http://127.27.17.253:33577/ using document root <none> and password file <none>
08:05:25.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.584354 27802 fs_manager.cc:362] Metadata directory not provided
08:05:25.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.584643 27802 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:05:25.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.585232 27802 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:05:25.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.591140 27802 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-1/data/instance:
08:05:25.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d34a8da72911433198b7fd244a9ac937"
08:05:25.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:25 on dist-test-slave-1jss"
08:05:25.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.592653 27802 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-1/wal/instance:
08:05:25.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d34a8da72911433198b7fd244a9ac937"
08:05:25.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:25 on dist-test-slave-1jss"
08:05:25.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.602238 27802 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.002s	sys 0.009s
08:05:25.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.610121 27823 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:05:25.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.611645 27802 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.002s
08:05:25.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.612104 27802 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-1/wal
08:05:25.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d34a8da72911433198b7fd244a9ac937"
08:05:25.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:25 on dist-test-slave-1jss"
08:05:25.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.612501 27802 fs_report.cc:389] FS layout report
08:05:25.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:05:25.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-1/wal
08:05:25.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-1/wal
08:05:25.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-1/data/data
08:05:25.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:05:25.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:05:25.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:05:25.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:05:25.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:05:25.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:05:25.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:05:25.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:05:25.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:05:25.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:05:25.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:05:25.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:25.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.694869 27802 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:05:25.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.696812 27802 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:05:25.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.697386 27802 kserver.cc:163] Server-wide thread pool size limit: 3276
08:05:25.763 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:25.763 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:25.764 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:25.764 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:25.764 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:25.764 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:25.764 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:25.764 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:25.764 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:25.764 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:25.764 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:25.765 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:25.765 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:25.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.788962 27802 rpc_server.cc:307] RPC server started. Bound to: 127.27.17.253:37621
08:05:25.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.789019 27874 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.17.253:37621 every 8 connection(s)
08:05:25.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.792451 27802 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-1/data/info.pb
08:05:25.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.798125 27719 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 27802
08:05:25.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.798672 27719 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-1/wal/instance
08:05:25.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.800776 27875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.802135 27719 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-2/wal
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-2/data
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-2/logs
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-2/data/info.pb
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.17.252:43595
08:05:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.17.252
08:05:25.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:05:25.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.17.212:35685
08:05:25.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:05:25.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:05:25.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:05:25.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:05:25.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.27.17.254:45447,127.27.17.253:37621,127.27.17.252:43595
08:05:25.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:05:25.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40929/jwks.json with env {}
08:05:25.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.817042 27875 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.17.254" port: 45447 } has no permanent_uuid. Determining permanent_uuid...
08:05:25.835 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:25.836 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:25.836 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:25.836 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:25.837 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:25.837 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:25.837 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:25.837 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:25.837 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:25.838 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:25.838 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:25.838 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:25.838 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:25.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.848498 27875 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } has no permanent_uuid. Determining permanent_uuid...
08:05:25.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.864842 27875 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } has no permanent_uuid. Determining permanent_uuid...
08:05:25.866 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091525865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:25.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:25.868438 27827 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.17.252:43595: connect: Connection refused (error 111)
08:05:25.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:25.876068 27875 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.17.252:43595: Network error: Client connection negotiation failed: client connection to 127.27.17.252:43595: connect: Connection refused (error 111)
08:05:25.877 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
08:05:25.879 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
08:05:25.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:25.925755 27875 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } attempt: 1
08:05:25.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:25.932137 27875 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.17.252:43595: Network error: Client connection negotiation failed: client connection to 127.27.17.252:43595: connect: Connection refused (error 111)
08:05:26.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:26.000715 27875 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } attempt: 2
08:05:26.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:26.007350 27875 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.17.252:43595: Network error: Client connection negotiation failed: client connection to 127.27.17.252:43595: connect: Connection refused (error 111)
08:05:26.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:26.048146 27800 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } attempt: 7
08:05:26.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:26.062552 27800 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } has no permanent_uuid. Determining permanent_uuid...
08:05:26.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:26.068866 27800 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.17.252:43595: Network error: Client connection negotiation failed: client connection to 127.27.17.252:43595: connect: Connection refused (error 111)
08:05:26.095 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:26.096 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:26.096 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:26.096 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:26.096 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:26.096 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:26.096 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:26.097 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:26.097 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:26.097 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:26.097 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:26.097 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:26.097 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:26.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:26.098831 27875 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } attempt: 3
08:05:26.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:26.103574 27875 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.17.252:43595: Network error: Client connection negotiation failed: client connection to 127.27.17.252:43595: connect: Connection refused (error 111)
08:05:26.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:26.127405 27800 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } attempt: 1
08:05:26.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:26.132428 27800 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.17.252:43595: Network error: Client connection negotiation failed: client connection to 127.27.17.252:43595: connect: Connection refused (error 111)
08:05:26.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:26.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:26.211850 27877 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:05:26.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:26.212719 27877 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:05:26.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:26.213354 27877 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:05:26.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:26.213936 27800 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } attempt: 2
08:05:26.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:26.218597 27800 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.17.252:43595: Network error: Client connection negotiation failed: client connection to 127.27.17.252:43595: connect: Connection refused (error 111)
08:05:26.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:26.247180 27875 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } attempt: 4
08:05:26.252 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:26.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:26.252488 27875 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.17.252:43595: Network error: Client connection negotiation failed: client connection to 127.27.17.252:43595: connect: Connection refused (error 111)
08:05:26.253 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:26.254 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:26.254 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:26.254 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:26.254 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:26.254 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:26.254 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:26.254 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:26.254 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:26.254 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:26.254 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:26.254 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:26.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:26.255002 27877 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:05:26.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:26.255380 27877 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:05:26.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:26.255681 27877 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:05:26.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:26.255980 27877 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:05:26.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:26.256201 27877 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:05:26.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:26.256356 27877 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:40929/jwks.json
08:05:26.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:26.300181 27877 master_runner.cc:387] Master server non-default flags:
08:05:26.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:05:26.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.17.212:35685
08:05:26.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-2/data
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-2/wal
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.27.17.254:45447,127.27.17.253:37621,127.27.17.252:43595
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.17.252:43595
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40929/jwks.json
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-2/data/info.pb
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.17.252
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-2/logs
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:05:26.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:05:26.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:26.302095 27877 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:05:26.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:26.304149 27877 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:05:26.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:26.304134 27800 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } attempt: 3
08:05:26.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:26.309151 27800 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.17.252:43595: Network error: Client connection negotiation failed: client connection to 127.27.17.252:43595: connect: Connection refused (error 111)
08:05:26.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:26.321180 27890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:26.367 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091526366 for job e26b904229418d0e047d5d94c5b9f905.
08:05:26.442 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:26.443 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:26.443 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:26.444 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:26.444 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:26.444 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:26.447 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:26.447 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:26.447 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:26.447 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:26.447 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:26.448 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:26.448 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:26.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:26.449708 27800 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } attempt: 4
08:05:26.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:26.458068 27800 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.17.252:43595: Network error: Client connection negotiation failed: client connection to 127.27.17.252:43595: connect: Connection refused (error 111)
08:05:26.461 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=94 ms, finalizationTime=0 ms).
08:05:26.462 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
08:05:26.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:26.552116 27875 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } attempt: 5
08:05:26.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:26.560313 27875 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.17.252:43595: Network error: Client connection negotiation failed: client connection to 127.27.17.252:43595: connect: Connection refused (error 111)
08:05:26.683 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:26.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:26.741778 27800 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } attempt: 5
08:05:26.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:26.751302 27800 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.17.252:43595: Network error: Client connection negotiation failed: client connection to 127.27.17.252:43595: connect: Connection refused (error 111)
08:05:26.866 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091526865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:26.892 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=26 ms, finalizationTime=1 ms).
08:05:26.898 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
08:05:26.933 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:26.934 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:26.934 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:26.935 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:26.935 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:26.936 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:26.936 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:26.936 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:26.937 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:26.937 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:26.938 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:26.938 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:26.938 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:27.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.107945 27875 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } attempt: 6
08:05:27.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:27.136626 27875 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.17.252:43595: Network error: Client connection negotiation failed: client connection to 127.27.17.252:43595: connect: Connection refused (error 111)
08:05:27.183 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:27.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.303965 27800 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } attempt: 6
08:05:27.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:27.341960 27800 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.17.252:43595: Network error: Client connection negotiation failed: client connection to 127.27.17.252:43595: connect: Connection refused (error 111)
08:05:27.367 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091527365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:27.391 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=22 ms, finalizationTime=4 ms).
08:05:27.394 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
08:05:27.433 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:27.437 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:27.438 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:27.439 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:27.439 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:27.439 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:27.440 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:27.440 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:27.440 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:27.441 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:27.441 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:27.441 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:27.442 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:27.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:27.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:27.726101 27889 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 27877
08:05:27.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:27.770179 27889 kernel_stack_watchdog.cc:198] Thread 27877 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 401ms:
08:05:27.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:05:27.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:05:27.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:05:27.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:05:27.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:26.322405 27891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:27.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:27.771986 27877 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.451s	user 0.497s	sys 0.936s
08:05:27.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:27.772403 27877 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.451s	user 0.497s	sys 0.936s
08:05:27.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:27.773902 27893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:27.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:27.776371 27892 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1448 milliseconds
08:05:27.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.776407 27877 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:05:27.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.778002 27877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:05:27.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.781098 27877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:05:27.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.782501 27877 hybrid_clock.cc:648] HybridClock initialized: now 1779091527782462 us; error 38 us; skew 500 ppm
08:05:27.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.783478 27877 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:05:27.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.791024 27877 webserver.cc:533] Webserver started at http://127.27.17.252:41095/ using document root <none> and password file <none>
08:05:27.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.792202 27877 fs_manager.cc:362] Metadata directory not provided
08:05:27.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.792474 27877 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:05:27.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.793162 27877 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:05:27.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.798503 27877 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-2/data/instance:
08:05:27.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "04cc86bb426540209d059661bb3dda84"
08:05:27.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:27 on dist-test-slave-1jss"
08:05:27.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.799970 27877 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-2/wal/instance:
08:05:27.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "04cc86bb426540209d059661bb3dda84"
08:05:27.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:27 on dist-test-slave-1jss"
08:05:27.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.808992 27877 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.005s
08:05:27.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.816048 27904 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:05:27.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.817379 27877 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.006s	sys 0.000s
08:05:27.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.817776 27877 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-2/wal
08:05:27.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "04cc86bb426540209d059661bb3dda84"
08:05:27.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:27 on dist-test-slave-1jss"
08:05:27.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.818342 27877 fs_report.cc:389] FS layout report
08:05:27.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:05:27.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-2/wal
08:05:27.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-2/wal
08:05:27.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-2/data/data
08:05:27.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:05:27.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:05:27.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:05:27.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:05:27.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:05:27.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:05:27.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:05:27.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:05:27.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:05:27.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:05:27.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:05:27.866 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091527865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:27.875 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
08:05:27.876 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
08:05:27.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.882335 27877 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:05:27.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.884251 27877 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:05:27.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.884806 27877 kserver.cc:163] Server-wide thread pool size limit: 3276
08:05:27.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.972821 27877 rpc_server.cc:307] RPC server started. Bound to: 127.27.17.252:43595
08:05:27.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.972920 27956 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.17.252:43595 every 8 connection(s)
08:05:27.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.976058 27877 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-2/data/info.pb
08:05:27.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.980401 27719 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 27877
08:05:27.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.980971 27719 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/master-2/wal/instance
08:05:27.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:27.984347 27957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:28.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.003911 27957 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.17.254" port: 45447 } has no permanent_uuid. Determining permanent_uuid...
08:05:28.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.031461 27957 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } has no permanent_uuid. Determining permanent_uuid...
08:05:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.042105 27957 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } has no permanent_uuid. Determining permanent_uuid...
08:05:28.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.062335 27957 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84: Bootstrap starting.
08:05:28.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.069974 27957 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84: Neither blocks nor log segments found. Creating new log.
08:05:28.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.072119 27957 log.cc:826] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84: Log is configured to *not* fsync() on all Append() calls
08:05:28.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.077319 27957 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84: No bootstrap required, opened a new log
08:05:28.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.098883 27957 raft_consensus.cc:359] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ee02c6c90a4b10a49d4b8354285330" member_type: VOTER last_known_addr { host: "127.27.17.254" port: 45447 } } peers { permanent_uuid: "d34a8da72911433198b7fd244a9ac937" member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } } peers { permanent_uuid: "04cc86bb426540209d059661bb3dda84" member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } }
08:05:28.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.099959 27957 raft_consensus.cc:385] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:28.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.100319 27957 raft_consensus.cc:740] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04cc86bb426540209d059661bb3dda84, State: Initialized, Role: FOLLOWER
08:05:28.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.101132 27957 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ee02c6c90a4b10a49d4b8354285330" member_type: VOTER last_known_addr { host: "127.27.17.254" port: 45447 } } peers { permanent_uuid: "d34a8da72911433198b7fd244a9ac937" member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } } peers { permanent_uuid: "04cc86bb426540209d059661bb3dda84" member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } }
08:05:28.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.103865 27966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ee02c6c90a4b10a49d4b8354285330" member_type: VOTER last_known_addr { host: "127.27.17.254" port: 45447 } } peers { permanent_uuid: "d34a8da72911433198b7fd244a9ac937" member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } } peers { permanent_uuid: "04cc86bb426540209d059661bb3dda84" member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } } }
08:05:28.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.104496 27966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [sys.catalog]: This master's current role is: FOLLOWER
08:05:28.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.105520 27957 sys_catalog.cc:565] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [sys.catalog]: configured and running, proceeding with master startup.
08:05:28.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.112571 27966 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:05:28.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.113296 27966 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ee02c6c90a4b10a49d4b8354285330" member_type: VOTER last_known_addr { host: "127.27.17.254" port: 45447 } } peers { permanent_uuid: "d34a8da72911433198b7fd244a9ac937" member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } } peers { permanent_uuid: "04cc86bb426540209d059661bb3dda84" member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } }
08:05:28.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.118052 27966 leader_election.cc:290] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ee02c6c90a4b10a49d4b8354285330 (127.27.17.254:45447), d34a8da72911433198b7fd244a9ac937 (127.27.17.253:37621)
08:05:28.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:28.141281 27910 tablet.cc:2404] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:05:28.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:28.142781 27977 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:05:28.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:28.143141 27977 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:05:28.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.133762 27877 master_runner.cc:187] Error getting master registration for 127.27.17.254:45447: OK, instance_id { permanent_uuid: "22ee02c6c90a4b10a49d4b8354285330" instance_seqno: 1779091523647751 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:05:28.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.164757 27877 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:05:28.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:28.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.197276 27875 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } attempt: 7
08:05:28.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.223549 27875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d34a8da72911433198b7fd244a9ac937: Bootstrap starting.
08:05:28.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.231791 27875 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d34a8da72911433198b7fd244a9ac937: Neither blocks nor log segments found. Creating new log.
08:05:28.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.234342 27875 log.cc:826] T 00000000000000000000000000000000 P d34a8da72911433198b7fd244a9ac937: Log is configured to *not* fsync() on all Append() calls
08:05:28.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.246578 27875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d34a8da72911433198b7fd244a9ac937: No bootstrap required, opened a new log
08:05:28.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.272934 27875 raft_consensus.cc:359] T 00000000000000000000000000000000 P d34a8da72911433198b7fd244a9ac937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ee02c6c90a4b10a49d4b8354285330" member_type: VOTER last_known_addr { host: "127.27.17.254" port: 45447 } } peers { permanent_uuid: "d34a8da72911433198b7fd244a9ac937" member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } } peers { permanent_uuid: "04cc86bb426540209d059661bb3dda84" member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } }
08:05:28.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.274376 27875 raft_consensus.cc:385] T 00000000000000000000000000000000 P d34a8da72911433198b7fd244a9ac937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:28.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.274863 27875 raft_consensus.cc:740] T 00000000000000000000000000000000 P d34a8da72911433198b7fd244a9ac937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d34a8da72911433198b7fd244a9ac937, State: Initialized, Role: FOLLOWER
08:05:28.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.275905 27875 consensus_queue.cc:260] T 00000000000000000000000000000000 P d34a8da72911433198b7fd244a9ac937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ee02c6c90a4b10a49d4b8354285330" member_type: VOTER last_known_addr { host: "127.27.17.254" port: 45447 } } peers { permanent_uuid: "d34a8da72911433198b7fd244a9ac937" member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } } peers { permanent_uuid: "04cc86bb426540209d059661bb3dda84" member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } }
08:05:28.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.279191 27981 sys_catalog.cc:455] T 00000000000000000000000000000000 P d34a8da72911433198b7fd244a9ac937 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ee02c6c90a4b10a49d4b8354285330" member_type: VOTER last_known_addr { host: "127.27.17.254" port: 45447 } } peers { permanent_uuid: "d34a8da72911433198b7fd244a9ac937" member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } } peers { permanent_uuid: "04cc86bb426540209d059661bb3dda84" member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } } }
08:05:28.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.280112 27981 sys_catalog.cc:458] T 00000000000000000000000000000000 P d34a8da72911433198b7fd244a9ac937 [sys.catalog]: This master's current role is: FOLLOWER
08:05:28.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.281564 27875 sys_catalog.cc:565] T 00000000000000000000000000000000 P d34a8da72911433198b7fd244a9ac937 [sys.catalog]: configured and running, proceeding with master startup.
08:05:28.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.281858 27850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04cc86bb426540209d059661bb3dda84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d34a8da72911433198b7fd244a9ac937" is_pre_election: true
08:05:28.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.283089 27850 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d34a8da72911433198b7fd244a9ac937 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04cc86bb426540209d059661bb3dda84 in term 0.
08:05:28.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.284905 27908 leader_election.cc:304] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04cc86bb426540209d059661bb3dda84, d34a8da72911433198b7fd244a9ac937; no voters: 
08:05:28.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.286361 27966 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:05:28.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.286895 27966 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:05:28.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.287336 27966 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [term 0 FOLLOWER]: Advancing to term 1
08:05:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.300607 27966 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ee02c6c90a4b10a49d4b8354285330" member_type: VOTER last_known_addr { host: "127.27.17.254" port: 45447 } } peers { permanent_uuid: "d34a8da72911433198b7fd244a9ac937" member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } } peers { permanent_uuid: "04cc86bb426540209d059661bb3dda84" member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } }
08:05:28.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.307067 27850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04cc86bb426540209d059661bb3dda84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d34a8da72911433198b7fd244a9ac937"
08:05:28.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.308032 27850 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d34a8da72911433198b7fd244a9ac937 [term 0 FOLLOWER]: Advancing to term 1
08:05:28.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.317265 27966 leader_election.cc:290] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [CANDIDATE]: Term 1 election: Requested vote from peers 22ee02c6c90a4b10a49d4b8354285330 (127.27.17.254:45447), d34a8da72911433198b7fd244a9ac937 (127.27.17.253:37621)
08:05:28.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.321727 27850 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d34a8da72911433198b7fd244a9ac937 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04cc86bb426540209d059661bb3dda84 in term 1.
08:05:28.323 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:28.324 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:28.324 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:28.325 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:28.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.324013 27908 leader_election.cc:304] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04cc86bb426540209d059661bb3dda84, d34a8da72911433198b7fd244a9ac937; no voters: 
08:05:28.325 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:28.325 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:28.326 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:28.326 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:28.326 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:28.327 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:28.327 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:28.327 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:28.327 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:28.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.328094 27966 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [term 1 FOLLOWER]: Leader election won for term 1
08:05:28.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.330336 27966 raft_consensus.cc:697] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [term 1 LEADER]: Becoming Leader. State: Replica: 04cc86bb426540209d059661bb3dda84, State: Running, Role: LEADER
08:05:28.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.331480 27966 consensus_queue.cc:237] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ee02c6c90a4b10a49d4b8354285330" member_type: VOTER last_known_addr { host: "127.27.17.254" port: 45447 } } peers { permanent_uuid: "d34a8da72911433198b7fd244a9ac937" member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } } peers { permanent_uuid: "04cc86bb426540209d059661bb3dda84" member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } }
08:05:28.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.346302 27987 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04cc86bb426540209d059661bb3dda84. Latest consensus state: current_term: 1 leader_uuid: "04cc86bb426540209d059661bb3dda84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ee02c6c90a4b10a49d4b8354285330" member_type: VOTER last_known_addr { host: "127.27.17.254" port: 45447 } } peers { permanent_uuid: "d34a8da72911433198b7fd244a9ac937" member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } } peers { permanent_uuid: "04cc86bb426540209d059661bb3dda84" member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } } }
08:05:28.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.347384 27987 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [sys.catalog]: This master's current role is: LEADER
08:05:28.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.354367 27993 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
08:05:28.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.362047 27995 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
08:05:28.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.366355 27993 catalog_manager.cc:1519] Initializing Kudu cluster ID...
08:05:28.367 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091528365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:28.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.375613 27800 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } attempt: 7
08:05:28.381 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
08:05:28.382 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
08:05:28.411 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:28.412 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:28.412 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:28.413 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:28.413 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:28.413 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:28.414 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:28.414 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:28.414 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:28.414 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:28.414 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:28.415 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:28.415 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:28.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.419716 27850 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d34a8da72911433198b7fd244a9ac937 [term 1 FOLLOWER]: Refusing update from remote peer 04cc86bb426540209d059661bb3dda84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:05:28.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.367667 27802 master_runner.cc:187] Error getting master registration for 127.27.17.254:45447: OK, instance_id { permanent_uuid: "22ee02c6c90a4b10a49d4b8354285330" instance_seqno: 1779091523647751 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:05:28.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.425889 27802 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:05:28.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.427860 27987 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d34a8da72911433198b7fd244a9ac937" member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:05:28.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.428642 27800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22ee02c6c90a4b10a49d4b8354285330: Bootstrap starting.
08:05:28.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.452447 27800 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22ee02c6c90a4b10a49d4b8354285330: Neither blocks nor log segments found. Creating new log.
08:05:28.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.455884 27800 log.cc:826] T 00000000000000000000000000000000 P 22ee02c6c90a4b10a49d4b8354285330: Log is configured to *not* fsync() on all Append() calls
08:05:28.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:28.458673 27829 tablet.cc:2404] T 00000000000000000000000000000000 P d34a8da72911433198b7fd244a9ac937: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:05:28.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.467447 27800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22ee02c6c90a4b10a49d4b8354285330: No bootstrap required, opened a new log
08:05:28.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.472239 27981 sys_catalog.cc:455] T 00000000000000000000000000000000 P d34a8da72911433198b7fd244a9ac937 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04cc86bb426540209d059661bb3dda84. Latest consensus state: current_term: 1 leader_uuid: "04cc86bb426540209d059661bb3dda84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ee02c6c90a4b10a49d4b8354285330" member_type: VOTER last_known_addr { host: "127.27.17.254" port: 45447 } } peers { permanent_uuid: "d34a8da72911433198b7fd244a9ac937" member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } } peers { permanent_uuid: "04cc86bb426540209d059661bb3dda84" member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } } }
08:05:28.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.476519 27981 sys_catalog.cc:458] T 00000000000000000000000000000000 P d34a8da72911433198b7fd244a9ac937 [sys.catalog]: This master's current role is: FOLLOWER
08:05:28.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.478401 27997 mvcc.cc:204] Tried to move back new op lower bound from 7287158900382679040 to 7287158900058890240. Current Snapshot: MvccSnapshot[applied={T|T < 7287158900382679040}]
08:05:28.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.480113 27966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "04cc86bb426540209d059661bb3dda84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ee02c6c90a4b10a49d4b8354285330" member_type: VOTER last_known_addr { host: "127.27.17.254" port: 45447 } } peers { permanent_uuid: "d34a8da72911433198b7fd244a9ac937" member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } } peers { permanent_uuid: "04cc86bb426540209d059661bb3dda84" member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } } }
08:05:28.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.480911 27966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [sys.catalog]: This master's current role is: LEADER
08:05:28.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.484264 27993 catalog_manager.cc:1382] Generated new cluster ID: 22a17096b08a45c194441337044b4cc7
08:05:28.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.484565 27993 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
08:05:28.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.501381 27800 raft_consensus.cc:359] T 00000000000000000000000000000000 P 22ee02c6c90a4b10a49d4b8354285330 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ee02c6c90a4b10a49d4b8354285330" member_type: VOTER last_known_addr { host: "127.27.17.254" port: 45447 } } peers { permanent_uuid: "d34a8da72911433198b7fd244a9ac937" member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } } peers { permanent_uuid: "04cc86bb426540209d059661bb3dda84" member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } }
08:05:28.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.502861 27800 raft_consensus.cc:385] T 00000000000000000000000000000000 P 22ee02c6c90a4b10a49d4b8354285330 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:28.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.503376 27800 raft_consensus.cc:740] T 00000000000000000000000000000000 P 22ee02c6c90a4b10a49d4b8354285330 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ee02c6c90a4b10a49d4b8354285330, State: Initialized, Role: FOLLOWER
08:05:28.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.504853 27800 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22ee02c6c90a4b10a49d4b8354285330 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ee02c6c90a4b10a49d4b8354285330" member_type: VOTER last_known_addr { host: "127.27.17.254" port: 45447 } } peers { permanent_uuid: "d34a8da72911433198b7fd244a9ac937" member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } } peers { permanent_uuid: "04cc86bb426540209d059661bb3dda84" member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } }
08:05:28.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.511377 27981 sys_catalog.cc:455] T 00000000000000000000000000000000 P d34a8da72911433198b7fd244a9ac937 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "04cc86bb426540209d059661bb3dda84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ee02c6c90a4b10a49d4b8354285330" member_type: VOTER last_known_addr { host: "127.27.17.254" port: 45447 } } peers { permanent_uuid: "d34a8da72911433198b7fd244a9ac937" member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } } peers { permanent_uuid: "04cc86bb426540209d059661bb3dda84" member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } } }
08:05:28.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.512115 27981 sys_catalog.cc:458] T 00000000000000000000000000000000 P d34a8da72911433198b7fd244a9ac937 [sys.catalog]: This master's current role is: FOLLOWER
08:05:28.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.521178 27800 sys_catalog.cc:565] T 00000000000000000000000000000000 P 22ee02c6c90a4b10a49d4b8354285330 [sys.catalog]: configured and running, proceeding with master startup.
08:05:28.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.522378 27774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04cc86bb426540209d059661bb3dda84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ee02c6c90a4b10a49d4b8354285330"
08:05:28.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.523233 27774 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 22ee02c6c90a4b10a49d4b8354285330 [term 0 FOLLOWER]: Advancing to term 1
08:05:28.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.526398 27775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04cc86bb426540209d059661bb3dda84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ee02c6c90a4b10a49d4b8354285330" is_pre_election: true
08:05:28.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.520182 28003 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22ee02c6c90a4b10a49d4b8354285330 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ee02c6c90a4b10a49d4b8354285330" member_type: VOTER last_known_addr { host: "127.27.17.254" port: 45447 } } peers { permanent_uuid: "d34a8da72911433198b7fd244a9ac937" member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } } peers { permanent_uuid: "04cc86bb426540209d059661bb3dda84" member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } } }
08:05:28.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.539994 28003 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22ee02c6c90a4b10a49d4b8354285330 [sys.catalog]: This master's current role is: FOLLOWER
08:05:28.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.541680 27774 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 22ee02c6c90a4b10a49d4b8354285330 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04cc86bb426540209d059661bb3dda84 in term 1.
08:05:28.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.543444 27773 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 22ee02c6c90a4b10a49d4b8354285330 [term 1 FOLLOWER]: Refusing update from remote peer 04cc86bb426540209d059661bb3dda84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:05:28.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.546435 27993 catalog_manager.cc:1405] Generated new certificate authority record
08:05:28.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.548924 27993 catalog_manager.cc:1539] Loading token signing keys...
08:05:28.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.562227 27966 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ee02c6c90a4b10a49d4b8354285330" member_type: VOTER last_known_addr { host: "127.27.17.254" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:05:28.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:28.593233 27753 tablet.cc:2404] T 00000000000000000000000000000000 P 22ee02c6c90a4b10a49d4b8354285330: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:05:28.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.600440 27993 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84: Generated new TSK 0
08:05:28.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.601831 27993 catalog_manager.cc:1549] Initializing in-progress tserver states...
08:05:28.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.618508 28003 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22ee02c6c90a4b10a49d4b8354285330 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04cc86bb426540209d059661bb3dda84. Latest consensus state: current_term: 1 leader_uuid: "04cc86bb426540209d059661bb3dda84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ee02c6c90a4b10a49d4b8354285330" member_type: VOTER last_known_addr { host: "127.27.17.254" port: 45447 } } peers { permanent_uuid: "d34a8da72911433198b7fd244a9ac937" member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } } peers { permanent_uuid: "04cc86bb426540209d059661bb3dda84" member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } } }
08:05:28.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.619350 28003 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22ee02c6c90a4b10a49d4b8354285330 [sys.catalog]: This master's current role is: FOLLOWER
08:05:28.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.620162 28017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22ee02c6c90a4b10a49d4b8354285330 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "04cc86bb426540209d059661bb3dda84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ee02c6c90a4b10a49d4b8354285330" member_type: VOTER last_known_addr { host: "127.27.17.254" port: 45447 } } peers { permanent_uuid: "d34a8da72911433198b7fd244a9ac937" member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } } peers { permanent_uuid: "04cc86bb426540209d059661bb3dda84" member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } } }
08:05:28.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.620993 28017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22ee02c6c90a4b10a49d4b8354285330 [sys.catalog]: This master's current role is: FOLLOWER
08:05:28.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.629838 27966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "04cc86bb426540209d059661bb3dda84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ee02c6c90a4b10a49d4b8354285330" member_type: VOTER last_known_addr { host: "127.27.17.254" port: 45447 } } peers { permanent_uuid: "d34a8da72911433198b7fd244a9ac937" member_type: VOTER last_known_addr { host: "127.27.17.253" port: 37621 } } peers { permanent_uuid: "04cc86bb426540209d059661bb3dda84" member_type: VOTER last_known_addr { host: "127.27.17.252" port: 43595 } } }
08:05:28.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.630792 27966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04cc86bb426540209d059661bb3dda84 [sys.catalog]: This master's current role is: LEADER
08:05:28.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.633607 27719 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:05:28.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:05:28.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-0/wal
08:05:28.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-0/data
08:05:28.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:05:28.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:05:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:05:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:05:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:05:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:05:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-0/logs
08:05:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-0/data/info.pb
08:05:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:05:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:05:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:05:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:05:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:05:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:05:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:05:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:05:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:05:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:05:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.17.193:0
08:05:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.27.17.193
08:05:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.17.193
08:05:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:05:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.27.17.254:45447,127.27.17.253:37621,127.27.17.252:43595
08:05:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.17.212:35685
08:05:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:05:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:05:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:05:28.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:28.626891 28020 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
08:05:28.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:28.867 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091528866 for job e26b904229418d0e047d5d94c5b9f905.
08:05:28.884 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
08:05:28.886 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
08:05:29.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:29.113731 28021 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:05:29.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:29.114516 28021 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:05:29.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:29.115124 28021 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:05:29.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:29.157100 28021 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:05:29.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:29.158269 28021 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.17.193
08:05:29.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:29.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:29.203898 28021 tablet_server_runner.cc:78] Tablet server non-default flags:
08:05:29.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:05:29.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.17.212:35685
08:05:29.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:05:29.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:05:29.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-0/data
08:05:29.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-0/wal
08:05:29.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:05:29.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:05:29.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.17.193:0
08:05:29.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:05:29.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:05:29.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:05:29.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-0/data/info.pb
08:05:29.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.17.193
08:05:29.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:05:29.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.27.17.254:45447,127.27.17.253:37621,127.27.17.252:43595
08:05:29.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:05:29.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:05:29.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:05:29.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:05:29.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:05:29.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.27.17.193
08:05:29.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-0/logs
08:05:29.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:05:29.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:05:29.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:05:29.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:05:29.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:05:29.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:05:29.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:05:29.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:05:29.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:05:29.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:05:29.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:29.206029 28021 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:05:29.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:29.208393 28021 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:05:29.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:29.232956 28028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:29.335 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:29.336 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:29.336 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:29.337 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:29.337 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:29.337 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:29.338 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:29.338 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:29.338 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:29.338 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:29.338 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:29.339 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:29.339 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:29.370 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091529365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:29.382 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
08:05:29.384 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
08:05:29.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:29.394052 27995 catalog_manager.cc:1294] Loaded cluster ID: 22a17096b08a45c194441337044b4cc7
08:05:29.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:29.394421 27995 catalog_manager.cc:1587] T 00000000000000000000000000000000 P d34a8da72911433198b7fd244a9ac937: loading cluster ID for follower catalog manager: success
08:05:29.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:29.421007 27995 catalog_manager.cc:1609] T 00000000000000000000000000000000 P d34a8da72911433198b7fd244a9ac937: acquiring CA information for follower catalog manager: success
08:05:29.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:29.445092 27995 catalog_manager.cc:1637] T 00000000000000000000000000000000 P d34a8da72911433198b7fd244a9ac937: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:05:29.592 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:29.593 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:29.593 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:29.594 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:29.594 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:29.594 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:29.594 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:29.594 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:29.594 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:29.595 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:29.595 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:29.595 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:29.596 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:29.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:29.655306 28020 catalog_manager.cc:1294] Loaded cluster ID: 22a17096b08a45c194441337044b4cc7
08:05:29.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:29.655637 28020 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 22ee02c6c90a4b10a49d4b8354285330: loading cluster ID for follower catalog manager: success
08:05:29.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:29.674574 28020 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 22ee02c6c90a4b10a49d4b8354285330: acquiring CA information for follower catalog manager: success
08:05:29.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:29.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:29.687505 28020 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 22ee02c6c90a4b10a49d4b8354285330: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:05:29.866 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091529865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:29.882 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
08:05:29.884 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
08:05:30.183 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:30.366 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091530365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:30.377 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
08:05:30.378 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
08:05:30.411 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:30.412 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:30.412 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:30.413 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:30.413 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:30.413 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:30.413 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:30.413 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:30.413 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:30.413 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:30.413 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:30.413 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:30.414 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:30.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:30.868 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091530865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:30.883 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
08:05:30.885 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
08:05:31.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:31.335 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:31.336 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:31.336 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:31.337 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:31.337 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:31.338 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:31.338 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:31.338 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:31.338 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:31.342 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:31.342 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:31.342 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:31.342 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:31.366 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091531365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:31.376 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
08:05:31.378 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
08:05:31.443 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:31.444 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:31.444 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:31.445 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:31.445 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:31.445 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:31.446 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:31.446 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:31.446 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:31.446 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:31.446 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:31.446 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:31.447 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:31.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:30.635578 28027 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 28021
08:05:31.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:31.476547 28021 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.240s	user 0.369s	sys 0.607s
08:05:31.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:31.480103 28021 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.244s	user 0.369s	sys 0.608s
08:05:31.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:31.480422 28031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:31.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:29.236284 28029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:31.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:31.486119 28030 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 2249 milliseconds
08:05:31.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:31.486899 28021 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:05:31.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:31.488885 28021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:05:31.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:31.501443 28021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:05:31.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:31.509478 28021 hybrid_clock.cc:648] HybridClock initialized: now 1779091531509417 us; error 122 us; skew 500 ppm
08:05:31.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:31.511314 28021 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:05:31.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:31.532258 28021 webserver.cc:533] Webserver started at http://127.27.17.193:37627/ using document root <none> and password file <none>
08:05:31.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:31.534076 28021 fs_manager.cc:362] Metadata directory not provided
08:05:31.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:31.534890 28021 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:05:31.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:31.535841 28021 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:05:31.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:31.543576 28021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-0/data/instance:
08:05:31.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d3419957393241e6b3e1b05dcab37487"
08:05:31.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:31 on dist-test-slave-1jss"
08:05:31.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:31.545413 28021 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-0/wal/instance:
08:05:31.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d3419957393241e6b3e1b05dcab37487"
08:05:31.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:31 on dist-test-slave-1jss"
08:05:31.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:31.563155 28021 fs_manager.cc:696] Time spent creating directory manager: real 0.017s	user 0.009s	sys 0.005s
08:05:31.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:31.578043 28041 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:05:31.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:31.579901 28021 fs_manager.cc:730] Time spent opening block manager: real 0.011s	user 0.003s	sys 0.007s
08:05:31.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:31.580487 28021 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-0/wal
08:05:31.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d3419957393241e6b3e1b05dcab37487"
08:05:31.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:31 on dist-test-slave-1jss"
08:05:31.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:31.581202 28021 fs_report.cc:389] FS layout report
08:05:31.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:05:31.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-0/wal
08:05:31.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-0/wal
08:05:31.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-0/data/data
08:05:31.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:05:31.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:05:31.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:05:31.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:05:31.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:05:31.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:05:31.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:05:31.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:05:31.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:05:31.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:05:31.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:05:31.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:31.675290 28021 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:05:31.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:31.677783 28021 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:05:31.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:31.678464 28021 kserver.cc:163] Server-wide thread pool size limit: 3276
08:05:31.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:31.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:31.698089 28021 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:05:31.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:31.724491 28021 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:05:31.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:31.724855 28021 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:05:31.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:31.726596 28021 ts_tablet_manager.cc:616] Registered 0 tablets
08:05:31.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:31.726871 28021 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:05:31.867 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091531866 for job e26b904229418d0e047d5d94c5b9f905.
08:05:31.882 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
08:05:31.883 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
08:05:32.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:32.037955 28021 rpc_server.cc:307] RPC server started. Bound to: 127.27.17.193:35571
08:05:32.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:32.038102 28155 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.17.193:35571 every 8 connection(s)
08:05:32.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:32.041360 28021 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-0/data/info.pb
08:05:32.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:32.043475 27719 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 28021
08:05:32.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:32.044389 27719 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-0/wal/instance
08:05:32.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:32.064112 27719 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:05:32.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:05:32.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-1/wal
08:05:32.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-1/data
08:05:32.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:05:32.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:05:32.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:05:32.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:05:32.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:05:32.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:05:32.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-1/logs
08:05:32.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-1/data/info.pb
08:05:32.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:05:32.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:05:32.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:05:32.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:05:32.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:05:32.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:05:32.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:05:32.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:05:32.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:05:32.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:05:32.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.17.194:0
08:05:32.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.27.17.194
08:05:32.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.17.194
08:05:32.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:05:32.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.27.17.254:45447,127.27.17.253:37621,127.27.17.252:43595
08:05:32.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.17.212:35685
08:05:32.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:05:32.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:05:32.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:05:32.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:32.141757 28157 heartbeater.cc:344] Connected to a master server at 127.27.17.253:37621
08:05:32.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:32.142448 28157 heartbeater.cc:461] Registering TS with master...
08:05:32.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:32.144191 28157 heartbeater.cc:507] Master 127.27.17.253:37621 requested a full tablet report, sending...
08:05:32.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:32.149040 27840 ts_manager.cc:194] Registered new tserver with Master: d3419957393241e6b3e1b05dcab37487 (127.27.17.193:35571)
08:05:32.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:32.149147 28156 heartbeater.cc:344] Connected to a master server at 127.27.17.252:43595
08:05:32.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:32.149565 28156 heartbeater.cc:461] Registering TS with master...
08:05:32.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:32.151172 28156 heartbeater.cc:507] Master 127.27.17.252:43595 requested a full tablet report, sending...
08:05:32.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:32.154536 27921 ts_manager.cc:194] Registered new tserver with Master: d3419957393241e6b3e1b05dcab37487 (127.27.17.193:35571)
08:05:32.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:32.158505 27921 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.17.193:60973
08:05:32.162 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:32.163 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:32.163 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:32.164 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:32.164 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:32.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:32.163815 28161 heartbeater.cc:344] Connected to a master server at 127.27.17.254:45447
08:05:32.164 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:32.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:32.164242 28161 heartbeater.cc:461] Registering TS with master...
08:05:32.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:32.165012 28161 heartbeater.cc:507] Master 127.27.17.254:45447 requested a full tablet report, sending...
08:05:32.165 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:32.165 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:32.165 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:32.166 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:32.166 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:32.166 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:32.166 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:32.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:32.168960 27765 ts_manager.cc:194] Registered new tserver with Master: d3419957393241e6b3e1b05dcab37487 (127.27.17.193:35571)
08:05:32.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:32.366 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091532365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:32.380 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
08:05:32.381 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
08:05:32.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:32.627357 28159 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:05:32.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:32.627929 28159 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:05:32.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:32.628351 28159 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:05:32.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:32.668134 28159 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:05:32.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:32.669193 28159 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.17.194
08:05:32.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:32.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:32.720626 28159 tablet_server_runner.cc:78] Tablet server non-default flags:
08:05:32.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:05:32.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.17.212:35685
08:05:32.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:05:32.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:05:32.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-1/data
08:05:32.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-1/wal
08:05:32.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:05:32.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:05:32.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.17.194:0
08:05:32.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:05:32.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:05:32.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:05:32.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-1/data/info.pb
08:05:32.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.17.194
08:05:32.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:05:32.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.27.17.254:45447,127.27.17.253:37621,127.27.17.252:43595
08:05:32.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:05:32.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:05:32.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:05:32.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:05:32.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:05:32.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.27.17.194
08:05:32.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-1/logs
08:05:32.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:05:32.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:05:32.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:05:32.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:05:32.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:05:32.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:05:32.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:05:32.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:05:32.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:05:32.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:05:32.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:32.722791 28159 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:05:32.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:32.724845 28159 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:05:32.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:32.740701 28174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:32.866 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091532865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:32.881 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
08:05:32.883 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
08:05:33.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:33.164870 28156 heartbeater.cc:499] Master 127.27.17.252:43595 was elected leader, sending a full tablet report...
08:05:33.184 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:33.367 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091533365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:33.379 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
08:05:33.381 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
08:05:33.632 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:33.633 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:33.634 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:33.634 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:33.634 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:33.634 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:33.634 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:33.634 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:33.634 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:33.635 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:33.635 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:33.635 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:33.635 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:33.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:33.867 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091533866 for job e26b904229418d0e047d5d94c5b9f905.
08:05:33.879 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
08:05:33.881 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
08:05:34.031 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:34.032 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:34.032 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:34.033 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:34.033 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:34.033 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:34.034 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:34.034 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:34.035 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:34.035 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:34.035 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:34.035 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:34.035 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:34.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:34.366 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091534365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:34.378 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
08:05:34.380 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
08:05:34.395 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:34.395 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:34.396 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:34.398 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:34.398 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:34.399 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:34.399 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:34.399 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:34.400 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:34.400 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:34.400 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:34.400 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:34.400 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:34.515 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:34.516 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:34.516 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:34.517 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:34.517 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:34.518 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:34.518 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:34.518 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:34.519 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:34.519 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:34.519 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:34.519 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:34.519 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:34.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:34.866 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091534865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:34.883 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
08:05:34.885 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
08:05:34.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:32.741765 28175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:34.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:34.942852 28159 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.201s	user 0.636s	sys 1.155s
08:05:34.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:34.943244 28159 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.201s	user 0.636s	sys 1.155s
08:05:34.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:34.142501 28173 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 28159
08:05:34.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:34.945727 28177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:34.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:34.952457 28176 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2209 milliseconds
08:05:34.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:34.952504 28159 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:05:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:34.954146 28159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:05:34.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:34.956837 28159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:05:34.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:34.958215 28159 hybrid_clock.cc:648] HybridClock initialized: now 1779091534958186 us; error 57 us; skew 500 ppm
08:05:34.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:34.959264 28159 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:05:34.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:34.966847 28159 webserver.cc:533] Webserver started at http://127.27.17.194:37949/ using document root <none> and password file <none>
08:05:34.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:34.967967 28159 fs_manager.cc:362] Metadata directory not provided
08:05:34.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:34.968187 28159 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:05:34.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:34.968729 28159 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:05:34.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:34.974537 28159 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-1/data/instance:
08:05:34.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "523ccfb52b2544c393ff06d08a25c7b6"
08:05:34.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:34 on dist-test-slave-1jss"
08:05:34.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:34.976015 28159 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-1/wal/instance:
08:05:34.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "523ccfb52b2544c393ff06d08a25c7b6"
08:05:34.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:34 on dist-test-slave-1jss"
08:05:34.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:34.985340 28159 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.009s	sys 0.001s
08:05:34.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:34.993731 28185 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:05:34.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:34.995352 28159 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.000s
08:05:34.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:34.995707 28159 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-1/wal
08:05:34.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "523ccfb52b2544c393ff06d08a25c7b6"
08:05:34.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:34 on dist-test-slave-1jss"
08:05:34.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:34.996079 28159 fs_report.cc:389] FS layout report
08:05:34.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:05:34.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-1/wal
08:05:34.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-1/wal
08:05:34.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-1/data/data
08:05:34.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:05:34.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:05:34.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:05:34.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:05:34.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:05:34.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:05:34.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:05:34.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:05:34.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:05:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:05:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:05:35.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.069341 28159 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:05:35.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.071919 28159 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:05:35.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.072646 28159 kserver.cc:163] Server-wide thread pool size limit: 3276
08:05:35.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.075938 28159 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:05:35.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.081322 28159 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:05:35.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.081580 28159 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:05:35.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.081969 28159 ts_tablet_manager.cc:616] Registered 0 tablets
08:05:35.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.082170 28159 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:05:35.183 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:35.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.254988 28159 rpc_server.cc:307] RPC server started. Bound to: 127.27.17.194:34219
08:05:35.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.255163 28298 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.17.194:34219 every 8 connection(s)
08:05:35.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.258392 28159 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-1/data/info.pb
08:05:35.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.266973 27719 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 28159
08:05:35.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.267629 27719 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-1/wal/instance
08:05:35.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.301066 28300 heartbeater.cc:344] Connected to a master server at 127.27.17.253:37621
08:05:35.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.301748 28300 heartbeater.cc:461] Registering TS with master...
08:05:35.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.303366 27719 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:05:35.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:05:35.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-2/wal
08:05:35.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-2/data
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-2/logs
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-2/data/info.pb
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.17.195:0
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.27.17.195
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.17.195
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.27.17.254:45447,127.27.17.253:37621,127.27.17.252:43595
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.17.212:35685
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:05:35.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.303802 28300 heartbeater.cc:507] Master 127.27.17.253:37621 requested a full tablet report, sending...
08:05:35.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.308079 27840 ts_manager.cc:194] Registered new tserver with Master: 523ccfb52b2544c393ff06d08a25c7b6 (127.27.17.194:34219)
08:05:35.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.313946 28299 heartbeater.cc:344] Connected to a master server at 127.27.17.252:43595
08:05:35.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.314355 28299 heartbeater.cc:461] Registering TS with master...
08:05:35.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.314350 28301 heartbeater.cc:344] Connected to a master server at 127.27.17.254:45447
08:05:35.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.314846 28301 heartbeater.cc:461] Registering TS with master...
08:05:35.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.315608 28301 heartbeater.cc:507] Master 127.27.17.254:45447 requested a full tablet report, sending...
08:05:35.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.315696 28299 heartbeater.cc:507] Master 127.27.17.252:43595 requested a full tablet report, sending...
08:05:35.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.317962 27921 ts_manager.cc:194] Registered new tserver with Master: 523ccfb52b2544c393ff06d08a25c7b6 (127.27.17.194:34219)
08:05:35.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.318328 27765 ts_manager.cc:194] Registered new tserver with Master: 523ccfb52b2544c393ff06d08a25c7b6 (127.27.17.194:34219)
08:05:35.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.319521 27921 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.17.194:50659
08:05:35.366 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091535365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:35.376 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:05:35.377 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
08:05:35.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:35.674983 28309 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:05:35.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:35.675655 28309 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:05:35.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:35.676288 28309 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:05:35.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:35.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:35.716161 28309 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:05:35.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:35.717353 28309 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.17.195
08:05:35.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.759924 28309 tablet_server_runner.cc:78] Tablet server non-default flags:
08:05:35.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:05:35.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.17.212:35685
08:05:35.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-2/data
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-2/wal
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.17.195:0
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-2/data/info.pb
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.17.195
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.27.17.254:45447,127.27.17.253:37621,127.27.17.252:43595
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.27.17.195
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-2/logs
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:05:35.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:05:35.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.762051 28309 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:05:35.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:35.764034 28309 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:05:35.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:35.779541 28315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:35.803 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:35.804 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:35.804 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:35.805 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:35.805 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:35.806 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:35.806 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:35.806 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:35.806 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:35.807 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:35.807 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:35.807 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:35.807 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:35.866 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091535865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:35.881 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
08:05:35.882 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
08:05:36.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:36.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:36.327669 28299 heartbeater.cc:499] Master 127.27.17.252:43595 was elected leader, sending a full tablet report...
08:05:36.351 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:36.351 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:36.352 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:36.354 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:36.354 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:36.354 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:36.355 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:36.355 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:36.355 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:36.356 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:36.356 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:36.356 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:36.356 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:36.367 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091536366 for job e26b904229418d0e047d5d94c5b9f905.
08:05:36.385 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
08:05:36.387 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
08:05:36.683 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:36.866 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091536865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:36.884 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
08:05:36.887 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
08:05:37.187 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:37.366 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091537365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:37.388 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=22 ms, finalizationTime=1 ms).
08:05:37.391 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
08:05:37.672 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:37.673 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:37.674 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:37.675 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:37.675 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:37.675 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:37.675 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:37.676 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:37.676 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:37.676 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:37.676 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:37.676 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:37.677 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:37.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:37.791 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:37.793 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:37.794 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:37.795 [INFO - pool-108-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:37.795 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:37.796 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:37.796 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:37.796 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:37.797 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:37.797 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:37.797 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:37.797 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:37.797 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:37.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:37.183458 28314 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 28309
08:05:37.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:37.807184 28309 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.027s	user 0.793s	sys 1.217s
08:05:37.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:37.808136 28309 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.029s	user 0.794s	sys 1.218s
08:05:37.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:35.780594 28316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:37.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:37.812269 28317 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2026 milliseconds
08:05:37.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:37.815757 28318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:37.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:37.815830 28309 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:05:37.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:37.817443 28309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:05:37.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:37.820369 28309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:05:37.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:37.821841 28309 hybrid_clock.cc:648] HybridClock initialized: now 1779091537821740 us; error 67 us; skew 500 ppm
08:05:37.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:37.823060 28309 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:05:37.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:37.831307 28309 webserver.cc:533] Webserver started at http://127.27.17.195:33375/ using document root <none> and password file <none>
08:05:37.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:37.832454 28309 fs_manager.cc:362] Metadata directory not provided
08:05:37.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:37.832747 28309 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:05:37.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:37.833276 28309 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:05:37.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:37.838567 28309 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-2/data/instance:
08:05:37.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ec9762b17dfd4956a4a1a622857eb01a"
08:05:37.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:37 on dist-test-slave-1jss"
08:05:37.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:37.840008 28309 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-2/wal/instance:
08:05:37.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ec9762b17dfd4956a4a1a622857eb01a"
08:05:37.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:37 on dist-test-slave-1jss"
08:05:37.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:37.848097 28309 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.002s
08:05:37.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:37.854694 28326 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:05:37.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:37.856081 28309 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
08:05:37.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:37.856389 28309 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-2/wal
08:05:37.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ec9762b17dfd4956a4a1a622857eb01a"
08:05:37.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:37 on dist-test-slave-1jss"
08:05:37.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:37.856705 28309 fs_report.cc:389] FS layout report
08:05:37.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:05:37.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-2/wal
08:05:37.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-2/wal
08:05:37.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-2/data/data
08:05:37.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:05:37.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:05:37.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:05:37.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:05:37.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:05:37.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:05:37.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:05:37.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:05:37.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:05:37.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:05:37.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:05:37.866 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091537865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:37.876 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:05:37.876 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
08:05:37.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:37.920775 28309 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:05:37.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:37.922556 28309 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:05:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:37.923138 28309 kserver.cc:163] Server-wide thread pool size limit: 3276
08:05:37.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:37.926259 28309 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:05:37.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:37.931318 28309 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:05:37.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:37.931515 28309 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:05:37.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:37.931720 28309 ts_tablet_manager.cc:616] Registered 0 tablets
08:05:37.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:37.931854 28309 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:05:38.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:38.114483 28309 rpc_server.cc:307] RPC server started. Bound to: 127.27.17.195:43439
08:05:38.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:38.114601 28439 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.17.195:43439 every 8 connection(s)
08:05:38.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:38.117496 28309 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-2/data/info.pb
08:05:38.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:38.120791 27719 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 28309
08:05:38.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:38.121342 27719 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12414088804437210124/ts-2/wal/instance
08:05:38.135 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:38.136 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:38.137 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:38.137 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:38.137 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:38.146 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:38.146 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:38.146 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:38.146 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:38.146 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:38.146 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:38.147 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:38.147 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:38.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:38.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:38.188349 28440 heartbeater.cc:344] Connected to a master server at 127.27.17.252:43595
08:05:38.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:38.189072 28440 heartbeater.cc:461] Registering TS with master...
08:05:38.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:38.191072 28440 heartbeater.cc:507] Master 127.27.17.252:43595 requested a full tablet report, sending...
08:05:38.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:38.197152 27921 ts_manager.cc:194] Registered new tserver with Master: ec9762b17dfd4956a4a1a622857eb01a (127.27.17.195:43439)
08:05:38.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:38.199510 27921 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.17.195:49925
08:05:38.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:38.213181 28441 heartbeater.cc:344] Connected to a master server at 127.27.17.253:37621
08:05:38.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:38.213625 28441 heartbeater.cc:461] Registering TS with master...
08:05:38.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:38.214381 28441 heartbeater.cc:507] Master 127.27.17.253:37621 requested a full tablet report, sending...
08:05:38.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:38.216280 28442 heartbeater.cc:344] Connected to a master server at 127.27.17.254:45447
08:05:38.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:38.216639 28442 heartbeater.cc:461] Registering TS with master...
08:05:38.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:38.217324 28442 heartbeater.cc:507] Master 127.27.17.254:45447 requested a full tablet report, sending...
08:05:38.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:38.217993 27840 ts_manager.cc:194] Registered new tserver with Master: ec9762b17dfd4956a4a1a622857eb01a (127.27.17.195:43439)
08:05:38.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:38.219732 27765 ts_manager.cc:194] Registered new tserver with Master: ec9762b17dfd4956a4a1a622857eb01a (127.27.17.195:43439)
08:05:38.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:38.233345 27719 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
08:05:38.244 [DEBUG - pool-48-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30010), Traces: [0ms] sending RPC to server master-127.24.230.252:40255, [16ms] received response from server master-127.24.230.252:40255: OK, deferred=null) with no deferred attached!
08:05:38.246 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:05:38.247 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

08:05:38.248 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.27.17.254"
      port: 45447
    }
    bound_http_address {
      host: "127.27.17.254"
      port: 34795
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.27.17.253"
      port: 37621
    }
    bound_http_address {
      host: "127.27.17.253"
      port: 33577
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.27.17.252"
      port: 43595
    }
    bound_http_address {
      host: "127.27.17.252"
      port: 41095
    }
  }
}

08:05:38.249 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

08:05:38.250 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.27.17.193"
      port: 35571
    }
    bound_http_address {
      host: "127.27.17.193"
      port: 37627
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.27.17.194"
      port: 34219
    }
    bound_http_address {
      host: "127.27.17.194"
      port: 37949
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.27.17.195"
      port: 43439
    }
    bound_http_address {
      host: "127.27.17.195"
      port: 33375
    }
  }
}

08:05:38.250 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
08:05:38.252 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:38.253 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
08:05:38.253 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskk4_r_T/test-tmp
08:05:38.254 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
08:05:38.254 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskk4_r_T/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
08:05:38.257 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

08:05:38.366 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091538365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:38.377 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
08:05:38.377 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
08:05:38.670 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:05:38.670 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

08:05:38.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:38.675539 28449 mini_oidc.cc:150] Starting JWKS server
08:05:38.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:38.679948 28449 webserver.cc:533] Webserver started at http://127.0.0.1:43807/ using document root <none> and password file <none>
08:05:38.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:38.680505 28449 mini_oidc.cc:186] Starting OIDC Discovery server
08:05:38.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:38.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:38.683784 28449 webserver.cc:533] Webserver started at http://127.0.0.1:39699/ using document root <none> and password file <none>
08:05:38.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:05:38Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
08:05:38.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:05:38Z Disabled control of system clock
08:05:38.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:38.758792 28449 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:05:38.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:05:38.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-0/wal
08:05:38.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-0/data
08:05:38.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:05:38.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:05:38.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:05:38.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:05:38.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-0/logs
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-0/data/info.pb
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.200.126:43511
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.200.126
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.200.84:44601
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.27.200.126:43511,127.27.200.125:46459,127.27.200.124:34439
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:05:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43807/jwks.json with env {}
08:05:38.866 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091538865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:38.877 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
08:05:38.878 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
08:05:38.883 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:38.883 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:38.884 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:38.884 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:38.884 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:38.884 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:38.884 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:38.884 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:38.884 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:38.884 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:38.884 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:38.884 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:38.884 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:38.892 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:38.893 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:38.893 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:38.893 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:38.893 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:38.893 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:38.893 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:38.893 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:38.894 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:38.894 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:38.894 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:38.894 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:38.894 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:39.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:39.144804 28461 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:05:39.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:39.145457 28461 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:05:39.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:39.146029 28461 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:05:39.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:39.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:39.185029 28461 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:05:39.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:39.185516 28461 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:05:39.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:39.185818 28461 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:05:39.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:39.186043 28461 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:05:39.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:39.186312 28461 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:05:39.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:39.186478 28461 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:43807/jwks.json
08:05:39.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:39.212656 28440 heartbeater.cc:499] Master 127.27.17.252:43595 was elected leader, sending a full tablet report...
08:05:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:39.232488 28461 master_runner.cc:387] Master server non-default flags:
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.200.84:44601
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-0/data
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-0/wal
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.27.200.126:43511,127.27.200.125:46459,127.27.200.124:34439
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.200.126:43511
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43807/jwks.json
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-0/data/info.pb
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.200.126
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-0/logs
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:05:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:05:39.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:39.234282 28461 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:05:39.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:39.236243 28461 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:05:39.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:39.249423 28468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:39.323 [DEBUG - pool-54-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30008), Traces: [0ms] sending RPC to server master-127.25.158.188:41049, [15ms] received response from server master-127.25.158.188:41049: OK, deferred=null) with no deferred attached!
08:05:39.324 [DEBUG - pool-54-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30008), Traces: [0ms] sending RPC to server master-127.25.158.188:41049, [23ms] received response from server master-127.25.158.188:41049: OK, deferred=null) with no deferred attached!
08:05:39.367 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091539366 for job e26b904229418d0e047d5d94c5b9f905.
08:05:39.387 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
08:05:39.394 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
08:05:39.540 [DEBUG - pool-56-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30013), Traces: [0ms] sending RPC to server master-127.25.158.188:41049, [20ms] received response from server master-127.25.158.188:41049: OK, deferred=null) with no deferred attached!
08:05:39.546 [DEBUG - pool-50-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30018), Traces: [0ms] sending RPC to server master-127.25.158.188:41049, [27ms] received response from server master-127.25.158.188:41049: OK, deferred=null) with no deferred attached!
08:05:39.546 [DEBUG - pool-50-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30018), Traces: [0ms] sending RPC to server master-127.25.158.188:41049, [17ms] received response from server master-127.25.158.188:41049: OK, deferred=null) with no deferred attached!
08:05:39.547 [DEBUG - pool-50-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30018), Traces: [0ms] sending RPC to server master-127.25.158.188:41049, [19ms] received response from server master-127.25.158.188:41049: OK, deferred=null) with no deferred attached!
08:05:39.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:39.866 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091539865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:39.880 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
08:05:39.882 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
08:05:39.915 [DEBUG - pool-52-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30018), Traces: [0ms] sending RPC to server master-127.25.158.188:41049, [7ms] received response from server master-127.25.158.188:41049: OK, deferred=null) with no deferred attached!
08:05:39.916 [DEBUG - pool-52-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30015), Traces: [0ms] sending RPC to server master-127.25.158.188:41049, [8ms] received response from server master-127.25.158.188:41049: OK, deferred=null) with no deferred attached!
08:05:39.916 [DEBUG - pool-52-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30010), Traces: [0ms] sending RPC to server master-127.25.158.188:41049, [5ms] received response from server master-127.25.158.188:41049: OK, deferred=null) with no deferred attached!
08:05:40.183 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:40.366 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091540365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:40.389 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=23 ms, finalizationTime=1 ms).
08:05:40.391 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
08:05:40.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:39.252229 28469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:40.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:39.255160 28471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:40.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:40.642546 28470 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1386 milliseconds
08:05:40.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.642726 28461 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:05:40.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.644181 28461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:05:40.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.647423 28461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:05:40.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.648815 28461 hybrid_clock.cc:648] HybridClock initialized: now 1779091540648766 us; error 49 us; skew 500 ppm
08:05:40.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.649776 28461 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:05:40.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.657683 28461 webserver.cc:533] Webserver started at http://127.27.200.126:36721/ using document root <none> and password file <none>
08:05:40.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.659080 28461 fs_manager.cc:362] Metadata directory not provided
08:05:40.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.659343 28461 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:05:40.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.659859 28461 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:05:40.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.665932 28461 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-0/data/instance:
08:05:40.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "de9d55b59a074da2824778ee8b77553c"
08:05:40.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:40 on dist-test-slave-1jss"
08:05:40.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.667295 28461 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-0/wal/instance:
08:05:40.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "de9d55b59a074da2824778ee8b77553c"
08:05:40.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:40 on dist-test-slave-1jss"
08:05:40.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.676831 28461 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.005s	sys 0.004s
08:05:40.681 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:40.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.685276 28478 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:05:40.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.686764 28461 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.004s
08:05:40.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.687171 28461 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-0/wal
08:05:40.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "de9d55b59a074da2824778ee8b77553c"
08:05:40.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:40 on dist-test-slave-1jss"
08:05:40.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.687651 28461 fs_report.cc:389] FS layout report
08:05:40.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:05:40.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-0/wal
08:05:40.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-0/wal
08:05:40.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-0/data/data
08:05:40.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:05:40.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:05:40.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:05:40.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:05:40.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:05:40.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:05:40.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:05:40.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:05:40.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:05:40.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:05:40.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:05:40.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.757717 28461 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:05:40.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.759670 28461 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:05:40.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.760344 28461 kserver.cc:163] Server-wide thread pool size limit: 3276
08:05:40.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.855580 28461 rpc_server.cc:307] RPC server started. Bound to: 127.27.200.126:43511
08:05:40.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.855715 28529 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.200.126:43511 every 8 connection(s)
08:05:40.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.859087 28461 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-0/data/info.pb
08:05:40.866 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091540865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:40.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.862344 28449 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 28461
08:05:40.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.862939 28449 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-0/wal/instance
08:05:40.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.868842 28449 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:05:40.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:05:40.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-1/wal
08:05:40.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-1/data
08:05:40.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:05:40.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:05:40.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:05:40.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:05:40.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:05:40.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:05:40.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-1/logs
08:05:40.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-1/data/info.pb
08:05:40.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:05:40.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:05:40.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:05:40.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:05:40.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:05:40.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:05:40.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:05:40.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:05:40.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:05:40.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:05:40.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:05:40.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:05:40.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.200.125:46459
08:05:40.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.200.125
08:05:40.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:05:40.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.200.84:44601
08:05:40.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:05:40.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:05:40.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:05:40.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:05:40.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.27.200.126:43511,127.27.200.125:46459,127.27.200.124:34439
08:05:40.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:05:40.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43807/jwks.json with env {}
08:05:40.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.869119 28530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:40.877 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:05:40.878 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
08:05:40.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.898756 28530 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.200.126" port: 43511 } has no permanent_uuid. Determining permanent_uuid...
08:05:40.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.930116 28530 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } has no permanent_uuid. Determining permanent_uuid...
08:05:40.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:40.932868 28479 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.200.125:46459: connect: Connection refused (error 111)
08:05:40.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:40.937958 28530 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.200.125:46459: Network error: Client connection negotiation failed: client connection to 127.27.200.125:46459: connect: Connection refused (error 111)
08:05:40.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:40.987617 28530 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } attempt: 1
08:05:40.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:40.993881 28530 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.200.125:46459: Network error: Client connection negotiation failed: client connection to 127.27.200.125:46459: connect: Connection refused (error 111)
08:05:41.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:41.062391 28530 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } attempt: 2
08:05:41.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:41.067126 28530 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.200.125:46459: Network error: Client connection negotiation failed: client connection to 127.27.200.125:46459: connect: Connection refused (error 111)
08:05:41.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:41.158566 28530 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } attempt: 3
08:05:41.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:41.163400 28530 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.200.125:46459: Network error: Client connection negotiation failed: client connection to 127.27.200.125:46459: connect: Connection refused (error 111)
08:05:41.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:41.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:41.270779 28532 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:05:41.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:41.271535 28532 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:05:41.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:41.272132 28532 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:05:41.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:41.306924 28530 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } attempt: 4
08:05:41.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:41.311576 28530 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.200.125:46459: Network error: Client connection negotiation failed: client connection to 127.27.200.125:46459: connect: Connection refused (error 111)
08:05:41.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:41.313369 28532 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:05:41.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:41.313751 28532 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:05:41.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:41.314131 28532 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:05:41.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:41.314435 28532 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:05:41.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:41.314735 28532 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:05:41.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:41.314986 28532 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:43807/jwks.json
08:05:41.315 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:41.316 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:41.316 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:41.316 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:41.316 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:41.316 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:41.316 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:41.316 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:41.317 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:41.317 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:41.317 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:41.317 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:41.317 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:41.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:41.359377 28532 master_runner.cc:387] Master server non-default flags:
08:05:41.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:05:41.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.200.84:44601
08:05:41.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:05:41.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:05:41.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-1/data
08:05:41.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-1/wal
08:05:41.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:05:41.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.27.200.126:43511,127.27.200.125:46459,127.27.200.124:34439
08:05:41.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:05:41.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:05:41.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:05:41.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.200.125:46459
08:05:41.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:05:41.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:05:41.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:05:41.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43807/jwks.json
08:05:41.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:05:41.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:05:41.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-1/data/info.pb
08:05:41.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.200.125
08:05:41.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:05:41.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:05:41.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:05:41.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:05:41.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:05:41.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:05:41.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-1/logs
08:05:41.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:05:41.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:05:41.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:05:41.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:05:41.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:05:41.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:05:41.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:05:41.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:05:41.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:05:41.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:05:41.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:41.361562 28532 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:05:41.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:41.363600 28532 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:05:41.366 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091541365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:41.377 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:05:41.379 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
08:05:41.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:41.380266 28541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:41.571 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:41.572 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:41.573 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:41.573 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:41.573 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:41.573 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:41.573 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:41.573 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:41.573 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:41.573 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:41.574 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:41.574 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:41.574 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:41.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:41.611028 28530 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } attempt: 5
08:05:41.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:41.615531 28530 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.200.125:46459: Network error: Client connection negotiation failed: client connection to 127.27.200.125:46459: connect: Connection refused (error 111)
08:05:41.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:41.866 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 66 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091541865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:41.879 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 66 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
08:05:41.880 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 66 as completed for source Source: KuduSource.
08:05:42.044 [DEBUG - pool-48-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30009), Traces: [0ms] sending RPC to server master-127.24.230.252:40255, [6ms] received response from server master-127.24.230.252:40255: OK, deferred=null) with no deferred attached!
08:05:42.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.163213 28530 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } attempt: 6
08:05:42.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:42.171774 28530 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.200.125:46459: Network error: Client connection negotiation failed: client connection to 127.27.200.125:46459: connect: Connection refused (error 111)
08:05:42.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:42.322 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:42.323 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:42.324 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:42.324 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:42.324 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:42.324 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:42.324 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:42.324 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:42.324 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:42.325 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:42.325 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:42.325 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:42.325 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:42.366 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 67 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091542366 for job e26b904229418d0e047d5d94c5b9f905.
08:05:42.376 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 67 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
08:05:42.377 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 67 as completed for source Source: KuduSource.
08:05:42.550 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:42.551 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:42.551 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:42.551 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:42.552 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:42.552 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:42.552 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:42.552 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:42.552 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:42.552 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:42.552 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:42.552 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:42.552 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:42.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:41.384773 28544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:42.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:41.383685 28542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:42.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:42.664158 28543 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1282 milliseconds
08:05:42.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.664461 28532 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:05:42.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.669018 28532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:05:42.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.672971 28532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:05:42.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.674427 28532 hybrid_clock.cc:648] HybridClock initialized: now 1779091542674376 us; error 65 us; skew 500 ppm
08:05:42.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.675657 28532 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:05:42.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:42.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.684908 28532 webserver.cc:533] Webserver started at http://127.27.200.125:38349/ using document root <none> and password file <none>
08:05:42.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.686295 28532 fs_manager.cc:362] Metadata directory not provided
08:05:42.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.686578 28532 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:05:42.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.687235 28532 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:05:42.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.694371 28532 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-1/data/instance:
08:05:42.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "82e1065462b346d48d18657fcd2563a2"
08:05:42.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:42 on dist-test-slave-1jss"
08:05:42.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.695950 28532 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-1/wal/instance:
08:05:42.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "82e1065462b346d48d18657fcd2563a2"
08:05:42.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:42 on dist-test-slave-1jss"
08:05:42.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.706408 28532 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.011s	sys 0.000s
08:05:42.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.715083 28556 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:05:42.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.716583 28532 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.003s
08:05:42.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.716935 28532 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-1/wal
08:05:42.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "82e1065462b346d48d18657fcd2563a2"
08:05:42.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:42 on dist-test-slave-1jss"
08:05:42.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.717368 28532 fs_report.cc:389] FS layout report
08:05:42.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:05:42.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-1/wal
08:05:42.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-1/wal
08:05:42.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-1/data/data
08:05:42.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:05:42.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:05:42.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:05:42.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:05:42.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:05:42.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:05:42.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:05:42.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:05:42.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:05:42.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:05:42.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:05:42.733 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:42.733 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:42.733 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:42.734 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:42.734 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:42.734 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:42.734 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:42.734 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:42.734 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:42.734 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:42.734 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:42.735 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:42.735 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:42.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.776244 28532 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:05:42.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.777951 28532 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:05:42.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.778400 28532 kserver.cc:163] Server-wide thread pool size limit: 3276
08:05:42.866 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 68 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091542865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:42.877 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 68 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
08:05:42.878 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 68 as completed for source Source: KuduSource.
08:05:42.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.881899 28532 rpc_server.cc:307] RPC server started. Bound to: 127.27.200.125:46459
08:05:42.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.881989 28608 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.200.125:46459 every 8 connection(s)
08:05:42.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.885136 28532 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-1/data/info.pb
08:05:42.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.892948 28609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:42.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.893725 28449 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 28532
08:05:42.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.894169 28449 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-1/wal/instance
08:05:42.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.896534 28449 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:05:42.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:05:42.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-2/wal
08:05:42.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-2/data
08:05:42.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:05:42.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:05:42.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:05:42.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:05:42.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:05:42.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:05:42.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-2/logs
08:05:42.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-2/data/info.pb
08:05:42.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:05:42.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:05:42.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:05:42.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:05:42.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:05:42.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:05:42.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:05:42.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:05:42.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:05:42.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:05:42.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:05:42.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:05:42.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.200.124:34439
08:05:42.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.200.124
08:05:42.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:05:42.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.200.84:44601
08:05:42.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:05:42.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:05:42.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:05:42.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:05:42.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.27.200.126:43511,127.27.200.125:46459,127.27.200.124:34439
08:05:42.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:05:42.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43807/jwks.json with env {}
08:05:42.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.906090 28609 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.200.126" port: 43511 } has no permanent_uuid. Determining permanent_uuid...
08:05:42.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.933979 28609 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } has no permanent_uuid. Determining permanent_uuid...
08:05:42.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:42.951144 28609 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } has no permanent_uuid. Determining permanent_uuid...
08:05:42.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:42.953965 28560 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.200.124:34439: connect: Connection refused (error 111)
08:05:42.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:42.959102 28609 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.200.124:34439: Network error: Client connection negotiation failed: client connection to 127.27.200.124:34439: connect: Connection refused (error 111)
08:05:43.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:43.008708 28609 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } attempt: 1
08:05:43.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:43.015249 28609 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.200.124:34439: Network error: Client connection negotiation failed: client connection to 127.27.200.124:34439: connect: Connection refused (error 111)
08:05:43.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:43.083910 28609 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } attempt: 2
08:05:43.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:43.088768 28609 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.200.124:34439: Network error: Client connection negotiation failed: client connection to 127.27.200.124:34439: connect: Connection refused (error 111)
08:05:43.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:43.180256 28609 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } attempt: 3
08:05:43.181 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:43.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:43.185180 28609 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.200.124:34439: Network error: Client connection negotiation failed: client connection to 127.27.200.124:34439: connect: Connection refused (error 111)
08:05:43.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:43.232625 28530 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } attempt: 7
08:05:43.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:43.251946 28530 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } has no permanent_uuid. Determining permanent_uuid...
08:05:43.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:43.263859 28530 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.200.124:34439: Network error: Client connection negotiation failed: client connection to 127.27.200.124:34439: connect: Connection refused (error 111)
08:05:43.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:43.295758 28611 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:05:43.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:43.296411 28611 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:05:43.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:43.296885 28611 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:05:43.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:43.322369 28530 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } attempt: 1
08:05:43.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:43.327586 28530 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.200.124:34439: Network error: Client connection negotiation failed: client connection to 127.27.200.124:34439: connect: Connection refused (error 111)
08:05:43.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:43.328661 28609 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } attempt: 4
08:05:43.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:43.333158 28609 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.200.124:34439: Network error: Client connection negotiation failed: client connection to 127.27.200.124:34439: connect: Connection refused (error 111)
08:05:43.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:43.339556 28611 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:05:43.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:43.339843 28611 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:05:43.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:43.340106 28611 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:05:43.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:43.340373 28611 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:05:43.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:43.340593 28611 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:05:43.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:43.340754 28611 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:43807/jwks.json
08:05:43.366 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 69 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091543365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:43.376 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 69 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:05:43.377 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 69 as completed for source Source: KuduSource.
08:05:43.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:43.389685 28611 master_runner.cc:387] Master server non-default flags:
08:05:43.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:05:43.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.200.84:44601
08:05:43.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:05:43.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:05:43.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-2/data
08:05:43.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-2/wal
08:05:43.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:05:43.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.27.200.126:43511,127.27.200.125:46459,127.27.200.124:34439
08:05:43.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:05:43.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:05:43.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:05:43.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.200.124:34439
08:05:43.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:05:43.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:05:43.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:05:43.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43807/jwks.json
08:05:43.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:05:43.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:05:43.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-2/data/info.pb
08:05:43.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.200.124
08:05:43.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:05:43.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:05:43.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:05:43.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:05:43.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:05:43.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:05:43.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-2/logs
08:05:43.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:05:43.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:05:43.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:05:43.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:05:43.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:05:43.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:05:43.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:05:43.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:05:43.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:05:43.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:05:43.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:43.391963 28611 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:05:43.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:43.394148 28611 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:05:43.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:43.409029 28530 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } attempt: 2
08:05:43.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:43.411816 28623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:43.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:43.415829 28530 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.200.124:34439: Network error: Client connection negotiation failed: client connection to 127.27.200.124:34439: connect: Connection refused (error 111)
08:05:43.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:43.501417 28530 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } attempt: 3
08:05:43.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:43.507011 28530 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.200.124:34439: Network error: Client connection negotiation failed: client connection to 127.27.200.124:34439: connect: Connection refused (error 111)
08:05:43.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:43.632607 28609 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } attempt: 5
08:05:43.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:43.637426 28609 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.200.124:34439: Network error: Client connection negotiation failed: client connection to 127.27.200.124:34439: connect: Connection refused (error 111)
08:05:43.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:43.647581 28530 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } attempt: 4
08:05:43.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:43.653537 28530 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.200.124:34439: Network error: Client connection negotiation failed: client connection to 127.27.200.124:34439: connect: Connection refused (error 111)
08:05:43.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:43.866 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 70 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091543865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:43.881 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 70 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=14 ms, finalizationTime=2 ms).
08:05:43.883 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 70 as completed for source Source: KuduSource.
08:05:43.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:43.937042 28530 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } attempt: 5
08:05:43.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:43.942519 28530 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.200.124:34439: Network error: Client connection negotiation failed: client connection to 127.27.200.124:34439: connect: Connection refused (error 111)
08:05:44.044 [DEBUG - pool-48-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30005), Traces: [0ms] sending RPC to server master-127.24.230.252:40255, [6ms] received response from server master-127.24.230.252:40255: OK, deferred=null) with no deferred attached!
08:05:44.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:44.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.185168 28609 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } attempt: 6
08:05:44.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:44.194475 28609 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.200.124:34439: Network error: Client connection negotiation failed: client connection to 127.27.200.124:34439: connect: Connection refused (error 111)
08:05:44.366 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 71 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091544365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:44.378 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 71 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
08:05:44.379 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 71 as completed for source Source: KuduSource.
08:05:44.475 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:44.476 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:44.476 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:44.476 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:44.476 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:44.476 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:44.476 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:44.476 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:44.476 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:44.476 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:44.477 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:44.477 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:44.477 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:44.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.494951 28530 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } attempt: 6
08:05:44.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:44.502477 28530 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.200.124:34439: Network error: Client connection negotiation failed: client connection to 127.27.200.124:34439: connect: Connection refused (error 111)
08:05:44.683 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:44.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:43.418684 28624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:44.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:43.421737 28611 server_base.cc:1061] running on GCE node
08:05:44.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:43.421706 28626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:44.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.731576 28611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:05:44.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.735430 28611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:05:44.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.736897 28611 hybrid_clock.cc:648] HybridClock initialized: now 1779091544736862 us; error 38 us; skew 500 ppm
08:05:44.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.737870 28611 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:05:44.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.745360 28611 webserver.cc:533] Webserver started at http://127.27.200.124:36861/ using document root <none> and password file <none>
08:05:44.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.746696 28611 fs_manager.cc:362] Metadata directory not provided
08:05:44.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.746928 28611 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:05:44.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.747381 28611 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:05:44.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.752714 28611 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-2/data/instance:
08:05:44.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cde4e3b57e254d7888a442a9775c03be"
08:05:44.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:44 on dist-test-slave-1jss"
08:05:44.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.754181 28611 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-2/wal/instance:
08:05:44.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cde4e3b57e254d7888a442a9775c03be"
08:05:44.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:44 on dist-test-slave-1jss"
08:05:44.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.763413 28611 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.007s	sys 0.001s
08:05:44.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.770151 28638 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:05:44.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.771597 28611 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.001s
08:05:44.772 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:44.773 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:44.774 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:44.774 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:44.774 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:44.774 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:44.774 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:44.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.772053 28611 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-2/wal
08:05:44.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cde4e3b57e254d7888a442a9775c03be"
08:05:44.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:44 on dist-test-slave-1jss"
08:05:44.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.772586 28611 fs_report.cc:389] FS layout report
08:05:44.774 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:44.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:05:44.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-2/wal
08:05:44.774 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:44.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-2/wal
08:05:44.774 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:44.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-2/data/data
08:05:44.774 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:44.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:05:44.775 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:44.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:05:44.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:05:44.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:05:44.775 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:44.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:05:44.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:05:44.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:05:44.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:05:44.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:05:44.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:05:44.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:05:44.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.847842 28611 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:05:44.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.849828 28611 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:05:44.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.850428 28611 kserver.cc:163] Server-wide thread pool size limit: 3276
08:05:44.855 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:44.855 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:44.856 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:44.857 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:44.857 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:44.857 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:44.857 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:44.857 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:44.857 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:44.857 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:44.858 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:44.858 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:44.858 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:44.867 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 72 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091544865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:44.876 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 72 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
08:05:44.878 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 72 as completed for source Source: KuduSource.
08:05:44.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.953552 28611 rpc_server.cc:307] RPC server started. Bound to: 127.27.200.124:34439
08:05:44.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.953631 28690 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.200.124:34439 every 8 connection(s)
08:05:44.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.956938 28611 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-2/data/info.pb
08:05:44.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.964808 28691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.966958 28449 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 28611
08:05:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.967492 28449 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/master-2/wal/instance
08:05:44.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:44.985339 28691 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.200.126" port: 43511 } has no permanent_uuid. Determining permanent_uuid...
08:05:45.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.100035 28691 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } has no permanent_uuid. Determining permanent_uuid...
08:05:45.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.116231 28691 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } has no permanent_uuid. Determining permanent_uuid...
08:05:45.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.137792 28691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be: Bootstrap starting.
08:05:45.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.145661 28691 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be: Neither blocks nor log segments found. Creating new log.
08:05:45.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.147825 28691 log.cc:826] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be: Log is configured to *not* fsync() on all Append() calls
08:05:45.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.154157 28691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be: No bootstrap required, opened a new log
08:05:45.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.177230 28691 raft_consensus.cc:359] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de9d55b59a074da2824778ee8b77553c" member_type: VOTER last_known_addr { host: "127.27.200.126" port: 43511 } } peers { permanent_uuid: "82e1065462b346d48d18657fcd2563a2" member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } } peers { permanent_uuid: "cde4e3b57e254d7888a442a9775c03be" member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } }
08:05:45.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.178074 28691 raft_consensus.cc:385] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:45.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.178403 28691 raft_consensus.cc:740] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cde4e3b57e254d7888a442a9775c03be, State: Initialized, Role: FOLLOWER
08:05:45.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.179270 28691 consensus_queue.cc:260] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de9d55b59a074da2824778ee8b77553c" member_type: VOTER last_known_addr { host: "127.27.200.126" port: 43511 } } peers { permanent_uuid: "82e1065462b346d48d18657fcd2563a2" member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } } peers { permanent_uuid: "cde4e3b57e254d7888a442a9775c03be" member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } }
08:05:45.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:45.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.182124 28700 sys_catalog.cc:455] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de9d55b59a074da2824778ee8b77553c" member_type: VOTER last_known_addr { host: "127.27.200.126" port: 43511 } } peers { permanent_uuid: "82e1065462b346d48d18657fcd2563a2" member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } } peers { permanent_uuid: "cde4e3b57e254d7888a442a9775c03be" member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } } }
08:05:45.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.183054 28700 sys_catalog.cc:458] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be [sys.catalog]: This master's current role is: FOLLOWER
08:05:45.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.184149 28691 sys_catalog.cc:565] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be [sys.catalog]: configured and running, proceeding with master startup.
08:05:45.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:45.215090 28711 catalog_manager.cc:1593] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:05:45.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:45.215595 28711 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:05:45.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.209089 28611 master_runner.cc:187] Error getting master registration for 127.27.200.126:43511: OK, instance_id { permanent_uuid: "de9d55b59a074da2824778ee8b77553c" instance_seqno: 1779091540831538 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:05:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.239078 28611 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:05:45.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.254943 28609 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } attempt: 7
08:05:45.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.280445 28609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2: Bootstrap starting.
08:05:45.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.288661 28609 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2: Neither blocks nor log segments found. Creating new log.
08:05:45.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.292003 28609 log.cc:826] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2: Log is configured to *not* fsync() on all Append() calls
08:05:45.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.298795 28609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2: No bootstrap required, opened a new log
08:05:45.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.332355 28609 raft_consensus.cc:359] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de9d55b59a074da2824778ee8b77553c" member_type: VOTER last_known_addr { host: "127.27.200.126" port: 43511 } } peers { permanent_uuid: "82e1065462b346d48d18657fcd2563a2" member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } } peers { permanent_uuid: "cde4e3b57e254d7888a442a9775c03be" member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } }
08:05:45.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.333511 28609 raft_consensus.cc:385] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:45.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.333904 28609 raft_consensus.cc:740] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82e1065462b346d48d18657fcd2563a2, State: Initialized, Role: FOLLOWER
08:05:45.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.335029 28609 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de9d55b59a074da2824778ee8b77553c" member_type: VOTER last_known_addr { host: "127.27.200.126" port: 43511 } } peers { permanent_uuid: "82e1065462b346d48d18657fcd2563a2" member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } } peers { permanent_uuid: "cde4e3b57e254d7888a442a9775c03be" member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } }
08:05:45.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.339145 28715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de9d55b59a074da2824778ee8b77553c" member_type: VOTER last_known_addr { host: "127.27.200.126" port: 43511 } } peers { permanent_uuid: "82e1065462b346d48d18657fcd2563a2" member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } } peers { permanent_uuid: "cde4e3b57e254d7888a442a9775c03be" member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } } }
08:05:45.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.340314 28715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [sys.catalog]: This master's current role is: FOLLOWER
08:05:45.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.342069 28609 sys_catalog.cc:565] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [sys.catalog]: configured and running, proceeding with master startup.
08:05:45.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:45.358345 28644 tablet.cc:2404] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:05:45.366 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 73 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091545366 for job e26b904229418d0e047d5d94c5b9f905.
08:05:45.378 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 73 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
08:05:45.380 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 73 as completed for source Source: KuduSource.
08:05:45.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:45.394675 28726 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:05:45.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:45.395200 28726 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:05:45.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.385241 28532 master_runner.cc:187] Error getting master registration for 127.27.200.126:43511: OK, instance_id { permanent_uuid: "de9d55b59a074da2824778ee8b77553c" instance_seqno: 1779091540831538 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:05:45.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.433257 28532 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:05:45.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.535928 28530 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } attempt: 7
08:05:45.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:45.539160 28562 tablet.cc:2404] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:05:45.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.564512 28530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de9d55b59a074da2824778ee8b77553c: Bootstrap starting.
08:05:45.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.574002 28530 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de9d55b59a074da2824778ee8b77553c: Neither blocks nor log segments found. Creating new log.
08:05:45.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.576759 28530 log.cc:826] T 00000000000000000000000000000000 P de9d55b59a074da2824778ee8b77553c: Log is configured to *not* fsync() on all Append() calls
08:05:45.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.582449 28530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de9d55b59a074da2824778ee8b77553c: No bootstrap required, opened a new log
08:05:45.611 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:45.612 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:45.612 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:45.613 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:45.613 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:45.613 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:45.614 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:45.614 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:45.614 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:45.618 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:45.618 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:45.618 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:45.618 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:45.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.615624 28700 raft_consensus.cc:493] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:05:45.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.616317 28700 raft_consensus.cc:515] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de9d55b59a074da2824778ee8b77553c" member_type: VOTER last_known_addr { host: "127.27.200.126" port: 43511 } } peers { permanent_uuid: "82e1065462b346d48d18657fcd2563a2" member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } } peers { permanent_uuid: "cde4e3b57e254d7888a442a9775c03be" member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } }
08:05:45.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.619321 28530 raft_consensus.cc:359] T 00000000000000000000000000000000 P de9d55b59a074da2824778ee8b77553c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de9d55b59a074da2824778ee8b77553c" member_type: VOTER last_known_addr { host: "127.27.200.126" port: 43511 } } peers { permanent_uuid: "82e1065462b346d48d18657fcd2563a2" member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } } peers { permanent_uuid: "cde4e3b57e254d7888a442a9775c03be" member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } }
08:05:45.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.620731 28530 raft_consensus.cc:385] T 00000000000000000000000000000000 P de9d55b59a074da2824778ee8b77553c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:45.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.621208 28530 raft_consensus.cc:740] T 00000000000000000000000000000000 P de9d55b59a074da2824778ee8b77553c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de9d55b59a074da2824778ee8b77553c, State: Initialized, Role: FOLLOWER
08:05:45.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.623073 28700 leader_election.cc:290] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de9d55b59a074da2824778ee8b77553c (127.27.200.126:43511), 82e1065462b346d48d18657fcd2563a2 (127.27.200.125:46459)
08:05:45.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.624333 28715 raft_consensus.cc:493] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:05:45.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.624513 28584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cde4e3b57e254d7888a442a9775c03be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e1065462b346d48d18657fcd2563a2" is_pre_election: true
08:05:45.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.624941 28715 raft_consensus.cc:515] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de9d55b59a074da2824778ee8b77553c" member_type: VOTER last_known_addr { host: "127.27.200.126" port: 43511 } } peers { permanent_uuid: "82e1065462b346d48d18657fcd2563a2" member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } } peers { permanent_uuid: "cde4e3b57e254d7888a442a9775c03be" member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } }
08:05:45.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.626273 28584 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cde4e3b57e254d7888a442a9775c03be in term 0.
08:05:45.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.628597 28639 leader_election.cc:304] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82e1065462b346d48d18657fcd2563a2, cde4e3b57e254d7888a442a9775c03be; no voters: 
08:05:45.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.631656 28665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "82e1065462b346d48d18657fcd2563a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde4e3b57e254d7888a442a9775c03be" is_pre_election: true
08:05:45.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.632581 28665 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82e1065462b346d48d18657fcd2563a2 in term 0.
08:05:45.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.634351 28560 leader_election.cc:304] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82e1065462b346d48d18657fcd2563a2, cde4e3b57e254d7888a442a9775c03be; no voters: 
08:05:45.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.634894 28530 consensus_queue.cc:260] T 00000000000000000000000000000000 P de9d55b59a074da2824778ee8b77553c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de9d55b59a074da2824778ee8b77553c" member_type: VOTER last_known_addr { host: "127.27.200.126" port: 43511 } } peers { permanent_uuid: "82e1065462b346d48d18657fcd2563a2" member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } } peers { permanent_uuid: "cde4e3b57e254d7888a442a9775c03be" member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } }
08:05:45.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.629916 28715 leader_election.cc:290] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de9d55b59a074da2824778ee8b77553c (127.27.200.126:43511), cde4e3b57e254d7888a442a9775c03be (127.27.200.124:34439)
08:05:45.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.638612 28715 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:05:45.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.640226 28700 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be [term 0 FOLLOWER]: Leader pre-election won for term 1
08:05:45.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.640060 28715 raft_consensus.cc:493] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:05:45.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.643209 28715 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [term 0 FOLLOWER]: Advancing to term 1
08:05:45.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.643456 28700 raft_consensus.cc:493] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:05:45.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.648087 28700 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be [term 0 FOLLOWER]: Advancing to term 1
08:05:45.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.661969 28505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cde4e3b57e254d7888a442a9775c03be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de9d55b59a074da2824778ee8b77553c" is_pre_election: true
08:05:45.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.663130 28505 raft_consensus.cc:2468] T 00000000000000000000000000000000 P de9d55b59a074da2824778ee8b77553c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cde4e3b57e254d7888a442a9775c03be in term 0.
08:05:45.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.664700 28504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "82e1065462b346d48d18657fcd2563a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de9d55b59a074da2824778ee8b77553c" is_pre_election: true
08:05:45.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.665382 28504 raft_consensus.cc:2468] T 00000000000000000000000000000000 P de9d55b59a074da2824778ee8b77553c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82e1065462b346d48d18657fcd2563a2 in term 0.
08:05:45.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.658819 28731 sys_catalog.cc:455] T 00000000000000000000000000000000 P de9d55b59a074da2824778ee8b77553c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de9d55b59a074da2824778ee8b77553c" member_type: VOTER last_known_addr { host: "127.27.200.126" port: 43511 } } peers { permanent_uuid: "82e1065462b346d48d18657fcd2563a2" member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } } peers { permanent_uuid: "cde4e3b57e254d7888a442a9775c03be" member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } } }
08:05:45.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.668905 28731 sys_catalog.cc:458] T 00000000000000000000000000000000 P de9d55b59a074da2824778ee8b77553c [sys.catalog]: This master's current role is: FOLLOWER
08:05:45.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.668440 28530 sys_catalog.cc:565] T 00000000000000000000000000000000 P de9d55b59a074da2824778ee8b77553c [sys.catalog]: configured and running, proceeding with master startup.
08:05:45.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.671255 28715 raft_consensus.cc:515] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de9d55b59a074da2824778ee8b77553c" member_type: VOTER last_known_addr { host: "127.27.200.126" port: 43511 } } peers { permanent_uuid: "82e1065462b346d48d18657fcd2563a2" member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } } peers { permanent_uuid: "cde4e3b57e254d7888a442a9775c03be" member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } }
08:05:45.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.673455 28700 raft_consensus.cc:515] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de9d55b59a074da2824778ee8b77553c" member_type: VOTER last_known_addr { host: "127.27.200.126" port: 43511 } } peers { permanent_uuid: "82e1065462b346d48d18657fcd2563a2" member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } } peers { permanent_uuid: "cde4e3b57e254d7888a442a9775c03be" member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } }
08:05:45.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:45.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.684039 28715 leader_election.cc:290] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [CANDIDATE]: Term 1 election: Requested vote from peers de9d55b59a074da2824778ee8b77553c (127.27.200.126:43511), cde4e3b57e254d7888a442a9775c03be (127.27.200.124:34439)
08:05:45.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.685611 28665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "82e1065462b346d48d18657fcd2563a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde4e3b57e254d7888a442a9775c03be"
08:05:45.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.685577 28504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "82e1065462b346d48d18657fcd2563a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de9d55b59a074da2824778ee8b77553c"
08:05:45.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.686247 28504 raft_consensus.cc:3060] T 00000000000000000000000000000000 P de9d55b59a074da2824778ee8b77553c [term 0 FOLLOWER]: Advancing to term 1
08:05:45.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.686517 28665 raft_consensus.cc:2393] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 82e1065462b346d48d18657fcd2563a2 in current term 1: Already voted for candidate cde4e3b57e254d7888a442a9775c03be in this term.
08:05:45.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.685495 28700 leader_election.cc:290] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be [CANDIDATE]: Term 1 election: Requested vote from peers de9d55b59a074da2824778ee8b77553c (127.27.200.126:43511), 82e1065462b346d48d18657fcd2563a2 (127.27.200.125:46459)
08:05:45.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.688884 28505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cde4e3b57e254d7888a442a9775c03be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de9d55b59a074da2824778ee8b77553c"
08:05:45.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.689059 28584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cde4e3b57e254d7888a442a9775c03be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e1065462b346d48d18657fcd2563a2"
08:05:45.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.690254 28584 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cde4e3b57e254d7888a442a9775c03be in current term 1: Already voted for candidate 82e1065462b346d48d18657fcd2563a2 in this term.
08:05:45.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.694517 28640 leader_election.cc:304] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cde4e3b57e254d7888a442a9775c03be; no voters: 82e1065462b346d48d18657fcd2563a2, de9d55b59a074da2824778ee8b77553c
08:05:45.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.695652 28504 raft_consensus.cc:2468] T 00000000000000000000000000000000 P de9d55b59a074da2824778ee8b77553c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82e1065462b346d48d18657fcd2563a2 in term 1.
08:05:45.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.695931 28700 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
08:05:45.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.697398 28558 leader_election.cc:304] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82e1065462b346d48d18657fcd2563a2, de9d55b59a074da2824778ee8b77553c; no voters: cde4e3b57e254d7888a442a9775c03be
08:05:45.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.698271 28715 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [term 1 FOLLOWER]: Leader election won for term 1
08:05:45.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.699122 28715 raft_consensus.cc:697] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [term 1 LEADER]: Becoming Leader. State: Replica: 82e1065462b346d48d18657fcd2563a2, State: Running, Role: LEADER
08:05:45.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.700443 28715 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de9d55b59a074da2824778ee8b77553c" member_type: VOTER last_known_addr { host: "127.27.200.126" port: 43511 } } peers { permanent_uuid: "82e1065462b346d48d18657fcd2563a2" member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } } peers { permanent_uuid: "cde4e3b57e254d7888a442a9775c03be" member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } }
08:05:45.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.736763 28730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82e1065462b346d48d18657fcd2563a2. Latest consensus state: current_term: 1 leader_uuid: "82e1065462b346d48d18657fcd2563a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de9d55b59a074da2824778ee8b77553c" member_type: VOTER last_known_addr { host: "127.27.200.126" port: 43511 } } peers { permanent_uuid: "82e1065462b346d48d18657fcd2563a2" member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } } peers { permanent_uuid: "cde4e3b57e254d7888a442a9775c03be" member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } } }
08:05:45.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.738536 28730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [sys.catalog]: This master's current role is: LEADER
08:05:45.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.751343 28737 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
08:05:45.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.760846 28737 catalog_manager.cc:1519] Initializing Kudu cluster ID...
08:05:45.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:45.772588 28484 tablet.cc:2404] T 00000000000000000000000000000000 P de9d55b59a074da2824778ee8b77553c: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:05:45.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.795625 28665 raft_consensus.cc:1275] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be [term 1 FOLLOWER]: Refusing update from remote peer 82e1065462b346d48d18657fcd2563a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:05:45.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.797916 28730 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cde4e3b57e254d7888a442a9775c03be" member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:05:45.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.819468 28504 raft_consensus.cc:1275] T 00000000000000000000000000000000 P de9d55b59a074da2824778ee8b77553c [term 1 FOLLOWER]: Refusing update from remote peer 82e1065462b346d48d18657fcd2563a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:05:45.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.821918 28730 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de9d55b59a074da2824778ee8b77553c" member_type: VOTER last_known_addr { host: "127.27.200.126" port: 43511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:05:45.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.837877 28700 sys_catalog.cc:455] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82e1065462b346d48d18657fcd2563a2. Latest consensus state: current_term: 1 leader_uuid: "82e1065462b346d48d18657fcd2563a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de9d55b59a074da2824778ee8b77553c" member_type: VOTER last_known_addr { host: "127.27.200.126" port: 43511 } } peers { permanent_uuid: "82e1065462b346d48d18657fcd2563a2" member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } } peers { permanent_uuid: "cde4e3b57e254d7888a442a9775c03be" member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } } }
08:05:45.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.841014 28700 sys_catalog.cc:458] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be [sys.catalog]: This master's current role is: FOLLOWER
08:05:45.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.849188 28741 mvcc.cc:204] Tried to move back new op lower bound from 7287158971558830080 to 7287158971201531904. Current Snapshot: MvccSnapshot[applied={T|T < 7287158971558830080}]
08:05:45.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.851356 28745 mvcc.cc:204] Tried to move back new op lower bound from 7287158971558830080 to 7287158971201531904. Current Snapshot: MvccSnapshot[applied={T|T < 7287158971558830080}]
08:05:45.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.863693 28700 sys_catalog.cc:455] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "82e1065462b346d48d18657fcd2563a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de9d55b59a074da2824778ee8b77553c" member_type: VOTER last_known_addr { host: "127.27.200.126" port: 43511 } } peers { permanent_uuid: "82e1065462b346d48d18657fcd2563a2" member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } } peers { permanent_uuid: "cde4e3b57e254d7888a442a9775c03be" member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } } }
08:05:45.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.864480 28700 sys_catalog.cc:458] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be [sys.catalog]: This master's current role is: FOLLOWER
08:05:45.866 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 74 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091545865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:45.882 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 74 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
08:05:45.886 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 74 as completed for source Source: KuduSource.
08:05:45.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.888794 28731 sys_catalog.cc:455] T 00000000000000000000000000000000 P de9d55b59a074da2824778ee8b77553c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82e1065462b346d48d18657fcd2563a2. Latest consensus state: current_term: 1 leader_uuid: "82e1065462b346d48d18657fcd2563a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de9d55b59a074da2824778ee8b77553c" member_type: VOTER last_known_addr { host: "127.27.200.126" port: 43511 } } peers { permanent_uuid: "82e1065462b346d48d18657fcd2563a2" member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } } peers { permanent_uuid: "cde4e3b57e254d7888a442a9775c03be" member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } } }
08:05:45.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.890889 28731 sys_catalog.cc:458] T 00000000000000000000000000000000 P de9d55b59a074da2824778ee8b77553c [sys.catalog]: This master's current role is: FOLLOWER
08:05:45.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.895162 28731 sys_catalog.cc:455] T 00000000000000000000000000000000 P de9d55b59a074da2824778ee8b77553c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "82e1065462b346d48d18657fcd2563a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de9d55b59a074da2824778ee8b77553c" member_type: VOTER last_known_addr { host: "127.27.200.126" port: 43511 } } peers { permanent_uuid: "82e1065462b346d48d18657fcd2563a2" member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } } peers { permanent_uuid: "cde4e3b57e254d7888a442a9775c03be" member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } } }
08:05:45.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.897418 28731 sys_catalog.cc:458] T 00000000000000000000000000000000 P de9d55b59a074da2824778ee8b77553c [sys.catalog]: This master's current role is: FOLLOWER
08:05:45.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.924602 28737 catalog_manager.cc:1382] Generated new cluster ID: 28ae2492f6a84de49465d55f81cfa1d3
08:05:45.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.925065 28737 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
08:05:45.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.959807 28748 mvcc.cc:204] Tried to move back new op lower bound from 7287158971558830080 to 7287158971201531904. Current Snapshot: MvccSnapshot[applied={T|T < 7287158971558830080}]
08:05:45.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:45.979548 28752 catalog_manager.cc:1593] T 00000000000000000000000000000000 P de9d55b59a074da2824778ee8b77553c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:05:45.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:45.984063 28752 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:05:45.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.986366 28715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "82e1065462b346d48d18657fcd2563a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de9d55b59a074da2824778ee8b77553c" member_type: VOTER last_known_addr { host: "127.27.200.126" port: 43511 } } peers { permanent_uuid: "82e1065462b346d48d18657fcd2563a2" member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } } peers { permanent_uuid: "cde4e3b57e254d7888a442a9775c03be" member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } } }
08:05:45.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.987183 28715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [sys.catalog]: This master's current role is: LEADER
08:05:45.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.987519 28730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "82e1065462b346d48d18657fcd2563a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de9d55b59a074da2824778ee8b77553c" member_type: VOTER last_known_addr { host: "127.27.200.126" port: 43511 } } peers { permanent_uuid: "82e1065462b346d48d18657fcd2563a2" member_type: VOTER last_known_addr { host: "127.27.200.125" port: 46459 } } peers { permanent_uuid: "cde4e3b57e254d7888a442a9775c03be" member_type: VOTER last_known_addr { host: "127.27.200.124" port: 34439 } } }
08:05:45.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:45.988198 28730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2 [sys.catalog]: This master's current role is: LEADER
08:05:46.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:46.013851 28737 catalog_manager.cc:1405] Generated new certificate authority record
08:05:46.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:46.016629 28737 catalog_manager.cc:1539] Loading token signing keys...
08:05:46.043 [DEBUG - pool-48-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30010), Traces: [0ms] sending RPC to server master-127.24.230.252:40255, [14ms] received response from server master-127.24.230.252:40255: OK, deferred=null) with no deferred attached!
08:05:46.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:46.084856 28152 debug-util.cc:398] Leaking SignalData structure 0x7b08000adfe0 after lost signal to thread 28022
08:05:46.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:46.086359 28152 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad9e0 after lost signal to thread 28155
08:05:46.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:46.096036 28737 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 82e1065462b346d48d18657fcd2563a2: Generated new TSK 0
08:05:46.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:46.097913 28737 catalog_manager.cc:1549] Initializing in-progress tserver states...
08:05:46.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:46.126192 28449 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:05:46.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:05:46.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-0/wal
08:05:46.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-0/data
08:05:46.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:05:46.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:05:46.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:05:46.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:05:46.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:05:46.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:05:46.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-0/logs
08:05:46.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-0/data/info.pb
08:05:46.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:05:46.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:05:46.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:05:46.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:05:46.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:05:46.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:05:46.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:05:46.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:05:46.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:05:46.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:05:46.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.200.65:0
08:05:46.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.27.200.65
08:05:46.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.200.65
08:05:46.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:05:46.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.27.200.126:43511,127.27.200.125:46459,127.27.200.124:34439
08:05:46.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.200.84:44601
08:05:46.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:05:46.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:05:46.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:05:46.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:46.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:46.225561 28711 catalog_manager.cc:1294] Loaded cluster ID: 28ae2492f6a84de49465d55f81cfa1d3
08:05:46.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:46.225889 28711 catalog_manager.cc:1587] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be: loading cluster ID for follower catalog manager: success
08:05:46.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:46.268217 28711 catalog_manager.cc:1609] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be: acquiring CA information for follower catalog manager: success
08:05:46.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:46.294085 28711 catalog_manager.cc:1637] T 00000000000000000000000000000000 P cde4e3b57e254d7888a442a9775c03be: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:05:46.350 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:46.351 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:46.351 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:46.353 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:46.353 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:46.353 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:46.354 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:46.354 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:46.354 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:46.355 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:46.355 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:46.355 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:46.355 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:46.366 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 75 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091546365 for job e26b904229418d0e047d5d94c5b9f905.
08:05:46.383 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:46.384 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:46.385 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:46.385 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:46.385 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 75 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
08:05:46.385 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:46.385 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:46.386 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:46.386 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:46.386 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:46.386 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:46.386 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 75 as completed for source Source: KuduSource.
08:05:46.386 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:46.387 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:46.387 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:46.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:46.868 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 76 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091546865 for job e26b904229418d0e047d5d94c5b9f905.
08:05:46.879 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 76 for job e26b904229418d0e047d5d94c5b9f905 (2384 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
08:05:46.885 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 76 as completed for source Source: KuduSource.
08:05:46.894 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:46.895 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:46.896 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:46.897 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:46.897 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:46.897 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:46.897 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:46.898 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:46.898 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:46.898 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:46.898 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:46.898 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:46.898 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:46.899 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=25, TimeoutTracker(timeout=29385, elapsed=28222), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [9ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [71ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: [peer master-127.24.230.253:39511(127.24.230.253:39511)] unexpected exception from downstream on [id: 0x1ac40f1c, L:/127.0.0.1:36038 - R:/127.24.230.253:39511], [123ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: [peer master-127.24.230.252:40255(127.24.230.252:40255)] unexpected exception from downstream on [id: 0xea1cc1c5, L:/127.0.0.1:53630 - R:/127.24.230.252:40255], [123ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: [peer master-127.24.230.253:39511(127.24.230.253:39511)] unexpected exception from downstream on [id: 0x1ac40f1c, L:/127.0.0.1:36038 - R:/127.24.230.253:39511],org.apache.kudu.client.RecoverableException: [peer master-127.24.230.252:40255(127.24.230.252:40255)] unexpected exception from downstream on [id: 0xea1cc1c5, L:/127.0.0.1:53630 - R:/127.24.230.252:40255], [138ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [141ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [142ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [143ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [144ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [162ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [162ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [162ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [162ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [178ms] refreshing cache from master, [178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [181ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [181ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [182ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [182ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [198ms] refreshing cache from master, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [200ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [201ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [201ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [201ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [238ms] refreshing cache from master, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [240ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [240ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [241ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [241ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [258ms] refreshing cache from master, [259ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [259ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [261ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [261ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [261ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [261ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [399ms] refreshing cache from master, [399ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [401ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [402ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [402ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [403ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [419ms] refreshing cache from master, [419ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [421ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [422ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [422ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [422ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [859ms] refreshing cache from master, [859ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [861ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [861ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [862ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [862ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1019ms] refreshing cache from master, [1019ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1021ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [2338ms] refreshing cache from master, [2338ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [2339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [2339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [2340ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [2340ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [2340ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [2341ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [5479ms] refreshing cache from master, [5479ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [5480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [5480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [5481ms] too many traces: truncated at 100 traces, deferred=Deferred@1777376501(state=PENDING, result=null, callback=(continuation of Deferred@1112179695 after retry RPC after error@101650297) -> (continuation of Deferred@843209329 after retry RPC after error@1597538296) -> (continuation of Deferred@1232853515 after retry RPC after error@930177178) -> (continuation of Deferred@398468567 after retry RPC after error@194731880) -> (continuation of Deferred@480733074 after retry RPC after error@544121132) -> (continuation of Deferred@915850859 after retry RPC after error@1739042766) -> (continuation of Deferred@1075568479 after retry RPC after error@363422129) -> (continuation of Deferred@353130737 after retry RPC after error@1326406721) -> (continuation of Deferred@1374716888 after retry RPC after error@252368062) -> (continuation of Deferred@2025250430 after retry RPC after error@1307474045) -> (continuation of Deferred@408280155 after retry RPC after error@1092834507) -> (continuation of Deferred@254289855 after retry RPC after error@825985975) -> (continuation of Deferred@121253583 after retry RPC after error@1550100463) -> (continuation of Deferred@314537475 after retry RPC after error@2142511568) -> (continuation of Deferred@690894015 after retry RPC after error@1351394730) -> (continuation of Deferred@963301078 after retry RPC after error@1729020554) -> (continuation of Deferred@1063094552 after retry RPC after error@180996780) -> (continuation of Deferred@1698347357 after retry RPC after error@1949384162) -> (continuation of Deferred@662138677 after retry RPC after error@1664048605) -> (continuation of Deferred@1399840948 after retry RPC after error@776739094) -> (continuation of Deferred@853460269 after retry RPC after error@730248990) -> (continuation of Deferred@130058394 after retry RPC after error@1233827293) -> (continuation of Deferred@230286956 after retry RPC after error@320441986) -> (continuation of Deferred@270422051 after retry RPC after error@203832224), errback=(continuation of Deferred@1112179695 after retry RPC after error@101650297) -> (continuation of Deferred@843209329 after retry RPC after error@1597538296) -> (continuation of Deferred@1232853515 after retry RPC after error@930177178) -> (continuation of Deferred@398468567 after retry RPC after error@194731880) -> (continuation of Deferred@480733074 after retry RPC after error@544121132) -> (continuation of Deferred@915850859 after retry RPC after error@1739042766) -> (continuation of Deferred@1075568479 after retry RPC after error@363422129) -> (continuation of Deferred@353130737 after retry RPC after error@1326406721) -> (continuation of Deferred@1374716888 after retry RPC after error@252368062) -> (continuation of Deferred@2025250430 after retry RPC after error@1307474045) -> (continuation of Deferred@408280155 after retry RPC after error@1092834507) -> (continuation of Deferred@254289855 after retry RPC after error@825985975) -> (continuation of Deferred@121253583 after retry RPC after error@1550100463) -> (continuation of Deferred@314537475 after retry RPC after error@2142511568) -> (continuation of Deferred@690894015 after retry RPC after error@1351394730) -> (continuation of Deferred@963301078 after retry RPC after error@1729020554) -> (continuation of Deferred@1063094552 after retry RPC after error@180996780) -> (continuation of Deferred@1698347357 after retry RPC after error@1949384162) -> (continuation of Deferred@662138677 after retry RPC after error@1664048605) -> (continuation of Deferred@1399840948 after retry RPC after error@776739094) -> (continuation of Deferred@853460269 after retry RPC after error@730248990) -> (continuation of Deferred@130058394 after retry RPC after error@1233827293) -> (continuation of Deferred@230286956 after retry RPC after error@320441986) -> (continuation of Deferred@270422051 after retry RPC after error@203832224)))
08:05:46.908 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1523) Notify RPC ScanRequest(scannerId=null, state=OPENING, tablet=dd533e1ae3024cc396ad8921413c2eaa, attempt=4, KuduRpc(method=Scan, tablet=dd533e1ae3024cc396ad8921413c2eaa, attempt=4, TimeoutTracker(timeout=30000, elapsed=28844), Traces: [0ms] sending RPC to server 9bda994622fa49ac9fabfbf40edba4ff, [540ms] received response from server 9bda994622fa49ac9fabfbf40edba4ff: Network error: connection closed, [540ms] delaying RPC due to: Network error: connection closed, [560ms] sending RPC to server 37d338f6c5db4cc4bace5615d0b1421a, [567ms] received response from server 37d338f6c5db4cc4bace5615d0b1421a: Network error: Failed to connect to peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057): Connection refused: /127.24.230.194:36057, [567ms] delaying RPC due to: Network error: Failed to connect to peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057): Connection refused: /127.24.230.194:36057, [580ms] sending RPC to server 97ad2967f56a4511a42f5f0981fb24d5, [583ms] received response from server 97ad2967f56a4511a42f5f0981fb24d5: Network error: Failed to connect to peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195): Connection refused: /127.24.230.193:33195, [584ms] delaying RPC due to: Network error: Failed to connect to peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195): Connection refused: /127.24.230.193:33195, [602ms] refreshing cache from master, [602ms] Sub RPC GetTableLocations: refreshing cache from master, [603ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [608ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [611ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [636ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [673ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: [peer master-127.24.230.253:39511(127.24.230.253:39511)] unexpected exception from downstream on [id: 0x1ac40f1c, L:/127.0.0.1:36038 - R:/127.24.230.253:39511], [725ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: [peer master-127.24.230.252:40255(127.24.230.252:40255)] unexpected exception from downstream on [id: 0xea1cc1c5, L:/127.0.0.1:53630 - R:/127.24.230.252:40255], [725ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: [peer master-127.24.230.253:39511(127.24.230.253:39511)] unexpected exception from downstream on [id: 0x1ac40f1c, L:/127.0.0.1:36038 - R:/127.24.230.253:39511],org.apache.kudu.client.RecoverableException: [peer master-127.24.230.252:40255(127.24.230.252:40255)] unexpected exception from downstream on [id: 0xea1cc1c5, L:/127.0.0.1:53630 - R:/127.24.230.252:40255], [740ms] Sub RPC GetTableLocations: refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [743ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [743ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [744ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [745ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [746ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [763ms] Sub RPC GetTableLocations: refreshing cache from master, [763ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [763ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [764ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [764ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [764ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [764ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [764ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [780ms] Sub RPC GetTableLocations: refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [783ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [783ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [784ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [784ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [800ms] Sub RPC GetTableLocations: refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [802ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [803ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [803ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [803ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [840ms] Sub RPC GetTableLocations: refreshing cache from master, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [842ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [842ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [843ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [843ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [860ms] Sub RPC GetTableLocations: refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [863ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [863ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [863ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [863ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1001ms] Sub RPC GetTableLocations: refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [1003ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [1004ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1004ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1005ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1021ms] Sub RPC GetTableLocations: refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [1023ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [1023ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [1023ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [1024ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1024ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1024ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1461ms] Sub RPC GetTableLocations: refreshing cache from master, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1464ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1464ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1621ms] Sub RPC GetTableLocations: refreshing cache from master, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [1623ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [1623ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1623ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1623ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [2940ms] Sub RPC GetTableLocations: refreshing cache from master, [2940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [2941ms] too many traces: truncated at 100 traces, deferred=Deferred@1324230350(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0, errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0))) after lookup exception
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=25, TimeoutTracker(timeout=29385, elapsed=28222), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [9ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [71ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: [peer master-127.24.230.253:39511(127.24.230.253:39511)] unexpected exception from downstream on [id: 0x1ac40f1c, L:/127.0.0.1:36038 - R:/127.24.230.253:39511], [123ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: [peer master-127.24.230.252:40255(127.24.230.252:40255)] unexpected exception from downstream on [id: 0xea1cc1c5, L:/127.0.0.1:53630 - R:/127.24.230.252:40255], [123ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: [peer master-127.24.230.253:39511(127.24.230.253:39511)] unexpected exception from downstream on [id: 0x1ac40f1c, L:/127.0.0.1:36038 - R:/127.24.230.253:39511],org.apache.kudu.client.RecoverableException: [peer master-127.24.230.252:40255(127.24.230.252:40255)] unexpected exception from downstream on [id: 0xea1cc1c5, L:/127.0.0.1:53630 - R:/127.24.230.252:40255], [138ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [141ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [142ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [143ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [144ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [162ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [162ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [162ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [162ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [178ms] refreshing cache from master, [178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [181ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [181ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [182ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [182ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [198ms] refreshing cache from master, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [200ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [201ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [201ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [201ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [238ms] refreshing cache from master, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [240ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [240ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [241ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [241ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [258ms] refreshing cache from master, [259ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [259ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [261ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [261ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [261ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [261ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [399ms] refreshing cache from master, [399ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [401ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [402ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [402ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [403ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [419ms] refreshing cache from master, [419ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [421ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [422ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [422ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [422ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [859ms] refreshing cache from master, [859ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [861ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [861ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [862ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [862ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1019ms] refreshing cache from master, [1019ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1021ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [2338ms] refreshing cache from master, [2338ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [2339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [2339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [2340ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [2340ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [2340ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [2341ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [5479ms] refreshing cache from master, [5479ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [5480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [5480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [5481ms] too many traces: truncated at 100 traces, deferred=Deferred@1777376501(state=PENDING, result=null, callback=(continuation of Deferred@1112179695 after retry RPC after error@101650297) -> (continuation of Deferred@843209329 after retry RPC after error@1597538296) -> (continuation of Deferred@1232853515 after retry RPC after error@930177178) -> (continuation of Deferred@398468567 after retry RPC after error@194731880) -> (continuation of Deferred@480733074 after retry RPC after error@544121132) -> (continuation of Deferred@915850859 after retry RPC after error@1739042766) -> (continuation of Deferred@1075568479 after retry RPC after error@363422129) -> (continuation of Deferred@353130737 after retry RPC after error@1326406721) -> (continuation of Deferred@1374716888 after retry RPC after error@252368062) -> (continuation of Deferred@2025250430 after retry RPC after error@1307474045) -> (continuation of Deferred@408280155 after retry RPC after error@1092834507) -> (continuation of Deferred@254289855 after retry RPC after error@825985975) -> (continuation of Deferred@121253583 after retry RPC after error@1550100463) -> (continuation of Deferred@314537475 after retry RPC after error@2142511568) -> (continuation of Deferred@690894015 after retry RPC after error@1351394730) -> (continuation of Deferred@963301078 after retry RPC after error@1729020554) -> (continuation of Deferred@1063094552 after retry RPC after error@180996780) -> (continuation of Deferred@1698347357 after retry RPC after error@1949384162) -> (continuation of Deferred@662138677 after retry RPC after error@1664048605) -> (continuation of Deferred@1399840948 after retry RPC after error@776739094) -> (continuation of Deferred@853460269 after retry RPC after error@730248990) -> (continuation of Deferred@130058394 after retry RPC after error@1233827293) -> (continuation of Deferred@230286956 after retry RPC after error@320441986) -> (continuation of Deferred@270422051 after retry RPC after error@203832224), errback=(continuation of Deferred@1112179695 after retry RPC after error@101650297) -> (continuation of Deferred@843209329 after retry RPC after error@1597538296) -> (continuation of Deferred@1232853515 after retry RPC after error@930177178) -> (continuation of Deferred@398468567 after retry RPC after error@194731880) -> (continuation of Deferred@480733074 after retry RPC after error@544121132) -> (continuation of Deferred@915850859 after retry RPC after error@1739042766) -> (continuation of Deferred@1075568479 after retry RPC after error@363422129) -> (continuation of Deferred@353130737 after retry RPC after error@1326406721) -> (continuation of Deferred@1374716888 after retry RPC after error@252368062) -> (continuation of Deferred@2025250430 after retry RPC after error@1307474045) -> (continuation of Deferred@408280155 after retry RPC after error@1092834507) -> (continuation of Deferred@254289855 after retry RPC after error@825985975) -> (continuation of Deferred@121253583 after retry RPC after error@1550100463) -> (continuation of Deferred@314537475 after retry RPC after error@2142511568) -> (continuation of Deferred@690894015 after retry RPC after error@1351394730) -> (continuation of Deferred@963301078 after retry RPC after error@1729020554) -> (continuation of Deferred@1063094552 after retry RPC after error@180996780) -> (continuation of Deferred@1698347357 after retry RPC after error@1949384162) -> (continuation of Deferred@662138677 after retry RPC after error@1664048605) -> (continuation of Deferred@1399840948 after retry RPC after error@776739094) -> (continuation of Deferred@853460269 after retry RPC after error@730248990) -> (continuation of Deferred@130058394 after retry RPC after error@1233827293) -> (continuation of Deferred@230286956 after retry RPC after error@320441986) -> (continuation of Deferred@270422051 after retry RPC after error@203832224)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.24.230.253:39511
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:05:46.917 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:686) Can not open scanner
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=25, TimeoutTracker(timeout=29385, elapsed=28222), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [9ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [71ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: [peer master-127.24.230.253:39511(127.24.230.253:39511)] unexpected exception from downstream on [id: 0x1ac40f1c, L:/127.0.0.1:36038 - R:/127.24.230.253:39511], [123ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: [peer master-127.24.230.252:40255(127.24.230.252:40255)] unexpected exception from downstream on [id: 0xea1cc1c5, L:/127.0.0.1:53630 - R:/127.24.230.252:40255], [123ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: [peer master-127.24.230.253:39511(127.24.230.253:39511)] unexpected exception from downstream on [id: 0x1ac40f1c, L:/127.0.0.1:36038 - R:/127.24.230.253:39511],org.apache.kudu.client.RecoverableException: [peer master-127.24.230.252:40255(127.24.230.252:40255)] unexpected exception from downstream on [id: 0xea1cc1c5, L:/127.0.0.1:53630 - R:/127.24.230.252:40255], [138ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [141ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [142ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [143ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [144ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [162ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [162ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [162ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [162ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [178ms] refreshing cache from master, [178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [181ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [181ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [182ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [182ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [198ms] refreshing cache from master, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [200ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [201ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [201ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [201ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [238ms] refreshing cache from master, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [240ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [240ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [241ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [241ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [258ms] refreshing cache from master, [259ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [259ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [261ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [261ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [261ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [261ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [399ms] refreshing cache from master, [399ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [401ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [402ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [402ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [403ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [419ms] refreshing cache from master, [419ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [421ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [422ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [422ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [422ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [859ms] refreshing cache from master, [859ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [861ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [861ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [862ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [862ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1019ms] refreshing cache from master, [1019ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1021ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [2338ms] refreshing cache from master, [2338ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [2339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [2339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [2340ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [2340ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [2340ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [2341ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [5479ms] refreshing cache from master, [5479ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [5480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [5480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [5481ms] too many traces: truncated at 100 traces, deferred=Deferred@1777376501(state=PENDING, result=null, callback=(continuation of Deferred@1112179695 after retry RPC after error@101650297) -> (continuation of Deferred@843209329 after retry RPC after error@1597538296) -> (continuation of Deferred@1232853515 after retry RPC after error@930177178) -> (continuation of Deferred@398468567 after retry RPC after error@194731880) -> (continuation of Deferred@480733074 after retry RPC after error@544121132) -> (continuation of Deferred@915850859 after retry RPC after error@1739042766) -> (continuation of Deferred@1075568479 after retry RPC after error@363422129) -> (continuation of Deferred@353130737 after retry RPC after error@1326406721) -> (continuation of Deferred@1374716888 after retry RPC after error@252368062) -> (continuation of Deferred@2025250430 after retry RPC after error@1307474045) -> (continuation of Deferred@408280155 after retry RPC after error@1092834507) -> (continuation of Deferred@254289855 after retry RPC after error@825985975) -> (continuation of Deferred@121253583 after retry RPC after error@1550100463) -> (continuation of Deferred@314537475 after retry RPC after error@2142511568) -> (continuation of Deferred@690894015 after retry RPC after error@1351394730) -> (continuation of Deferred@963301078 after retry RPC after error@1729020554) -> (continuation of Deferred@1063094552 after retry RPC after error@180996780) -> (continuation of Deferred@1698347357 after retry RPC after error@1949384162) -> (continuation of Deferred@662138677 after retry RPC after error@1664048605) -> (continuation of Deferred@1399840948 after retry RPC after error@776739094) -> (continuation of Deferred@853460269 after retry RPC after error@730248990) -> (continuation of Deferred@130058394 after retry RPC after error@1233827293) -> (continuation of Deferred@230286956 after retry RPC after error@320441986) -> (continuation of Deferred@270422051 after retry RPC after error@203832224), errback=(continuation of Deferred@1112179695 after retry RPC after error@101650297) -> (continuation of Deferred@843209329 after retry RPC after error@1597538296) -> (continuation of Deferred@1232853515 after retry RPC after error@930177178) -> (continuation of Deferred@398468567 after retry RPC after error@194731880) -> (continuation of Deferred@480733074 after retry RPC after error@544121132) -> (continuation of Deferred@915850859 after retry RPC after error@1739042766) -> (continuation of Deferred@1075568479 after retry RPC after error@363422129) -> (continuation of Deferred@353130737 after retry RPC after error@1326406721) -> (continuation of Deferred@1374716888 after retry RPC after error@252368062) -> (continuation of Deferred@2025250430 after retry RPC after error@1307474045) -> (continuation of Deferred@408280155 after retry RPC after error@1092834507) -> (continuation of Deferred@254289855 after retry RPC after error@825985975) -> (continuation of Deferred@121253583 after retry RPC after error@1550100463) -> (continuation of Deferred@314537475 after retry RPC after error@2142511568) -> (continuation of Deferred@690894015 after retry RPC after error@1351394730) -> (continuation of Deferred@963301078 after retry RPC after error@1729020554) -> (continuation of Deferred@1063094552 after retry RPC after error@180996780) -> (continuation of Deferred@1698347357 after retry RPC after error@1949384162) -> (continuation of Deferred@662138677 after retry RPC after error@1664048605) -> (continuation of Deferred@1399840948 after retry RPC after error@776739094) -> (continuation of Deferred@853460269 after retry RPC after error@730248990) -> (continuation of Deferred@130058394 after retry RPC after error@1233827293) -> (continuation of Deferred@230286956 after retry RPC after error@320441986) -> (continuation of Deferred@270422051 after retry RPC after error@203832224)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.24.230.253:39511
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:05:46.931 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduScanner.java:862) Scanner null closed on null
08:05:46.932 [ERROR - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:190) Received uncaught exception.
java.lang.RuntimeException: SplitFetcher thread 6 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=25, TimeoutTracker(timeout=29385, elapsed=28222), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [9ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [71ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: [peer master-127.24.230.253:39511(127.24.230.253:39511)] unexpected exception from downstream on [id: 0x1ac40f1c, L:/127.0.0.1:36038 - R:/127.24.230.253:39511], [123ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: [peer master-127.24.230.252:40255(127.24.230.252:40255)] unexpected exception from downstream on [id: 0xea1cc1c5, L:/127.0.0.1:53630 - R:/127.24.230.252:40255], [123ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: [peer master-127.24.230.253:39511(127.24.230.253:39511)] unexpected exception from downstream on [id: 0x1ac40f1c, L:/127.0.0.1:36038 - R:/127.24.230.253:39511],org.apache.kudu.client.RecoverableException: [peer master-127.24.230.252:40255(127.24.230.252:40255)] unexpected exception from downstream on [id: 0xea1cc1c5, L:/127.0.0.1:53630 - R:/127.24.230.252:40255], [138ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [141ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [142ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [143ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [144ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [162ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [162ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [162ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [162ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [178ms] refreshing cache from master, [178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [181ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [181ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [182ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [182ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [198ms] refreshing cache from master, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [200ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [201ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [201ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [201ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [238ms] refreshing cache from master, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [240ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [240ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [241ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [241ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [258ms] refreshing cache from master, [259ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [259ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [261ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [261ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [261ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [261ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [399ms] refreshing cache from master, [399ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [401ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [402ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [402ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [403ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [419ms] refreshing cache from master, [419ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [421ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [422ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [422ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [422ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [859ms] refreshing cache from master, [859ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [861ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [861ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [862ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [862ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1019ms] refreshing cache from master, [1019ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1021ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [2338ms] refreshing cache from master, [2338ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [2339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [2339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [2340ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [2340ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [2340ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [2341ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [5479ms] refreshing cache from master, [5479ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [5480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [5480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [5481ms] too many traces: truncated at 100 traces, deferred=Deferred@1777376501(state=PENDING, result=null, callback=(continuation of Deferred@1112179695 after retry RPC after error@101650297) -> (continuation of Deferred@843209329 after retry RPC after error@1597538296) -> (continuation of Deferred@1232853515 after retry RPC after error@930177178) -> (continuation of Deferred@398468567 after retry RPC after error@194731880) -> (continuation of Deferred@480733074 after retry RPC after error@544121132) -> (continuation of Deferred@915850859 after retry RPC after error@1739042766) -> (continuation of Deferred@1075568479 after retry RPC after error@363422129) -> (continuation of Deferred@353130737 after retry RPC after error@1326406721) -> (continuation of Deferred@1374716888 after retry RPC after error@252368062) -> (continuation of Deferred@2025250430 after retry RPC after error@1307474045) -> (continuation of Deferred@408280155 after retry RPC after error@1092834507) -> (continuation of Deferred@254289855 after retry RPC after error@825985975) -> (continuation of Deferred@121253583 after retry RPC after error@1550100463) -> (continuation of Deferred@314537475 after retry RPC after error@2142511568) -> (continuation of Deferred@690894015 after retry RPC after error@1351394730) -> (continuation of Deferred@963301078 after retry RPC after error@1729020554) -> (continuation of Deferred@1063094552 after retry RPC after error@180996780) -> (continuation of Deferred@1698347357 after retry RPC after error@1949384162) -> (continuation of Deferred@662138677 after retry RPC after error@1664048605) -> (continuation of Deferred@1399840948 after retry RPC after error@776739094) -> (continuation of Deferred@853460269 after retry RPC after error@730248990) -> (continuation of Deferred@130058394 after retry RPC after error@1233827293) -> (continuation of Deferred@230286956 after retry RPC after error@320441986) -> (continuation of Deferred@270422051 after retry RPC after error@203832224), errback=(continuation of Deferred@1112179695 after retry RPC after error@101650297) -> (continuation of Deferred@843209329 after retry RPC after error@1597538296) -> (continuation of Deferred@1232853515 after retry RPC after error@930177178) -> (continuation of Deferred@398468567 after retry RPC after error@194731880) -> (continuation of Deferred@480733074 after retry RPC after error@544121132) -> (continuation of Deferred@915850859 after retry RPC after error@1739042766) -> (continuation of Deferred@1075568479 after retry RPC after error@363422129) -> (continuation of Deferred@353130737 after retry RPC after error@1326406721) -> (continuation of Deferred@1374716888 after retry RPC after error@252368062) -> (continuation of Deferred@2025250430 after retry RPC after error@1307474045) -> (continuation of Deferred@408280155 after retry RPC after error@1092834507) -> (continuation of Deferred@254289855 after retry RPC after error@825985975) -> (continuation of Deferred@121253583 after retry RPC after error@1550100463) -> (continuation of Deferred@314537475 after retry RPC after error@2142511568) -> (continuation of Deferred@690894015 after retry RPC after error@1351394730) -> (continuation of Deferred@963301078 after retry RPC after error@1729020554) -> (continuation of Deferred@1063094552 after retry RPC after error@180996780) -> (continuation of Deferred@1698347357 after retry RPC after error@1949384162) -> (continuation of Deferred@662138677 after retry RPC after error@1664048605) -> (continuation of Deferred@1399840948 after retry RPC after error@776739094) -> (continuation of Deferred@853460269 after retry RPC after error@730248990) -> (continuation of Deferred@130058394 after retry RPC after error@1233827293) -> (continuation of Deferred@230286956 after retry RPC after error@320441986) -> (continuation of Deferred@270422051 after retry RPC after error@203832224)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.24.230.253:39511
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:05:46.939 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.25.158.189:46677(127.25.158.189:46677)] disconnecting while in state TERMINATED
08:05:46.939 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer c43299aa669648b7a17043222c5796c1(127.25.158.130:45041)] disconnecting while in state TERMINATED
08:05:46.939 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.25.158.190:44627(127.25.158.190:44627)] disconnecting while in state TERMINATED
08:05:46.939 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.25.158.188:41049(127.25.158.188:41049)] disconnecting while in state TERMINATED
08:05:46.940 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:46.941 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-1
08:05:46.941 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-3
08:05:46.942 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
08:05:46.943 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)] disconnecting while in state TERMINATED
08:05:46.944 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.24.230.254:40685(127.24.230.254:40685)] disconnecting while in state TERMINATED
08:05:46.944 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.24.230.252:40255(127.24.230.252:40255)] disconnecting while in state TERMINATED
08:05:46.944 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)] disconnecting while in state TERMINATED
08:05:46.944 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state TERMINATED
08:05:46.944 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.24.230.253:39511(127.24.230.253:39511)] disconnecting while in state TERMINATED
08:05:46.947 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:46.950 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:05:46.951 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 15 thread-local buffer(s) from thread: kudu-nio-4
08:05:46.951 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 6 exited.
08:05:46.951 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 4 thread-local buffer(s) from thread: kudu-nio-5
08:05:46.965 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-0
08:05:46.965 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
08:05:46.967 [WARN - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#0 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to FAILED with failure cause:
java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: SplitFetcher thread 6 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=25, TimeoutTracker(timeout=29385, elapsed=28222), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [9ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [71ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: [peer master-127.24.230.253:39511(127.24.230.253:39511)] unexpected exception from downstream on [id: 0x1ac40f1c, L:/127.0.0.1:36038 - R:/127.24.230.253:39511], [123ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: [peer master-127.24.230.252:40255(127.24.230.252:40255)] unexpected exception from downstream on [id: 0xea1cc1c5, L:/127.0.0.1:53630 - R:/127.24.230.252:40255], [123ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: [peer master-127.24.230.253:39511(127.24.230.253:39511)] unexpected exception from downstream on [id: 0x1ac40f1c, L:/127.0.0.1:36038 - R:/127.24.230.253:39511],org.apache.kudu.client.RecoverableException: [peer master-127.24.230.252:40255(127.24.230.252:40255)] unexpected exception from downstream on [id: 0xea1cc1c5, L:/127.0.0.1:53630 - R:/127.24.230.252:40255], [138ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [141ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [142ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [143ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [144ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [162ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [162ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [162ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [162ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [178ms] refreshing cache from master, [178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [181ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [181ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [182ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [182ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [198ms] refreshing cache from master, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [200ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [201ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [201ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [201ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [238ms] refreshing cache from master, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [240ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [240ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [241ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [241ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [258ms] refreshing cache from master, [259ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [259ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [261ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [261ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [261ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [261ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [399ms] refreshing cache from master, [399ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [401ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [402ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [402ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [403ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [419ms] refreshing cache from master, [419ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [421ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [422ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [422ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [422ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [859ms] refreshing cache from master, [859ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [861ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [861ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [862ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [862ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1019ms] refreshing cache from master, [1019ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1021ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [2338ms] refreshing cache from master, [2338ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [2339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [2339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [2340ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [2340ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [2340ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [2341ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [5479ms] refreshing cache from master, [5479ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [5480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [5480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [5481ms] too many traces: truncated at 100 traces, deferred=Deferred@1777376501(state=PENDING, result=null, callback=(continuation of Deferred@1112179695 after retry RPC after error@101650297) -> (continuation of Deferred@843209329 after retry RPC after error@1597538296) -> (continuation of Deferred@1232853515 after retry RPC after error@930177178) -> (continuation of Deferred@398468567 after retry RPC after error@194731880) -> (continuation of Deferred@480733074 after retry RPC after error@544121132) -> (continuation of Deferred@915850859 after retry RPC after error@1739042766) -> (continuation of Deferred@1075568479 after retry RPC after error@363422129) -> (continuation of Deferred@353130737 after retry RPC after error@1326406721) -> (continuation of Deferred@1374716888 after retry RPC after error@252368062) -> (continuation of Deferred@2025250430 after retry RPC after error@1307474045) -> (continuation of Deferred@408280155 after retry RPC after error@1092834507) -> (continuation of Deferred@254289855 after retry RPC after error@825985975) -> (continuation of Deferred@121253583 after retry RPC after error@1550100463) -> (continuation of Deferred@314537475 after retry RPC after error@2142511568) -> (continuation of Deferred@690894015 after retry RPC after error@1351394730) -> (continuation of Deferred@963301078 after retry RPC after error@1729020554) -> (continuation of Deferred@1063094552 after retry RPC after error@180996780) -> (continuation of Deferred@1698347357 after retry RPC after error@1949384162) -> (continuation of Deferred@662138677 after retry RPC after error@1664048605) -> (continuation of Deferred@1399840948 after retry RPC after error@776739094) -> (continuation of Deferred@853460269 after retry RPC after error@730248990) -> (continuation of Deferred@130058394 after retry RPC after error@1233827293) -> (continuation of Deferred@230286956 after retry RPC after error@320441986) -> (continuation of Deferred@270422051 after retry RPC after error@203832224), errback=(continuation of Deferred@1112179695 after retry RPC after error@101650297) -> (continuation of Deferred@843209329 after retry RPC after error@1597538296) -> (continuation of Deferred@1232853515 after retry RPC after error@930177178) -> (continuation of Deferred@398468567 after retry RPC after error@194731880) -> (continuation of Deferred@480733074 after retry RPC after error@544121132) -> (continuation of Deferred@915850859 after retry RPC after error@1739042766) -> (continuation of Deferred@1075568479 after retry RPC after error@363422129) -> (continuation of Deferred@353130737 after retry RPC after error@1326406721) -> (continuation of Deferred@1374716888 after retry RPC after error@252368062) -> (continuation of Deferred@2025250430 after retry RPC after error@1307474045) -> (continuation of Deferred@408280155 after retry RPC after error@1092834507) -> (continuation of Deferred@254289855 after retry RPC after error@825985975) -> (continuation of Deferred@121253583 after retry RPC after error@1550100463) -> (continuation of Deferred@314537475 after retry RPC after error@2142511568) -> (continuation of Deferred@690894015 after retry RPC after error@1351394730) -> (continuation of Deferred@963301078 after retry RPC after error@1729020554) -> (continuation of Deferred@1063094552 after retry RPC after error@180996780) -> (continuation of Deferred@1698347357 after retry RPC after error@1949384162) -> (continuation of Deferred@662138677 after retry RPC after error@1664048605) -> (continuation of Deferred@1399840948 after retry RPC after error@776739094) -> (continuation of Deferred@853460269 after retry RPC after error@730248990) -> (continuation of Deferred@130058394 after retry RPC after error@1233827293) -> (continuation of Deferred@230286956 after retry RPC after error@320441986) -> (continuation of Deferred@270422051 after retry RPC after error@203832224)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.24.230.253:39511
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:05:46.975 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
08:05:46.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:46.977960 28756 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:05:46.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:46.978902 28756 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:05:46.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:46.979892 28756 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:05:46.981 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
08:05:46.988 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to FAILED on 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: SplitFetcher thread 6 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=25, TimeoutTracker(timeout=29385, elapsed=28222), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [9ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [71ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: [peer master-127.24.230.253:39511(127.24.230.253:39511)] unexpected exception from downstream on [id: 0x1ac40f1c, L:/127.0.0.1:36038 - R:/127.24.230.253:39511], [123ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: [peer master-127.24.230.252:40255(127.24.230.252:40255)] unexpected exception from downstream on [id: 0xea1cc1c5, L:/127.0.0.1:53630 - R:/127.24.230.252:40255], [123ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: [peer master-127.24.230.253:39511(127.24.230.253:39511)] unexpected exception from downstream on [id: 0x1ac40f1c, L:/127.0.0.1:36038 - R:/127.24.230.253:39511],org.apache.kudu.client.RecoverableException: [peer master-127.24.230.252:40255(127.24.230.252:40255)] unexpected exception from downstream on [id: 0xea1cc1c5, L:/127.0.0.1:53630 - R:/127.24.230.252:40255], [138ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [141ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [142ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [143ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [144ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [162ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [162ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [162ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [162ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [178ms] refreshing cache from master, [178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [181ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [181ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [182ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [182ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [198ms] refreshing cache from master, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [200ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [201ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [201ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [201ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [238ms] refreshing cache from master, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [240ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [240ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [241ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [241ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [258ms] refreshing cache from master, [259ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [259ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [261ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [261ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [261ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [261ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [399ms] refreshing cache from master, [399ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [401ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [402ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [402ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [403ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [419ms] refreshing cache from master, [419ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [421ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [422ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [422ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [422ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [859ms] refreshing cache from master, [859ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [861ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [861ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [862ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [862ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1019ms] refreshing cache from master, [1019ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1021ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [2338ms] refreshing cache from master, [2338ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [2339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [2339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [2340ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [2340ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [2340ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [2341ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [5479ms] refreshing cache from master, [5479ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [5480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [5480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [5481ms] too many traces: truncated at 100 traces, deferred=Deferred@1777376501(state=PENDING, result=null, callback=(continuation of Deferred@1112179695 after retry RPC after error@101650297) -> (continuation of Deferred@843209329 after retry RPC after error@1597538296) -> (continuation of Deferred@1232853515 after retry RPC after error@930177178) -> (continuation of Deferred@398468567 after retry RPC after error@194731880) -> (continuation of Deferred@480733074 after retry RPC after error@544121132) -> (continuation of Deferred@915850859 after retry RPC after error@1739042766) -> (continuation of Deferred@1075568479 after retry RPC after error@363422129) -> (continuation of Deferred@353130737 after retry RPC after error@1326406721) -> (continuation of Deferred@1374716888 after retry RPC after error@252368062) -> (continuation of Deferred@2025250430 after retry RPC after error@1307474045) -> (continuation of Deferred@408280155 after retry RPC after error@1092834507) -> (continuation of Deferred@254289855 after retry RPC after error@825985975) -> (continuation of Deferred@121253583 after retry RPC after error@1550100463) -> (continuation of Deferred@314537475 after retry RPC after error@2142511568) -> (continuation of Deferred@690894015 after retry RPC after error@1351394730) -> (continuation of Deferred@963301078 after retry RPC after error@1729020554) -> (continuation of Deferred@1063094552 after retry RPC after error@180996780) -> (continuation of Deferred@1698347357 after retry RPC after error@1949384162) -> (continuation of Deferred@662138677 after retry RPC after error@1664048605) -> (continuation of Deferred@1399840948 after retry RPC after error@776739094) -> (continuation of Deferred@853460269 after retry RPC after error@730248990) -> (continuation of Deferred@130058394 after retry RPC after error@1233827293) -> (continuation of Deferred@230286956 after retry RPC after error@320441986) -> (continuation of Deferred@270422051 after retry RPC after error@203832224), errback=(continuation of Deferred@1112179695 after retry RPC after error@101650297) -> (continuation of Deferred@843209329 after retry RPC after error@1597538296) -> (continuation of Deferred@1232853515 after retry RPC after error@930177178) -> (continuation of Deferred@398468567 after retry RPC after error@194731880) -> (continuation of Deferred@480733074 after retry RPC after error@544121132) -> (continuation of Deferred@915850859 after retry RPC after error@1739042766) -> (continuation of Deferred@1075568479 after retry RPC after error@363422129) -> (continuation of Deferred@353130737 after retry RPC after error@1326406721) -> (continuation of Deferred@1374716888 after retry RPC after error@252368062) -> (continuation of Deferred@2025250430 after retry RPC after error@1307474045) -> (continuation of Deferred@408280155 after retry RPC after error@1092834507) -> (continuation of Deferred@254289855 after retry RPC after error@825985975) -> (continuation of Deferred@121253583 after retry RPC after error@1550100463) -> (continuation of Deferred@314537475 after retry RPC after error@2142511568) -> (continuation of Deferred@690894015 after retry RPC after error@1351394730) -> (continuation of Deferred@963301078 after retry RPC after error@1729020554) -> (continuation of Deferred@1063094552 after retry RPC after error@180996780) -> (continuation of Deferred@1698347357 after retry RPC after error@1949384162) -> (continuation of Deferred@662138677 after retry RPC after error@1664048605) -> (continuation of Deferred@1399840948 after retry RPC after error@776739094) -> (continuation of Deferred@853460269 after retry RPC after error@730248990) -> (continuation of Deferred@130058394 after retry RPC after error@1233827293) -> (continuation of Deferred@230286956 after retry RPC after error@320441986) -> (continuation of Deferred@270422051 after retry RPC after error@203832224)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.24.230.253:39511
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:05:46.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:46.991633 28752 catalog_manager.cc:1294] Loaded cluster ID: 28ae2492f6a84de49465d55f81cfa1d3
08:05:46.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:46.991943 28752 catalog_manager.cc:1587] T 00000000000000000000000000000000 P de9d55b59a074da2824778ee8b77553c: loading cluster ID for follower catalog manager: success
08:05:46.994 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:05:46.998 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
08:05:46.998 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
08:05:46.999 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (e26b904229418d0e047d5d94c5b9f905) switched from state RUNNING to RESTARTING.
08:05:47.001 [WARN - flink-pekko.actor.default-dispatcher-9] (TaskManagerLocation.java:276) No hostname could be resolved for the IP address 127.0.0.1, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted.
08:05:47.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:47.025431 28752 catalog_manager.cc:1609] T 00000000000000000000000000000000 P de9d55b59a074da2824778ee8b77553c: acquiring CA information for follower catalog manager: success
08:05:47.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:47.049772 28756 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:05:47.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:47.051234 28756 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.200.65
08:05:47.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:47.076596 28752 catalog_manager.cc:1637] T 00000000000000000000000000000000 P de9d55b59a074da2824778ee8b77553c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:47.146458 28756 tablet_server_runner.cc:78] Tablet server non-default flags:
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.200.84:44601
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-0/data
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-0/wal
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.200.65:0
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-0/data/info.pb
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.200.65
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.27.200.126:43511,127.27.200.125:46459,127.27.200.124:34439
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.27.200.65
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-0/logs
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:05:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:05:47.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:05:47.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:05:47.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:05:47.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:05:47.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:47.148983 28756 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:05:47.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:47.152204 28756 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:05:47.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:47.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:47.195611 28766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:47.331 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:47.332 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:47.332 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:47.332 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:47.332 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:47.333 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:47.333 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:47.333 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:47.333 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:47.333 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:47.333 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:47.334 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:47.334 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:47.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:47.711 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:47.711 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:47.711 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:47.712 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:47.712 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:47.712 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:47.713 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:47.713 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:47.713 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:47.714 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:47.714 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:47.714 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:47.714 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:47.715 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29194), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [13ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [18ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [24ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [24ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [89ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [91ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [92ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [96ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [106ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [106ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [107ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [108ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [108ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [123ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [123ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [141ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [143ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [184ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [185ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [186ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [186ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [263ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [264ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [265ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [265ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [282ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [283ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [283ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [283ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [302ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [303ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [304ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [304ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [602ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [602ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [603ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [603ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1060ms] refreshing cache from master, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1063ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1740ms] refreshing cache from master, [1740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1742ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1742ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1742ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1742ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2560ms] refreshing cache from master, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [2562ms] too many traces: truncated at 100 traces, deferred=Deferred@1635153708(state=PENDING, result=null, callback=(continuation of Deferred@473806545 after retry RPC after error@336006868) -> (continuation of Deferred@1929267040 after retry RPC after error@543396100) -> (continuation of Deferred@1360601319 after retry RPC after error@2101667262) -> (continuation of Deferred@2097248305 after retry RPC after error@1104555300) -> (continuation of Deferred@1506812897 after retry RPC after error@56841328) -> (continuation of Deferred@1976923357 after retry RPC after error@94033998) -> (continuation of Deferred@1569537079 after retry RPC after error@1154757410) -> (continuation of Deferred@452580601 after retry RPC after error@1232217920) -> (continuation of Deferred@2108348125 after retry RPC after error@402831209) -> (continuation of Deferred@1284040332 after retry RPC after error@345538682) -> (continuation of Deferred@1068474378 after retry RPC after error@849076585) -> (continuation of Deferred@959237424 after retry RPC after error@1768362303) -> (continuation of Deferred@730481641 after retry RPC after error@1182236504) -> (continuation of Deferred@434995179 after retry RPC after error@1213360896) -> (continuation of Deferred@834596072 after retry RPC after error@1288620088) -> (continuation of Deferred@1043264621 after retry RPC after error@1702855363) -> (continuation of Deferred@601942824 after retry RPC after error@425031780) -> (continuation of Deferred@1343322815 after retry RPC after error@1231127524) -> (continuation of Deferred@1836881995 after retry RPC after error@1608010712) -> (continuation of Deferred@80156190 after retry RPC after error@1107086273) -> (continuation of Deferred@1212923253 after retry RPC after error@1439742255) -> (continuation of Deferred@1771774573 after retry RPC after error@1318997596) -> (continuation of Deferred@1529602799 after retry RPC after error@199369060) -> (continuation of Deferred@1004200511 after retry RPC after error@118142902) -> (continuation of Deferred@61997346 after retry RPC after error@423749937), errback=(continuation of Deferred@473806545 after retry RPC after error@336006868) -> (continuation of Deferred@1929267040 after retry RPC after error@543396100) -> (continuation of Deferred@1360601319 after retry RPC after error@2101667262) -> (continuation of Deferred@2097248305 after retry RPC after error@1104555300) -> (continuation of Deferred@1506812897 after retry RPC after error@56841328) -> (continuation of Deferred@1976923357 after retry RPC after error@94033998) -> (continuation of Deferred@1569537079 after retry RPC after error@1154757410) -> (continuation of Deferred@452580601 after retry RPC after error@1232217920) -> (continuation of Deferred@2108348125 after retry RPC after error@402831209) -> (continuation of Deferred@1284040332 after retry RPC after error@345538682) -> (continuation of Deferred@1068474378 after retry RPC after error@849076585) -> (continuation of Deferred@959237424 after retry RPC after error@1768362303) -> (continuation of Deferred@730481641 after retry RPC after error@1182236504) -> (continuation of Deferred@434995179 after retry RPC after error@1213360896) -> (continuation of Deferred@834596072 after retry RPC after error@1288620088) -> (continuation of Deferred@1043264621 after retry RPC after error@1702855363) -> (continuation of Deferred@601942824 after retry RPC after error@425031780) -> (continuation of Deferred@1343322815 after retry RPC after error@1231127524) -> (continuation of Deferred@1836881995 after retry RPC after error@1608010712) -> (continuation of Deferred@80156190 after retry RPC after error@1107086273) -> (continuation of Deferred@1212923253 after retry RPC after error@1439742255) -> (continuation of Deferred@1771774573 after retry RPC after error@1318997596) -> (continuation of Deferred@1529602799 after retry RPC after error@199369060) -> (continuation of Deferred@1004200511 after retry RPC after error@118142902) -> (continuation of Deferred@61997346 after retry RPC after error@423749937)))
08:05:47.722 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
08:05:47.722 [WARN - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#2 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29194), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [13ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [18ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [24ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [24ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [89ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [91ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [92ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [96ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [106ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [106ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [107ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [108ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [108ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [123ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [123ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [141ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [143ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [184ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [185ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [186ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [186ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [263ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [264ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [265ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [265ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [282ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [283ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [283ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [283ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [302ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [303ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [304ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [304ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [602ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [602ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [603ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [603ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1060ms] refreshing cache from master, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1063ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1740ms] refreshing cache from master, [1740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1742ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1742ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1742ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1742ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2560ms] refreshing cache from master, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [2562ms] too many traces: truncated at 100 traces, deferred=Deferred@1635153708(state=PENDING, result=null, callback=(continuation of Deferred@473806545 after retry RPC after error@336006868) -> (continuation of Deferred@1929267040 after retry RPC after error@543396100) -> (continuation of Deferred@1360601319 after retry RPC after error@2101667262) -> (continuation of Deferred@2097248305 after retry RPC after error@1104555300) -> (continuation of Deferred@1506812897 after retry RPC after error@56841328) -> (continuation of Deferred@1976923357 after retry RPC after error@94033998) -> (continuation of Deferred@1569537079 after retry RPC after error@1154757410) -> (continuation of Deferred@452580601 after retry RPC after error@1232217920) -> (continuation of Deferred@2108348125 after retry RPC after error@402831209) -> (continuation of Deferred@1284040332 after retry RPC after error@345538682) -> (continuation of Deferred@1068474378 after retry RPC after error@849076585) -> (continuation of Deferred@959237424 after retry RPC after error@1768362303) -> (continuation of Deferred@730481641 after retry RPC after error@1182236504) -> (continuation of Deferred@434995179 after retry RPC after error@1213360896) -> (continuation of Deferred@834596072 after retry RPC after error@1288620088) -> (continuation of Deferred@1043264621 after retry RPC after error@1702855363) -> (continuation of Deferred@601942824 after retry RPC after error@425031780) -> (continuation of Deferred@1343322815 after retry RPC after error@1231127524) -> (continuation of Deferred@1836881995 after retry RPC after error@1608010712) -> (continuation of Deferred@80156190 after retry RPC after error@1107086273) -> (continuation of Deferred@1212923253 after retry RPC after error@1439742255) -> (continuation of Deferred@1771774573 after retry RPC after error@1318997596) -> (continuation of Deferred@1529602799 after retry RPC after error@199369060) -> (continuation of Deferred@1004200511 after retry RPC after error@118142902) -> (continuation of Deferred@61997346 after retry RPC after error@423749937), errback=(continuation of Deferred@473806545 after retry RPC after error@336006868) -> (continuation of Deferred@1929267040 after retry RPC after error@543396100) -> (continuation of Deferred@1360601319 after retry RPC after error@2101667262) -> (continuation of Deferred@2097248305 after retry RPC after error@1104555300) -> (continuation of Deferred@1506812897 after retry RPC after error@56841328) -> (continuation of Deferred@1976923357 after retry RPC after error@94033998) -> (continuation of Deferred@1569537079 after retry RPC after error@1154757410) -> (continuation of Deferred@452580601 after retry RPC after error@1232217920) -> (continuation of Deferred@2108348125 after retry RPC after error@402831209) -> (continuation of Deferred@1284040332 after retry RPC after error@345538682) -> (continuation of Deferred@1068474378 after retry RPC after error@849076585) -> (continuation of Deferred@959237424 after retry RPC after error@1768362303) -> (continuation of Deferred@730481641 after retry RPC after error@1182236504) -> (continuation of Deferred@434995179 after retry RPC after error@1213360896) -> (continuation of Deferred@834596072 after retry RPC after error@1288620088) -> (continuation of Deferred@1043264621 after retry RPC after error@1702855363) -> (continuation of Deferred@601942824 after retry RPC after error@425031780) -> (continuation of Deferred@1343322815 after retry RPC after error@1231127524) -> (continuation of Deferred@1836881995 after retry RPC after error@1608010712) -> (continuation of Deferred@80156190 after retry RPC after error@1107086273) -> (continuation of Deferred@1212923253 after retry RPC after error@1439742255) -> (continuation of Deferred@1771774573 after retry RPC after error@1318997596) -> (continuation of Deferred@1529602799 after retry RPC after error@199369060) -> (continuation of Deferred@1004200511 after retry RPC after error@118142902) -> (continuation of Deferred@61997346 after retry RPC after error@423749937)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:05:47.729 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#2 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
08:05:47.731 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#2 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_2.
08:05:47.734 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to FAILED on 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29194), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [13ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [18ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [24ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [24ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [89ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [91ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [92ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [96ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [106ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [106ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [107ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [108ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [108ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [123ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [123ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [141ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [143ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [184ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [185ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [186ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [186ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [263ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [264ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [265ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [265ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [282ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [283ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [283ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [283ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [302ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [303ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [304ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [304ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [602ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [602ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [603ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [603ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1060ms] refreshing cache from master, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1063ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1740ms] refreshing cache from master, [1740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1742ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1742ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1742ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1742ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2560ms] refreshing cache from master, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [2562ms] too many traces: truncated at 100 traces, deferred=Deferred@1635153708(state=PENDING, result=null, callback=(continuation of Deferred@473806545 after retry RPC after error@336006868) -> (continuation of Deferred@1929267040 after retry RPC after error@543396100) -> (continuation of Deferred@1360601319 after retry RPC after error@2101667262) -> (continuation of Deferred@2097248305 after retry RPC after error@1104555300) -> (continuation of Deferred@1506812897 after retry RPC after error@56841328) -> (continuation of Deferred@1976923357 after retry RPC after error@94033998) -> (continuation of Deferred@1569537079 after retry RPC after error@1154757410) -> (continuation of Deferred@452580601 after retry RPC after error@1232217920) -> (continuation of Deferred@2108348125 after retry RPC after error@402831209) -> (continuation of Deferred@1284040332 after retry RPC after error@345538682) -> (continuation of Deferred@1068474378 after retry RPC after error@849076585) -> (continuation of Deferred@959237424 after retry RPC after error@1768362303) -> (continuation of Deferred@730481641 after retry RPC after error@1182236504) -> (continuation of Deferred@434995179 after retry RPC after error@1213360896) -> (continuation of Deferred@834596072 after retry RPC after error@1288620088) -> (continuation of Deferred@1043264621 after retry RPC after error@1702855363) -> (continuation of Deferred@601942824 after retry RPC after error@425031780) -> (continuation of Deferred@1343322815 after retry RPC after error@1231127524) -> (continuation of Deferred@1836881995 after retry RPC after error@1608010712) -> (continuation of Deferred@80156190 after retry RPC after error@1107086273) -> (continuation of Deferred@1212923253 after retry RPC after error@1439742255) -> (continuation of Deferred@1771774573 after retry RPC after error@1318997596) -> (continuation of Deferred@1529602799 after retry RPC after error@199369060) -> (continuation of Deferred@1004200511 after retry RPC after error@118142902) -> (continuation of Deferred@61997346 after retry RPC after error@423749937), errback=(continuation of Deferred@473806545 after retry RPC after error@336006868) -> (continuation of Deferred@1929267040 after retry RPC after error@543396100) -> (continuation of Deferred@1360601319 after retry RPC after error@2101667262) -> (continuation of Deferred@2097248305 after retry RPC after error@1104555300) -> (continuation of Deferred@1506812897 after retry RPC after error@56841328) -> (continuation of Deferred@1976923357 after retry RPC after error@94033998) -> (continuation of Deferred@1569537079 after retry RPC after error@1154757410) -> (continuation of Deferred@452580601 after retry RPC after error@1232217920) -> (continuation of Deferred@2108348125 after retry RPC after error@402831209) -> (continuation of Deferred@1284040332 after retry RPC after error@345538682) -> (continuation of Deferred@1068474378 after retry RPC after error@849076585) -> (continuation of Deferred@959237424 after retry RPC after error@1768362303) -> (continuation of Deferred@730481641 after retry RPC after error@1182236504) -> (continuation of Deferred@434995179 after retry RPC after error@1213360896) -> (continuation of Deferred@834596072 after retry RPC after error@1288620088) -> (continuation of Deferred@1043264621 after retry RPC after error@1702855363) -> (continuation of Deferred@601942824 after retry RPC after error@425031780) -> (continuation of Deferred@1343322815 after retry RPC after error@1231127524) -> (continuation of Deferred@1836881995 after retry RPC after error@1608010712) -> (continuation of Deferred@80156190 after retry RPC after error@1107086273) -> (continuation of Deferred@1212923253 after retry RPC after error@1439742255) -> (continuation of Deferred@1771774573 after retry RPC after error@1318997596) -> (continuation of Deferred@1529602799 after retry RPC after error@199369060) -> (continuation of Deferred@1004200511 after retry RPC after error@118142902) -> (continuation of Deferred@61997346 after retry RPC after error@423749937)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:05:47.739 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:05:47.740 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#2) of source Source: KuduSource.
08:05:47.740 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_2.
08:05:47.741 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (b42812d69c586178cf7556c3c92998f3) switched from state RUNNING to RESTARTING.
08:05:47.803 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.254:40685(127.24.230.254:40685)] connecting to peer
08:05:47.803 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.252:40255(127.24.230.252:40255)] connecting to peer
08:05:47.804 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.24.230.253:39511(127.24.230.253:39511)] connecting to peer
08:05:47.804 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:47.804 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:47.804 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.24.230.254:40685(127.24.230.254:40685)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:47.804 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.24.230.252:40255(127.24.230.252:40255)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:47.804 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.254:40685: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685
08:05:47.804 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.252:40255: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255
08:05:47.805 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:47.805 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.24.230.253:39511(127.24.230.253:39511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:47.805 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.24.230.253:39511: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
08:05:47.805 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511; will retry
08:05:47.807 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=21, TimeoutTracker(timeout=29486, elapsed=28982), Traces: [0ms] sending RPC to server master-127.24.230.252:40255, [0ms] received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [0ms] delaying RPC due to: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [19ms] refreshing cache from master, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [20ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [21ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [22ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [22ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [39ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [41ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [41ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [41ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [42ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [62ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [65ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [68ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [69ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [79ms] refreshing cache from master, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [82ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [83ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [85ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [85ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [122ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [123ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [127ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [127ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [183ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [187ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [187ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [189ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [189ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [299ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [301ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [302ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [303ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [303ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [561ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [562ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [563ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [564ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1080ms] refreshing cache from master, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1083ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1939ms] refreshing cache from master, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1942ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [3620ms] refreshing cache from master, [3620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [3622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [3623ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [3625ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [3626ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [3626ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [6939ms] refreshing cache from master, [6939ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [6940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [6941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [6941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [6941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [6941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [6942ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [9500ms] refreshing cache from master, [9500ms] too many traces: truncated at 100 traces, deferred=Deferred@530712973(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@204897986 after retry RPC after error@178948207) -> (continuation of Deferred@1616981107 after retry RPC after error@1870704531) -> (continuation of Deferred@1358892239 after retry RPC after error@239603535) -> (continuation of Deferred@1730390081 after retry RPC after error@229998337) -> (continuation of Deferred@621052684 after retry RPC after error@1811468948) -> (continuation of Deferred@291708426 after retry RPC after error@923285072) -> (continuation of Deferred@915791710 after retry RPC after error@458540906) -> (continuation of Deferred@307104068 after retry RPC after error@1677854699) -> (continuation of Deferred@2096454426 after retry RPC after error@1101507705) -> (continuation of Deferred@599886112 after retry RPC after error@1460203500) -> (continuation of Deferred@32723868 after retry RPC after error@2102129599) -> (continuation of Deferred@1391263167 after retry RPC after error@1108021121) -> (continuation of Deferred@1509936111 after retry RPC after error@2064325988) -> (continuation of Deferred@1312757439 after retry RPC after error@1423077374) -> (continuation of Deferred@1943365176 after retry RPC after error@1343665435) -> (continuation of Deferred@1714084680 after retry RPC after error@566293996) -> (continuation of Deferred@2046600010 after retry RPC after error@480739075) -> (continuation of Deferred@753338180 after retry RPC after error@170850465) -> (continuation of Deferred@374668381 after retry RPC after error@833406707), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@204897986 after retry RPC after error@178948207) -> (continuation of Deferred@1616981107 after retry RPC after error@1870704531) -> (continuation of Deferred@1358892239 after retry RPC after error@239603535) -> (continuation of Deferred@1730390081 after retry RPC after error@229998337) -> (continuation of Deferred@621052684 after retry RPC after error@1811468948) -> (continuation of Deferred@291708426 after retry RPC after error@923285072) -> (continuation of Deferred@915791710 after retry RPC after error@458540906) -> (continuation of Deferred@307104068 after retry RPC after error@1677854699) -> (continuation of Deferred@2096454426 after retry RPC after error@1101507705) -> (continuation of Deferred@599886112 after retry RPC after error@1460203500) -> (continuation of Deferred@32723868 after retry RPC after error@2102129599) -> (continuation of Deferred@1391263167 after retry RPC after error@1108021121) -> (continuation of Deferred@1509936111 after retry RPC after error@2064325988) -> (continuation of Deferred@1312757439 after retry RPC after error@1423077374) -> (continuation of Deferred@1943365176 after retry RPC after error@1343665435) -> (continuation of Deferred@1714084680 after retry RPC after error@566293996) -> (continuation of Deferred@2046600010 after retry RPC after error@480739075) -> (continuation of Deferred@753338180 after retry RPC after error@170850465) -> (continuation of Deferred@374668381 after retry RPC after error@833406707)))
08:05:47.811 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1523) Notify RPC ScanRequest(scannerId=null, state=OPENING, tablet=4be0df9f650f41e59a6c52d0160ab38d, attempt=8, KuduRpc(method=Scan, tablet=4be0df9f650f41e59a6c52d0160ab38d, attempt=8, TimeoutTracker(timeout=30000, elapsed=29502), Traces: [0ms] sending RPC to server 9bda994622fa49ac9fabfbf40edba4ff, [190ms] received response from server 9bda994622fa49ac9fabfbf40edba4ff: Network error: [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] unexpected exception from downstream on [id: 0xe312c579, L:/127.0.0.1:34068 - R:/127.24.230.195:45755], [190ms] delaying RPC due to: Network error: [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] unexpected exception from downstream on [id: 0xe312c579, L:/127.0.0.1:34068 - R:/127.24.230.195:45755], [202ms] sending RPC to server 37d338f6c5db4cc4bace5615d0b1421a, [209ms] received response from server 37d338f6c5db4cc4bace5615d0b1421a: Network error: Failed to connect to peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057): Connection refused: /127.24.230.194:36057, [209ms] delaying RPC due to: Network error: Failed to connect to peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057): Connection refused: /127.24.230.194:36057, [221ms] sending RPC to server 97ad2967f56a4511a42f5f0981fb24d5, [223ms] received response from server 97ad2967f56a4511a42f5f0981fb24d5: Network error: Failed to connect to peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195): Connection refused: /127.24.230.193:33195, [224ms] delaying RPC due to: Network error: Failed to connect to peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195): Connection refused: /127.24.230.193:33195, [240ms] refreshing cache from master, [240ms] Sub RPC GetTableLocations: refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [259ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: [peer master-127.24.230.254:40685(127.24.230.254:40685)] unexpected exception from downstream on [id: 0x4878b077, L:/127.0.0.1:37506 - R:/127.24.230.254:40685], [298ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: OK, [299ms] Sub RPC GetTableLocations: sending RPC to server master-127.24.230.252:40255, [305ms] Sub RPC GetTableLocations: received response from server master-127.24.230.252:40255: OK, [306ms] sending RPC to server 9bda994622fa49ac9fabfbf40edba4ff, [320ms] received response from server 9bda994622fa49ac9fabfbf40edba4ff: Network error: Failed to connect to peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755): Connection refused: /127.24.230.195:45755, [320ms] delaying RPC due to: Network error: Failed to connect to peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755): Connection refused: /127.24.230.195:45755, [340ms] sending RPC to server 37d338f6c5db4cc4bace5615d0b1421a, [343ms] received response from server 37d338f6c5db4cc4bace5615d0b1421a: Network error: Failed to connect to peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057): Connection refused: /127.24.230.194:36057, [343ms] delaying RPC due to: Network error: Failed to connect to peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057): Connection refused: /127.24.230.194:36057, [360ms] sending RPC to server 97ad2967f56a4511a42f5f0981fb24d5, [362ms] received response from server 97ad2967f56a4511a42f5f0981fb24d5: Network error: Failed to connect to peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195): Connection refused: /127.24.230.193:33195, [362ms] delaying RPC due to: Network error: Failed to connect to peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195): Connection refused: /127.24.230.193:33195, [400ms] refreshing cache from master, [401ms] Sub RPC GetTableLocations: sending RPC to server master-127.24.230.252:40255, [401ms] Sub RPC GetTableLocations: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [401ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [420ms] Sub RPC GetTableLocations: refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [421ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [422ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [423ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [423ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [440ms] Sub RPC GetTableLocations: refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [442ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [442ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [442ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [443ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [461ms] Sub RPC GetTableLocations: refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [463ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [466ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [469ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [470ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [480ms] Sub RPC GetTableLocations: refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [483ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [484ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [485ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [486ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [486ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [521ms] Sub RPC GetTableLocations: refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [523ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [524ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [528ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [528ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [581ms] Sub RPC GetTableLocations: refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [584ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [585ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [588ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [588ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [590ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [590ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [700ms] Sub RPC GetTableLocations: refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [702ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [703ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [704ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [704ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [961ms] Sub RPC GetTableLocations: refreshing cache from master, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [962ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [963ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [964ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [965ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1481ms] Sub RPC GetTableLocations: refreshing cache from master, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [1482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [1482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [1483ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [1483ms] too many traces: truncated at 100 traces, deferred=Deferred@317532512(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0 -> (continuation of Deferred@627387045 after retry RPC@1483941208), errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0 -> (continuation of Deferred@627387045 after retry RPC@1483941208)))) after lookup exception
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=21, TimeoutTracker(timeout=29486, elapsed=28982), Traces: [0ms] sending RPC to server master-127.24.230.252:40255, [0ms] received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [0ms] delaying RPC due to: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [19ms] refreshing cache from master, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [20ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [21ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [22ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [22ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [39ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [41ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [41ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [41ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [42ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [62ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [65ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [68ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [69ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [79ms] refreshing cache from master, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [82ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [83ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [85ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [85ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [122ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [123ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [127ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [127ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [183ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [187ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [187ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [189ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [189ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [299ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [301ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [302ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [303ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [303ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [561ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [562ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [563ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [564ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1080ms] refreshing cache from master, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1083ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1939ms] refreshing cache from master, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1942ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [3620ms] refreshing cache from master, [3620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [3622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [3623ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [3625ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [3626ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [3626ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [6939ms] refreshing cache from master, [6939ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [6940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [6941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [6941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [6941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [6941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [6942ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [9500ms] refreshing cache from master, [9500ms] too many traces: truncated at 100 traces, deferred=Deferred@530712973(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@204897986 after retry RPC after error@178948207) -> (continuation of Deferred@1616981107 after retry RPC after error@1870704531) -> (continuation of Deferred@1358892239 after retry RPC after error@239603535) -> (continuation of Deferred@1730390081 after retry RPC after error@229998337) -> (continuation of Deferred@621052684 after retry RPC after error@1811468948) -> (continuation of Deferred@291708426 after retry RPC after error@923285072) -> (continuation of Deferred@915791710 after retry RPC after error@458540906) -> (continuation of Deferred@307104068 after retry RPC after error@1677854699) -> (continuation of Deferred@2096454426 after retry RPC after error@1101507705) -> (continuation of Deferred@599886112 after retry RPC after error@1460203500) -> (continuation of Deferred@32723868 after retry RPC after error@2102129599) -> (continuation of Deferred@1391263167 after retry RPC after error@1108021121) -> (continuation of Deferred@1509936111 after retry RPC after error@2064325988) -> (continuation of Deferred@1312757439 after retry RPC after error@1423077374) -> (continuation of Deferred@1943365176 after retry RPC after error@1343665435) -> (continuation of Deferred@1714084680 after retry RPC after error@566293996) -> (continuation of Deferred@2046600010 after retry RPC after error@480739075) -> (continuation of Deferred@753338180 after retry RPC after error@170850465) -> (continuation of Deferred@374668381 after retry RPC after error@833406707), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@204897986 after retry RPC after error@178948207) -> (continuation of Deferred@1616981107 after retry RPC after error@1870704531) -> (continuation of Deferred@1358892239 after retry RPC after error@239603535) -> (continuation of Deferred@1730390081 after retry RPC after error@229998337) -> (continuation of Deferred@621052684 after retry RPC after error@1811468948) -> (continuation of Deferred@291708426 after retry RPC after error@923285072) -> (continuation of Deferred@915791710 after retry RPC after error@458540906) -> (continuation of Deferred@307104068 after retry RPC after error@1677854699) -> (continuation of Deferred@2096454426 after retry RPC after error@1101507705) -> (continuation of Deferred@599886112 after retry RPC after error@1460203500) -> (continuation of Deferred@32723868 after retry RPC after error@2102129599) -> (continuation of Deferred@1391263167 after retry RPC after error@1108021121) -> (continuation of Deferred@1509936111 after retry RPC after error@2064325988) -> (continuation of Deferred@1312757439 after retry RPC after error@1423077374) -> (continuation of Deferred@1943365176 after retry RPC after error@1343665435) -> (continuation of Deferred@1714084680 after retry RPC after error@566293996) -> (continuation of Deferred@2046600010 after retry RPC after error@480739075) -> (continuation of Deferred@753338180 after retry RPC after error@170850465) -> (continuation of Deferred@374668381 after retry RPC after error@833406707)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.24.230.253:39511
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:05:47.815 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:686) Can not open scanner
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=21, TimeoutTracker(timeout=29486, elapsed=28982), Traces: [0ms] sending RPC to server master-127.24.230.252:40255, [0ms] received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [0ms] delaying RPC due to: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [19ms] refreshing cache from master, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [20ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [21ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [22ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [22ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [39ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [41ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [41ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [41ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [42ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [62ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [65ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [68ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [69ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [79ms] refreshing cache from master, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [82ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [83ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [85ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [85ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [122ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [123ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [127ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [127ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [183ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [187ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [187ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [189ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [189ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [299ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [301ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [302ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [303ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [303ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [561ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [562ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [563ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [564ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1080ms] refreshing cache from master, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1083ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1939ms] refreshing cache from master, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1942ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [3620ms] refreshing cache from master, [3620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [3622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [3623ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [3625ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [3626ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [3626ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [6939ms] refreshing cache from master, [6939ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [6940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [6941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [6941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [6941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [6941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [6942ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [9500ms] refreshing cache from master, [9500ms] too many traces: truncated at 100 traces, deferred=Deferred@530712973(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@204897986 after retry RPC after error@178948207) -> (continuation of Deferred@1616981107 after retry RPC after error@1870704531) -> (continuation of Deferred@1358892239 after retry RPC after error@239603535) -> (continuation of Deferred@1730390081 after retry RPC after error@229998337) -> (continuation of Deferred@621052684 after retry RPC after error@1811468948) -> (continuation of Deferred@291708426 after retry RPC after error@923285072) -> (continuation of Deferred@915791710 after retry RPC after error@458540906) -> (continuation of Deferred@307104068 after retry RPC after error@1677854699) -> (continuation of Deferred@2096454426 after retry RPC after error@1101507705) -> (continuation of Deferred@599886112 after retry RPC after error@1460203500) -> (continuation of Deferred@32723868 after retry RPC after error@2102129599) -> (continuation of Deferred@1391263167 after retry RPC after error@1108021121) -> (continuation of Deferred@1509936111 after retry RPC after error@2064325988) -> (continuation of Deferred@1312757439 after retry RPC after error@1423077374) -> (continuation of Deferred@1943365176 after retry RPC after error@1343665435) -> (continuation of Deferred@1714084680 after retry RPC after error@566293996) -> (continuation of Deferred@2046600010 after retry RPC after error@480739075) -> (continuation of Deferred@753338180 after retry RPC after error@170850465) -> (continuation of Deferred@374668381 after retry RPC after error@833406707), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@204897986 after retry RPC after error@178948207) -> (continuation of Deferred@1616981107 after retry RPC after error@1870704531) -> (continuation of Deferred@1358892239 after retry RPC after error@239603535) -> (continuation of Deferred@1730390081 after retry RPC after error@229998337) -> (continuation of Deferred@621052684 after retry RPC after error@1811468948) -> (continuation of Deferred@291708426 after retry RPC after error@923285072) -> (continuation of Deferred@915791710 after retry RPC after error@458540906) -> (continuation of Deferred@307104068 after retry RPC after error@1677854699) -> (continuation of Deferred@2096454426 after retry RPC after error@1101507705) -> (continuation of Deferred@599886112 after retry RPC after error@1460203500) -> (continuation of Deferred@32723868 after retry RPC after error@2102129599) -> (continuation of Deferred@1391263167 after retry RPC after error@1108021121) -> (continuation of Deferred@1509936111 after retry RPC after error@2064325988) -> (continuation of Deferred@1312757439 after retry RPC after error@1423077374) -> (continuation of Deferred@1943365176 after retry RPC after error@1343665435) -> (continuation of Deferred@1714084680 after retry RPC after error@566293996) -> (continuation of Deferred@2046600010 after retry RPC after error@480739075) -> (continuation of Deferred@753338180 after retry RPC after error@170850465) -> (continuation of Deferred@374668381 after retry RPC after error@833406707)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.24.230.253:39511
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:05:47.823 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduScanner.java:862) Scanner null closed on null
08:05:47.823 [ERROR - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:190) Received uncaught exception.
java.lang.RuntimeException: SplitFetcher thread 7 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=21, TimeoutTracker(timeout=29486, elapsed=28982), Traces: [0ms] sending RPC to server master-127.24.230.252:40255, [0ms] received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [0ms] delaying RPC due to: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [19ms] refreshing cache from master, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [20ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [21ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [22ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [22ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [39ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [41ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [41ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [41ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [42ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [62ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [65ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [68ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [69ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [79ms] refreshing cache from master, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [82ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [83ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [85ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [85ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [122ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [123ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [127ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [127ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [183ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [187ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [187ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [189ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [189ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [299ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [301ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [302ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [303ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [303ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [561ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [562ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [563ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [564ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1080ms] refreshing cache from master, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1083ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1939ms] refreshing cache from master, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1942ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [3620ms] refreshing cache from master, [3620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [3622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [3623ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [3625ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [3626ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [3626ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [6939ms] refreshing cache from master, [6939ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [6940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [6941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [6941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [6941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [6941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [6942ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [9500ms] refreshing cache from master, [9500ms] too many traces: truncated at 100 traces, deferred=Deferred@530712973(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@204897986 after retry RPC after error@178948207) -> (continuation of Deferred@1616981107 after retry RPC after error@1870704531) -> (continuation of Deferred@1358892239 after retry RPC after error@239603535) -> (continuation of Deferred@1730390081 after retry RPC after error@229998337) -> (continuation of Deferred@621052684 after retry RPC after error@1811468948) -> (continuation of Deferred@291708426 after retry RPC after error@923285072) -> (continuation of Deferred@915791710 after retry RPC after error@458540906) -> (continuation of Deferred@307104068 after retry RPC after error@1677854699) -> (continuation of Deferred@2096454426 after retry RPC after error@1101507705) -> (continuation of Deferred@599886112 after retry RPC after error@1460203500) -> (continuation of Deferred@32723868 after retry RPC after error@2102129599) -> (continuation of Deferred@1391263167 after retry RPC after error@1108021121) -> (continuation of Deferred@1509936111 after retry RPC after error@2064325988) -> (continuation of Deferred@1312757439 after retry RPC after error@1423077374) -> (continuation of Deferred@1943365176 after retry RPC after error@1343665435) -> (continuation of Deferred@1714084680 after retry RPC after error@566293996) -> (continuation of Deferred@2046600010 after retry RPC after error@480739075) -> (continuation of Deferred@753338180 after retry RPC after error@170850465) -> (continuation of Deferred@374668381 after retry RPC after error@833406707), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@204897986 after retry RPC after error@178948207) -> (continuation of Deferred@1616981107 after retry RPC after error@1870704531) -> (continuation of Deferred@1358892239 after retry RPC after error@239603535) -> (continuation of Deferred@1730390081 after retry RPC after error@229998337) -> (continuation of Deferred@621052684 after retry RPC after error@1811468948) -> (continuation of Deferred@291708426 after retry RPC after error@923285072) -> (continuation of Deferred@915791710 after retry RPC after error@458540906) -> (continuation of Deferred@307104068 after retry RPC after error@1677854699) -> (continuation of Deferred@2096454426 after retry RPC after error@1101507705) -> (continuation of Deferred@599886112 after retry RPC after error@1460203500) -> (continuation of Deferred@32723868 after retry RPC after error@2102129599) -> (continuation of Deferred@1391263167 after retry RPC after error@1108021121) -> (continuation of Deferred@1509936111 after retry RPC after error@2064325988) -> (continuation of Deferred@1312757439 after retry RPC after error@1423077374) -> (continuation of Deferred@1943365176 after retry RPC after error@1343665435) -> (continuation of Deferred@1714084680 after retry RPC after error@566293996) -> (continuation of Deferred@2046600010 after retry RPC after error@480739075) -> (continuation of Deferred@753338180 after retry RPC after error@170850465) -> (continuation of Deferred@374668381 after retry RPC after error@833406707)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.24.230.253:39511
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:05:47.831 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 9ae9aa4067a84876910d8ee905ea9e80(127.25.158.131:36181)] disconnecting while in state TERMINATED
08:05:47.831 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.25.158.189:46677(127.25.158.189:46677)] disconnecting while in state TERMINATED
08:05:47.831 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.25.158.190:44627(127.25.158.190:44627)] disconnecting while in state TERMINATED
08:05:47.831 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.25.158.188:41049(127.25.158.188:41049)] disconnecting while in state TERMINATED
08:05:47.831 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:47.833 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
08:05:47.833 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
08:05:47.834 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-3
08:05:47.836 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 37d338f6c5db4cc4bace5615d0b1421a(127.24.230.194:36057)] disconnecting while in state TERMINATED
08:05:47.836 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.24.230.254:40685(127.24.230.254:40685)] disconnecting while in state TERMINATED
08:05:47.836 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.24.230.252:40255(127.24.230.252:40255)] disconnecting while in state TERMINATED
08:05:47.836 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 97ad2967f56a4511a42f5f0981fb24d5(127.24.230.193:33195)] disconnecting while in state TERMINATED
08:05:47.836 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 9bda994622fa49ac9fabfbf40edba4ff(127.24.230.195:45755)] disconnecting while in state TERMINATED
08:05:47.837 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.24.230.253:39511(127.24.230.253:39511)] disconnecting while in state TERMINATED
08:05:47.837 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:47.838 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-4
08:05:47.838 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 4 thread-local buffer(s) from thread: kudu-nio-3
08:05:47.838 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 7 exited.
08:05:47.847 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
08:05:47.847 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
08:05:47.848 [WARN - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#0 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to FAILED with failure cause:
java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: SplitFetcher thread 7 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=21, TimeoutTracker(timeout=29486, elapsed=28982), Traces: [0ms] sending RPC to server master-127.24.230.252:40255, [0ms] received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [0ms] delaying RPC due to: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [19ms] refreshing cache from master, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [20ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [21ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [22ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [22ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [39ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [41ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [41ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [41ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [42ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [62ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [65ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [68ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [69ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [79ms] refreshing cache from master, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [82ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [83ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [85ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [85ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [122ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [123ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [127ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [127ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [183ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [187ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [187ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [189ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [189ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [299ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [301ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [302ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [303ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [303ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [561ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [562ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [563ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [564ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1080ms] refreshing cache from master, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1083ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1939ms] refreshing cache from master, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1942ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [3620ms] refreshing cache from master, [3620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [3622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [3623ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [3625ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [3626ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [3626ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [6939ms] refreshing cache from master, [6939ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [6940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [6941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [6941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [6941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [6941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [6942ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [9500ms] refreshing cache from master, [9500ms] too many traces: truncated at 100 traces, deferred=Deferred@530712973(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@204897986 after retry RPC after error@178948207) -> (continuation of Deferred@1616981107 after retry RPC after error@1870704531) -> (continuation of Deferred@1358892239 after retry RPC after error@239603535) -> (continuation of Deferred@1730390081 after retry RPC after error@229998337) -> (continuation of Deferred@621052684 after retry RPC after error@1811468948) -> (continuation of Deferred@291708426 after retry RPC after error@923285072) -> (continuation of Deferred@915791710 after retry RPC after error@458540906) -> (continuation of Deferred@307104068 after retry RPC after error@1677854699) -> (continuation of Deferred@2096454426 after retry RPC after error@1101507705) -> (continuation of Deferred@599886112 after retry RPC after error@1460203500) -> (continuation of Deferred@32723868 after retry RPC after error@2102129599) -> (continuation of Deferred@1391263167 after retry RPC after error@1108021121) -> (continuation of Deferred@1509936111 after retry RPC after error@2064325988) -> (continuation of Deferred@1312757439 after retry RPC after error@1423077374) -> (continuation of Deferred@1943365176 after retry RPC after error@1343665435) -> (continuation of Deferred@1714084680 after retry RPC after error@566293996) -> (continuation of Deferred@2046600010 after retry RPC after error@480739075) -> (continuation of Deferred@753338180 after retry RPC after error@170850465) -> (continuation of Deferred@374668381 after retry RPC after error@833406707), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@204897986 after retry RPC after error@178948207) -> (continuation of Deferred@1616981107 after retry RPC after error@1870704531) -> (continuation of Deferred@1358892239 after retry RPC after error@239603535) -> (continuation of Deferred@1730390081 after retry RPC after error@229998337) -> (continuation of Deferred@621052684 after retry RPC after error@1811468948) -> (continuation of Deferred@291708426 after retry RPC after error@923285072) -> (continuation of Deferred@915791710 after retry RPC after error@458540906) -> (continuation of Deferred@307104068 after retry RPC after error@1677854699) -> (continuation of Deferred@2096454426 after retry RPC after error@1101507705) -> (continuation of Deferred@599886112 after retry RPC after error@1460203500) -> (continuation of Deferred@32723868 after retry RPC after error@2102129599) -> (continuation of Deferred@1391263167 after retry RPC after error@1108021121) -> (continuation of Deferred@1509936111 after retry RPC after error@2064325988) -> (continuation of Deferred@1312757439 after retry RPC after error@1423077374) -> (continuation of Deferred@1943365176 after retry RPC after error@1343665435) -> (continuation of Deferred@1714084680 after retry RPC after error@566293996) -> (continuation of Deferred@2046600010 after retry RPC after error@480739075) -> (continuation of Deferred@753338180 after retry RPC after error@170850465) -> (continuation of Deferred@374668381 after retry RPC after error@833406707)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.24.230.253:39511
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:05:47.849 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 4 thread-local buffer(s) from thread: kudu-nio-5
08:05:47.849 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 7 thread-local buffer(s) from thread: kudu-nio-0
08:05:47.854 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#0 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
08:05:47.857 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#0 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
08:05:47.861 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to FAILED on 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: SplitFetcher thread 7 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=21, TimeoutTracker(timeout=29486, elapsed=28982), Traces: [0ms] sending RPC to server master-127.24.230.252:40255, [0ms] received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [0ms] delaying RPC due to: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [19ms] refreshing cache from master, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [20ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [21ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [22ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [22ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [39ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [41ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [41ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [41ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [42ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [62ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [65ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [68ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [69ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [79ms] refreshing cache from master, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [82ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [83ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [85ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [85ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [122ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [123ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [127ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [127ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [183ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [187ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [187ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [189ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [189ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [299ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [301ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [302ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [303ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [303ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [561ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [562ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [563ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [564ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1080ms] refreshing cache from master, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1083ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1939ms] refreshing cache from master, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [1942ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [3620ms] refreshing cache from master, [3620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [3622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [3623ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [3625ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [3626ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [3626ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [6939ms] refreshing cache from master, [6939ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.254:40685, [6940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.252:40255, [6941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.230.253:39511, [6941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.254:40685: Network error: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685, [6941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.252:40255: Network error: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255, [6941ms] Sub RPC ConnectToMaster: received response from server master-127.24.230.253:39511: Network error: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [6942ms] delaying RPC due to: Service unavailable: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511, [9500ms] refreshing cache from master, [9500ms] too many traces: truncated at 100 traces, deferred=Deferred@530712973(state=PENDING, result=null, callback=get tablet locations from the master for table replication_test_table -> release master lookup permit -> retry RPC -> (continuation of Deferred@204897986 after retry RPC after error@178948207) -> (continuation of Deferred@1616981107 after retry RPC after error@1870704531) -> (continuation of Deferred@1358892239 after retry RPC after error@239603535) -> (continuation of Deferred@1730390081 after retry RPC after error@229998337) -> (continuation of Deferred@621052684 after retry RPC after error@1811468948) -> (continuation of Deferred@291708426 after retry RPC after error@923285072) -> (continuation of Deferred@915791710 after retry RPC after error@458540906) -> (continuation of Deferred@307104068 after retry RPC after error@1677854699) -> (continuation of Deferred@2096454426 after retry RPC after error@1101507705) -> (continuation of Deferred@599886112 after retry RPC after error@1460203500) -> (continuation of Deferred@32723868 after retry RPC after error@2102129599) -> (continuation of Deferred@1391263167 after retry RPC after error@1108021121) -> (continuation of Deferred@1509936111 after retry RPC after error@2064325988) -> (continuation of Deferred@1312757439 after retry RPC after error@1423077374) -> (continuation of Deferred@1943365176 after retry RPC after error@1343665435) -> (continuation of Deferred@1714084680 after retry RPC after error@566293996) -> (continuation of Deferred@2046600010 after retry RPC after error@480739075) -> (continuation of Deferred@753338180 after retry RPC after error@170850465) -> (continuation of Deferred@374668381 after retry RPC after error@833406707), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@204897986 after retry RPC after error@178948207) -> (continuation of Deferred@1616981107 after retry RPC after error@1870704531) -> (continuation of Deferred@1358892239 after retry RPC after error@239603535) -> (continuation of Deferred@1730390081 after retry RPC after error@229998337) -> (continuation of Deferred@621052684 after retry RPC after error@1811468948) -> (continuation of Deferred@291708426 after retry RPC after error@923285072) -> (continuation of Deferred@915791710 after retry RPC after error@458540906) -> (continuation of Deferred@307104068 after retry RPC after error@1677854699) -> (continuation of Deferred@2096454426 after retry RPC after error@1101507705) -> (continuation of Deferred@599886112 after retry RPC after error@1460203500) -> (continuation of Deferred@32723868 after retry RPC after error@2102129599) -> (continuation of Deferred@1391263167 after retry RPC after error@1108021121) -> (continuation of Deferred@1509936111 after retry RPC after error@2064325988) -> (continuation of Deferred@1312757439 after retry RPC after error@1423077374) -> (continuation of Deferred@1943365176 after retry RPC after error@1343665435) -> (continuation of Deferred@1714084680 after retry RPC after error@566293996) -> (continuation of Deferred@2046600010 after retry RPC after error@480739075) -> (continuation of Deferred@753338180 after retry RPC after error@170850465) -> (continuation of Deferred@374668381 after retry RPC after error@833406707)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.24.230.254:40685,127.24.230.252:40255,127.24.230.253:39511) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.254:40685(127.24.230.254:40685): Connection refused: /127.24.230.254:40685,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.252:40255(127.24.230.252:40255): Connection refused: /127.24.230.252:40255,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.230.253:39511(127.24.230.253:39511): Connection refused: /127.24.230.253:39511
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.24.230.253:39511
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:05:47.866 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:05:47.867 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#0) of source Source: KuduSource.
08:05:47.867 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
08:05:48.044 [DEBUG - pool-48-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30003), Traces: [0ms] sending RPC to server master-127.24.230.252:40255, [7ms] received response from server master-127.24.230.252:40255: OK, deferred=null) with no deferred attached!
08:05:48.095 [INFO - flink-pekko.actor.default-dispatcher-10] (CheckpointCoordinator.java:1805) Restoring job e26b904229418d0e047d5d94c5b9f905 from Checkpoint 76 @ 1779091546865 for e26b904229418d0e047d5d94c5b9f905 located at file:/tmp/junit16937918701930502306/checkpoints/e26b904229418d0e047d5d94c5b9f905/chk-76.
08:05:48.096 [INFO - flink-pekko.actor.default-dispatcher-10] (MasterHooks.java:201) No master state to restore
08:05:48.096 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 2 to checkpoint 76 for source Source: KuduSource to checkpoint.
08:05:48.096 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to SCHEDULED.
08:05:48.098 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:05:48.099 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from SCHEDULED to DEPLOYING.
08:05:48.100 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #1) with attempt id 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1) with allocation id 0f1066b174fb1f271b9fbb4939140659
08:05:48.100 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (e26b904229418d0e047d5d94c5b9f905) switched from state RESTARTING to RUNNING.
08:05:48.100 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 0f1066b174fb1f271b9fbb4939140659.
08:05:48.102 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#1 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_1), deploy into slot with allocation id 0f1066b174fb1f271b9fbb4939140659.
08:05:48.104 [INFO - flink-pekko.actor.default-dispatcher-10] (CheckpointCoordinator.java:1805) Restoring job e26b904229418d0e047d5d94c5b9f905 from Checkpoint 76 @ 1779091546865 for e26b904229418d0e047d5d94c5b9f905 located at file:/tmp/junit16937918701930502306/checkpoints/e26b904229418d0e047d5d94c5b9f905/chk-76.
08:05:48.106 [INFO - flink-pekko.actor.default-dispatcher-10] (MasterHooks.java:201) No master state to restore
08:05:48.106 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 76 for source Source: KuduSource to checkpoint.
08:05:48.106 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
08:05:48.108 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:05:48.109 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
08:05:48.109 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1) with allocation id bc35714883422bae5e4de5056d4b8678
08:05:48.112 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:48.113 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:48.113 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:48.114 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:48.114 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:48.114 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:48.114 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:48.115 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:48.115 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:48.115 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:48.115 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:48.115 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:48.115 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:48.117 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot bc35714883422bae5e4de5056d4b8678.
08:05:48.119 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id bc35714883422bae5e4de5056d4b8678.
08:05:48.120 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to DEPLOYING.
08:05:48.120 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#1 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_1) [DEPLOYING].
08:05:48.122 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@17c44b51
08:05:48.122 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:05:48.125 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16937918701930502306/checkpoints")
08:05:48.127 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
08:05:48.127 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
08:05:48.128 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2afebae8
08:05:48.128 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:05:48.128 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16937918701930502306/checkpoints")
08:05:48.128 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
08:05:48.129 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
08:05:48.133 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
08:05:48.133 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
08:05:48.147 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@26217972
08:05:48.155 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7146399d
08:05:48.162 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:48.164 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:48.184 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:48.185 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:48.197 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:48.206 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:48.207 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.207 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.207 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.208 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.210 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.210 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.214 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:48.215 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.215 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.216 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.222 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:48.224 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.224 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.224 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.231 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.232 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.232 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.232 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:48.237 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.237 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.237 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.238 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:48.244 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:48.245 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:48.273 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:48.279 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.280 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.280 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.285 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:48.292 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:48.293 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.293 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.294 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.303 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.303 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.303 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.304 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:48.307 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:48.310 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.310 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.310 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.324 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:48.330 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:48.335 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.336 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.336 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.339 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.339 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.339 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.340 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:48.344 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:48.345 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.345 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.346 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.346 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:48.353 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:48.353 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.353 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.353 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.355 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.355 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.355 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.355 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:48.359 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:48.363 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:48.364 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:48.364 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:48.364 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.364 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.365 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.366 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.366 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.367 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.367 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.367 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.367 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.367 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:48.374 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.374 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.374 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.375 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:48.375 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.376 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.376 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.376 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.376 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.377 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.377 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:48.383 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:48.384 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:48.384 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.384 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.384 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:48.384 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.384 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.384 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.384 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.385 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:48.386 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:48.386 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:48.386 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.386 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.387 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.387 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.387 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.387 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.387 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.387 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.387 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.388 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:48.388 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.388 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.388 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.388 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:48.403 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:48.403 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:48.403 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:48.404 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.404 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.404 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.404 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.404 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.405 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.405 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.405 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.405 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.405 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:48.405 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:48.406 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:48.406 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:48.406 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.406 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.407 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.407 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.407 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.407 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.407 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.407 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.407 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.408 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:48.423 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:48.423 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:48.424 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:48.424 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.424 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.424 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.425 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.425 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.425 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.426 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.426 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.426 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.426 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:48.446 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:48.447 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:48.447 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:48.449 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.449 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.449 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.451 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.451 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.451 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.452 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.452 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.452 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.452 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:48.506 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:48.507 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:48.507 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:48.508 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.508 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.508 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.509 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.509 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.509 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.509 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.509 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.510 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.510 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:48.524 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:48.524 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:48.524 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:48.525 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.525 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.525 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.525 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.525 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.526 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.526 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.526 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.526 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.526 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:48.566 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:48.567 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:48.567 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:48.568 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.569 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.569 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.569 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.569 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.570 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.570 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.570 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.570 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.570 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:48.586 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:48.586 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:48.586 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:48.587 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.587 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.588 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.588 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.588 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.588 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.589 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.589 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.589 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.589 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:48.643 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:48.644 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:48.644 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:48.645 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.646 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.646 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.646 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.646 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.646 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.646 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.647 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.647 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.647 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:48.693 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:48.693 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:48.694 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:48.694 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:48.694 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:48.695 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:48.695 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:48.695 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:48.695 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:48.695 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:48.696 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:48.696 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:48.696 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:48.696 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28025), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [4ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [4ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [5ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [6ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [23ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [24ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [24ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [25ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [43ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [43ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [44ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [45ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [63ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [63ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [63ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [63ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [84ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [103ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [163ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [164ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [164ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [164ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [262ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [263ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [263ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [263ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [362ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [363ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [363ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [363ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [643ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [643ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [643ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [643ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1261ms] refreshing cache from master, [1262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1264ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1264ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1264ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3241ms] refreshing cache from master, [3241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [3242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [3243ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [3243ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [3243ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3244ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [4781ms] refreshing cache from master, [4782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [4782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [4783ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [4783ms] too many traces: truncated at 100 traces, deferred=Deferred@251443643(state=PENDING, result=null, callback=(continuation of Deferred@1096035695 after retry RPC after error@1886423519) -> (continuation of Deferred@699314790 after retry RPC after error@1114961801) -> (continuation of Deferred@573281789 after retry RPC after error@1449254422) -> (continuation of Deferred@176188222 after retry RPC after error@1873612120) -> (continuation of Deferred@290978093 after retry RPC after error@1235092607) -> (continuation of Deferred@1087262697 after retry RPC after error@1192123749) -> (continuation of Deferred@1765689912 after retry RPC after error@1345980060) -> (continuation of Deferred@1647946357 after retry RPC after error@1466512930) -> (continuation of Deferred@1285409149 after retry RPC after error@1284712596) -> (continuation of Deferred@1666599281 after retry RPC after error@2098244383) -> (continuation of Deferred@1600410593 after retry RPC after error@174462737) -> (continuation of Deferred@1529531117 after retry RPC after error@597351108) -> (continuation of Deferred@1587310093 after retry RPC after error@1685595216) -> (continuation of Deferred@1762195344 after retry RPC after error@472992911) -> (continuation of Deferred@559981826 after retry RPC after error@77549530) -> (continuation of Deferred@705006766 after retry RPC after error@1019668565) -> (continuation of Deferred@405406330 after retry RPC after error@1714782010) -> (continuation of Deferred@1616117678 after retry RPC after error@1801201585) -> (continuation of Deferred@590201202 after retry RPC after error@1856808578) -> (continuation of Deferred@293440118 after retry RPC after error@462833223) -> (continuation of Deferred@1459429910 after retry RPC after error@1567495933) -> (continuation of Deferred@549263644 after retry RPC after error@154191666) -> (continuation of Deferred@920828304 after retry RPC after error@462854223), errback=(continuation of Deferred@1096035695 after retry RPC after error@1886423519) -> (continuation of Deferred@699314790 after retry RPC after error@1114961801) -> (continuation of Deferred@573281789 after retry RPC after error@1449254422) -> (continuation of Deferred@176188222 after retry RPC after error@1873612120) -> (continuation of Deferred@290978093 after retry RPC after error@1235092607) -> (continuation of Deferred@1087262697 after retry RPC after error@1192123749) -> (continuation of Deferred@1765689912 after retry RPC after error@1345980060) -> (continuation of Deferred@1647946357 after retry RPC after error@1466512930) -> (continuation of Deferred@1285409149 after retry RPC after error@1284712596) -> (continuation of Deferred@1666599281 after retry RPC after error@2098244383) -> (continuation of Deferred@1600410593 after retry RPC after error@174462737) -> (continuation of Deferred@1529531117 after retry RPC after error@597351108) -> (continuation of Deferred@1587310093 after retry RPC after error@1685595216) -> (continuation of Deferred@1762195344 after retry RPC after error@472992911) -> (continuation of Deferred@559981826 after retry RPC after error@77549530) -> (continuation of Deferred@705006766 after retry RPC after error@1019668565) -> (continuation of Deferred@405406330 after retry RPC after error@1714782010) -> (continuation of Deferred@1616117678 after retry RPC after error@1801201585) -> (continuation of Deferred@590201202 after retry RPC after error@1856808578) -> (continuation of Deferred@293440118 after retry RPC after error@462833223) -> (continuation of Deferred@1459429910 after retry RPC after error@1567495933) -> (continuation of Deferred@549263644 after retry RPC after error@154191666) -> (continuation of Deferred@920828304 after retry RPC after error@462854223)))
08:05:48.728 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
08:05:48.728 [WARN - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#2 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28025), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [4ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [4ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [5ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [6ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [23ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [24ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [24ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [25ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [43ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [43ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [44ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [45ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [63ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [63ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [63ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [63ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [84ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [103ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [163ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [164ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [164ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [164ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [262ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [263ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [263ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [263ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [362ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [363ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [363ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [363ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [643ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [643ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [643ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [643ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1261ms] refreshing cache from master, [1262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1264ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1264ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1264ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3241ms] refreshing cache from master, [3241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [3242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [3243ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [3243ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [3243ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3244ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [4781ms] refreshing cache from master, [4782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [4782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [4783ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [4783ms] too many traces: truncated at 100 traces, deferred=Deferred@251443643(state=PENDING, result=null, callback=(continuation of Deferred@1096035695 after retry RPC after error@1886423519) -> (continuation of Deferred@699314790 after retry RPC after error@1114961801) -> (continuation of Deferred@573281789 after retry RPC after error@1449254422) -> (continuation of Deferred@176188222 after retry RPC after error@1873612120) -> (continuation of Deferred@290978093 after retry RPC after error@1235092607) -> (continuation of Deferred@1087262697 after retry RPC after error@1192123749) -> (continuation of Deferred@1765689912 after retry RPC after error@1345980060) -> (continuation of Deferred@1647946357 after retry RPC after error@1466512930) -> (continuation of Deferred@1285409149 after retry RPC after error@1284712596) -> (continuation of Deferred@1666599281 after retry RPC after error@2098244383) -> (continuation of Deferred@1600410593 after retry RPC after error@174462737) -> (continuation of Deferred@1529531117 after retry RPC after error@597351108) -> (continuation of Deferred@1587310093 after retry RPC after error@1685595216) -> (continuation of Deferred@1762195344 after retry RPC after error@472992911) -> (continuation of Deferred@559981826 after retry RPC after error@77549530) -> (continuation of Deferred@705006766 after retry RPC after error@1019668565) -> (continuation of Deferred@405406330 after retry RPC after error@1714782010) -> (continuation of Deferred@1616117678 after retry RPC after error@1801201585) -> (continuation of Deferred@590201202 after retry RPC after error@1856808578) -> (continuation of Deferred@293440118 after retry RPC after error@462833223) -> (continuation of Deferred@1459429910 after retry RPC after error@1567495933) -> (continuation of Deferred@549263644 after retry RPC after error@154191666) -> (continuation of Deferred@920828304 after retry RPC after error@462854223), errback=(continuation of Deferred@1096035695 after retry RPC after error@1886423519) -> (continuation of Deferred@699314790 after retry RPC after error@1114961801) -> (continuation of Deferred@573281789 after retry RPC after error@1449254422) -> (continuation of Deferred@176188222 after retry RPC after error@1873612120) -> (continuation of Deferred@290978093 after retry RPC after error@1235092607) -> (continuation of Deferred@1087262697 after retry RPC after error@1192123749) -> (continuation of Deferred@1765689912 after retry RPC after error@1345980060) -> (continuation of Deferred@1647946357 after retry RPC after error@1466512930) -> (continuation of Deferred@1285409149 after retry RPC after error@1284712596) -> (continuation of Deferred@1666599281 after retry RPC after error@2098244383) -> (continuation of Deferred@1600410593 after retry RPC after error@174462737) -> (continuation of Deferred@1529531117 after retry RPC after error@597351108) -> (continuation of Deferred@1587310093 after retry RPC after error@1685595216) -> (continuation of Deferred@1762195344 after retry RPC after error@472992911) -> (continuation of Deferred@559981826 after retry RPC after error@77549530) -> (continuation of Deferred@705006766 after retry RPC after error@1019668565) -> (continuation of Deferred@405406330 after retry RPC after error@1714782010) -> (continuation of Deferred@1616117678 after retry RPC after error@1801201585) -> (continuation of Deferred@590201202 after retry RPC after error@1856808578) -> (continuation of Deferred@293440118 after retry RPC after error@462833223) -> (continuation of Deferred@1459429910 after retry RPC after error@1567495933) -> (continuation of Deferred@549263644 after retry RPC after error@154191666) -> (continuation of Deferred@920828304 after retry RPC after error@462854223)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:05:48.734 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#2 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
08:05:48.736 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#2 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_2.
08:05:48.739 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to FAILED on 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28025), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [4ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [4ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [5ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [6ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [23ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [24ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [24ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [25ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [43ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [43ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [44ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [45ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [63ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [63ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [63ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [63ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [84ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [103ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [163ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [164ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [164ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [164ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [262ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [263ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [263ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [263ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [362ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [363ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [363ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [363ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [643ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [643ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [643ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [643ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1261ms] refreshing cache from master, [1262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1264ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1264ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1264ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3241ms] refreshing cache from master, [3241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [3242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [3243ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [3243ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [3243ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3244ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [4781ms] refreshing cache from master, [4782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [4782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [4783ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [4783ms] too many traces: truncated at 100 traces, deferred=Deferred@251443643(state=PENDING, result=null, callback=(continuation of Deferred@1096035695 after retry RPC after error@1886423519) -> (continuation of Deferred@699314790 after retry RPC after error@1114961801) -> (continuation of Deferred@573281789 after retry RPC after error@1449254422) -> (continuation of Deferred@176188222 after retry RPC after error@1873612120) -> (continuation of Deferred@290978093 after retry RPC after error@1235092607) -> (continuation of Deferred@1087262697 after retry RPC after error@1192123749) -> (continuation of Deferred@1765689912 after retry RPC after error@1345980060) -> (continuation of Deferred@1647946357 after retry RPC after error@1466512930) -> (continuation of Deferred@1285409149 after retry RPC after error@1284712596) -> (continuation of Deferred@1666599281 after retry RPC after error@2098244383) -> (continuation of Deferred@1600410593 after retry RPC after error@174462737) -> (continuation of Deferred@1529531117 after retry RPC after error@597351108) -> (continuation of Deferred@1587310093 after retry RPC after error@1685595216) -> (continuation of Deferred@1762195344 after retry RPC after error@472992911) -> (continuation of Deferred@559981826 after retry RPC after error@77549530) -> (continuation of Deferred@705006766 after retry RPC after error@1019668565) -> (continuation of Deferred@405406330 after retry RPC after error@1714782010) -> (continuation of Deferred@1616117678 after retry RPC after error@1801201585) -> (continuation of Deferred@590201202 after retry RPC after error@1856808578) -> (continuation of Deferred@293440118 after retry RPC after error@462833223) -> (continuation of Deferred@1459429910 after retry RPC after error@1567495933) -> (continuation of Deferred@549263644 after retry RPC after error@154191666) -> (continuation of Deferred@920828304 after retry RPC after error@462854223), errback=(continuation of Deferred@1096035695 after retry RPC after error@1886423519) -> (continuation of Deferred@699314790 after retry RPC after error@1114961801) -> (continuation of Deferred@573281789 after retry RPC after error@1449254422) -> (continuation of Deferred@176188222 after retry RPC after error@1873612120) -> (continuation of Deferred@290978093 after retry RPC after error@1235092607) -> (continuation of Deferred@1087262697 after retry RPC after error@1192123749) -> (continuation of Deferred@1765689912 after retry RPC after error@1345980060) -> (continuation of Deferred@1647946357 after retry RPC after error@1466512930) -> (continuation of Deferred@1285409149 after retry RPC after error@1284712596) -> (continuation of Deferred@1666599281 after retry RPC after error@2098244383) -> (continuation of Deferred@1600410593 after retry RPC after error@174462737) -> (continuation of Deferred@1529531117 after retry RPC after error@597351108) -> (continuation of Deferred@1587310093 after retry RPC after error@1685595216) -> (continuation of Deferred@1762195344 after retry RPC after error@472992911) -> (continuation of Deferred@559981826 after retry RPC after error@77549530) -> (continuation of Deferred@705006766 after retry RPC after error@1019668565) -> (continuation of Deferred@405406330 after retry RPC after error@1714782010) -> (continuation of Deferred@1616117678 after retry RPC after error@1801201585) -> (continuation of Deferred@590201202 after retry RPC after error@1856808578) -> (continuation of Deferred@293440118 after retry RPC after error@462833223) -> (continuation of Deferred@1459429910 after retry RPC after error@1567495933) -> (continuation of Deferred@549263644 after retry RPC after error@154191666) -> (continuation of Deferred@920828304 after retry RPC after error@462854223)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:05:48.745 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:05:48.746 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#2) of source Source: KuduSource.
08:05:48.746 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_2.
08:05:48.766 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:48.767 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:48.767 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:48.768 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.768 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.768 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:48.769 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.769 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.769 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:48.770 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.770 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.770 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:48.770 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:48.785 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:49.123 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:49.124 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:49.124 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:49.125 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:49.125 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:49.125 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:49.126 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:49.126 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:49.126 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:49.126 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:49.126 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:49.126 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:49.127 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:49.363 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:49.363 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:49.364 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:49.365 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:49.365 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:49.365 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:49.366 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:49.366 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:49.366 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:49.366 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:49.367 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:49.367 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:49.367 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:49.367 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:49.684 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:49.684 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:49.685 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:49.686 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:49.686 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:49.686 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:49.687 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:49.687 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:49.687 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:49.687 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:49.688 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:49.688 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:49.688 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:49.786 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:49.863 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:49.864 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:49.864 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:49.865 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:49.865 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:49.865 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:49.866 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:49.866 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:49.866 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:49.867 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:49.867 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:49.867 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:49.867 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:50.294 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:50.785 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:50.786 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:50.787 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:50.788 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:50.789 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:50.789 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:50.789 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:50.790 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:50.790 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:50.790 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:50.790 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:50.790 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:50.790 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:50.791 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:50.806 [INFO - flink-pekko.actor.default-dispatcher-5] (CheckpointCoordinator.java:1805) Restoring job b42812d69c586178cf7556c3c92998f3 from Checkpoint 65 @ 1779091487380 for b42812d69c586178cf7556c3c92998f3 located at file:/tmp/junit1738461414297871817/checkpoints/b42812d69c586178cf7556c3c92998f3/chk-65.
08:05:50.806 [INFO - flink-pekko.actor.default-dispatcher-5] (MasterHooks.java:201) No master state to restore
08:05:50.807 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to SCHEDULED.
08:05:50.808 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 3 to checkpoint 65 for source Source: KuduSource to checkpoint.
08:05:50.810 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:05:50.810 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from SCHEDULED to DEPLOYING.
08:05:50.811 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #3) with attempt id 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1) with allocation id 2f9a5ebd231a465571d2109e36591407
08:05:50.811 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (b42812d69c586178cf7556c3c92998f3) switched from state RESTARTING to RUNNING.
08:05:50.811 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 2f9a5ebd231a465571d2109e36591407.
08:05:50.812 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#3 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_3), deploy into slot with allocation id 2f9a5ebd231a465571d2109e36591407.
08:05:50.813 [INFO - flink-pekko.actor.default-dispatcher-5] (CheckpointCoordinator.java:1805) Restoring job b42812d69c586178cf7556c3c92998f3 from Checkpoint 65 @ 1779091487380 for b42812d69c586178cf7556c3c92998f3 located at file:/tmp/junit1738461414297871817/checkpoints/b42812d69c586178cf7556c3c92998f3/chk-65.
08:05:50.813 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to DEPLOYING.
08:05:50.814 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#3 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_3) [DEPLOYING].
08:05:50.815 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@78c70af3
08:05:50.815 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:05:50.815 [INFO - flink-pekko.actor.default-dispatcher-5] (MasterHooks.java:201) No master state to restore
08:05:50.815 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 0 to checkpoint 65 for source Source: KuduSource to checkpoint.
08:05:50.815 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit1738461414297871817/checkpoints")
08:05:50.815 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to SCHEDULED.
08:05:50.815 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
08:05:50.816 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:05:50.822 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from SCHEDULED to DEPLOYING.
08:05:50.822 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #3) with attempt id 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1) with allocation id 4c78869737ef27e21dadfe7d1a23010d
08:05:50.823 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 4c78869737ef27e21dadfe7d1a23010d.
08:05:50.826 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#3 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_3), deploy into slot with allocation id 4c78869737ef27e21dadfe7d1a23010d.
08:05:50.826 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
08:05:50.832 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3c590367
08:05:50.838 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:50.845 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to DEPLOYING.
08:05:50.845 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#3 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_3) [DEPLOYING].
08:05:50.846 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@584ae3b2
08:05:50.846 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:05:50.846 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit1738461414297871817/checkpoints")
08:05:50.847 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
08:05:50.847 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
08:05:50.866 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:50.879 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:50.886 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:50.896 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@573e972f
08:05:50.899 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:50.899 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:50.899 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:50.900 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:50.903 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:50.904 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:50.904 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:50.915 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:50.915 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:50.916 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:50.916 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:50.922 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:50.926 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:50.926 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:50.932 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:50.938 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:50.938 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:50.943 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:50.946 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:50.947 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:50.948 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:50.958 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:50.962 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:50.962 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:50.963 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:50.963 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:50.965 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:50.965 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:50.965 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:50.965 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:50.966 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:50.966 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:50.966 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:50.969 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:50.970 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:50.970 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:50.970 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:50.983 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:50.987 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:50.998 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:51.000 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:51.002 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:51.003 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.004 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:51.005 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.005 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.006 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.009 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.010 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.010 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.009 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.011 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.011 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.011 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.016 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.016 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.016 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:51.017 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.017 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.017 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.018 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.020 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.020 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:51.026 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:51.027 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:51.027 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.027 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:51.027 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.027 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.027 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.027 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.027 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.028 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.028 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.028 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.028 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:51.042 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:51.044 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:51.045 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.045 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.045 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.046 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:51.046 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.047 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.047 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.047 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:51.048 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:51.048 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.048 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:51.048 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.048 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.048 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.048 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.049 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.049 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.049 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.049 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.049 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:51.050 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.050 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.050 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.053 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:51.062 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:51.063 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:51.063 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:51.064 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.064 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.064 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.064 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.064 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.064 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.064 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.064 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.064 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.064 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:51.083 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:51.084 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:51.084 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:51.085 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.085 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.085 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.086 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.086 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.086 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.089 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:51.089 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:51.089 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:51.090 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.090 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.090 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.090 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.090 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.091 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.097 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.097 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.097 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.097 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:51.098 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.099 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.099 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.099 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:51.143 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:51.144 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:51.144 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:51.145 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.145 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.145 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.146 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.146 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.146 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.146 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.147 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.147 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.147 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:51.167 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:51.167 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:51.168 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:51.168 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.168 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.168 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.168 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.168 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.168 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.170 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.170 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.170 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.170 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:51.181 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:51.203 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:51.203 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:51.204 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:51.204 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.204 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.204 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.204 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.204 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.205 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.205 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.205 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.205 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.206 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:51.222 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:51.223 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:51.223 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:51.226 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.226 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.226 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.227 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.227 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.227 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.227 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.227 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.227 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.227 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:51.247 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:51.247 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:51.248 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:51.248 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.248 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.248 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.248 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.248 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.248 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.249 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.249 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.249 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.250 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:51.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:48.578389 28765 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 28756
08:05:51.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:51.255631 28765 kernel_stack_watchdog.cc:198] Thread 28756 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 372ms:
08:05:51.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:05:51.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:05:51.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:05:51.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:05:51.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:47.207455 28767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:51.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:51.272090 28756 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 4.068s	user 0.681s	sys 1.129s
08:05:51.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:51.272558 28756 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 4.068s	user 0.681s	sys 1.129s
08:05:51.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:51.275099 28770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:51.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:51.282263 28768 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 4078 milliseconds
08:05:51.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.283080 28756 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:05:51.285 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:51.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.287462 28756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:05:51.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.298136 28756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:05:51.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.303610 28756 hybrid_clock.cc:648] HybridClock initialized: now 1779091551303557 us; error 74 us; skew 500 ppm
08:05:51.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.309521 28756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:05:51.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.340531 28756 webserver.cc:533] Webserver started at http://127.27.200.65:44939/ using document root <none> and password file <none>
08:05:51.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.342756 28756 fs_manager.cc:362] Metadata directory not provided
08:05:51.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.343245 28756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:05:51.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.344229 28756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:05:51.347 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:51.348 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:51.348 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:51.348 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.348 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.348 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.349 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.349 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.349 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.350 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.350 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.350 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.350 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:51.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.356221 28756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-0/data/instance:
08:05:51.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "325c80ff728d4ecfb2fa78a1d106c164"
08:05:51.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:51 on dist-test-slave-1jss"
08:05:51.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.358285 28756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-0/wal/instance:
08:05:51.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "325c80ff728d4ecfb2fa78a1d106c164"
08:05:51.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:51 on dist-test-slave-1jss"
08:05:51.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.377329 28756 fs_manager.cc:696] Time spent creating directory manager: real 0.018s	user 0.012s	sys 0.004s
08:05:51.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.392969 28825 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:05:51.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.394590 28756 fs_manager.cc:730] Time spent opening block manager: real 0.011s	user 0.005s	sys 0.003s
08:05:51.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.395121 28756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-0/wal
08:05:51.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "325c80ff728d4ecfb2fa78a1d106c164"
08:05:51.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:51 on dist-test-slave-1jss"
08:05:51.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.395640 28756 fs_report.cc:389] FS layout report
08:05:51.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:05:51.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-0/wal
08:05:51.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-0/wal
08:05:51.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-0/data/data
08:05:51.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:05:51.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:05:51.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:05:51.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:05:51.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:05:51.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:05:51.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:05:51.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:05:51.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:05:51.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:05:51.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:05:51.407 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:51.408 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:51.408 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:51.409 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.409 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.409 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.410 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.410 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.410 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.410 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.410 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.410 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.410 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:51.463 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:51.463 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:51.464 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:51.465 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.465 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.465 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.466 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.466 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.466 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.467 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.467 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.467 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.467 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:51.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.502022 28756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:05:51.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.504122 28756 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:05:51.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.504665 28756 kserver.cc:163] Server-wide thread pool size limit: 3276
08:05:51.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.509079 28756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:05:51.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.515198 28756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:05:51.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.515447 28756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:05:51.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.515790 28756 ts_tablet_manager.cc:616] Registered 0 tablets
08:05:51.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.515977 28756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:05:51.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:51.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.739792 28756 rpc_server.cc:307] RPC server started. Bound to: 127.27.200.65:36745
08:05:51.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.739862 28939 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.200.65:36745 every 8 connection(s)
08:05:51.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.744258 28756 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-0/data/info.pb
08:05:51.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.748564 28449 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 28756
08:05:51.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.749271 28449 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-0/wal/instance
08:05:51.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.777057 28449 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:05:51.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:05:51.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-1/wal
08:05:51.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-1/data
08:05:51.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:05:51.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:05:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:05:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:05:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:05:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:05:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-1/logs
08:05:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-1/data/info.pb
08:05:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:05:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:05:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:05:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:05:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:05:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:05:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:05:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:05:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:05:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:05:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.200.66:0
08:05:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.27.200.66
08:05:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.200.66
08:05:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:05:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.27.200.126:43511,127.27.200.125:46459,127.27.200.124:34439
08:05:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.200.84:44601
08:05:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:05:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:05:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:05:51.782 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:51.783 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:51.783 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:51.784 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.784 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.784 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:51.785 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.785 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.785 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:51.786 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.786 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.786 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:51.786 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:51.787 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:51.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.838201 28941 heartbeater.cc:344] Connected to a master server at 127.27.200.125:46459
08:05:51.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.838868 28941 heartbeater.cc:461] Registering TS with master...
08:05:51.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.840721 28941 heartbeater.cc:507] Master 127.27.200.125:46459 requested a full tablet report, sending...
08:05:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.844830 28573 ts_manager.cc:194] Registered new tserver with Master: 325c80ff728d4ecfb2fa78a1d106c164 (127.27.200.65:36745)
08:05:51.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.848344 28573 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.200.65:55867
08:05:51.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.865367 28942 heartbeater.cc:344] Connected to a master server at 127.27.200.126:43511
08:05:51.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.865792 28942 heartbeater.cc:461] Registering TS with master...
08:05:51.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.866554 28942 heartbeater.cc:507] Master 127.27.200.126:43511 requested a full tablet report, sending...
08:05:51.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.868729 28940 heartbeater.cc:344] Connected to a master server at 127.27.200.124:34439
08:05:51.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.869122 28940 heartbeater.cc:461] Registering TS with master...
08:05:51.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.869824 28940 heartbeater.cc:507] Master 127.27.200.124:34439 requested a full tablet report, sending...
08:05:51.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.870774 28494 ts_manager.cc:194] Registered new tserver with Master: 325c80ff728d4ecfb2fa78a1d106c164 (127.27.200.65:36745)
08:05:51.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:51.874701 28655 ts_manager.cc:194] Registered new tserver with Master: 325c80ff728d4ecfb2fa78a1d106c164 (127.27.200.65:36745)
08:05:52.062 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:52.063 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:52.063 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:52.063 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:52.064 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:52.064 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:52.065 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:52.065 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:52.065 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:52.066 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:52.066 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:52.066 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:52.066 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:52.107 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:52.108 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:52.108 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:52.109 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:52.109 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:52.109 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:52.109 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:52.110 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:52.110 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:52.110 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:52.110 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:52.110 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:52.110 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:52.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:52.286 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:52.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:52.297122 28947 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:05:52.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:52.297693 28947 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:05:52.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:52.298214 28947 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:05:52.343 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:52.344 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:52.344 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:52.345 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:52.345 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:52.345 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:52.345 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:52.345 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:52.345 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:52.345 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:52.346 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:52.346 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:52.346 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:52.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:52.357661 28947 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:05:52.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:52.358596 28947 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.200.66
08:05:52.403 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:52.404 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:52.404 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:52.404 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:52.404 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:52.405 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:52.405 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:52.405 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:52.405 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:52.405 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:52.405 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:52.406 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:52.406 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:52.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:52.408376 28947 tablet_server_runner.cc:78] Tablet server non-default flags:
08:05:52.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:05:52.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.200.84:44601
08:05:52.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-1/data
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-1/wal
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.200.66:0
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-1/data/info.pb
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.200.66
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.27.200.126:43511,127.27.200.125:46459,127.27.200.124:34439
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.27.200.66
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-1/logs
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:05:52.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:05:52.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:52.410655 28947 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:05:52.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:52.412844 28947 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:05:52.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:52.429916 28958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:52.603 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:52.603 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:52.604 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:52.604 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:52.604 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:52.604 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:52.604 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:52.604 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:52.604 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:52.604 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:52.604 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:52.605 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:52.605 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:52.680 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:52.786 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:52.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:52.858172 28941 heartbeater.cc:499] Master 127.27.200.125:46459 was elected leader, sending a full tablet report...
08:05:53.047 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:53.047 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:53.048 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:53.048 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:53.048 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:53.048 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:53.048 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:53.048 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:53.048 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:53.048 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:53.049 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:53.049 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:53.049 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:53.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:53.146595 27953 debug-util.cc:398] Leaking SignalData structure 0x7b08000aa060 after lost signal to thread 27885
08:05:53.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:53.147502 27953 debug-util.cc:398] Leaking SignalData structure 0x7b08000adba0 after lost signal to thread 27956
08:05:53.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:53.284 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:53.627 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:53.627 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:53.628 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:53.628 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:53.628 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:53.628 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:53.628 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:53.628 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:53.628 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:53.629 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:53.629 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:53.629 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:53.629 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:53.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:53.785 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:53.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:52.434509 28959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:53.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:52.436789 28947 server_base.cc:1061] running on GCE node
08:05:53.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:52.434271 28961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:53.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:53.791070 28947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:05:53.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:53.796252 28947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:05:53.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:53.797993 28947 hybrid_clock.cc:648] HybridClock initialized: now 1779091553797911 us; error 62 us; skew 500 ppm
08:05:53.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:53.799027 28947 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:05:53.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:53.808015 28947 webserver.cc:533] Webserver started at http://127.27.200.66:46573/ using document root <none> and password file <none>
08:05:53.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:53.809278 28947 fs_manager.cc:362] Metadata directory not provided
08:05:53.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:53.809583 28947 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:05:53.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:53.810247 28947 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:05:53.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:53.815905 28947 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-1/data/instance:
08:05:53.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b60948bfd2884317a63414cab8002497"
08:05:53.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:53 on dist-test-slave-1jss"
08:05:53.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:53.817234 28947 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-1/wal/instance:
08:05:53.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b60948bfd2884317a63414cab8002497"
08:05:53.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:53 on dist-test-slave-1jss"
08:05:53.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:53.828347 28947 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.009s	sys 0.000s
08:05:53.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:53.836339 28971 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:05:53.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:53.837857 28947 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.006s	sys 0.000s
08:05:53.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:53.838238 28947 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-1/wal
08:05:53.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b60948bfd2884317a63414cab8002497"
08:05:53.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:53 on dist-test-slave-1jss"
08:05:53.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:53.838665 28947 fs_report.cc:389] FS layout report
08:05:53.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:05:53.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-1/wal
08:05:53.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-1/wal
08:05:53.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-1/data/data
08:05:53.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:05:53.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:05:53.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:05:53.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:05:53.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:05:53.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:05:53.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:05:53.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:05:53.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:05:53.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:05:53.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:05:53.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:53.931105 28947 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:05:53.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:53.933343 28947 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:05:53.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:53.933918 28947 kserver.cc:163] Server-wide thread pool size limit: 3276
08:05:53.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:53.937968 28947 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:05:53.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:53.943463 28947 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:05:53.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:53.943805 28947 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:05:53.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:53.944065 28947 ts_tablet_manager.cc:616] Registered 0 tablets
08:05:53.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:53.944203 28947 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:05:54.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:54.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:54.187162 28947 rpc_server.cc:307] RPC server started. Bound to: 127.27.200.66:36045
08:05:54.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:54.187304 29085 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.200.66:36045 every 8 connection(s)
08:05:54.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:54.190553 28947 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-1/data/info.pb
08:05:54.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:54.197095 28449 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 28947
08:05:54.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:54.197655 28449 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-1/wal/instance
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:54.234229 28449 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-2/wal
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-2/data
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-2/logs
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-2/data/info.pb
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.200.67:0
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.27.200.67
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.200.67
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.27.200.126:43511,127.27.200.125:46459,127.27.200.124:34439
08:05:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.200.84:44601
08:05:54.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:05:54.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:05:54.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:05:54.263 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:54.264 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:54.264 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:54.264 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:54.264 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:54.264 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:54.265 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:54.264 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:54.265 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:54.265 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:54.265 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:54.265 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:54.265 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:54.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:54.281888 29086 heartbeater.cc:344] Connected to a master server at 127.27.200.124:34439
08:05:54.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:54.282527 29086 heartbeater.cc:461] Registering TS with master...
08:05:54.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:54.284337 29086 heartbeater.cc:507] Master 127.27.200.124:34439 requested a full tablet report, sending...
08:05:54.286 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:54.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:54.290905 29087 heartbeater.cc:344] Connected to a master server at 127.27.200.125:46459
08:05:54.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:54.291361 29087 heartbeater.cc:461] Registering TS with master...
08:05:54.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:54.292465 29087 heartbeater.cc:507] Master 127.27.200.125:46459 requested a full tablet report, sending...
08:05:54.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:54.295092 28573 ts_manager.cc:194] Registered new tserver with Master: b60948bfd2884317a63414cab8002497 (127.27.200.66:36045)
08:05:54.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:54.297045 28573 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.200.66:50675
08:05:54.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:54.297160 28655 ts_manager.cc:194] Registered new tserver with Master: b60948bfd2884317a63414cab8002497 (127.27.200.66:36045)
08:05:54.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:54.300465 29088 heartbeater.cc:344] Connected to a master server at 127.27.200.126:43511
08:05:54.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:54.300877 29088 heartbeater.cc:461] Registering TS with master...
08:05:54.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:54.301982 29088 heartbeater.cc:507] Master 127.27.200.126:43511 requested a full tablet report, sending...
08:05:54.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:54.306111 28494 ts_manager.cc:194] Registered new tserver with Master: b60948bfd2884317a63414cab8002497 (127.27.200.66:36045)
08:05:54.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:54.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:54.702627 29096 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:05:54.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:54.703301 29096 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:05:54.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:54.703928 29096 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:05:54.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:54.761690 29096 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:05:54.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:54.762830 29096 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.200.67
08:05:54.785 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:54.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:54.814459 29096 tablet_server_runner.cc:78] Tablet server non-default flags:
08:05:54.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:05:54.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.200.84:44601
08:05:54.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:05:54.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:05:54.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-2/data
08:05:54.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-2/wal
08:05:54.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:05:54.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:05:54.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.200.67:0
08:05:54.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:05:54.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:05:54.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:05:54.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-2/data/info.pb
08:05:54.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.200.67
08:05:54.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:05:54.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.27.200.126:43511,127.27.200.125:46459,127.27.200.124:34439
08:05:54.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:05:54.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:05:54.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:05:54.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:05:54.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:05:54.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.27.200.67
08:05:54.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-2/logs
08:05:54.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:05:54.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:05:54.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:05:54.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:05:54.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:05:54.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:05:54.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:05:54.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:05:54.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:05:54.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:05:54.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:54.817513 29096 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:05:54.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:54.819953 29096 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:05:54.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:54.839704 29102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:55.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:55.287 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:55.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:55.308946 29087 heartbeater.cc:499] Master 127.27.200.125:46459 was elected leader, sending a full tablet report...
08:05:55.486 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:55.487 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:55.487 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:55.488 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:55.488 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:55.488 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:55.488 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:55.488 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:55.488 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:55.489 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:55.489 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:55.489 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:55.489 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:55.603 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:55.604 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:55.604 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:55.604 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:55.604 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:55.605 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:55.605 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:55.605 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:55.605 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:55.606 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:55.606 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:55.606 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:55.606 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:55.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:55.785 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:56.023 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:56.024 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:56.024 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:56.026 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:56.026 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:56.026 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:56.027 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:56.027 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:56.027 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:56.027 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:56.028 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:56.028 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:56.029 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:56.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:56.286 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:56.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:54.844678 29103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:56.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:56.241000 29101 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 29096
08:05:56.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:56.542618 29096 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.700s	user 0.596s	sys 1.029s
08:05:56.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:56.543064 29096 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.701s	user 0.596s	sys 1.030s
08:05:56.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.552749 29096 server_base.cc:1061] running on GCE node
08:05:56.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:56.552749 29110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:05:56.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.554337 29096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:05:56.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.556862 29096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:05:56.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.558255 29096 hybrid_clock.cc:648] HybridClock initialized: now 1779091556558162 us; error 98 us; skew 500 ppm
08:05:56.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.559393 29096 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:05:56.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.566928 29096 webserver.cc:533] Webserver started at http://127.27.200.67:41239/ using document root <none> and password file <none>
08:05:56.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.568075 29096 fs_manager.cc:362] Metadata directory not provided
08:05:56.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.568328 29096 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:05:56.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.568925 29096 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:05:56.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.574800 29096 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-2/data/instance:
08:05:56.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fa47904803a04de8b3b6afc059f9455d"
08:05:56.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:56 on dist-test-slave-1jss"
08:05:56.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.576218 29096 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-2/wal/instance:
08:05:56.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fa47904803a04de8b3b6afc059f9455d"
08:05:56.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:56 on dist-test-slave-1jss"
08:05:56.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.585616 29096 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.009s	sys 0.001s
08:05:56.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.592042 29116 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:05:56.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.593315 29096 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.006s	sys 0.000s
08:05:56.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.593711 29096 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-2/wal
08:05:56.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fa47904803a04de8b3b6afc059f9455d"
08:05:56.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:05:56 on dist-test-slave-1jss"
08:05:56.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.594137 29096 fs_report.cc:389] FS layout report
08:05:56.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:05:56.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-2/wal
08:05:56.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-2/wal
08:05:56.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-2/data/data
08:05:56.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:05:56.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:05:56.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:05:56.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:05:56.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:05:56.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:05:56.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:05:56.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:05:56.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:05:56.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:05:56.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:05:56.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.655472 29096 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:05:56.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.657320 29096 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:05:56.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.657770 29096 kserver.cc:163] Server-wide thread pool size limit: 3276
08:05:56.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.660960 29096 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:05:56.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.666280 29096 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:05:56.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.666513 29096 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:05:56.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.666734 29096 ts_tablet_manager.cc:616] Registered 0 tablets
08:05:56.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.666886 29096 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:05:56.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:56.743 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:56.744 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:56.744 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:56.745 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:56.745 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:56.745 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:56.745 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:56.745 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:56.746 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:56.746 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:56.746 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:56.746 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:56.746 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:56.785 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:56.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.928587 29096 rpc_server.cc:307] RPC server started. Bound to: 127.27.200.67:44327
08:05:56.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.928740 29231 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.200.67:44327 every 8 connection(s)
08:05:56.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.932767 29096 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-2/data/info.pb
08:05:56.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.939260 28449 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 29096
08:05:56.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:56.939891 28449 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster18193424375221964176/ts-2/wal/instance
08:05:57.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.022884 29232 heartbeater.cc:344] Connected to a master server at 127.27.200.124:34439
08:05:57.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.023553 29232 heartbeater.cc:461] Registering TS with master...
08:05:57.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.024741 29233 heartbeater.cc:344] Connected to a master server at 127.27.200.125:46459
08:05:57.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.025134 29233 heartbeater.cc:461] Registering TS with master...
08:05:57.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.025226 29232 heartbeater.cc:507] Master 127.27.200.124:34439 requested a full tablet report, sending...
08:05:57.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.026187 29233 heartbeater.cc:507] Master 127.27.200.125:46459 requested a full tablet report, sending...
08:05:57.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.028103 29234 heartbeater.cc:344] Connected to a master server at 127.27.200.126:43511
08:05:57.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.028469 29234 heartbeater.cc:461] Registering TS with master...
08:05:57.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.029457 29234 heartbeater.cc:507] Master 127.27.200.126:43511 requested a full tablet report, sending...
08:05:57.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.029690 28655 ts_manager.cc:194] Registered new tserver with Master: fa47904803a04de8b3b6afc059f9455d (127.27.200.67:44327)
08:05:57.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.031252 28572 ts_manager.cc:194] Registered new tserver with Master: fa47904803a04de8b3b6afc059f9455d (127.27.200.67:44327)
08:05:57.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.032223 28494 ts_manager.cc:194] Registered new tserver with Master: fa47904803a04de8b3b6afc059f9455d (127.27.200.67:44327)
08:05:57.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.033172 28572 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.200.67:39067
08:05:57.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.057637 28449 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
08:05:57.071 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:05:57.072 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

08:05:57.074 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.27.200.126"
      port: 43511
    }
    bound_http_address {
      host: "127.27.200.126"
      port: 36721
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.27.200.125"
      port: 46459
    }
    bound_http_address {
      host: "127.27.200.125"
      port: 38349
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.27.200.124"
      port: 34439
    }
    bound_http_address {
      host: "127.27.200.124"
      port: 36861
    }
  }
}

08:05:57.074 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

08:05:57.075 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.27.200.65"
      port: 36745
    }
    bound_http_address {
      host: "127.27.200.65"
      port: 44939
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.27.200.66"
      port: 36045
    }
    bound_http_address {
      host: "127.27.200.66"
      port: 46573
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.27.200.67"
      port: 44327
    }
    bound_http_address {
      host: "127.27.200.67"
      port: 41239
    }
  }
}

08:05:57.075 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
08:05:57.077 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:57.079 [DEBUG - main] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:05:57.080 [DEBUG - main] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:05:57.080 [DEBUG - main] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:05:57.080 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.27.17.252:43595(127.27.17.252:43595)] Successfully connected to peer
08:05:57.081 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.27.17.254:45447(127.27.17.254:45447)] Successfully connected to peer
08:05:57.087 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.27.17.253:37621(127.27.17.253:37621)] Successfully connected to peer
08:05:57.088 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.17.252
08:05:57.089 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.17.254
08:05:57.091 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.17.253
08:05:57.102 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:57.102 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:57.108 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x130aa017, L:/127.0.0.1:45970 - R:/127.27.17.254:45447] using SASL/PLAIN
08:05:57.108 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x162008ea, L:/127.0.0.1:59050 - R:/127.27.17.253:37621] using SASL/PLAIN
08:05:57.119 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:57.126 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xbfbbfe36, L:/127.0.0.1:49834 - R:/127.27.17.252:43595] using SASL/PLAIN
08:05:57.131 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:05:57.131 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=53), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [32ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: OK, [35ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: OK, [51ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: OK, deferred=null) after lookup
08:05:57.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.134073 27921 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49834:
08:05:57.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
08:05:57.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
08:05:57.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:05:57.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
08:05:57.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:05:57.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:05:57.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:05:57.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:05:57.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:05:57.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:05:57.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:05:57.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:05:57.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
08:05:57.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:05:57.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:05:57.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:05:57.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:05:57.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:05:57.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:05:57.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:05:57.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:05:57.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
08:05:57.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:05:57.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:05:57.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:05:57.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:05:57.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:05:57.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:05:57.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:05:57.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:05:57.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
08:05:57.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:05:57.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:05:57.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:05:57.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:05:57.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:05:57.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:05:57.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:05:57.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:05:57.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
08:05:57.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
08:05:57.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:05:57.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:05:57.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:57.138309 27921 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
08:05:57.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:57.179 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table bf7fb2df00f74650a621c1e6c3ca0806
08:05:57.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.243224 28374 tablet_service.cc:1511] Processing CreateTablet for tablet d155ea2c19454246a949669fc5eb32d1 (DEFAULT_TABLE table=replication_test_table [id=bf7fb2df00f74650a621c1e6c3ca0806]), partition=
08:05:57.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.246181 28374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d155ea2c19454246a949669fc5eb32d1. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:57.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.251493 28089 tablet_service.cc:1511] Processing CreateTablet for tablet d155ea2c19454246a949669fc5eb32d1 (DEFAULT_TABLE table=replication_test_table [id=bf7fb2df00f74650a621c1e6c3ca0806]), partition=
08:05:57.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.251988 28233 tablet_service.cc:1511] Processing CreateTablet for tablet d155ea2c19454246a949669fc5eb32d1 (DEFAULT_TABLE table=replication_test_table [id=bf7fb2df00f74650a621c1e6c3ca0806]), partition=
08:05:57.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.253563 28089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d155ea2c19454246a949669fc5eb32d1. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:57.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.254246 28233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d155ea2c19454246a949669fc5eb32d1. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:57.285 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:57.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.293272 29267 tablet_bootstrap.cc:492] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a: Bootstrap starting.
08:05:57.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.301694 29268 tablet_bootstrap.cc:492] T d155ea2c19454246a949669fc5eb32d1 P d3419957393241e6b3e1b05dcab37487: Bootstrap starting.
08:05:57.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.308625 29267 tablet_bootstrap.cc:654] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a: Neither blocks nor log segments found. Creating new log.
08:05:57.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.309955 29269 tablet_bootstrap.cc:492] T d155ea2c19454246a949669fc5eb32d1 P 523ccfb52b2544c393ff06d08a25c7b6: Bootstrap starting.
08:05:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.311800 29268 tablet_bootstrap.cc:654] T d155ea2c19454246a949669fc5eb32d1 P d3419957393241e6b3e1b05dcab37487: Neither blocks nor log segments found. Creating new log.
08:05:57.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.314615 29268 log.cc:826] T d155ea2c19454246a949669fc5eb32d1 P d3419957393241e6b3e1b05dcab37487: Log is configured to *not* fsync() on all Append() calls
08:05:57.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.316303 29267 log.cc:826] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a: Log is configured to *not* fsync() on all Append() calls
08:05:57.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.319878 29269 tablet_bootstrap.cc:654] T d155ea2c19454246a949669fc5eb32d1 P 523ccfb52b2544c393ff06d08a25c7b6: Neither blocks nor log segments found. Creating new log.
08:05:57.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.336114 29269 log.cc:826] T d155ea2c19454246a949669fc5eb32d1 P 523ccfb52b2544c393ff06d08a25c7b6: Log is configured to *not* fsync() on all Append() calls
08:05:57.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.337358 29268 tablet_bootstrap.cc:492] T d155ea2c19454246a949669fc5eb32d1 P d3419957393241e6b3e1b05dcab37487: No bootstrap required, opened a new log
08:05:57.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.338037 29268 ts_tablet_manager.cc:1403] T d155ea2c19454246a949669fc5eb32d1 P d3419957393241e6b3e1b05dcab37487: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.013s
08:05:57.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.344568 29267 tablet_bootstrap.cc:492] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a: No bootstrap required, opened a new log
08:05:57.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.345203 29267 ts_tablet_manager.cc:1403] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a: Time spent bootstrapping tablet: real 0.053s	user 0.033s	sys 0.008s
08:05:57.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.345444 29269 tablet_bootstrap.cc:492] T d155ea2c19454246a949669fc5eb32d1 P 523ccfb52b2544c393ff06d08a25c7b6: No bootstrap required, opened a new log
08:05:57.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.346067 29269 ts_tablet_manager.cc:1403] T d155ea2c19454246a949669fc5eb32d1 P 523ccfb52b2544c393ff06d08a25c7b6: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.005s
08:05:57.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.371682 29269 raft_consensus.cc:359] T d155ea2c19454246a949669fc5eb32d1 P 523ccfb52b2544c393ff06d08a25c7b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec9762b17dfd4956a4a1a622857eb01a" member_type: VOTER last_known_addr { host: "127.27.17.195" port: 43439 } } peers { permanent_uuid: "523ccfb52b2544c393ff06d08a25c7b6" member_type: VOTER last_known_addr { host: "127.27.17.194" port: 34219 } } peers { permanent_uuid: "d3419957393241e6b3e1b05dcab37487" member_type: VOTER last_known_addr { host: "127.27.17.193" port: 35571 } }
08:05:57.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.372622 29269 raft_consensus.cc:385] T d155ea2c19454246a949669fc5eb32d1 P 523ccfb52b2544c393ff06d08a25c7b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:57.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.372923 29269 raft_consensus.cc:740] T d155ea2c19454246a949669fc5eb32d1 P 523ccfb52b2544c393ff06d08a25c7b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523ccfb52b2544c393ff06d08a25c7b6, State: Initialized, Role: FOLLOWER
08:05:57.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.370581 29268 raft_consensus.cc:359] T d155ea2c19454246a949669fc5eb32d1 P d3419957393241e6b3e1b05dcab37487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec9762b17dfd4956a4a1a622857eb01a" member_type: VOTER last_known_addr { host: "127.27.17.195" port: 43439 } } peers { permanent_uuid: "523ccfb52b2544c393ff06d08a25c7b6" member_type: VOTER last_known_addr { host: "127.27.17.194" port: 34219 } } peers { permanent_uuid: "d3419957393241e6b3e1b05dcab37487" member_type: VOTER last_known_addr { host: "127.27.17.193" port: 35571 } }
08:05:57.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.373499 29268 raft_consensus.cc:385] T d155ea2c19454246a949669fc5eb32d1 P d3419957393241e6b3e1b05dcab37487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:57.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.374662 29268 raft_consensus.cc:740] T d155ea2c19454246a949669fc5eb32d1 P d3419957393241e6b3e1b05dcab37487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3419957393241e6b3e1b05dcab37487, State: Initialized, Role: FOLLOWER
08:05:57.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.374815 29269 consensus_queue.cc:260] T d155ea2c19454246a949669fc5eb32d1 P 523ccfb52b2544c393ff06d08a25c7b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec9762b17dfd4956a4a1a622857eb01a" member_type: VOTER last_known_addr { host: "127.27.17.195" port: 43439 } } peers { permanent_uuid: "523ccfb52b2544c393ff06d08a25c7b6" member_type: VOTER last_known_addr { host: "127.27.17.194" port: 34219 } } peers { permanent_uuid: "d3419957393241e6b3e1b05dcab37487" member_type: VOTER last_known_addr { host: "127.27.17.193" port: 35571 } }
08:05:57.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.375754 29268 consensus_queue.cc:260] T d155ea2c19454246a949669fc5eb32d1 P d3419957393241e6b3e1b05dcab37487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec9762b17dfd4956a4a1a622857eb01a" member_type: VOTER last_known_addr { host: "127.27.17.195" port: 43439 } } peers { permanent_uuid: "523ccfb52b2544c393ff06d08a25c7b6" member_type: VOTER last_known_addr { host: "127.27.17.194" port: 34219 } } peers { permanent_uuid: "d3419957393241e6b3e1b05dcab37487" member_type: VOTER last_known_addr { host: "127.27.17.193" port: 35571 } }
08:05:57.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.388221 29268 ts_tablet_manager.cc:1434] T d155ea2c19454246a949669fc5eb32d1 P d3419957393241e6b3e1b05dcab37487: Time spent starting tablet: real 0.050s	user 0.036s	sys 0.006s
08:05:57.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.390081 29269 ts_tablet_manager.cc:1434] T d155ea2c19454246a949669fc5eb32d1 P 523ccfb52b2544c393ff06d08a25c7b6: Time spent starting tablet: real 0.044s	user 0.026s	sys 0.007s
08:05:57.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.394924 29267 raft_consensus.cc:359] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec9762b17dfd4956a4a1a622857eb01a" member_type: VOTER last_known_addr { host: "127.27.17.195" port: 43439 } } peers { permanent_uuid: "523ccfb52b2544c393ff06d08a25c7b6" member_type: VOTER last_known_addr { host: "127.27.17.194" port: 34219 } } peers { permanent_uuid: "d3419957393241e6b3e1b05dcab37487" member_type: VOTER last_known_addr { host: "127.27.17.193" port: 35571 } }
08:05:57.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.395989 29267 raft_consensus.cc:385] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:57.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.396353 29267 raft_consensus.cc:740] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9762b17dfd4956a4a1a622857eb01a, State: Initialized, Role: FOLLOWER
08:05:57.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.397436 29267 consensus_queue.cc:260] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec9762b17dfd4956a4a1a622857eb01a" member_type: VOTER last_known_addr { host: "127.27.17.195" port: 43439 } } peers { permanent_uuid: "523ccfb52b2544c393ff06d08a25c7b6" member_type: VOTER last_known_addr { host: "127.27.17.194" port: 34219 } } peers { permanent_uuid: "d3419957393241e6b3e1b05dcab37487" member_type: VOTER last_known_addr { host: "127.27.17.193" port: 35571 } }
08:05:57.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.404693 29267 ts_tablet_manager.cc:1434] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a: Time spent starting tablet: real 0.059s	user 0.032s	sys 0.010s
08:05:57.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:57.409986 28164 tablet.cc:2404] T d155ea2c19454246a949669fc5eb32d1 P d3419957393241e6b3e1b05dcab37487: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:05:57.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:57.496444 28447 tablet.cc:2404] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:05:57.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.502594 29275 raft_consensus.cc:493] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:05:57.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.503309 29275 raft_consensus.cc:515] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec9762b17dfd4956a4a1a622857eb01a" member_type: VOTER last_known_addr { host: "127.27.17.195" port: 43439 } } peers { permanent_uuid: "523ccfb52b2544c393ff06d08a25c7b6" member_type: VOTER last_known_addr { host: "127.27.17.194" port: 34219 } } peers { permanent_uuid: "d3419957393241e6b3e1b05dcab37487" member_type: VOTER last_known_addr { host: "127.27.17.193" port: 35571 } }
08:05:57.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.507072 29275 leader_election.cc:290] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 523ccfb52b2544c393ff06d08a25c7b6 (127.27.17.194:34219), d3419957393241e6b3e1b05dcab37487 (127.27.17.193:35571)
08:05:57.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.523231 28254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d155ea2c19454246a949669fc5eb32d1" candidate_uuid: "ec9762b17dfd4956a4a1a622857eb01a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523ccfb52b2544c393ff06d08a25c7b6" is_pre_election: true
08:05:57.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.524221 28110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d155ea2c19454246a949669fc5eb32d1" candidate_uuid: "ec9762b17dfd4956a4a1a622857eb01a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3419957393241e6b3e1b05dcab37487" is_pre_election: true
08:05:57.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.524418 28254 raft_consensus.cc:2468] T d155ea2c19454246a949669fc5eb32d1 P 523ccfb52b2544c393ff06d08a25c7b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec9762b17dfd4956a4a1a622857eb01a in term 0.
08:05:57.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.525257 28110 raft_consensus.cc:2468] T d155ea2c19454246a949669fc5eb32d1 P d3419957393241e6b3e1b05dcab37487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec9762b17dfd4956a4a1a622857eb01a in term 0.
08:05:57.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.526226 28330 leader_election.cc:304] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523ccfb52b2544c393ff06d08a25c7b6, ec9762b17dfd4956a4a1a622857eb01a; no voters: 
08:05:57.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.527323 29275 raft_consensus.cc:2804] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a [term 0 FOLLOWER]: Leader pre-election won for term 1
08:05:57.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.527661 29275 raft_consensus.cc:493] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:05:57.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.528002 29275 raft_consensus.cc:3060] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a [term 0 FOLLOWER]: Advancing to term 1
08:05:57.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.533710 29275 raft_consensus.cc:515] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec9762b17dfd4956a4a1a622857eb01a" member_type: VOTER last_known_addr { host: "127.27.17.195" port: 43439 } } peers { permanent_uuid: "523ccfb52b2544c393ff06d08a25c7b6" member_type: VOTER last_known_addr { host: "127.27.17.194" port: 34219 } } peers { permanent_uuid: "d3419957393241e6b3e1b05dcab37487" member_type: VOTER last_known_addr { host: "127.27.17.193" port: 35571 } }
08:05:57.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.535559 29275 leader_election.cc:290] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a [CANDIDATE]: Term 1 election: Requested vote from peers 523ccfb52b2544c393ff06d08a25c7b6 (127.27.17.194:34219), d3419957393241e6b3e1b05dcab37487 (127.27.17.193:35571)
08:05:57.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.536672 28110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d155ea2c19454246a949669fc5eb32d1" candidate_uuid: "ec9762b17dfd4956a4a1a622857eb01a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3419957393241e6b3e1b05dcab37487"
08:05:57.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.536671 28254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d155ea2c19454246a949669fc5eb32d1" candidate_uuid: "ec9762b17dfd4956a4a1a622857eb01a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523ccfb52b2544c393ff06d08a25c7b6"
08:05:57.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.537214 28254 raft_consensus.cc:3060] T d155ea2c19454246a949669fc5eb32d1 P 523ccfb52b2544c393ff06d08a25c7b6 [term 0 FOLLOWER]: Advancing to term 1
08:05:57.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.537264 28110 raft_consensus.cc:3060] T d155ea2c19454246a949669fc5eb32d1 P d3419957393241e6b3e1b05dcab37487 [term 0 FOLLOWER]: Advancing to term 1
08:05:57.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.544000 28110 raft_consensus.cc:2468] T d155ea2c19454246a949669fc5eb32d1 P d3419957393241e6b3e1b05dcab37487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec9762b17dfd4956a4a1a622857eb01a in term 1.
08:05:57.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.544360 28254 raft_consensus.cc:2468] T d155ea2c19454246a949669fc5eb32d1 P 523ccfb52b2544c393ff06d08a25c7b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec9762b17dfd4956a4a1a622857eb01a in term 1.
08:05:57.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.545481 28328 leader_election.cc:304] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d3419957393241e6b3e1b05dcab37487, ec9762b17dfd4956a4a1a622857eb01a; no voters: 
08:05:57.546 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:57.547 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:57.547 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:57.548 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:57.548 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:57.548 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:57.548 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:57.548 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:57.548 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:57.549 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:57.549 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:57.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.547770 29275 raft_consensus.cc:2804] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a [term 1 FOLLOWER]: Leader election won for term 1
08:05:57.550 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:57.550 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:57.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.550576 29275 raft_consensus.cc:697] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a [term 1 LEADER]: Becoming Leader. State: Replica: ec9762b17dfd4956a4a1a622857eb01a, State: Running, Role: LEADER
08:05:57.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.552748 29275 consensus_queue.cc:237] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec9762b17dfd4956a4a1a622857eb01a" member_type: VOTER last_known_addr { host: "127.27.17.195" port: 43439 } } peers { permanent_uuid: "523ccfb52b2544c393ff06d08a25c7b6" member_type: VOTER last_known_addr { host: "127.27.17.194" port: 34219 } } peers { permanent_uuid: "d3419957393241e6b3e1b05dcab37487" member_type: VOTER last_known_addr { host: "127.27.17.193" port: 35571 } }
08:05:57.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.567028 27920 catalog_manager.cc:5696] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a reported cstate change: term changed from 0 to 1, leader changed from <none> to ec9762b17dfd4956a4a1a622857eb01a (127.27.17.195). New cstate: current_term: 1 leader_uuid: "ec9762b17dfd4956a4a1a622857eb01a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec9762b17dfd4956a4a1a622857eb01a" member_type: VOTER last_known_addr { host: "127.27.17.195" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "523ccfb52b2544c393ff06d08a25c7b6" member_type: VOTER last_known_addr { host: "127.27.17.194" port: 34219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3419957393241e6b3e1b05dcab37487" member_type: VOTER last_known_addr { host: "127.27.17.193" port: 35571 } health_report { overall_health: UNKNOWN } } }
08:05:57.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:57.597506 28303 tablet.cc:2404] T d155ea2c19454246a949669fc5eb32d1 P 523ccfb52b2544c393ff06d08a25c7b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:05:57.605 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table bf7fb2df00f74650a621c1e6c3ca0806
08:05:57.610 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d155ea2c19454246a949669fc5eb32d1 for table 'replication_test_table' with partition [<start>, <end>)
08:05:57.610 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d155ea2c19454246a949669fc5eb32d1@[523ccfb52b2544c393ff06d08a25c7b6(127.27.17.194:34219),d3419957393241e6b3e1b05dcab37487(127.27.17.193:35571),ec9762b17dfd4956a4a1a622857eb01a(127.27.17.195:43439)[L]]}]
08:05:57.610 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.27.17.252:43595, [5ms] Sub RPC GetTableLocations: received response from server master-127.27.17.252:43595: OK, deferred=null) after lookup
08:05:57.611 [DEBUG - kudu-nio-0] (Connection.java:748) [peer ec9762b17dfd4956a4a1a622857eb01a(127.27.17.195:43439)] connecting to peer
08:05:57.612 [DEBUG - kudu-nio-3] (Connection.java:757) [peer ec9762b17dfd4956a4a1a622857eb01a(127.27.17.195:43439)] Successfully connected to peer
08:05:57.624 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:57.628 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xdcb0acf4, L:/127.0.0.1:43482 - R:/127.27.17.195:43439] using TOKEN/null
08:05:57.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.644119 28254 raft_consensus.cc:1275] T d155ea2c19454246a949669fc5eb32d1 P 523ccfb52b2544c393ff06d08a25c7b6 [term 1 FOLLOWER]: Refusing update from remote peer ec9762b17dfd4956a4a1a622857eb01a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:05:57.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.644104 28110 raft_consensus.cc:1275] T d155ea2c19454246a949669fc5eb32d1 P d3419957393241e6b3e1b05dcab37487 [term 1 FOLLOWER]: Refusing update from remote peer ec9762b17dfd4956a4a1a622857eb01a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:05:57.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.646188 29278 consensus_queue.cc:1048] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a [LEADER]: Connected to new peer: Peer: permanent_uuid: "523ccfb52b2544c393ff06d08a25c7b6" member_type: VOTER last_known_addr { host: "127.27.17.194" port: 34219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:05:57.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.646992 29275 consensus_queue.cc:1048] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3419957393241e6b3e1b05dcab37487" member_type: VOTER last_known_addr { host: "127.27.17.193" port: 35571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:05:57.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:57.674227 29282 mvcc.cc:204] Tried to move back new op lower bound from 7287159020089933824 to 7287159019746996224. Current Snapshot: MvccSnapshot[applied={T|T < 7287159020089933824}]
08:05:57.680 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:57.786 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:57.846 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:57.846 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:57.847 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:57.847 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:57.847 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:57.847 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:57.847 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:57.847 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:57.848 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:57.848 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:57.848 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:57.848 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:57.848 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:57.855 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:57.857 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:05:57.860 [DEBUG - main] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:05:57.861 [DEBUG - main] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:05:57.861 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.27.200.126:43511(127.27.200.126:43511)] Successfully connected to peer
08:05:57.863 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:57.863 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:57.864 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:57.864 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:57.864 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:57.864 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:57.864 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:57.864 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:57.864 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:57.865 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:57.865 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:57.865 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:57.865 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:57.868 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.200.126
08:05:57.873 [DEBUG - main] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:05:57.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:57.874465 27796 debug-util.cc:398] Leaking SignalData structure 0x7b08000a5180 after lost signal to thread 27732
08:05:57.877 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.27.200.125:46459(127.27.200.125:46459)] Successfully connected to peer
08:05:57.890 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.27.200.124:34439(127.27.200.124:34439)] Successfully connected to peer
08:05:57.892 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:57.896 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x40eb10fd, L:/127.0.0.1:50288 - R:/127.27.200.126:43511] using SASL/PLAIN
08:05:57.898 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.200.124
08:05:57.923 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:57.923 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.200.125
08:05:57.930 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x8e25349c, L:/127.0.0.1:50640 - R:/127.27.200.124:34439] using SASL/PLAIN
08:05:57.948 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:57.957 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x8a526a98, L:/127.0.0.1:50216 - R:/127.27.200.125:46459] using SASL/PLAIN
08:05:57.972 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:05:57.972 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=114), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [43ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: OK, [73ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: OK, [111ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: OK, deferred=null) after lookup
08:05:57.977 [DEBUG - main] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:05:57.982 [DEBUG - main] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:05:57.982 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.27.17.252:43595(127.27.17.252:43595)] Successfully connected to peer
08:05:57.992 [DEBUG - main] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:05:57.994 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.27.17.254:45447(127.27.17.254:45447)] Successfully connected to peer
08:05:57.999 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.17.252
08:05:58.009 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.27.17.253:37621(127.27.17.253:37621)] Successfully connected to peer
08:05:58.016 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.17.254
08:05:58.016 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.17.253
08:05:58.028 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:58.028 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:58.032 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x62e123f6, L:/127.0.0.1:41488 - R:/127.27.17.252:43595] using SASL/PLAIN
08:05:58.035 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:05:58.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.038219 29233 heartbeater.cc:499] Master 127.27.200.125:46459 was elected leader, sending a full tablet report...
08:05:58.039 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xb013e3fd, L:/127.0.0.1:52366 - R:/127.27.17.253:37621] using SASL/PLAIN
08:05:58.045 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:05:58.047 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=71), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [67ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: OK, deferred=null) after lookup
08:05:58.048 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x4b5cbce8, L:/127.0.0.1:36242 - R:/127.27.17.254:45447] using SASL/PLAIN
08:05:58.051 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table bf7fb2df00f74650a621c1e6c3ca0806
08:05:58.056 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d155ea2c19454246a949669fc5eb32d1 for table 'replication_test_table' with partition [<start>, <end>)
08:05:58.057 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d155ea2c19454246a949669fc5eb32d1@[523ccfb52b2544c393ff06d08a25c7b6(127.27.17.194:34219),d3419957393241e6b3e1b05dcab37487(127.27.17.193:35571),ec9762b17dfd4956a4a1a622857eb01a(127.27.17.195:43439)[L]]}]
08:05:58.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.060752 28572 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50216:
08:05:58.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
08:05:58.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
08:05:58.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:05:58.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
08:05:58.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:05:58.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:05:58.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:05:58.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:05:58.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:05:58.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:05:58.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:05:58.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:05:58.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:05:58.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:05:58.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:05:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:05:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:05:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:05:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:05:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
08:05:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
08:05:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\000\007\000"
08:05:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:05:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
08:05:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
08:05:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:05:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:05:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
08:05:58.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:58.066180 28572 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
08:05:58.139 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 58958c1a8dd2482595eed28616c883d5
08:05:58.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:58.224 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:05:58.224 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:05:58.225 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:05:58.225 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:58.225 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:58.226 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:58.226 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:05:58.226 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:58.226 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:58.226 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:05:58.227 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:58.227 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:05:58.227 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:05:58.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.227948 28874 tablet_service.cc:1511] Processing CreateTablet for tablet d06139fadd954d16b290b208c9e5a749 (DEFAULT_TABLE table=replication_test_table [id=58958c1a8dd2482595eed28616c883d5]), partition=
08:05:58.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.230561 28874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06139fadd954d16b290b208c9e5a749. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:58.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.243847 29019 tablet_service.cc:1511] Processing CreateTablet for tablet d06139fadd954d16b290b208c9e5a749 (DEFAULT_TABLE table=replication_test_table [id=58958c1a8dd2482595eed28616c883d5]), partition=
08:05:58.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.246340 29019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06139fadd954d16b290b208c9e5a749. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:58.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.246181 29165 tablet_service.cc:1511] Processing CreateTablet for tablet d06139fadd954d16b290b208c9e5a749 (DEFAULT_TABLE table=replication_test_table [id=58958c1a8dd2482595eed28616c883d5]), partition=
08:05:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.248700 29165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06139fadd954d16b290b208c9e5a749. 1 dirs total, 0 dirs full, 0 dirs failed
08:05:58.285 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:58.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.291260 29323 tablet_bootstrap.cc:492] T d06139fadd954d16b290b208c9e5a749 P b60948bfd2884317a63414cab8002497: Bootstrap starting.
08:05:58.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.299400 29324 tablet_bootstrap.cc:492] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164: Bootstrap starting.
08:05:58.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.308202 29323 tablet_bootstrap.cc:654] T d06139fadd954d16b290b208c9e5a749 P b60948bfd2884317a63414cab8002497: Neither blocks nor log segments found. Creating new log.
08:05:58.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.320745 29323 log.cc:826] T d06139fadd954d16b290b208c9e5a749 P b60948bfd2884317a63414cab8002497: Log is configured to *not* fsync() on all Append() calls
08:05:58.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.325870 29324 tablet_bootstrap.cc:654] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164: Neither blocks nor log segments found. Creating new log.
08:05:58.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.330075 29324 log.cc:826] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164: Log is configured to *not* fsync() on all Append() calls
08:05:58.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.354209 29324 tablet_bootstrap.cc:492] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164: No bootstrap required, opened a new log
08:05:58.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.354332 29326 tablet_bootstrap.cc:492] T d06139fadd954d16b290b208c9e5a749 P fa47904803a04de8b3b6afc059f9455d: Bootstrap starting.
08:05:58.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.355082 29324 ts_tablet_manager.cc:1403] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164: Time spent bootstrapping tablet: real 0.056s	user 0.024s	sys 0.000s
08:05:58.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.356765 29323 tablet_bootstrap.cc:492] T d06139fadd954d16b290b208c9e5a749 P b60948bfd2884317a63414cab8002497: No bootstrap required, opened a new log
08:05:58.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.357378 29323 ts_tablet_manager.cc:1403] T d06139fadd954d16b290b208c9e5a749 P b60948bfd2884317a63414cab8002497: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.008s
08:05:58.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.365636 29326 tablet_bootstrap.cc:654] T d06139fadd954d16b290b208c9e5a749 P fa47904803a04de8b3b6afc059f9455d: Neither blocks nor log segments found. Creating new log.
08:05:58.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.385222 29326 log.cc:826] T d06139fadd954d16b290b208c9e5a749 P fa47904803a04de8b3b6afc059f9455d: Log is configured to *not* fsync() on all Append() calls
08:05:58.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.395541 29324 raft_consensus.cc:359] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "325c80ff728d4ecfb2fa78a1d106c164" member_type: VOTER last_known_addr { host: "127.27.200.65" port: 36745 } } peers { permanent_uuid: "fa47904803a04de8b3b6afc059f9455d" member_type: VOTER last_known_addr { host: "127.27.200.67" port: 44327 } } peers { permanent_uuid: "b60948bfd2884317a63414cab8002497" member_type: VOTER last_known_addr { host: "127.27.200.66" port: 36045 } }
08:05:58.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.396869 29324 raft_consensus.cc:385] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:58.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.397259 29324 raft_consensus.cc:740] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 325c80ff728d4ecfb2fa78a1d106c164, State: Initialized, Role: FOLLOWER
08:05:58.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.398986 29324 consensus_queue.cc:260] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "325c80ff728d4ecfb2fa78a1d106c164" member_type: VOTER last_known_addr { host: "127.27.200.65" port: 36745 } } peers { permanent_uuid: "fa47904803a04de8b3b6afc059f9455d" member_type: VOTER last_known_addr { host: "127.27.200.67" port: 44327 } } peers { permanent_uuid: "b60948bfd2884317a63414cab8002497" member_type: VOTER last_known_addr { host: "127.27.200.66" port: 36045 } }
08:05:58.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.405359 29326 tablet_bootstrap.cc:492] T d06139fadd954d16b290b208c9e5a749 P fa47904803a04de8b3b6afc059f9455d: No bootstrap required, opened a new log
08:05:58.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.406219 29326 ts_tablet_manager.cc:1403] T d06139fadd954d16b290b208c9e5a749 P fa47904803a04de8b3b6afc059f9455d: Time spent bootstrapping tablet: real 0.054s	user 0.022s	sys 0.000s
08:05:58.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.425488 29324 ts_tablet_manager.cc:1434] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164: Time spent starting tablet: real 0.070s	user 0.029s	sys 0.029s
08:05:58.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.433691 29323 raft_consensus.cc:359] T d06139fadd954d16b290b208c9e5a749 P b60948bfd2884317a63414cab8002497 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "325c80ff728d4ecfb2fa78a1d106c164" member_type: VOTER last_known_addr { host: "127.27.200.65" port: 36745 } } peers { permanent_uuid: "fa47904803a04de8b3b6afc059f9455d" member_type: VOTER last_known_addr { host: "127.27.200.67" port: 44327 } } peers { permanent_uuid: "b60948bfd2884317a63414cab8002497" member_type: VOTER last_known_addr { host: "127.27.200.66" port: 36045 } }
08:05:58.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.434849 29323 raft_consensus.cc:385] T d06139fadd954d16b290b208c9e5a749 P b60948bfd2884317a63414cab8002497 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:58.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.435215 29323 raft_consensus.cc:740] T d06139fadd954d16b290b208c9e5a749 P b60948bfd2884317a63414cab8002497 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b60948bfd2884317a63414cab8002497, State: Initialized, Role: FOLLOWER
08:05:58.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.439882 29323 consensus_queue.cc:260] T d06139fadd954d16b290b208c9e5a749 P b60948bfd2884317a63414cab8002497 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "325c80ff728d4ecfb2fa78a1d106c164" member_type: VOTER last_known_addr { host: "127.27.200.65" port: 36745 } } peers { permanent_uuid: "fa47904803a04de8b3b6afc059f9455d" member_type: VOTER last_known_addr { host: "127.27.200.67" port: 44327 } } peers { permanent_uuid: "b60948bfd2884317a63414cab8002497" member_type: VOTER last_known_addr { host: "127.27.200.66" port: 36045 } }
08:05:58.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.449478 29323 ts_tablet_manager.cc:1434] T d06139fadd954d16b290b208c9e5a749 P b60948bfd2884317a63414cab8002497: Time spent starting tablet: real 0.092s	user 0.032s	sys 0.008s
08:05:58.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.473959 29326 raft_consensus.cc:359] T d06139fadd954d16b290b208c9e5a749 P fa47904803a04de8b3b6afc059f9455d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "325c80ff728d4ecfb2fa78a1d106c164" member_type: VOTER last_known_addr { host: "127.27.200.65" port: 36745 } } peers { permanent_uuid: "fa47904803a04de8b3b6afc059f9455d" member_type: VOTER last_known_addr { host: "127.27.200.67" port: 44327 } } peers { permanent_uuid: "b60948bfd2884317a63414cab8002497" member_type: VOTER last_known_addr { host: "127.27.200.66" port: 36045 } }
08:05:58.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.475479 29326 raft_consensus.cc:385] T d06139fadd954d16b290b208c9e5a749 P fa47904803a04de8b3b6afc059f9455d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:05:58.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.475988 29326 raft_consensus.cc:740] T d06139fadd954d16b290b208c9e5a749 P fa47904803a04de8b3b6afc059f9455d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa47904803a04de8b3b6afc059f9455d, State: Initialized, Role: FOLLOWER
08:05:58.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.477331 29326 consensus_queue.cc:260] T d06139fadd954d16b290b208c9e5a749 P fa47904803a04de8b3b6afc059f9455d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "325c80ff728d4ecfb2fa78a1d106c164" member_type: VOTER last_known_addr { host: "127.27.200.65" port: 36745 } } peers { permanent_uuid: "fa47904803a04de8b3b6afc059f9455d" member_type: VOTER last_known_addr { host: "127.27.200.67" port: 44327 } } peers { permanent_uuid: "b60948bfd2884317a63414cab8002497" member_type: VOTER last_known_addr { host: "127.27.200.66" port: 36045 } }
08:05:58.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.499755 29326 ts_tablet_manager.cc:1434] T d06139fadd954d16b290b208c9e5a749 P fa47904803a04de8b3b6afc059f9455d: Time spent starting tablet: real 0.093s	user 0.034s	sys 0.009s
08:05:58.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:58.507838 29089 tablet.cc:2404] T d06139fadd954d16b290b208c9e5a749 P b60948bfd2884317a63414cab8002497: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:05:58.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:58.581786 28948 tablet.cc:2404] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:05:58.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.603333 29329 raft_consensus.cc:493] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:05:58.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.604117 29329 raft_consensus.cc:515] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "325c80ff728d4ecfb2fa78a1d106c164" member_type: VOTER last_known_addr { host: "127.27.200.65" port: 36745 } } peers { permanent_uuid: "fa47904803a04de8b3b6afc059f9455d" member_type: VOTER last_known_addr { host: "127.27.200.67" port: 44327 } } peers { permanent_uuid: "b60948bfd2884317a63414cab8002497" member_type: VOTER last_known_addr { host: "127.27.200.66" port: 36045 } }
08:05:58.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.608108 29329 leader_election.cc:290] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa47904803a04de8b3b6afc059f9455d (127.27.200.67:44327), b60948bfd2884317a63414cab8002497 (127.27.200.66:36045)
08:05:58.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.640125 29185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06139fadd954d16b290b208c9e5a749" candidate_uuid: "325c80ff728d4ecfb2fa78a1d106c164" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa47904803a04de8b3b6afc059f9455d" is_pre_election: true
08:05:58.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.641285 29185 raft_consensus.cc:2468] T d06139fadd954d16b290b208c9e5a749 P fa47904803a04de8b3b6afc059f9455d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 325c80ff728d4ecfb2fa78a1d106c164 in term 0.
08:05:58.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.644006 28828 leader_election.cc:304] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 325c80ff728d4ecfb2fa78a1d106c164, fa47904803a04de8b3b6afc059f9455d; no voters: 
08:05:58.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.645131 29329 raft_consensus.cc:2804] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:05:58.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.645534 29329 raft_consensus.cc:493] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:05:58.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.645931 29329 raft_consensus.cc:3060] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164 [term 0 FOLLOWER]: Advancing to term 1
08:05:58.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.653966 29329 raft_consensus.cc:515] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "325c80ff728d4ecfb2fa78a1d106c164" member_type: VOTER last_known_addr { host: "127.27.200.65" port: 36745 } } peers { permanent_uuid: "fa47904803a04de8b3b6afc059f9455d" member_type: VOTER last_known_addr { host: "127.27.200.67" port: 44327 } } peers { permanent_uuid: "b60948bfd2884317a63414cab8002497" member_type: VOTER last_known_addr { host: "127.27.200.66" port: 36045 } }
08:05:58.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.657346 29185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06139fadd954d16b290b208c9e5a749" candidate_uuid: "325c80ff728d4ecfb2fa78a1d106c164" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa47904803a04de8b3b6afc059f9455d"
08:05:58.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.658270 29185 raft_consensus.cc:3060] T d06139fadd954d16b290b208c9e5a749 P fa47904803a04de8b3b6afc059f9455d [term 0 FOLLOWER]: Advancing to term 1
08:05:58.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.666989 29329 leader_election.cc:290] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164 [CANDIDATE]: Term 1 election: Requested vote from peers fa47904803a04de8b3b6afc059f9455d (127.27.200.67:44327), b60948bfd2884317a63414cab8002497 (127.27.200.66:36045)
08:05:58.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.669978 29185 raft_consensus.cc:2468] T d06139fadd954d16b290b208c9e5a749 P fa47904803a04de8b3b6afc059f9455d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 325c80ff728d4ecfb2fa78a1d106c164 in term 1.
08:05:58.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.671370 28828 leader_election.cc:304] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 325c80ff728d4ecfb2fa78a1d106c164, fa47904803a04de8b3b6afc059f9455d; no voters: 
08:05:58.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.672349 29329 raft_consensus.cc:2804] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164 [term 1 FOLLOWER]: Leader election won for term 1
08:05:58.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.677618 29039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06139fadd954d16b290b208c9e5a749" candidate_uuid: "325c80ff728d4ecfb2fa78a1d106c164" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b60948bfd2884317a63414cab8002497" is_pre_election: true
08:05:58.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.678748 29039 raft_consensus.cc:2468] T d06139fadd954d16b290b208c9e5a749 P b60948bfd2884317a63414cab8002497 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 325c80ff728d4ecfb2fa78a1d106c164 in term 0.
08:05:58.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:58.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.680395 29038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06139fadd954d16b290b208c9e5a749" candidate_uuid: "325c80ff728d4ecfb2fa78a1d106c164" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b60948bfd2884317a63414cab8002497"
08:05:58.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.678606 29329 raft_consensus.cc:697] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164 [term 1 LEADER]: Becoming Leader. State: Replica: 325c80ff728d4ecfb2fa78a1d106c164, State: Running, Role: LEADER
08:05:58.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.681135 29038 raft_consensus.cc:3060] T d06139fadd954d16b290b208c9e5a749 P b60948bfd2884317a63414cab8002497 [term 0 FOLLOWER]: Advancing to term 1
08:05:58.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.681684 29329 consensus_queue.cc:237] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "325c80ff728d4ecfb2fa78a1d106c164" member_type: VOTER last_known_addr { host: "127.27.200.65" port: 36745 } } peers { permanent_uuid: "fa47904803a04de8b3b6afc059f9455d" member_type: VOTER last_known_addr { host: "127.27.200.67" port: 44327 } } peers { permanent_uuid: "b60948bfd2884317a63414cab8002497" member_type: VOTER last_known_addr { host: "127.27.200.66" port: 36045 } }
08:05:58.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.691000 29038 raft_consensus.cc:2468] T d06139fadd954d16b290b208c9e5a749 P b60948bfd2884317a63414cab8002497 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 325c80ff728d4ecfb2fa78a1d106c164 in term 1.
08:05:58.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:58.700297 28572 catalog_manager.cc:5696] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164 reported cstate change: term changed from 0 to 1, leader changed from <none> to 325c80ff728d4ecfb2fa78a1d106c164 (127.27.200.65). New cstate: current_term: 1 leader_uuid: "325c80ff728d4ecfb2fa78a1d106c164" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "325c80ff728d4ecfb2fa78a1d106c164" member_type: VOTER last_known_addr { host: "127.27.200.65" port: 36745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa47904803a04de8b3b6afc059f9455d" member_type: VOTER last_known_addr { host: "127.27.200.67" port: 44327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b60948bfd2884317a63414cab8002497" member_type: VOTER last_known_addr { host: "127.27.200.66" port: 36045 } health_report { overall_health: UNKNOWN } } }
08:05:58.728 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:05:58.729 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:05:58.729 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:05:58.732 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:58.732 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:58.732 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:05:58.736 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:58.736 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:58.736 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:05:58.737 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:58.737 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:58.737 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:05:58.737 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:05:58.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:05:58.729977 29239 tablet.cc:2404] T d06139fadd954d16b290b208c9e5a749 P fa47904803a04de8b3b6afc059f9455d: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:05:58.785 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:58.964 [DEBUG - main] (Connection.java:575) [peer master-127.27.17.253:37621(127.27.17.253:37621)] disconnecting while in state READY
08:05:58.964 [DEBUG - main] (Connection.java:575) [peer master-127.27.17.252:43595(127.27.17.252:43595)] disconnecting while in state READY
08:05:58.964 [DEBUG - main] (Connection.java:575) [peer master-127.27.17.254:45447(127.27.17.254:45447)] disconnecting while in state READY
08:05:58.965 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.27.17.253:37621(127.27.17.253:37621)] handling channelInactive
08:05:58.966 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state READY due to: connection closed
08:05:58.966 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.27.17.254:45447(127.27.17.254:45447)] handling channelInactive
08:05:58.966 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state READY due to: connection closed
08:05:58.967 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:58.968 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
08:05:58.970 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
08:05:58.981 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.27.17.252:43595(127.27.17.252:43595)] handling channelInactive
08:05:58.981 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state READY due to: connection closed
08:05:58.981 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
08:05:58.982 [DEBUG - main] (Connection.java:575) [peer master-127.27.200.125:46459(127.27.200.125:46459)] disconnecting while in state READY
08:05:58.982 [DEBUG - main] (Connection.java:575) [peer master-127.27.200.126:43511(127.27.200.126:43511)] disconnecting while in state READY
08:05:58.982 [DEBUG - main] (Connection.java:575) [peer master-127.27.200.124:34439(127.27.200.124:34439)] disconnecting while in state READY
08:05:58.983 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.27.200.124:34439(127.27.200.124:34439)] handling channelInactive
08:05:58.983 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state READY due to: connection closed
08:05:58.983 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.27.200.125:46459(127.27.200.125:46459)] handling channelInactive
08:05:58.983 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state READY due to: connection closed
08:05:58.984 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:05:58.987 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
08:05:58.987 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-2
08:05:58.999 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.27.200.126:43511(127.27.200.126:43511)] handling channelInactive
08:05:58.999 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state READY due to: connection closed
08:05:58.999 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
08:05:59.002 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:05:59.003 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
08:05:59.003 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
08:05:59.003 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:05:59.003 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:05:59.003 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:05:59.047 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
08:05:59.047 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
08:05:59.047 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
08:05:59.047 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
08:05:59.047 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
08:05:59.047 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
08:05:59.048 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
08:05:59.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:59.065287 29329 consensus_queue.cc:1048] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b60948bfd2884317a63414cab8002497" member_type: VOTER last_known_addr { host: "127.27.200.66" port: 36045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:05:59.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:05:59.172515 29329 consensus_queue.cc:1048] T d06139fadd954d16b290b208c9e5a749 P 325c80ff728d4ecfb2fa78a1d106c164 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa47904803a04de8b3b6afc059f9455d" member_type: VOTER last_known_addr { host: "127.27.200.67" port: 44327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:05:59.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:59.285 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:59.351 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
08:05:59.435 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
08:05:59.436 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
08:05:59.436 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
08:05:59.453 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
08:05:59.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:05:59.784 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:00.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:00.284 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:00.286 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:00.286 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:00.287 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:00.287 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:00.287 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:00.288 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:00.288 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:00.288 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:00.288 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:00.289 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:00.289 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:00.289 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:00.289 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:00.473 [INFO - flink-pekko.actor.default-dispatcher-4] (Slf4jLogger.scala:117) Slf4jLogger started
08:06:00.624 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:00.625 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:00.625 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:00.626 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:00.626 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:00.626 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:00.626 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:00.626 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:00.627 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:00.628 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:00.628 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:00.628 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:00.628 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:00.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:00.688 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
08:06:00.708 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
08:06:00.748 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
08:06:00.780 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
08:06:00.782 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:00.783 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:00.784 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:00.784 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:00.784 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:00.785 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:00.785 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:00.785 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:00.785 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:00.786 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:00.786 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:00.786 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:00.810 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:00.810 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:00.829 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
08:06:00.842 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
08:06:00.844 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
08:06:00.844 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
08:06:00.845 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
08:06:00.848 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:00.850 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:00.851 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:00.851 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:00.852 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:00.852 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:00.852 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:00.853 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:00.853 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:00.853 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:00.853 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:00.853 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:00.853 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:00.854 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
08:06:00.854 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
08:06:00.854 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
08:06:00.854 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
08:06:00.855 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
08:06:00.855 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
08:06:00.856 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
08:06:00.856 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
08:06:00.856 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
08:06:00.856 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
08:06:00.856 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
08:06:00.856 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
08:06:00.856 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
08:06:00.857 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
08:06:00.857 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
08:06:00.857 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
08:06:00.857 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
08:06:00.858 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
08:06:00.858 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
08:06:00.858 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
08:06:00.859 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_304f888531820a0c56e17cb587aa0798/blobStorage
08:06:00.860 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:41731 - max concurrent requests: 50 - max backlog: 1000
08:06:00.861 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_304f888531820a0c56e17cb587aa0798/blobStorage
08:06:00.862 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_304f888531820a0c56e17cb587aa0798/blobStorage
08:06:00.862 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
08:06:00.863 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: 602375e5-074a-479e-9f69-650d6717a4da
08:06:00.865 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 37 GB (77.08% usable)
08:06:00.867 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-030e22c3-a396-4b26-b355-2d50328be2bb
08:06:00.869 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-03568c46-427e-47b4-b70c-43b030d5d405
08:06:00.984 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
08:06:00.985 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
08:06:00.986 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
08:06:00.986 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
08:06:00.987 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
08:06:00.992 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_8 .
08:06:01.025 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultJobLeaderService.java:127) Start job leader service.
08:06:01.026 [INFO - flink-pekko.actor.default-dispatcher-4] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-563c22c2-84c6-4f28-96dd-84b334b59770
08:06:01.047 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
08:06:01.048 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
08:06:01.097 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
08:06:01.097 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
08:06:01.108 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:37787
08:06:01.108 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
08:06:01.110 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
08:06:01.111 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:37787 was granted leadership with leaderSessionID=60afa3a2-ef5d-4b84-976b-7efd92be7c31
08:06:01.111 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:37787 , session=60afa3a2-ef5d-4b84-976b-7efd92be7c31
08:06:01.112 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
08:06:01.112 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
08:06:01.112 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id 5e5f3216-9dd2-4801-8c27-66fc582cd52e. Creating new DispatcherLeaderProcess.
08:06:01.112 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
08:06:01.113 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
08:06:01.132 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
08:06:01.132 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
08:06:01.137 [INFO - mini-cluster-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_9 .
08:06:01.146 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_9 , session=5e5f3216-9dd2-4801-8c27-66fc582cd52e
08:06:01.159 [INFO - pool-129-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id 884e01ec-f162-445f-97a9-7f6de8b8d2a0.
08:06:01.161 [INFO - pool-129-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_10 .
08:06:01.180 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:01.182 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:253) Starting the resource manager.
08:06:01.189 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:212) Starting the slot manager.
08:06:01.190 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:308) Starting tokens update task
08:06:01.190 [WARN - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
08:06:01.190 [WARN - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
08:06:01.193 [INFO - mini-cluster-io-thread-3] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_10 , session=884e01ec-f162-445f-97a9-7f6de8b8d2a0
08:06:01.195 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_10(97a97f6de8b8d2a0884e01ecf162445f).
08:06:01.215 [INFO - flink-pekko.actor.default-dispatcher-7] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
08:06:01.226 [INFO - flink-pekko.actor.default-dispatcher-7] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (0d2ddb76420639a9ec06ca05e894cb50).
08:06:01.226 [INFO - flink-pekko.actor.default-dispatcher-8] (ResourceManager.java:1080) Registering TaskManager with ResourceID 602375e5-074a-479e-9f69-650d6717a4da (pekko://flink/user/rpc/taskmanager_8) at ResourceManager
08:06:01.227 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_10 under registration id 6a31d73fdb313194a2d09bdf36cb5975.
08:06:01.227 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:344) Registering task executor 602375e5-074a-479e-9f69-650d6717a4da under 6a31d73fdb313194a2d09bdf36cb5975 at the slot manager.
08:06:01.230 [INFO - flink-pekko.actor.default-dispatcher-7] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (0d2ddb76420639a9ec06ca05e894cb50).
08:06:01.230 [INFO - flink-pekko.actor.default-dispatcher-7] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-0d2ddb76420639a9ec06ca05e894cb50'.
08:06:01.231 [INFO - mini-cluster-io-thread-4] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job 0d2ddb76420639a9ec06ca05e894cb50 was granted leadership with leader id eba02128-7684-42de-8718-739323db0955. Creating new JobMasterServiceProcess.
08:06:01.245 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_11 .
08:06:01.252 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (0d2ddb76420639a9ec06ca05e894cb50).
08:06:01.253 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (0d2ddb76420639a9ec06ca05e894cb50).
08:06:01.257 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph bc67995db6a61b8ee40948722213b72d for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:01.263 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (0d2ddb76420639a9ec06ca05e894cb50).
08:06:01.263 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
08:06:01.265 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
08:06:01.265 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@12672900
08:06:01.265 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:06:01.266 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:06:01.269 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
08:06:01.269 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@3ceb49d7 for Flink Streaming Job (0d2ddb76420639a9ec06ca05e894cb50).
08:06:01.270 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_11 , session=eba02128-7684-42de-8718-739323db0955
08:06:01.272 [INFO - flink-pekko.actor.default-dispatcher-6] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (0d2ddb76420639a9ec06ca05e894cb50) under job master id 8718739323db0955eba02128768442de.
08:06:01.273 [INFO - flink-pekko.actor.default-dispatcher-6] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
08:06:01.275 [DEBUG - flink-pekko.actor.default-dispatcher-6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:01.276 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
08:06:01.276 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (0d2ddb76420639a9ec06ca05e894cb50) switched from state CREATED to RUNNING.
08:06:01.278 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
08:06:01.279 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
08:06:01.280 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
08:06:01.280 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
08:06:01.281 [INFO - flink-pekko.actor.default-dispatcher-6] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_10(97a97f6de8b8d2a0884e01ecf162445f)
08:06:01.282 [INFO - flink-pekko.actor.default-dispatcher-7] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
08:06:01.283 [INFO - flink-pekko.actor.default-dispatcher-7] (ResourceManager.java:390) Registering job manager 8718739323db0955eba02128768442de@pekko://flink/user/rpc/jobmanager_11 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:01.284 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:01.288 [INFO - flink-pekko.actor.default-dispatcher-7] (ResourceManager.java:1015) Registered job manager 8718739323db0955eba02128768442de@pekko://flink/user/rpc/jobmanager_11 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:01.293 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:01.297 [INFO - flink-pekko.actor.default-dispatcher-6] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: 97a97f6de8b8d2a0884e01ecf162445f.
08:06:01.297 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:01.297 [DEBUG - main] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:01.298 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:06:01.299 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.27.17.252:43595(127.27.17.252:43595)] Successfully connected to peer
08:06:01.300 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:01.300 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job 0d2ddb76420639a9ec06ca05e894cb50
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager 602375e5-074a-479e-9f69-650d6717a4da
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
08:06:01.301 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.27.17.254:45447(127.27.17.254:45447)] Successfully connected to peer
08:06:01.304 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 23d75c1cae20f6d786d6e473edbc6825 from 602375e5-074a-479e-9f69-650d6717a4da for job 0d2ddb76420639a9ec06ca05e894cb50 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:06:01.305 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.17.252
08:06:01.305 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 51ba13794eaa695dfcc17a66fc9521a4 from 602375e5-074a-479e-9f69-650d6717a4da for job 0d2ddb76420639a9ec06ca05e894cb50 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:06:01.306 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot e7235da53f93c0af3219c2857bfb1cae from 602375e5-074a-479e-9f69-650d6717a4da for job 0d2ddb76420639a9ec06ca05e894cb50 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:06:01.306 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 562b84b71b659c92bf587d4c4d45167a from 602375e5-074a-479e-9f69-650d6717a4da for job 0d2ddb76420639a9ec06ca05e894cb50 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:06:01.307 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:1149) Receive slot request 23d75c1cae20f6d786d6e473edbc6825 for job 0d2ddb76420639a9ec06ca05e894cb50 from resource manager with leader id 97a97f6de8b8d2a0884e01ecf162445f.
08:06:01.307 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:321) Allocated slot for 23d75c1cae20f6d786d6e473edbc6825 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:06:01.311 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.17.254
08:06:01.313 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.27.17.253:37621(127.27.17.253:37621)] Successfully connected to peer
08:06:01.323 [DEBUG - main] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:01.326 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultJobLeaderService.java:192) Add job 0d2ddb76420639a9ec06ca05e894cb50 for job leader monitoring.
08:06:01.326 [INFO - mini-cluster-io-thread-4] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_11 with leader id eba02128-7684-42de-8718-739323db0955.
08:06:01.328 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:1149) Receive slot request 51ba13794eaa695dfcc17a66fc9521a4 for job 0d2ddb76420639a9ec06ca05e894cb50 from resource manager with leader id 97a97f6de8b8d2a0884e01ecf162445f.
08:06:01.328 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:321) Allocated slot for 51ba13794eaa695dfcc17a66fc9521a4 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:06:01.329 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:1149) Receive slot request e7235da53f93c0af3219c2857bfb1cae for job 0d2ddb76420639a9ec06ca05e894cb50 from resource manager with leader id 97a97f6de8b8d2a0884e01ecf162445f.
08:06:01.329 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:321) Allocated slot for e7235da53f93c0af3219c2857bfb1cae with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:06:01.330 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:1149) Receive slot request 562b84b71b659c92bf587d4c4d45167a for job 0d2ddb76420639a9ec06ca05e894cb50 from resource manager with leader id 97a97f6de8b8d2a0884e01ecf162445f.
08:06:01.330 [INFO - flink-pekko.actor.default-dispatcher-4] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
08:06:01.330 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:321) Allocated slot for 562b84b71b659c92bf587d4c4d45167a with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:06:01.331 [DEBUG - main] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:01.332 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_11 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:01.333 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1783) Establish JobManager connection for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:01.333 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:01.334 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
08:06:01.335 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id 23d75c1cae20f6d786d6e473edbc6825
08:06:01.335 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 23d75c1cae20f6d786d6e473edbc6825.
08:06:01.336 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.27.200.124:34439(127.27.200.124:34439)] Successfully connected to peer
08:06:01.337 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:01.337 [INFO - flink-pekko.actor.default-dispatcher-4] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
08:06:01.337 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id 0d2ddb76420639a9ec06ca05e894cb50
08:06:01.339 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 23d75c1cae20f6d786d6e473edbc6825.
08:06:01.340 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:01.351 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x3415c278, L:/127.0.0.1:41490 - R:/127.27.17.252:43595] using SASL/PLAIN
08:06:01.351 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.27.200.126:43511(127.27.200.126:43511)] Successfully connected to peer
08:06:01.361 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:06:01.361 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:01.361 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=77), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: OK, deferred=null) after lookup
08:06:01.367 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.200.126
08:06:01.367 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table bf7fb2df00f74650a621c1e6c3ca0806
08:06:01.367 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.17.253
08:06:01.375 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d155ea2c19454246a949669fc5eb32d1 for table 'replication_test_table' with partition [<start>, <end>)
08:06:01.375 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d155ea2c19454246a949669fc5eb32d1@[523ccfb52b2544c393ff06d08a25c7b6(127.27.17.194:34219),d3419957393241e6b3e1b05dcab37487(127.27.17.193:35571),ec9762b17dfd4956a4a1a622857eb01a(127.27.17.195:43439)[L]]}]
08:06:01.380 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x869716ab, L:/127.0.0.1:36244 - R:/127.27.17.254:45447] using SASL/PLAIN
08:06:01.382 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.27.200.125:46459(127.27.200.125:46459)] Successfully connected to peer
08:06:01.382 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:01.386 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.200.124
08:06:01.390 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x2658b4a8, L:/127.0.0.1:52376 - R:/127.27.17.253:37621] using SASL/PLAIN
08:06:01.390 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:01.396 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7fe5bb52, L:/127.0.0.1:50300 - R:/127.27.200.126:43511] using SASL/PLAIN
08:06:01.400 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.200.125
08:06:01.403 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:01.406 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
08:06:01.406 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id 562b84b71b659c92bf587d4c4d45167a
08:06:01.408 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xe6b71720, L:/127.0.0.1:50650 - R:/127.27.200.124:34439] using SASL/PLAIN
08:06:01.410 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
08:06:01.410 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id 51ba13794eaa695dfcc17a66fc9521a4
08:06:01.422 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
08:06:01.422 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id e7235da53f93c0af3219c2857bfb1cae
08:06:01.424 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:01.425 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:01.426 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 562b84b71b659c92bf587d4c4d45167a.
08:06:01.428 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id 562b84b71b659c92bf587d4c4d45167a.
08:06:01.429 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 51ba13794eaa695dfcc17a66fc9521a4.
08:06:01.431 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id 51ba13794eaa695dfcc17a66fc9521a4.
08:06:01.432 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
08:06:01.432 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
08:06:01.433 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@245c8e25
08:06:01.433 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:06:01.433 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:06:01.434 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
08:06:01.434 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
08:06:01.437 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
08:06:01.437 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
08:06:01.437 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@25f4feb3
08:06:01.437 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:06:01.438 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:06:01.438 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
08:06:01.439 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
08:06:01.441 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 23d75c1cae20f6d786d6e473edbc6825.
08:06:01.441 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 562b84b71b659c92bf587d4c4d45167a.
08:06:01.441 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 51ba13794eaa695dfcc17a66fc9521a4.
08:06:01.441 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot e7235da53f93c0af3219c2857bfb1cae.
08:06:01.441 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x437e57ea, L:/127.0.0.1:50232 - R:/127.27.200.125:46459] using SASL/PLAIN
08:06:01.441 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot e7235da53f93c0af3219c2857bfb1cae.
08:06:01.446 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2339c444
08:06:01.447 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:06:01.447 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=152), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [105ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: OK, [115ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: OK, [149ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: OK, deferred=null) after lookup
08:06:01.448 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
08:06:01.454 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
08:06:01.454 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:01.455 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 58958c1a8dd2482595eed28616c883d5
08:06:01.455 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@442315ad
08:06:01.455 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:06:01.455 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:01.455 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:06:01.456 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
08:06:01.456 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
08:06:01.458 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id e7235da53f93c0af3219c2857bfb1cae.
08:06:01.460 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@25994c62
08:06:01.462 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d06139fadd954d16b290b208c9e5a749 for table 'replication_test_table' with partition [<start>, <end>)
08:06:01.462 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d06139fadd954d16b290b208c9e5a749@[325c80ff728d4ecfb2fa78a1d106c164(127.27.200.65:36745)[L],b60948bfd2884317a63414cab8002497(127.27.200.66:36045),fa47904803a04de8b3b6afc059f9455d(127.27.200.67:44327)]}]
08:06:01.462 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=6), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.27.200.125:46459, [6ms] Sub RPC GetTableLocations: received response from server master-127.27.200.125:46459: OK, deferred=null)) after lookup
08:06:01.463 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 325c80ff728d4ecfb2fa78a1d106c164(127.27.200.65:36745)] connecting to peer
08:06:01.464 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@713bbc21
08:06:01.464 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:01.466 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:01.470 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:01.471 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
08:06:01.471 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.27.200.126:43511(127.27.200.126:43511)] Successfully connected to peer
08:06:01.471 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
08:06:01.473 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@32b0ffa0
08:06:01.473 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:06:01.473 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 325c80ff728d4ecfb2fa78a1d106c164(127.27.200.65:36745)] Successfully connected to peer
08:06:01.473 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:06:01.474 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
08:06:01.474 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
08:06:01.475 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.200.126
08:06:01.479 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@15962e26
08:06:01.482 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:01.486 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:01.487 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:01.487 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.27.200.124:34439(127.27.200.124:34439)] Successfully connected to peer
08:06:01.488 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:01.488 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:01.488 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:01.488 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:01.488 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:01.489 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:01.489 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:01.489 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:01.489 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:01.489 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:01.490 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:01.490 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:01.491 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:01.493 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.200.124
08:06:01.498 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:01.503 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.27.200.125:46459(127.27.200.125:46459)] Successfully connected to peer
08:06:01.504 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:01.505 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x43071e6b, L:/127.0.0.1:50316 - R:/127.27.200.126:43511] using SASL/PLAIN
08:06:01.510 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.200.125
08:06:01.514 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x3871aa31, L:/127.0.0.1:37452 - R:/127.27.200.65:36745] using TOKEN/null
08:06:01.521 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:01.522 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:01.524 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:01.524 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:01.526 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x89506136, L:/127.0.0.1:50656 - R:/127.27.200.124:34439] using SASL/PLAIN
08:06:01.527 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x7a4ca3bc, L:/127.0.0.1:50246 - R:/127.27.200.125:46459] using SASL/PLAIN
08:06:01.528 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.27.200.126:43511(127.27.200.126:43511)] Successfully connected to peer
08:06:01.531 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.200.126
08:06:01.536 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:06:01.536 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=81), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [58ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: OK, [75ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: OK, [80ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: OK, deferred=null) after lookup
08:06:01.539 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 58958c1a8dd2482595eed28616c883d5
08:06:01.543 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 58958c1a8dd2482595eed28616c883d5
08:06:01.544 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5f803382
08:06:01.546 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
08:06:01.546 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
08:06:01.548 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:01.551 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x382bb93a, L:/127.0.0.1:50328 - R:/127.27.200.126:43511] using SASL/PLAIN
08:06:01.555 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d06139fadd954d16b290b208c9e5a749, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:01.566 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:01.566 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.27.200.126:43511(127.27.200.126:43511)] Successfully connected to peer
08:06:01.569 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.200.126
08:06:01.570 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:01.571 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.27.200.124:34439(127.27.200.124:34439)] Successfully connected to peer
08:06:01.575 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.200.124
08:06:01.578 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:01.581 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:01.588 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x743fff26, L:/127.0.0.1:50334 - R:/127.27.200.126:43511] using SASL/PLAIN
08:06:01.598 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
08:06:01.599 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='26358df4ef86a3c0927ef188c1b7636fe78b7eda3db1d38ff6a159df36335c44'}]
08:06:01.599 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:01.601 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:01.602 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.27.200.125:46459(127.27.200.125:46459)] Successfully connected to peer
08:06:01.604 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:01.605 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.200.125
08:06:01.611 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d06139fadd954d16b290b208c9e5a749, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:01.612 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.27.200.126:43511(127.27.200.126:43511)] Successfully connected to peer
08:06:01.613 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:01.617 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:01.618 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x5dfb2782, L:/127.0.0.1:50664 - R:/127.27.200.124:34439] using SASL/PLAIN
08:06:01.618 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.27.200.125:46459(127.27.200.125:46459)] Successfully connected to peer
08:06:01.623 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.200.126
08:06:01.628 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.27.200.124:34439(127.27.200.124:34439)] Successfully connected to peer
08:06:01.634 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.200.124
08:06:01.636 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x9934d857, L:/127.0.0.1:50256 - R:/127.27.200.125:46459] using SASL/PLAIN
08:06:01.642 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.200.125
08:06:01.643 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:01.646 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:06:01.648 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=160), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [70ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: OK, [98ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: OK, [122ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: OK, deferred=null) after lookup
08:06:01.652 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:06:01.653 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299998, tablet=d155ea2c19454246a949669fc5eb32d1@[523ccfb52b2544c393ff06d08a25c7b6(127.27.17.194:34219),d3419957393241e6b3e1b05dcab37487(127.27.17.193:35571),ec9762b17dfd4956a4a1a622857eb01a(127.27.17.195:43439)[L]]}]
08:06:01.655 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:01.658 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xe55d4e8f, L:/127.0.0.1:50258 - R:/127.27.200.125:46459] using SASL/PLAIN
08:06:01.662 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:06:01.662 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 58958c1a8dd2482595eed28616c883d5
08:06:01.662 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=171), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [83ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: OK, deferred=null) after lookup
08:06:01.666 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 58958c1a8dd2482595eed28616c883d5
08:06:01.666 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@90a8bc0
08:06:01.670 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d06139fadd954d16b290b208c9e5a749, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:01.671 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
08:06:01.672 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x84c1bf08, L:/127.0.0.1:50348 - R:/127.27.200.126:43511] using SASL/PLAIN
08:06:01.673 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
08:06:01.673 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
08:06:01.673 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:01.677 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 58958c1a8dd2482595eed28616c883d5
08:06:01.677 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:01.679 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x19bc2727, L:/127.0.0.1:50672 - R:/127.27.200.124:34439] using SASL/PLAIN
08:06:01.680 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:01.680 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 58958c1a8dd2482595eed28616c883d5
08:06:01.681 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@f644e49
08:06:01.683 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
08:06:01.683 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
08:06:01.683 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.27.200.124:34439(127.27.200.124:34439)] Successfully connected to peer
08:06:01.690 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.27.200.125:46459(127.27.200.125:46459)] Successfully connected to peer
08:06:01.693 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.200.124
08:06:01.693 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.200.125
08:06:01.694 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 523ccfb52b2544c393ff06d08a25c7b6(127.27.17.194:34219)] connecting to peer
08:06:01.704 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:01.710 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
08:06:01.711 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:01.723 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x59f1de1f, L:/127.0.0.1:50678 - R:/127.27.200.124:34439] using SASL/PLAIN
08:06:01.728 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d06139fadd954d16b290b208c9e5a749, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:01.745 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xdfa2241d, L:/127.0.0.1:50268 - R:/127.27.200.125:46459] using SASL/PLAIN
08:06:01.740 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 523ccfb52b2544c393ff06d08a25c7b6(127.27.17.194:34219)] Successfully connected to peer
08:06:01.753 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:06:01.753 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=288), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [72ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: OK, [195ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [245ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: OK, [270ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: OK, deferred=null) after lookup
08:06:01.767 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.17.194
08:06:01.779 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
08:06:01.788 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
08:06:01.788 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:01.789 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d06139fadd954d16b290b208c9e5a749, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:01.791 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 58958c1a8dd2482595eed28616c883d5
08:06:01.795 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
08:06:01.800 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 58958c1a8dd2482595eed28616c883d5
08:06:01.800 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3b6eb0a3
08:06:01.802 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
08:06:01.802 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
08:06:01.819 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
08:06:01.821 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
08:06:01.824 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:01.839 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x3c63a152, L:/127.0.0.1:60166 - R:/127.27.17.194:34219] using SASL/PLAIN
08:06:01.846 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d06139fadd954d16b290b208c9e5a749, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:01.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091561847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:01.865 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false, responseScanTimestamp = 7287159035015168001) for scanner KuduScanner(table=replication_test_table, tablet=d155ea2c19454246a949669fc5eb32d1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:01.866 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [26358df4ef86a3c0927ef188c1b7636fe78b7eda3db1d38ff6a159df36335c44]
08:06:01.903 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d06139fadd954d16b290b208c9e5a749, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:01.915 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
08:06:01.921 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [26358df4ef86a3c0927ef188c1b7636fe78b7eda3db1d38ff6a159df36335c44]
08:06:01.923 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
08:06:01.923 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
08:06:01.924 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 26358df4ef86a3c0927ef188c1b7636fe78b7eda3db1d38ff6a159df36335c44 finished by subtask 0; deferring removal (restored in pending)
08:06:01.926 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 523ccfb52b2544c393ff06d08a25c7b6(127.27.17.194:34219)] disconnecting while in state READY
08:06:01.927 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d06139fadd954d16b290b208c9e5a749 for table 'replication_test_table' with partition [<start>, <end>)
08:06:01.927 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d06139fadd954d16b290b208c9e5a749@[325c80ff728d4ecfb2fa78a1d106c164(127.27.200.65:36745)[L],b60948bfd2884317a63414cab8002497(127.27.200.66:36045),fa47904803a04de8b3b6afc059f9455d(127.27.200.67:44327)]}]
08:06:01.932 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:06:01.932 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job 0d2ddb76420639a9ec06ca05e894cb50 (1584 bytes, checkpointDuration=85 ms, finalizationTime=0 ms).
08:06:01.935 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
08:06:01.935 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 26358df4ef86a3c0927ef188c1b7636fe78b7eda3db1d38ff6a159df36335c44 from pending
08:06:01.936 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 1 finished splits from enumerator state
08:06:01.939 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d06139fadd954d16b290b208c9e5a749 for table 'replication_test_table' with partition [<start>, <end>)
08:06:01.939 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d06139fadd954d16b290b208c9e5a749@[325c80ff728d4ecfb2fa78a1d106c164(127.27.200.65:36745)[L],b60948bfd2884317a63414cab8002497(127.27.200.66:36045),fa47904803a04de8b3b6afc059f9455d(127.27.200.67:44327)]}]
08:06:01.940 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d06139fadd954d16b290b208c9e5a749 for table 'replication_test_table' with partition [<start>, <end>)
08:06:01.940 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d06139fadd954d16b290b208c9e5a749@[325c80ff728d4ecfb2fa78a1d106c164(127.27.200.65:36745)[L],b60948bfd2884317a63414cab8002497(127.27.200.66:36045),fa47904803a04de8b3b6afc059f9455d(127.27.200.67:44327)]}]
08:06:01.941 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d06139fadd954d16b290b208c9e5a749 for table 'replication_test_table' with partition [<start>, <end>)
08:06:01.941 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d06139fadd954d16b290b208c9e5a749@[325c80ff728d4ecfb2fa78a1d106c164(127.27.200.65:36745)[L],b60948bfd2884317a63414cab8002497(127.27.200.66:36045),fa47904803a04de8b3b6afc059f9455d(127.27.200.67:44327)]}]
08:06:01.942 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d06139fadd954d16b290b208c9e5a749 for table 'replication_test_table' with partition [<start>, <end>)
08:06:01.942 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d06139fadd954d16b290b208c9e5a749@[325c80ff728d4ecfb2fa78a1d106c164(127.27.200.65:36745)[L],b60948bfd2884317a63414cab8002497(127.27.200.66:36045),fa47904803a04de8b3b6afc059f9455d(127.27.200.67:44327)]}]
08:06:01.943 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d06139fadd954d16b290b208c9e5a749 for table 'replication_test_table' with partition [<start>, <end>)
08:06:01.943 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d06139fadd954d16b290b208c9e5a749@[325c80ff728d4ecfb2fa78a1d106c164(127.27.200.65:36745)[L],b60948bfd2884317a63414cab8002497(127.27.200.66:36045),fa47904803a04de8b3b6afc059f9455d(127.27.200.67:44327)]}]
08:06:01.947 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d06139fadd954d16b290b208c9e5a749 for table 'replication_test_table' with partition [<start>, <end>)
08:06:01.947 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d06139fadd954d16b290b208c9e5a749@[325c80ff728d4ecfb2fa78a1d106c164(127.27.200.65:36745)[L],b60948bfd2884317a63414cab8002497(127.27.200.66:36045),fa47904803a04de8b3b6afc059f9455d(127.27.200.67:44327)]}]
08:06:01.947 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d06139fadd954d16b290b208c9e5a749 for table 'replication_test_table' with partition [<start>, <end>)
08:06:01.948 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d06139fadd954d16b290b208c9e5a749@[325c80ff728d4ecfb2fa78a1d106c164(127.27.200.65:36745)[L],b60948bfd2884317a63414cab8002497(127.27.200.66:36045),fa47904803a04de8b3b6afc059f9455d(127.27.200.67:44327)]}]
08:06:01.962 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d06139fadd954d16b290b208c9e5a749, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:02.001 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 523ccfb52b2544c393ff06d08a25c7b6(127.27.17.194:34219)] handling channelInactive
08:06:02.001 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 523ccfb52b2544c393ff06d08a25c7b6(127.27.17.194:34219)] cleaning up while in state READY due to: connection closed
08:06:02.002 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
08:06:02.002 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
08:06:02.021 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d06139fadd954d16b290b208c9e5a749, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:02.078 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d06139fadd954d16b290b208c9e5a749, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:02.137 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d06139fadd954d16b290b208c9e5a749, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:02.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:02.197 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d06139fadd954d16b290b208c9e5a749, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:02.256 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d06139fadd954d16b290b208c9e5a749, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:02.285 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:02.325 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d06139fadd954d16b290b208c9e5a749, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:02.348 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091562347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:02.360 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=8, operationSize=504, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@f597959, flushNotification=Deferred@1443564819(state=PENDING, result=null, callback=<none>, errback=<none>)}
08:06:02.361 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 325c80ff728d4ecfb2fa78a1d106c164(127.27.200.65:36745)] connecting to peer
08:06:02.365 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 325c80ff728d4ecfb2fa78a1d106c164(127.27.200.65:36745)] Successfully connected to peer
08:06:02.382 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d06139fadd954d16b290b208c9e5a749, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:02.410 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:02.412 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xfa92b37f, L:/127.0.0.1:37466 - R:/127.27.200.65:36745] using TOKEN/null
08:06:02.441 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d06139fadd954d16b290b208c9e5a749, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:02.500 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d06139fadd954d16b290b208c9e5a749, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:02.559 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d06139fadd954d16b290b208c9e5a749, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:02.624 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d06139fadd954d16b290b208c9e5a749, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:02.680 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:02.703 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=355 ms, finalizationTime=0 ms).
08:06:02.706 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
08:06:02.712 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d06139fadd954d16b290b208c9e5a749, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:02.786 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:02.786 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d06139fadd954d16b290b208c9e5a749, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:02.786 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:02.787 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:02.787 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:02.787 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:02.787 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:02.787 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:02.787 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:02.787 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:02.787 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:02.788 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:02.788 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:02.788 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:02.788 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:02.793 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table bf7fb2df00f74650a621c1e6c3ca0806
08:06:02.799 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 58958c1a8dd2482595eed28616c883d5
08:06:02.802 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table bf7fb2df00f74650a621c1e6c3ca0806
08:06:02.806 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 58958c1a8dd2482595eed28616c883d5
08:06:02.810 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table bf7fb2df00f74650a621c1e6c3ca0806
08:06:02.814 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 58958c1a8dd2482595eed28616c883d5
08:06:02.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091562847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:02.849 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d155ea2c19454246a949669fc5eb32d1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:02.865 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d06139fadd954d16b290b208c9e5a749, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:02.880 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=32 ms, finalizationTime=1 ms).
08:06:02.881 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
08:06:02.891 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d155ea2c19454246a949669fc5eb32d1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:02.903 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d06139fadd954d16b290b208c9e5a749, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:02.903 [DEBUG - main] (Connection.java:575) [peer master-127.27.200.125:46459(127.27.200.125:46459)] disconnecting while in state READY
08:06:02.903 [DEBUG - main] (Connection.java:575) [peer 325c80ff728d4ecfb2fa78a1d106c164(127.27.200.65:36745)] disconnecting while in state READY
08:06:02.904 [DEBUG - main] (Connection.java:575) [peer master-127.27.200.126:43511(127.27.200.126:43511)] disconnecting while in state READY
08:06:02.904 [DEBUG - main] (Connection.java:575) [peer master-127.27.200.124:34439(127.27.200.124:34439)] disconnecting while in state READY
08:06:02.904 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.27.200.125:46459(127.27.200.125:46459)] handling channelInactive
08:06:02.904 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state READY due to: connection closed
08:06:02.905 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.27.200.126:43511(127.27.200.126:43511)] handling channelInactive
08:06:02.905 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state READY due to: connection closed
08:06:02.906 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.27.200.124:34439(127.27.200.124:34439)] handling channelInactive
08:06:02.906 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state READY due to: connection closed
08:06:02.907 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:06:02.909 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
08:06:02.909 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-1
08:06:02.910 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-2
08:06:02.917 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 325c80ff728d4ecfb2fa78a1d106c164(127.27.200.65:36745)] handling channelInactive
08:06:02.918 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 325c80ff728d4ecfb2fa78a1d106c164(127.27.200.65:36745)] cleaning up while in state READY due to: connection closed
08:06:02.918 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
08:06:02.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:02.919287 28449 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 28756
08:06:03.031 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 325c80ff728d4ecfb2fa78a1d106c164(127.27.200.65:36745)] handling channelInactive
08:06:03.031 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 325c80ff728d4ecfb2fa78a1d106c164(127.27.200.65:36745)] cleaning up while in state READY due to: connection closed
08:06:03.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:03.046502 28449 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 28947
08:06:03.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:03.094846 28449 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 29096
08:06:03.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:03.156167 28449 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 28461
08:06:03.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:03.203 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:03.204 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.27.200.126:43511(127.27.200.126:43511)] handling channelInactive
08:06:03.204 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.27.200.126:43511(127.27.200.126:43511)] handling channelInactive
08:06:03.204 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state READY due to: connection closed
08:06:03.204 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state READY due to: connection closed
08:06:03.204 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:03.204 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:03.204 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.27.200.126:43511(127.27.200.126:43511)] handling channelInactive
08:06:03.204 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state READY due to: connection closed
08:06:03.204 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:03.204 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:03.205 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:03.205 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:03.206 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:03.206 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:03.206 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:03.207 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.27.200.126:43511(127.27.200.126:43511)] handling channelInactive
08:06:03.207 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state READY due to: connection closed
08:06:03.209 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:03.209 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:03.209 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:03.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:03.218004 28449 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 28532
08:06:03.282 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table bf7fb2df00f74650a621c1e6c3ca0806
08:06:03.285 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:03.285 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='d8ac12723171e042a73fc811b0a090ab7af2e1d71866b6d1c2a03f05cfb791c0'}]
08:06:03.288 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:03.307 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:06:03.310 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=298090, tablet=d155ea2c19454246a949669fc5eb32d1@[523ccfb52b2544c393ff06d08a25c7b6(127.27.17.194:34219),d3419957393241e6b3e1b05dcab37487(127.27.17.193:35571),ec9762b17dfd4956a4a1a622857eb01a(127.27.17.195:43439)[L]]}]
08:06:03.317 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.27.200.125:46459(127.27.200.125:46459)] handling channelInactive
08:06:03.317 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.27.200.125:46459(127.27.200.125:46459)] handling channelInactive
08:06:03.318 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state READY due to: connection closed
08:06:03.318 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state READY due to: connection closed
08:06:03.318 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.27.200.125:46459(127.27.200.125:46459)] handling channelInactive
08:06:03.318 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.27.200.125:46459(127.27.200.125:46459)] handling channelInactive
08:06:03.319 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state READY due to: connection closed
08:06:03.318 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state READY due to: connection closed
08:06:03.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:03.330199 28449 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 28611
08:06:03.330 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 523ccfb52b2544c393ff06d08a25c7b6(127.27.17.194:34219)] connecting to peer
08:06:03.337 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 523ccfb52b2544c393ff06d08a25c7b6(127.27.17.194:34219)] Successfully connected to peer
08:06:03.343 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.17.194
08:06:03.350 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091563347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:03.356 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:03.361 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x330e2fb5, L:/127.0.0.1:60182 - R:/127.27.17.194:34219] using SASL/PLAIN
08:06:03.362 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job 0d2ddb76420639a9ec06ca05e894cb50 (1594 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
08:06:03.364 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
08:06:03.380 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159043182592001) for scanner KuduScanner(table=replication_test_table, tablet=d155ea2c19454246a949669fc5eb32d1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:03.383 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [d8ac12723171e042a73fc811b0a090ab7af2e1d71866b6d1c2a03f05cfb791c0]
08:06:03.383 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [d8ac12723171e042a73fc811b0a090ab7af2e1d71866b6d1c2a03f05cfb791c0]
08:06:03.383 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
08:06:03.383 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
08:06:03.385 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 523ccfb52b2544c393ff06d08a25c7b6(127.27.17.194:34219)] disconnecting while in state READY
08:06:03.385 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split d8ac12723171e042a73fc811b0a090ab7af2e1d71866b6d1c2a03f05cfb791c0 finished by subtask 2; deferring removal (restored in pending)
08:06:03.386 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:06:03.432 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.27.200.124:34439(127.27.200.124:34439)] handling channelInactive
08:06:03.432 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.27.200.124:34439(127.27.200.124:34439)] handling channelInactive
08:06:03.432 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state READY due to: connection closed
08:06:03.432 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state READY due to: connection closed
08:06:03.432 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.27.200.124:34439(127.27.200.124:34439)] handling channelInactive
08:06:03.433 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state READY due to: connection closed
08:06:03.432 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.27.200.124:34439(127.27.200.124:34439)] handling channelInactive
08:06:03.433 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state READY due to: connection closed
08:06:03.433 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 523ccfb52b2544c393ff06d08a25c7b6(127.27.17.194:34219)] handling channelInactive
08:06:03.433 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 523ccfb52b2544c393ff06d08a25c7b6(127.27.17.194:34219)] cleaning up while in state READY due to: connection closed
08:06:03.433 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
08:06:03.434 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
08:06:03.486 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:03.486 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:03.487 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:03.487 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:03.487 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:03.487 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:03.487 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:03.488 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:03.488 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:03.488 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:03.488 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:03.488 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:03.489 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:03.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:03.790 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:03.827 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:03.828 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:03.828 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:03.829 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:03.829 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:03.829 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:03.830 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:03.830 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:03.830 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:03.831 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:03.831 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:03.831 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:03.831 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:03.850 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091563847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:03.898 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job 0d2ddb76420639a9ec06ca05e894cb50 (1594 bytes, checkpointDuration=50 ms, finalizationTime=1 ms).
08:06:03.906 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
08:06:03.906 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split d8ac12723171e042a73fc811b0a090ab7af2e1d71866b6d1c2a03f05cfb791c0 from pending
08:06:03.906 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 5 complete: removed 1 finished splits from enumerator state
08:06:04.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:04.286 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:04.350 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091564347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:04.375 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=28 ms, finalizationTime=0 ms).
08:06:04.378 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
08:06:04.402 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:04.403 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:04.403 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:04.403 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:04.404 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:04.404 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:04.404 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:04.404 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:04.404 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:04.404 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:04.404 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:04.404 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:04.405 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:04.586 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:04.586 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:04.587 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:04.587 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:04.587 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:04.588 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:04.588 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:04.588 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:04.588 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:04.588 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:04.588 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:04.588 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:04.588 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:04.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:04.763 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:04.764 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:04.764 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:04.765 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:04.765 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:04.765 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:04.766 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:04.766 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:04.766 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:04.767 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:04.767 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:04.767 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:04.767 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:04.785 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:04.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091564847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:04.867 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=19 ms, finalizationTime=0 ms).
08:06:04.869 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
08:06:04.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:06:04Z chronyd exiting
08:06:04.986 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:04.986 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:04.986 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:04.987 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:04.987 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:04.987 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:04.987 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:04.987 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:04.988 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:04.988 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:04.988 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:04.988 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:04.988 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:05.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:05.282 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table bf7fb2df00f74650a621c1e6c3ca0806
08:06:05.284 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:05.289 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='a731b33853ef7ac989869a392f2ebf8f716c1e75855a08447eec6c73e64aaa2b'}]
08:06:05.291 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:05.299 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:06:05.300 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=296088, tablet=d155ea2c19454246a949669fc5eb32d1@[523ccfb52b2544c393ff06d08a25c7b6(127.27.17.194:34219),d3419957393241e6b3e1b05dcab37487(127.27.17.193:35571),ec9762b17dfd4956a4a1a622857eb01a(127.27.17.195:43439)[L]]}]
08:06:05.310 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 523ccfb52b2544c393ff06d08a25c7b6(127.27.17.194:34219)] connecting to peer
08:06:05.314 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 523ccfb52b2544c393ff06d08a25c7b6(127.27.17.194:34219)] Successfully connected to peer
08:06:05.328 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.27.17.194
08:06:05.343 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:05.347 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x20b54f58, L:/127.0.0.1:60194 - R:/127.27.17.194:34219] using SASL/PLAIN
08:06:05.348 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091565347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:05.367 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job 0d2ddb76420639a9ec06ca05e894cb50 (1594 bytes, checkpointDuration=20 ms, finalizationTime=0 ms).
08:06:05.370 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
08:06:05.404 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:05.404 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:05.405 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:05.405 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:05.405 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:05.405 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:05.405 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:05.405 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:05.405 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:05.405 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:05.405 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:05.405 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:05.405 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:05.523 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159051374592001) for scanner KuduScanner(table=replication_test_table, tablet=d155ea2c19454246a949669fc5eb32d1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:05.524 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [a731b33853ef7ac989869a392f2ebf8f716c1e75855a08447eec6c73e64aaa2b]
08:06:05.524 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [a731b33853ef7ac989869a392f2ebf8f716c1e75855a08447eec6c73e64aaa2b]
08:06:05.524 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
08:06:05.525 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
08:06:05.526 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split a731b33853ef7ac989869a392f2ebf8f716c1e75855a08447eec6c73e64aaa2b finished by subtask 3; deferring removal (restored in pending)
08:06:05.526 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 523ccfb52b2544c393ff06d08a25c7b6(127.27.17.194:34219)] disconnecting while in state READY
08:06:05.527 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:06:05.531 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 523ccfb52b2544c393ff06d08a25c7b6(127.27.17.194:34219)] handling channelInactive
08:06:05.531 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 523ccfb52b2544c393ff06d08a25c7b6(127.27.17.194:34219)] cleaning up while in state READY due to: connection closed
08:06:05.531 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:06:05.531 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
08:06:05.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:05.785 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:05.855 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091565854 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:05.869 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job 0d2ddb76420639a9ec06ca05e894cb50 (1594 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
08:06:05.872 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
08:06:05.872 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split a731b33853ef7ac989869a392f2ebf8f716c1e75855a08447eec6c73e64aaa2b from pending
08:06:05.872 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 9 complete: removed 1 finished splits from enumerator state
08:06:05.984 [ERROR - main] (RetryRule.java:206) org.apache.kudu.replication.TestReplicationTableInitializer.testUnpartitionedTable: failed attempt 1
org.apache.kudu.shaded.org.apache.commons.logging.LogConfigurationException: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl (Caused by java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1158)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory$2.run(LogFactory.java:960)
	at java.base/java.security.AccessController.doPrivileged(AccessController.java:318)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.newFactory(LogFactory.java:957)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getFactory(LogFactory.java:624)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getLog(LogFactory.java:655)
	at org.apache.kudu.shaded.org.apache.http.conn.ssl.DefaultHostnameVerifier.<init>(DefaultHostnameVerifier.java:82)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClientBuilder.build(HttpClientBuilder.java:970)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClients.createDefault(HttpClients.java:56)
	at org.apache.kudu.test.junit.ResultReporter.reportResult(ResultReporter.java:207)
	at org.apache.kudu.test.junit.ResultReporter.tryReportResult(ResultReporter.java:244)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.report(RetryRule.java:165)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:191)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
Caused by: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1020)
	... 42 more
08:06:06.010 [ERROR - main] (RetryRule.java:253) org.apache.kudu.replication.TestReplicationTableInitializer.testUnpartitionedTable: giving up after 1 attempts
08:06:06.010 [DEBUG - main] (Connection.java:575) [peer master-127.27.17.253:37621(127.27.17.253:37621)] disconnecting while in state READY
08:06:06.010 [DEBUG - main] (Connection.java:575) [peer ec9762b17dfd4956a4a1a622857eb01a(127.27.17.195:43439)] disconnecting while in state READY
08:06:06.010 [DEBUG - main] (Connection.java:575) [peer master-127.27.17.252:43595(127.27.17.252:43595)] disconnecting while in state READY
08:06:06.011 [DEBUG - main] (Connection.java:575) [peer master-127.27.17.254:45447(127.27.17.254:45447)] disconnecting while in state READY
08:06:06.011 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.27.17.253:37621(127.27.17.253:37621)] handling channelInactive
08:06:06.011 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state READY due to: connection closed
08:06:06.011 [DEBUG - kudu-nio-3] (Connection.java:239) [peer ec9762b17dfd4956a4a1a622857eb01a(127.27.17.195:43439)] handling channelInactive
08:06:06.011 [DEBUG - kudu-nio-3] (Connection.java:709) [peer ec9762b17dfd4956a4a1a622857eb01a(127.27.17.195:43439)] cleaning up while in state READY due to: connection closed
08:06:06.012 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.27.17.252:43595(127.27.17.252:43595)] handling channelInactive
08:06:06.012 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state READY due to: connection closed
08:06:06.012 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:06:06.016 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
08:06:06.016 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-0
08:06:06.016 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
08:06:06.016 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.27.17.254:45447(127.27.17.254:45447)] handling channelInactive
08:06:06.017 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state READY due to: connection closed
08:06:06.017 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
08:06:06.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:06.018261 27719 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 28021
08:06:06.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:06.080327 27719 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 28159
08:06:06.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:06.078847 28328 connection.cc:582] client connection to 127.27.17.193:35571 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:06:06.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:06.083617 28328 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:06:06.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:06.097563 28328 consensus_peers.cc:597] T d155ea2c19454246a949669fc5eb32d1 P ec9762b17dfd4956a4a1a622857eb01a -> Peer d3419957393241e6b3e1b05dcab37487 (127.27.17.193:35571): Couldn't send request to peer d3419957393241e6b3e1b05dcab37487. Status: Network error: Client connection negotiation failed: client connection to 127.27.17.193:35571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
08:06:06.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:06.143586 27719 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 28309
08:06:06.147 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:06.147 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:06.147 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:06.148 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:06.148 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:06.148 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:06.148 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:06.148 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:06.148 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:06.148 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:06.148 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:06.148 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:06.148 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:06.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:06.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:06.187274 27719 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 27731
08:06:06.227 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.27.17.254:45447(127.27.17.254:45447)] handling channelInactive
08:06:06.227 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state READY due to: connection closed
08:06:06.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:06.228875 27719 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 27802
08:06:06.267 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.27.17.253:37621(127.27.17.253:37621)] handling channelInactive
08:06:06.267 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state READY due to: connection closed
08:06:06.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:06.267552 27719 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 27877
08:06:06.285 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:06.312 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.27.17.252:43595(127.27.17.252:43595)] handling channelInactive
08:06:06.312 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state READY due to: connection closed
08:06:06.348 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091566347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:06.359 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:06:06.361 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
08:06:06.678 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:06.785 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:06.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091566847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:06.858 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:06:06.859 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
08:06:07.178 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:07.277 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:07.281 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.282 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.282 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.27.17.252:43595(127.27.17.252:43595) for tablet Kudu Master: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.285 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:07.294 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:07.295 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:07.296 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:07.296 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.296 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.296 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.296 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:07.297 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:07.297 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:07.297 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:07.298 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:07.298 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:07.298 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:07.313 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:07.315 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:07.315 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:07.315 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:07.315 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.315 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:07.315 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.315 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.316 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:07.316 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:07.316 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:07.316 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:07.316 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:07.334 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:07.335 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:07.335 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:07.335 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:07.336 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:07.336 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.336 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.336 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:07.336 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.336 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:07.336 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:07.336 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:07.336 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:07.348 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091567347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:07.356 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:07.356 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:07.356 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:07.357 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.357 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.358 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.358 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:07.359 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:07.359 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:07.359 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:07.359 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:07.359 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:07.359 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:07.360 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
08:06:07.361 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
08:06:07.393 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:07.394 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:07.394 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:07.394 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.394 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.394 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.395 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:07.395 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:07.395 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:07.395 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:07.395 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:07.395 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:07.395 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:07.414 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:07.414 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:07.414 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:07.414 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.415 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.415 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:07.415 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.415 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:07.415 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:07.415 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:07.415 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:07.415 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:07.415 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:07.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:06:07Z chronyd exiting
08:06:07.514 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:07.514 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:07.515 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:07.515 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.515 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.515 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:07.515 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:07.515 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.515 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:07.515 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:07.515 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:07.515 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:07.515 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:07.587 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:07.587 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:07.588 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:07.588 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:07.588 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:07.588 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:07.588 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:07.588 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:07.588 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:07.588 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:07.588 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:07.589 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:07.589 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:07.622 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:07.622 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:07.623 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:07.623 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:07.623 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:07.623 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:07.623 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:07.623 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:07.623 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:07.623 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:07.623 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:07.623 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:07.623 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:07.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:07.734 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:07.734 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:07.734 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:07.735 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:07.735 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.735 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:07.735 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:07.735 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.735 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:07.735 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:07.735 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:07.735 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:07.735 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:07.785 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:07.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091567847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:07.858 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
08:06:07.858 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
08:06:08.013 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:08.014 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:08.014 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:08.014 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:08.014 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:08.015 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:08.015 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:08.015 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:08.015 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:08.015 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:08.015 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:08.015 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:08.015 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:08.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:08.284 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:08.286 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:08.287 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:08.287 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:08.287 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:08.287 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:08.287 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:08.288 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:08.288 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:08.288 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:08.288 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:08.288 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:08.288 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:08.288 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:08.348 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091568347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:08.358 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:06:08.358 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
08:06:08.493 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:08.494 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:08.494 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:08.494 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:08.494 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:08.494 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:08.494 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:08.494 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:08.494 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:08.495 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:08.495 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:08.495 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:08.495 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:08.560 [ERROR - main] (RetryRule.java:206) org.apache.kudu.replication.TestReplicationTableInitializer.testUnpartitionedTable: failed attempt 1
org.apache.kudu.shaded.org.apache.commons.logging.LogConfigurationException: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl (Caused by java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1158)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory$2.run(LogFactory.java:960)
	at java.base/java.security.AccessController.doPrivileged(AccessController.java:318)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.newFactory(LogFactory.java:957)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getFactory(LogFactory.java:624)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getLog(LogFactory.java:655)
	at org.apache.kudu.shaded.org.apache.http.conn.ssl.DefaultHostnameVerifier.<init>(DefaultHostnameVerifier.java:82)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClientBuilder.build(HttpClientBuilder.java:970)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClients.createDefault(HttpClients.java:56)
	at org.apache.kudu.test.junit.ResultReporter.reportResult(ResultReporter.java:207)
	at org.apache.kudu.test.junit.ResultReporter.tryReportResult(ResultReporter.java:244)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.report(RetryRule.java:165)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:216)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
Caused by: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1020)
	... 42 more
08:06:08.583 [ERROR - main] (RetryRule.java:253) org.apache.kudu.replication.TestReplicationTableInitializer.testUnpartitionedTable: giving up after 1 attempts
E.08:06:08.583 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779091568583
08:06:08.584 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779091568584
08:06:08.588 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
08:06:08.591 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
08:06:08.592 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
08:06:08.592 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskk4_r_T/test-tmp
08:06:08.592 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
08:06:08.593 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskk4_r_T/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
08:06:08.596 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

08:06:08.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:08.785 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:08.849 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091568848 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:08.860 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:06:08.861 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
08:06:08.985 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:06:08.986 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

08:06:08.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:08.990134 29555 mini_oidc.cc:150] Starting JWKS server
08:06:08.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:08.994331 29555 webserver.cc:533] Webserver started at http://127.0.0.1:39397/ using document root <none> and password file <none>
08:06:08.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:08.994781 29555 mini_oidc.cc:186] Starting OIDC Discovery server
08:06:08.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:08.997068 29555 webserver.cc:533] Webserver started at http://127.0.0.1:34685/ using document root <none> and password file <none>
08:06:09.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:06:09Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
08:06:09.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:06:09Z Disabled control of system clock
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:09.070663 29555 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-0/wal
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-0/data
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-0/logs
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-0/data/info.pb
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.220.254:37365
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.220.254
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.220.212:42111
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.220.254:37365,127.28.220.253:45079,127.28.220.252:33543
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:06:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39397/jwks.json with env {}
08:06:09.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:09.285 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:09.347 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091569347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:09.357 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
08:06:09.358 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
08:06:09.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:09.433364 29567 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:06:09.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:09.434221 29567 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:06:09.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:09.434867 29567 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:06:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:09.474056 29567 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:06:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:09.474483 29567 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:06:09.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:09.474872 29567 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:06:09.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:09.475206 29567 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:06:09.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:09.475531 29567 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:06:09.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:09.475801 29567 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:39397/jwks.json
08:06:09.503 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:09.504 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:09.504 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:09.504 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:09.504 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:09.504 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:09.504 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:09.504 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:09.504 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:09.504 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:09.504 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:09.504 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:09.505 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:09.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:09.520357 29567 master_runner.cc:387] Master server non-default flags:
08:06:09.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:09.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.220.212:42111
08:06:09.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:09.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-0/data
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-0/wal
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.220.254:37365,127.28.220.253:45079,127.28.220.252:33543
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.220.254:37365
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39397/jwks.json
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-0/data/info.pb
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.220.254
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-0/logs
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:06:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:06:09.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:09.522557 29567 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:06:09.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:09.524559 29567 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:06:09.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:09.537925 29573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:09.680 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:09.694 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:09.695 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:09.695 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:09.695 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:09.695 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:09.695 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:09.698 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:09.698 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:09.698 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:09.699 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:09.699 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:09.699 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:09.699 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:09.785 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:09.794 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:09.795 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:09.795 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:09.796 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:09.796 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:09.796 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:09.797 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:09.797 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:09.797 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:09.798 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:09.798 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:09.798 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:09.798 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:09.806 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:09.806 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:09.807 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:09.807 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:09.807 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:09.807 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:09.807 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:09.807 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:09.807 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:09.808 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:09.808 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:09.808 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:09.808 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:09.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091569847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:09.869 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=21 ms, finalizationTime=1 ms).
08:06:09.872 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
08:06:10.162 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:10.163 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:10.163 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:10.164 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:10.164 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:10.164 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:10.164 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:10.164 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:10.164 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:10.165 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:10.165 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:10.165 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:10.165 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:10.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:10.285 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:10.348 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091570347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:10.373 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=18 ms, finalizationTime=8 ms).
08:06:10.379 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
08:06:10.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:10.785 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:10.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091570847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:10.869 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=21 ms, finalizationTime=1 ms).
08:06:10.871 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
08:06:11.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:11.287 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:11.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:10.943209 29572 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 29567
08:06:11.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:11.347472 29572 kernel_stack_watchdog.cc:198] Thread 29567 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 401ms:
08:06:11.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:06:11.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:06:11.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:06:11.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:06:11.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:11.347843 29567 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.809s	user 0.002s	sys 0.000s
08:06:11.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:11.348242 29567 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.810s	user 0.002s	sys 0.000s
08:06:11.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:09.538969 29574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:11.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:11.348364 29575 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1808 milliseconds
08:06:11.349 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091571348 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:11.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:11.350047 29576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:11.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.350135 29567 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:06:11.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.360836 29567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:06:11.363 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
08:06:11.364 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
08:06:11.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.366513 29567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:06:11.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.368321 29567 hybrid_clock.cc:648] HybridClock initialized: now 1779091571368261 us; error 89 us; skew 500 ppm
08:06:11.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.369663 29567 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:06:11.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.379297 29567 webserver.cc:533] Webserver started at http://127.28.220.254:40533/ using document root <none> and password file <none>
08:06:11.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.380574 29567 fs_manager.cc:362] Metadata directory not provided
08:06:11.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.380844 29567 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:06:11.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.381430 29567 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:06:11.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.386969 29567 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-0/data/instance:
08:06:11.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6"
08:06:11.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:11 on dist-test-slave-1jss"
08:06:11.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.388547 29567 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-0/wal/instance:
08:06:11.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6"
08:06:11.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:11 on dist-test-slave-1jss"
08:06:11.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.397871 29567 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.008s	sys 0.000s
08:06:11.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.405682 29583 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:06:11.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.407274 29567 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.007s	sys 0.000s
08:06:11.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.407600 29567 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-0/wal
08:06:11.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6"
08:06:11.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:11 on dist-test-slave-1jss"
08:06:11.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.407981 29567 fs_report.cc:389] FS layout report
08:06:11.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:06:11.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-0/wal
08:06:11.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-0/wal
08:06:11.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-0/data/data
08:06:11.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:06:11.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:06:11.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:06:11.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:06:11.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:06:11.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:06:11.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:06:11.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:06:11.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:06:11.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:06:11.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:06:11.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.470674 29567 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:06:11.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.472478 29567 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:06:11.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.472919 29567 kserver.cc:163] Server-wide thread pool size limit: 3276
08:06:11.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.562994 29567 rpc_server.cc:307] RPC server started. Bound to: 127.28.220.254:37365
08:06:11.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.563081 29634 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.220.254:37365 every 8 connection(s)
08:06:11.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.566398 29567 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-0/data/info.pb
08:06:11.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.573853 29635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:11.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.576342 29555 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 29567
08:06:11.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.576941 29555 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-0/wal/instance
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.582962 29555 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-1/wal
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-1/data
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-1/logs
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-1/data/info.pb
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.220.253:45079
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.220.253
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.220.212:42111
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:06:11.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:06:11.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.220.254:37365,127.28.220.253:45079,127.28.220.252:33543
08:06:11.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:06:11.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39397/jwks.json with env {}
08:06:11.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.592471 29635 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.220.254" port: 37365 } has no permanent_uuid. Determining permanent_uuid...
08:06:11.606 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:11.607 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:11.607 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:11.607 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:11.607 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:11.608 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:11.608 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:11.608 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:11.608 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:11.608 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:11.608 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:11.609 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:11.609 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:11.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.630564 29635 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } has no permanent_uuid. Determining permanent_uuid...
08:06:11.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:11.634102 29585 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.220.253:45079: connect: Connection refused (error 111)
08:06:11.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:11.641651 29635 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.220.253:45079: Network error: Client connection negotiation failed: client connection to 127.28.220.253:45079: connect: Connection refused (error 111)
08:06:11.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:11.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.691555 29635 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } attempt: 1
08:06:11.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:11.697255 29635 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.220.253:45079: Network error: Client connection negotiation failed: client connection to 127.28.220.253:45079: connect: Connection refused (error 111)
08:06:11.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.765893 29635 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } attempt: 2
08:06:11.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:11.770925 29635 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.220.253:45079: Network error: Client connection negotiation failed: client connection to 127.28.220.253:45079: connect: Connection refused (error 111)
08:06:11.785 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:11.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091571847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:11.859 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
08:06:11.859 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
08:06:11.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:11.862416 29635 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } attempt: 3
08:06:11.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:11.867491 29635 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.220.253:45079: Network error: Client connection negotiation failed: client connection to 127.28.220.253:45079: connect: Connection refused (error 111)
08:06:11.894 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:11.895 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:11.895 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:11.895 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:11.895 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:11.895 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:11.896 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:11.896 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:11.896 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:11.896 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:11.896 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:11.896 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:11.896 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:11.914 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:11.914 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:11.915 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:11.915 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:11.915 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:11.915 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:11.915 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:11.916 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:11.916 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:11.916 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:11.916 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:11.916 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:11.916 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:11.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:11.966634 29637 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:06:11.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:11.967546 29637 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:06:11.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:11.968204 29637 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:06:11.983 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:11.983 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:11.984 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:11.984 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:11.984 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:11.984 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:11.984 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:11.984 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:11.984 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:11.984 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:11.984 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:11.984 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:11.984 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:12.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:12.006848 29637 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:06:12.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:12.007325 29637 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:06:12.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:12.007712 29637 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:06:12.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:12.008062 29637 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:06:12.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:12.008394 29637 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:06:12.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:12.008682 29637 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:39397/jwks.json
08:06:12.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:12.010938 29635 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } attempt: 4
08:06:12.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:12.015491 29635 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.220.253:45079: Network error: Client connection negotiation failed: client connection to 127.28.220.253:45079: connect: Connection refused (error 111)
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:12.052541 29637 master_runner.cc:387] Master server non-default flags:
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.220.212:42111
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-1/data
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-1/wal
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.220.254:37365,127.28.220.253:45079,127.28.220.252:33543
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.220.253:45079
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39397/jwks.json
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-1/data/info.pb
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.220.253
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-1/logs
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:06:12.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:06:12.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:06:12.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:12.054275 29637 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:06:12.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:12.056118 29637 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:06:12.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:12.068898 29647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:12.144 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:12.144 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:12.145 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:12.146 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:12.146 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:12.146 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:12.147 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:12.147 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:12.147 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:12.151 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:12.151 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:12.151 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:12.151 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:12.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:12.254 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:12.254 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:12.255 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:12.256 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:12.256 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:12.256 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:12.257 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:12.257 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:12.257 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:12.258 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:12.258 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:12.258 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:12.258 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:12.285 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:12.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:12.315403 29635 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } attempt: 5
08:06:12.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:12.329993 29635 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.220.253:45079: Network error: Client connection negotiation failed: client connection to 127.28.220.253:45079: connect: Connection refused (error 111)
08:06:12.348 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091572347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:12.372 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=24 ms, finalizationTime=1 ms).
08:06:12.374 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
08:06:12.681 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:12.785 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:12.849 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091572847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:12.868 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
08:06:12.870 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
08:06:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:12.877653 29635 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } attempt: 6
08:06:12.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:12.916582 29635 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.220.253:45079: Network error: Client connection negotiation failed: client connection to 127.28.220.253:45079: connect: Connection refused (error 111)
08:06:13.180 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:13.286 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:13.348 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091573347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:13.360 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
08:06:13.364 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
08:06:13.444 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:13.445 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:13.445 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:13.452 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:13.452 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:13.452 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:13.453 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:13.453 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:13.453 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:13.453 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:13.453 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:13.454 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:13.454 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:13.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:13.473973 29646 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 29637
08:06:13.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:13.585125 29637 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.516s	user 0.488s	sys 1.021s
08:06:13.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:13.585530 29637 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.516s	user 0.488s	sys 1.021s
08:06:13.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:13.586338 29649 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1513 milliseconds
08:06:13.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:12.069819 29648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:13.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.586432 29637 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:06:13.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:13.586547 29650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:13.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.591677 29637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:06:13.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.595026 29637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:06:13.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.596421 29637 hybrid_clock.cc:648] HybridClock initialized: now 1779091573596388 us; error 38 us; skew 500 ppm
08:06:13.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.597522 29637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:06:13.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.605340 29637 webserver.cc:533] Webserver started at http://127.28.220.253:39225/ using document root <none> and password file <none>
08:06:13.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.606591 29637 fs_manager.cc:362] Metadata directory not provided
08:06:13.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.606855 29637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:06:13.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.607537 29637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:06:13.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.612984 29637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-1/data/instance:
08:06:13.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1dc49395a8864663a313fd133d34eb29"
08:06:13.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:13 on dist-test-slave-1jss"
08:06:13.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.614302 29637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-1/wal/instance:
08:06:13.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1dc49395a8864663a313fd133d34eb29"
08:06:13.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:13 on dist-test-slave-1jss"
08:06:13.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.622942 29637 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.002s
08:06:13.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.629463 29660 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:06:13.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.630729 29637 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
08:06:13.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.631109 29637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-1/wal
08:06:13.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1dc49395a8864663a313fd133d34eb29"
08:06:13.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:13 on dist-test-slave-1jss"
08:06:13.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.631482 29637 fs_report.cc:389] FS layout report
08:06:13.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:06:13.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-1/wal
08:06:13.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-1/wal
08:06:13.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-1/data/data
08:06:13.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:06:13.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:06:13.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:06:13.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:06:13.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:06:13.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:06:13.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:06:13.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:06:13.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:06:13.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:06:13.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:06:13.678 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:13.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.704407 29637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:06:13.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.706435 29637 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:06:13.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.707000 29637 kserver.cc:163] Server-wide thread pool size limit: 3276
08:06:13.726 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:13.727 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:13.727 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:13.727 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:13.727 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:13.727 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:13.728 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:13.728 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:13.728 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:13.727 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:13.728 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:13.728 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:13.728 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:13.753 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:13.754 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:13.754 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:13.754 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:13.755 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:13.755 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:13.755 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:13.755 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:13.755 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:13.755 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:13.755 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:13.755 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:13.756 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:13.786 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:13.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.798992 29637 rpc_server.cc:307] RPC server started. Bound to: 127.28.220.253:45079
08:06:13.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.799122 29711 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.220.253:45079 every 8 connection(s)
08:06:13.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.802572 29637 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-1/data/info.pb
08:06:13.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.810246 29712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:13.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.812206 29555 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 29637
08:06:13.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.812633 29555 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-1/wal/instance
08:06:13.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.815032 29555 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:06:13.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:06:13.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-2/wal
08:06:13.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-2/data
08:06:13.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-2/logs
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-2/data/info.pb
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.220.252:33543
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.220.252
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.220.212:42111
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.220.254:37365,127.28.220.253:45079,127.28.220.252:33543
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:06:13.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39397/jwks.json with env {}
08:06:13.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.823985 29712 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.220.254" port: 37365 } has no permanent_uuid. Determining permanent_uuid...
08:06:13.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091573847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:13.858 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:06:13.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.858517 29712 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } has no permanent_uuid. Determining permanent_uuid...
08:06:13.859 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
08:06:13.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.877116 29712 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } has no permanent_uuid. Determining permanent_uuid...
08:06:13.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:13.880103 29661 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.220.252:33543: connect: Connection refused (error 111)
08:06:13.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:13.885142 29712 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.220.252:33543: Network error: Client connection negotiation failed: client connection to 127.28.220.252:33543: connect: Connection refused (error 111)
08:06:13.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.934710 29712 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } attempt: 1
08:06:13.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:13.939358 29712 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.220.252:33543: Network error: Client connection negotiation failed: client connection to 127.28.220.252:33543: connect: Connection refused (error 111)
08:06:13.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.977253 29635 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } attempt: 7
08:06:13.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:13.992389 29635 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } has no permanent_uuid. Determining permanent_uuid...
08:06:13.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:13.999322 29635 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.220.252:33543: Network error: Client connection negotiation failed: client connection to 127.28.220.252:33543: connect: Connection refused (error 111)
08:06:14.004 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:14.004 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:14.004 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:14.004 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:14.004 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:14.005 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:14.005 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:14.005 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:14.005 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:14.005 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:14.005 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:14.005 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:14.005 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:14.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:14.007825 29712 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } attempt: 2
08:06:14.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:14.013442 29712 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.220.252:33543: Network error: Client connection negotiation failed: client connection to 127.28.220.252:33543: connect: Connection refused (error 111)
08:06:14.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:14.057955 29635 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } attempt: 1
08:06:14.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:14.062706 29635 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.220.252:33543: Network error: Client connection negotiation failed: client connection to 127.28.220.252:33543: connect: Connection refused (error 111)
08:06:14.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:14.104929 29712 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } attempt: 3
08:06:14.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:14.109445 29712 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.220.252:33543: Network error: Client connection negotiation failed: client connection to 127.28.220.252:33543: connect: Connection refused (error 111)
08:06:14.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:14.144241 29635 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } attempt: 2
08:06:14.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:14.149873 29635 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.220.252:33543: Network error: Client connection negotiation failed: client connection to 127.28.220.252:33543: connect: Connection refused (error 111)
08:06:14.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:14.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:14.206697 29714 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:06:14.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:14.207425 29714 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:06:14.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:14.207945 29714 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:06:14.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:14.235332 29635 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } attempt: 3
08:06:14.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:14.240187 29635 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.220.252:33543: Network error: Client connection negotiation failed: client connection to 127.28.220.252:33543: connect: Connection refused (error 111)
08:06:14.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:14.247889 29714 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:06:14.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:14.248311 29714 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:06:14.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:14.248693 29714 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:06:14.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:14.249025 29714 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:06:14.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:14.249346 29714 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:06:14.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:14.249611 29714 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:39397/jwks.json
08:06:14.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:14.252893 29712 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } attempt: 4
08:06:14.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:14.258162 29712 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.220.252:33543: Network error: Client connection negotiation failed: client connection to 127.28.220.252:33543: connect: Connection refused (error 111)
08:06:14.284 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:14.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:14.296092 29714 master_runner.cc:387] Master server non-default flags:
08:06:14.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:14.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.220.212:42111
08:06:14.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:14.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:06:14.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-2/data
08:06:14.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-2/wal
08:06:14.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.220.254:37365,127.28.220.253:45079,127.28.220.252:33543
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.220.252:33543
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39397/jwks.json
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-2/data/info.pb
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.220.252
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-2/logs
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:06:14.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:06:14.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:14.298238 29714 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:06:14.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:14.300357 29714 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:06:14.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:14.315733 29726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:14.349 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091574348 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:14.364 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
08:06:14.365 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
08:06:14.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:14.380666 29635 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } attempt: 4
08:06:14.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:14.389603 29635 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.220.252:33543: Network error: Client connection negotiation failed: client connection to 127.28.220.252:33543: connect: Connection refused (error 111)
08:06:14.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:14.557605 29712 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } attempt: 5
08:06:14.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:14.567653 29712 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.220.252:33543: Network error: Client connection negotiation failed: client connection to 127.28.220.252:33543: connect: Connection refused (error 111)
08:06:14.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:14.673416 29635 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } attempt: 5
08:06:14.683 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:14.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:14.683693 29635 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.220.252:33543: Network error: Client connection negotiation failed: client connection to 127.28.220.252:33543: connect: Connection refused (error 111)
08:06:14.785 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:14.786 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:14.787 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:14.787 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:14.788 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:14.788 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:14.788 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:14.788 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:14.788 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:14.788 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:14.788 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:14.788 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:14.789 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:14.789 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:14.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091574847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:14.868 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
08:06:14.869 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
08:06:15.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.115393 29712 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } attempt: 6
08:06:15.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:15.127538 29712 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.220.252:33543: Network error: Client connection negotiation failed: client connection to 127.28.220.252:33543: connect: Connection refused (error 111)
08:06:15.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:15.183 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:15.183 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:15.183 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:15.184 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:15.184 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:15.184 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:15.185 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:15.185 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:15.185 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:15.185 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:15.184 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:15.186 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:15.186 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:15.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.236364 29635 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } attempt: 6
08:06:15.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:15.248231 29635 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.220.252:33543: Network error: Client connection negotiation failed: client connection to 127.28.220.252:33543: connect: Connection refused (error 111)
08:06:15.285 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:15.348 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091575347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:15.363 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
08:06:15.364 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
08:06:15.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:15.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:14.321991 29729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:15.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:14.318451 29727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:15.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:15.690843 29728 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1367 milliseconds
08:06:15.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.690971 29714 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:06:15.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.692610 29714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:06:15.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.695780 29714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:06:15.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.697219 29714 hybrid_clock.cc:648] HybridClock initialized: now 1779091575697184 us; error 74 us; skew 500 ppm
08:06:15.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.698279 29714 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:06:15.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.705878 29714 webserver.cc:533] Webserver started at http://127.28.220.252:38841/ using document root <none> and password file <none>
08:06:15.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.707019 29714 fs_manager.cc:362] Metadata directory not provided
08:06:15.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.707245 29714 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:06:15.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.707703 29714 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:06:15.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.712883 29714 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-2/data/instance:
08:06:15.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b8917341a39944e691d689c45c16bef2"
08:06:15.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:15 on dist-test-slave-1jss"
08:06:15.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.714162 29714 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-2/wal/instance:
08:06:15.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b8917341a39944e691d689c45c16bef2"
08:06:15.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:15 on dist-test-slave-1jss"
08:06:15.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.722888 29714 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.001s
08:06:15.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.729709 29740 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:06:15.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.731129 29714 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
08:06:15.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.731487 29714 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-2/wal
08:06:15.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b8917341a39944e691d689c45c16bef2"
08:06:15.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:15 on dist-test-slave-1jss"
08:06:15.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.731827 29714 fs_report.cc:389] FS layout report
08:06:15.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:06:15.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-2/wal
08:06:15.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-2/wal
08:06:15.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-2/data/data
08:06:15.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:06:15.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:06:15.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:06:15.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:06:15.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:06:15.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:06:15.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:06:15.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:06:15.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:06:15.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:06:15.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:06:15.785 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:15.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.792906 29714 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:06:15.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.794950 29714 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:06:15.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.795480 29714 kserver.cc:163] Server-wide thread pool size limit: 3276
08:06:15.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091575847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:15.862 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
08:06:15.862 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
08:06:15.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.890259 29714 rpc_server.cc:307] RPC server started. Bound to: 127.28.220.252:33543
08:06:15.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.890365 29792 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.220.252:33543 every 8 connection(s)
08:06:15.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.893368 29714 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-2/data/info.pb
08:06:15.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.896365 29555 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 29714
08:06:15.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.896930 29555 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/master-2/wal/instance
08:06:15.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.902225 29793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:15.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.920989 29793 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.220.254" port: 37365 } has no permanent_uuid. Determining permanent_uuid...
08:06:15.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.949868 29793 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } has no permanent_uuid. Determining permanent_uuid...
08:06:15.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.962105 29793 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } has no permanent_uuid. Determining permanent_uuid...
08:06:15.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.980525 29793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2: Bootstrap starting.
08:06:15.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.989205 29793 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2: Neither blocks nor log segments found. Creating new log.
08:06:15.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.991487 29793 log.cc:826] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2: Log is configured to *not* fsync() on all Append() calls
08:06:15.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:15.997535 29793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2: No bootstrap required, opened a new log
08:06:16.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.019654 29793 raft_consensus.cc:359] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6" member_type: VOTER last_known_addr { host: "127.28.220.254" port: 37365 } } peers { permanent_uuid: "1dc49395a8864663a313fd133d34eb29" member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } } peers { permanent_uuid: "b8917341a39944e691d689c45c16bef2" member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } }
08:06:16.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.020526 29793 raft_consensus.cc:385] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:16.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.020737 29793 raft_consensus.cc:740] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8917341a39944e691d689c45c16bef2, State: Initialized, Role: FOLLOWER
08:06:16.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.021463 29793 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6" member_type: VOTER last_known_addr { host: "127.28.220.254" port: 37365 } } peers { permanent_uuid: "1dc49395a8864663a313fd133d34eb29" member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } } peers { permanent_uuid: "b8917341a39944e691d689c45c16bef2" member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } }
08:06:16.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.024258 29802 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6" member_type: VOTER last_known_addr { host: "127.28.220.254" port: 37365 } } peers { permanent_uuid: "1dc49395a8864663a313fd133d34eb29" member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } } peers { permanent_uuid: "b8917341a39944e691d689c45c16bef2" member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } } }
08:06:16.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.024902 29802 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [sys.catalog]: This master's current role is: FOLLOWER
08:06:16.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.025990 29793 sys_catalog.cc:565] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [sys.catalog]: configured and running, proceeding with master startup.
08:06:16.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:16.052583 29746 tablet.cc:2404] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:06:16.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:16.056628 29813 catalog_manager.cc:1593] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:06:16.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:16.057015 29813 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:06:16.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.056303 29714 master_runner.cc:187] Error getting master registration for 127.28.220.254:37365: OK, instance_id { permanent_uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6" instance_seqno: 1779091571538458 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:06:16.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.082229 29714 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:06:16.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.108103 29802 raft_consensus.cc:493] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:06:16.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.108884 29802 raft_consensus.cc:515] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6" member_type: VOTER last_known_addr { host: "127.28.220.254" port: 37365 } } peers { permanent_uuid: "1dc49395a8864663a313fd133d34eb29" member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } } peers { permanent_uuid: "b8917341a39944e691d689c45c16bef2" member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } }
08:06:16.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.112113 29802 leader_election.cc:290] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af9631fd9f8049ab835ebbd3fc3dc8f6 (127.28.220.254:37365), 1dc49395a8864663a313fd133d34eb29 (127.28.220.253:45079)
08:06:16.180 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:16.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.188184 29712 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } attempt: 7
08:06:16.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.216756 29712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1dc49395a8864663a313fd133d34eb29: Bootstrap starting.
08:06:16.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.226536 29712 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1dc49395a8864663a313fd133d34eb29: Neither blocks nor log segments found. Creating new log.
08:06:16.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.229727 29712 log.cc:826] T 00000000000000000000000000000000 P 1dc49395a8864663a313fd133d34eb29: Log is configured to *not* fsync() on all Append() calls
08:06:16.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.238224 29712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1dc49395a8864663a313fd133d34eb29: No bootstrap required, opened a new log
08:06:16.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.269691 29712 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1dc49395a8864663a313fd133d34eb29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6" member_type: VOTER last_known_addr { host: "127.28.220.254" port: 37365 } } peers { permanent_uuid: "1dc49395a8864663a313fd133d34eb29" member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } } peers { permanent_uuid: "b8917341a39944e691d689c45c16bef2" member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } }
08:06:16.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.270780 29712 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1dc49395a8864663a313fd133d34eb29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:16.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.271108 29712 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1dc49395a8864663a313fd133d34eb29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc49395a8864663a313fd133d34eb29, State: Initialized, Role: FOLLOWER
08:06:16.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.272306 29712 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1dc49395a8864663a313fd133d34eb29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6" member_type: VOTER last_known_addr { host: "127.28.220.254" port: 37365 } } peers { permanent_uuid: "1dc49395a8864663a313fd133d34eb29" member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } } peers { permanent_uuid: "b8917341a39944e691d689c45c16bef2" member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } }
08:06:16.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.276109 29818 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dc49395a8864663a313fd133d34eb29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6" member_type: VOTER last_known_addr { host: "127.28.220.254" port: 37365 } } peers { permanent_uuid: "1dc49395a8864663a313fd133d34eb29" member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } } peers { permanent_uuid: "b8917341a39944e691d689c45c16bef2" member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } } }
08:06:16.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.277048 29818 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dc49395a8864663a313fd133d34eb29 [sys.catalog]: This master's current role is: FOLLOWER
08:06:16.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.278311 29712 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1dc49395a8864663a313fd133d34eb29 [sys.catalog]: configured and running, proceeding with master startup.
08:06:16.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.278522 29687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b8917341a39944e691d689c45c16bef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc49395a8864663a313fd133d34eb29" is_pre_election: true
08:06:16.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.279742 29687 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1dc49395a8864663a313fd133d34eb29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8917341a39944e691d689c45c16bef2 in term 0.
08:06:16.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.281559 29742 leader_election.cc:304] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc49395a8864663a313fd133d34eb29, b8917341a39944e691d689c45c16bef2; no voters: 
08:06:16.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.281885 29635 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } attempt: 7
08:06:16.285 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:16.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.282970 29802 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:06:16.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.283406 29802 raft_consensus.cc:493] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:06:16.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.283748 29802 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [term 0 FOLLOWER]: Advancing to term 1
08:06:16.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.300390 29802 raft_consensus.cc:515] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6" member_type: VOTER last_known_addr { host: "127.28.220.254" port: 37365 } } peers { permanent_uuid: "1dc49395a8864663a313fd133d34eb29" member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } } peers { permanent_uuid: "b8917341a39944e691d689c45c16bef2" member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } }
08:06:16.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.340373 29802 leader_election.cc:290] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [CANDIDATE]: Term 1 election: Requested vote from peers af9631fd9f8049ab835ebbd3fc3dc8f6 (127.28.220.254:37365), 1dc49395a8864663a313fd133d34eb29 (127.28.220.253:45079)
08:06:16.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.341755 29687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b8917341a39944e691d689c45c16bef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc49395a8864663a313fd133d34eb29"
08:06:16.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.342669 29687 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1dc49395a8864663a313fd133d34eb29 [term 0 FOLLOWER]: Advancing to term 1
08:06:16.348 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091576347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:16.363 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
08:06:16.364 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
08:06:16.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.376868 29635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af9631fd9f8049ab835ebbd3fc3dc8f6: Bootstrap starting.
08:06:16.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.381536 29687 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1dc49395a8864663a313fd133d34eb29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8917341a39944e691d689c45c16bef2 in term 1.
08:06:16.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.383519 29742 leader_election.cc:304] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc49395a8864663a313fd133d34eb29, b8917341a39944e691d689c45c16bef2; no voters: 
08:06:16.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.384543 29802 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [term 1 FOLLOWER]: Leader election won for term 1
08:06:16.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.405014 29802 raft_consensus.cc:697] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [term 1 LEADER]: Becoming Leader. State: Replica: b8917341a39944e691d689c45c16bef2, State: Running, Role: LEADER
08:06:16.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.406736 29802 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6" member_type: VOTER last_known_addr { host: "127.28.220.254" port: 37365 } } peers { permanent_uuid: "1dc49395a8864663a313fd133d34eb29" member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } } peers { permanent_uuid: "b8917341a39944e691d689c45c16bef2" member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } }
08:06:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.419893 29635 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af9631fd9f8049ab835ebbd3fc3dc8f6: Neither blocks nor log segments found. Creating new log.
08:06:16.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.436957 29635 log.cc:826] T 00000000000000000000000000000000 P af9631fd9f8049ab835ebbd3fc3dc8f6: Log is configured to *not* fsync() on all Append() calls
08:06:16.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.444273 29823 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8917341a39944e691d689c45c16bef2. Latest consensus state: current_term: 1 leader_uuid: "b8917341a39944e691d689c45c16bef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6" member_type: VOTER last_known_addr { host: "127.28.220.254" port: 37365 } } peers { permanent_uuid: "1dc49395a8864663a313fd133d34eb29" member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } } peers { permanent_uuid: "b8917341a39944e691d689c45c16bef2" member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } } }
08:06:16.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.445185 29823 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [sys.catalog]: This master's current role is: LEADER
08:06:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:16.466665 29666 tablet.cc:2404] T 00000000000000000000000000000000 P 1dc49395a8864663a313fd133d34eb29: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:06:16.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.468708 29635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af9631fd9f8049ab835ebbd3fc3dc8f6: No bootstrap required, opened a new log
08:06:16.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.490919 29828 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
08:06:16.494 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:16.495 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:16.495 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:16.496 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:16.496 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:16.496 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:16.496 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:16.496 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:16.497 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:16.497 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:16.498 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:16.498 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:16.498 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:16.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.529574 29828 catalog_manager.cc:1519] Initializing Kudu cluster ID...
08:06:16.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.529167 29635 raft_consensus.cc:359] T 00000000000000000000000000000000 P af9631fd9f8049ab835ebbd3fc3dc8f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6" member_type: VOTER last_known_addr { host: "127.28.220.254" port: 37365 } } peers { permanent_uuid: "1dc49395a8864663a313fd133d34eb29" member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } } peers { permanent_uuid: "b8917341a39944e691d689c45c16bef2" member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } }
08:06:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.534119 29635 raft_consensus.cc:385] T 00000000000000000000000000000000 P af9631fd9f8049ab835ebbd3fc3dc8f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.534610 29635 raft_consensus.cc:740] T 00000000000000000000000000000000 P af9631fd9f8049ab835ebbd3fc3dc8f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af9631fd9f8049ab835ebbd3fc3dc8f6, State: Initialized, Role: FOLLOWER
08:06:16.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.535980 29635 consensus_queue.cc:260] T 00000000000000000000000000000000 P af9631fd9f8049ab835ebbd3fc3dc8f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6" member_type: VOTER last_known_addr { host: "127.28.220.254" port: 37365 } } peers { permanent_uuid: "1dc49395a8864663a313fd133d34eb29" member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } } peers { permanent_uuid: "b8917341a39944e691d689c45c16bef2" member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } }
08:06:16.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.551132 29635 sys_catalog.cc:565] T 00000000000000000000000000000000 P af9631fd9f8049ab835ebbd3fc3dc8f6 [sys.catalog]: configured and running, proceeding with master startup.
08:06:16.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.551326 29609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b8917341a39944e691d689c45c16bef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6"
08:06:16.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.553777 29609 raft_consensus.cc:3060] T 00000000000000000000000000000000 P af9631fd9f8049ab835ebbd3fc3dc8f6 [term 0 FOLLOWER]: Advancing to term 1
08:06:16.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.552066 29610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b8917341a39944e691d689c45c16bef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6" is_pre_election: true
08:06:16.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.564332 29609 raft_consensus.cc:2468] T 00000000000000000000000000000000 P af9631fd9f8049ab835ebbd3fc3dc8f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8917341a39944e691d689c45c16bef2 in term 1.
08:06:16.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.552575 29834 sys_catalog.cc:455] T 00000000000000000000000000000000 P af9631fd9f8049ab835ebbd3fc3dc8f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6" member_type: VOTER last_known_addr { host: "127.28.220.254" port: 37365 } } peers { permanent_uuid: "1dc49395a8864663a313fd133d34eb29" member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } } peers { permanent_uuid: "b8917341a39944e691d689c45c16bef2" member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } } }
08:06:16.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.566594 29834 sys_catalog.cc:458] T 00000000000000000000000000000000 P af9631fd9f8049ab835ebbd3fc3dc8f6 [sys.catalog]: This master's current role is: FOLLOWER
08:06:16.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:16.588783 29835 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 1dc49395a8864663a313fd133d34eb29: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:06:16.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:16.589291 29835 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:06:16.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.611274 29687 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 1dc49395a8864663a313fd133d34eb29 [term 1 FOLLOWER]: Refusing update from remote peer b8917341a39944e691d689c45c16bef2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:06:16.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.611963 29609 raft_consensus.cc:1275] T 00000000000000000000000000000000 P af9631fd9f8049ab835ebbd3fc3dc8f6 [term 1 FOLLOWER]: Refusing update from remote peer b8917341a39944e691d689c45c16bef2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:06:16.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.613969 29823 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc49395a8864663a313fd133d34eb29" member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:06:16.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.614765 29802 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6" member_type: VOTER last_known_addr { host: "127.28.220.254" port: 37365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:06:16.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.557389 29637 master_runner.cc:187] Error getting master registration for 127.28.220.254:37365: OK, instance_id { permanent_uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6" instance_seqno: 1779091571538458 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:06:16.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.629381 29637 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:06:16.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.676815 29818 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dc49395a8864663a313fd133d34eb29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8917341a39944e691d689c45c16bef2. Latest consensus state: current_term: 1 leader_uuid: "b8917341a39944e691d689c45c16bef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6" member_type: VOTER last_known_addr { host: "127.28.220.254" port: 37365 } } peers { permanent_uuid: "1dc49395a8864663a313fd133d34eb29" member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } } peers { permanent_uuid: "b8917341a39944e691d689c45c16bef2" member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } } }
08:06:16.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:16.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.680037 29818 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dc49395a8864663a313fd133d34eb29 [sys.catalog]: This master's current role is: FOLLOWER
08:06:16.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.704941 29845 mvcc.cc:204] Tried to move back new op lower bound from 7287159097769312256 to 7287159097023934464. Current Snapshot: MvccSnapshot[applied={T|T < 7287159097769312256}]
08:06:16.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.725034 29818 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dc49395a8864663a313fd133d34eb29 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b8917341a39944e691d689c45c16bef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6" member_type: VOTER last_known_addr { host: "127.28.220.254" port: 37365 } } peers { permanent_uuid: "1dc49395a8864663a313fd133d34eb29" member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } } peers { permanent_uuid: "b8917341a39944e691d689c45c16bef2" member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } } }
08:06:16.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.725950 29818 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dc49395a8864663a313fd133d34eb29 [sys.catalog]: This master's current role is: FOLLOWER
08:06:16.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:16.736224 29589 tablet.cc:2404] T 00000000000000000000000000000000 P af9631fd9f8049ab835ebbd3fc3dc8f6: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:06:16.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.738112 29823 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b8917341a39944e691d689c45c16bef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6" member_type: VOTER last_known_addr { host: "127.28.220.254" port: 37365 } } peers { permanent_uuid: "1dc49395a8864663a313fd133d34eb29" member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } } peers { permanent_uuid: "b8917341a39944e691d689c45c16bef2" member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } } }
08:06:16.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.738929 29823 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [sys.catalog]: This master's current role is: LEADER
08:06:16.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.744604 29828 catalog_manager.cc:1382] Generated new cluster ID: c418c155bba2494f8c69002395c57cb4
08:06:16.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.744977 29828 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
08:06:16.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.754797 29854 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
08:06:16.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.755034 29834 sys_catalog.cc:455] T 00000000000000000000000000000000 P af9631fd9f8049ab835ebbd3fc3dc8f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8917341a39944e691d689c45c16bef2. Latest consensus state: current_term: 1 leader_uuid: "b8917341a39944e691d689c45c16bef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6" member_type: VOTER last_known_addr { host: "127.28.220.254" port: 37365 } } peers { permanent_uuid: "1dc49395a8864663a313fd133d34eb29" member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } } peers { permanent_uuid: "b8917341a39944e691d689c45c16bef2" member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } } }
08:06:16.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.755836 29834 sys_catalog.cc:458] T 00000000000000000000000000000000 P af9631fd9f8049ab835ebbd3fc3dc8f6 [sys.catalog]: This master's current role is: FOLLOWER
08:06:16.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.760407 29802 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b8917341a39944e691d689c45c16bef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6" member_type: VOTER last_known_addr { host: "127.28.220.254" port: 37365 } } peers { permanent_uuid: "1dc49395a8864663a313fd133d34eb29" member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } } peers { permanent_uuid: "b8917341a39944e691d689c45c16bef2" member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } } }
08:06:16.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.761214 29802 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2 [sys.catalog]: This master's current role is: LEADER
08:06:16.784 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:16.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.795305 29834 sys_catalog.cc:455] T 00000000000000000000000000000000 P af9631fd9f8049ab835ebbd3fc3dc8f6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b8917341a39944e691d689c45c16bef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af9631fd9f8049ab835ebbd3fc3dc8f6" member_type: VOTER last_known_addr { host: "127.28.220.254" port: 37365 } } peers { permanent_uuid: "1dc49395a8864663a313fd133d34eb29" member_type: VOTER last_known_addr { host: "127.28.220.253" port: 45079 } } peers { permanent_uuid: "b8917341a39944e691d689c45c16bef2" member_type: VOTER last_known_addr { host: "127.28.220.252" port: 33543 } } }
08:06:16.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.796545 29834 sys_catalog.cc:458] T 00000000000000000000000000000000 P af9631fd9f8049ab835ebbd3fc3dc8f6 [sys.catalog]: This master's current role is: FOLLOWER
08:06:16.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.822978 29828 catalog_manager.cc:1405] Generated new certificate authority record
08:06:16.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.835407 29828 catalog_manager.cc:1539] Loading token signing keys...
08:06:16.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091576847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:16.860 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
08:06:16.863 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
08:06:16.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.876695 29828 catalog_manager.cc:6069] T 00000000000000000000000000000000 P b8917341a39944e691d689c45c16bef2: Generated new TSK 0
08:06:16.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.878472 29828 catalog_manager.cc:1549] Initializing in-progress tserver states...
08:06:16.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:16.930114 29555 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:06:16.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:06:16.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-0/wal
08:06:16.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-0/data
08:06:16.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:06:16.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:06:16.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:06:16.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:16.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:16.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:16.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-0/logs
08:06:16.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-0/data/info.pb
08:06:16.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:16.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:06:16.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:06:16.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:06:16.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:06:16.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:16.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:16.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:16.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:06:16.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:06:16.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.220.193:0
08:06:16.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.220.193
08:06:16.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.220.193
08:06:16.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:16.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.220.254:37365,127.28.220.253:45079,127.28.220.252:33543
08:06:16.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.220.212:42111
08:06:16.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:16.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:16.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:06:17.034 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:17.034 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:17.034 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:17.035 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:17.035 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:17.035 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:17.035 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:17.035 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:17.036 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:17.036 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:17.036 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:17.035 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:17.038 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:17.114 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:17.115 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:17.115 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:17.116 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:17.116 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:17.116 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:17.116 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:17.116 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:17.117 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:17.117 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:17.117 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:17.117 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:17.117 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:17.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:17.284 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:17.348 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091577347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:17.367 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
08:06:17.369 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
08:06:17.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:17.499342 29857 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:06:17.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:17.500149 29857 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:06:17.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:17.500939 29857 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:06:17.506 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:17.506 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:17.507 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:17.507 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:17.507 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:17.508 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:17.508 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:17.508 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:17.508 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:17.508 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:17.509 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:17.509 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:17.509 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:17.510 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29344), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [25ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [31ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [52ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [53ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [125ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [151ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [154ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [155ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [174ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [189ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [190ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [191ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [192ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [192ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [201ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [202ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [202ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [203ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [221ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [223ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [264ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [266ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [267ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [267ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [323ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [324ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [324ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [325ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [384ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [385ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [385ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [385ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [400ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [402ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [403ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [404ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [404ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [583ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [584ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [585ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [585ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1177ms] refreshing cache from master, [1177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1180ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1181ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1182ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2601ms] refreshing cache from master, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2603ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2604ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2605ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2605ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [2606ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [4861ms] refreshing cache from master, [4861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [4862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [4863ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [4863ms] too many traces: truncated at 100 traces, [4863ms] too many traces: truncated at 100 traces, deferred=Deferred@1559393495(state=PENDING, result=null, callback=(continuation of Deferred@664450327 after retry RPC after error@839601677) -> (continuation of Deferred@1171956757 after retry RPC after error@172041397) -> (continuation of Deferred@2021726951 after retry RPC after error@278026460) -> (continuation of Deferred@7912663 after retry RPC after error@52380897) -> (continuation of Deferred@1941512263 after retry RPC after error@1911538260) -> (continuation of Deferred@875845306 after retry RPC after error@1299522705) -> (continuation of Deferred@2004127328 after retry RPC after error@2022051768) -> (continuation of Deferred@1855002516 after retry RPC after error@170190715) -> (continuation of Deferred@1500544977 after retry RPC after error@289624200) -> (continuation of Deferred@2005452931 after retry RPC after error@1513813558) -> (continuation of Deferred@15631447 after retry RPC after error@186799058) -> (continuation of Deferred@979324645 after retry RPC after error@928617694) -> (continuation of Deferred@1138844254 after retry RPC after error@1514411315) -> (continuation of Deferred@439111928 after retry RPC after error@1630062599) -> (continuation of Deferred@697546222 after retry RPC after error@1392820322) -> (continuation of Deferred@735568234 after retry RPC after error@202927335) -> (continuation of Deferred@940610639 after retry RPC after error@1306674431) -> (continuation of Deferred@1495937176 after retry RPC after error@379191310) -> (continuation of Deferred@714366078 after retry RPC after error@1972252783) -> (continuation of Deferred@2108186806 after retry RPC after error@1005884797) -> (continuation of Deferred@864766417 after retry RPC after error@931269255) -> (continuation of Deferred@160526609 after retry RPC after error@374424099) -> (continuation of Deferred@2147304697 after retry RPC after error@1477226419), errback=(continuation of Deferred@664450327 after retry RPC after error@839601677) -> (continuation of Deferred@1171956757 after retry RPC after error@172041397) -> (continuation of Deferred@2021726951 after retry RPC after error@278026460) -> (continuation of Deferred@7912663 after retry RPC after error@52380897) -> (continuation of Deferred@1941512263 after retry RPC after error@1911538260) -> (continuation of Deferred@875845306 after retry RPC after error@1299522705) -> (continuation of Deferred@2004127328 after retry RPC after error@2022051768) -> (continuation of Deferred@1855002516 after retry RPC after error@170190715) -> (continuation of Deferred@1500544977 after retry RPC after error@289624200) -> (continuation of Deferred@2005452931 after retry RPC after error@1513813558) -> (continuation of Deferred@15631447 after retry RPC after error@186799058) -> (continuation of Deferred@979324645 after retry RPC after error@928617694) -> (continuation of Deferred@1138844254 after retry RPC after error@1514411315) -> (continuation of Deferred@439111928 after retry RPC after error@1630062599) -> (continuation of Deferred@697546222 after retry RPC after error@1392820322) -> (continuation of Deferred@735568234 after retry RPC after error@202927335) -> (continuation of Deferred@940610639 after retry RPC after error@1306674431) -> (continuation of Deferred@1495937176 after retry RPC after error@379191310) -> (continuation of Deferred@714366078 after retry RPC after error@1972252783) -> (continuation of Deferred@2108186806 after retry RPC after error@1005884797) -> (continuation of Deferred@864766417 after retry RPC after error@931269255) -> (continuation of Deferred@160526609 after retry RPC after error@374424099) -> (continuation of Deferred@2147304697 after retry RPC after error@1477226419)))
08:06:17.512 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
08:06:17.512 [WARN - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#1 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29344), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [25ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [31ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [52ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [53ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [125ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [151ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [154ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [155ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [174ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [189ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [190ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [191ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [192ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [192ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [201ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [202ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [202ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [203ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [221ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [223ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [264ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [266ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [267ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [267ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [323ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [324ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [324ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [325ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [384ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [385ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [385ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [385ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [400ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [402ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [403ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [404ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [404ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [583ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [584ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [585ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [585ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1177ms] refreshing cache from master, [1177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1180ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1181ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1182ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2601ms] refreshing cache from master, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2603ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2604ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2605ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2605ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [2606ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [4861ms] refreshing cache from master, [4861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [4862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [4863ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [4863ms] too many traces: truncated at 100 traces, [4863ms] too many traces: truncated at 100 traces, deferred=Deferred@1559393495(state=PENDING, result=null, callback=(continuation of Deferred@664450327 after retry RPC after error@839601677) -> (continuation of Deferred@1171956757 after retry RPC after error@172041397) -> (continuation of Deferred@2021726951 after retry RPC after error@278026460) -> (continuation of Deferred@7912663 after retry RPC after error@52380897) -> (continuation of Deferred@1941512263 after retry RPC after error@1911538260) -> (continuation of Deferred@875845306 after retry RPC after error@1299522705) -> (continuation of Deferred@2004127328 after retry RPC after error@2022051768) -> (continuation of Deferred@1855002516 after retry RPC after error@170190715) -> (continuation of Deferred@1500544977 after retry RPC after error@289624200) -> (continuation of Deferred@2005452931 after retry RPC after error@1513813558) -> (continuation of Deferred@15631447 after retry RPC after error@186799058) -> (continuation of Deferred@979324645 after retry RPC after error@928617694) -> (continuation of Deferred@1138844254 after retry RPC after error@1514411315) -> (continuation of Deferred@439111928 after retry RPC after error@1630062599) -> (continuation of Deferred@697546222 after retry RPC after error@1392820322) -> (continuation of Deferred@735568234 after retry RPC after error@202927335) -> (continuation of Deferred@940610639 after retry RPC after error@1306674431) -> (continuation of Deferred@1495937176 after retry RPC after error@379191310) -> (continuation of Deferred@714366078 after retry RPC after error@1972252783) -> (continuation of Deferred@2108186806 after retry RPC after error@1005884797) -> (continuation of Deferred@864766417 after retry RPC after error@931269255) -> (continuation of Deferred@160526609 after retry RPC after error@374424099) -> (continuation of Deferred@2147304697 after retry RPC after error@1477226419), errback=(continuation of Deferred@664450327 after retry RPC after error@839601677) -> (continuation of Deferred@1171956757 after retry RPC after error@172041397) -> (continuation of Deferred@2021726951 after retry RPC after error@278026460) -> (continuation of Deferred@7912663 after retry RPC after error@52380897) -> (continuation of Deferred@1941512263 after retry RPC after error@1911538260) -> (continuation of Deferred@875845306 after retry RPC after error@1299522705) -> (continuation of Deferred@2004127328 after retry RPC after error@2022051768) -> (continuation of Deferred@1855002516 after retry RPC after error@170190715) -> (continuation of Deferred@1500544977 after retry RPC after error@289624200) -> (continuation of Deferred@2005452931 after retry RPC after error@1513813558) -> (continuation of Deferred@15631447 after retry RPC after error@186799058) -> (continuation of Deferred@979324645 after retry RPC after error@928617694) -> (continuation of Deferred@1138844254 after retry RPC after error@1514411315) -> (continuation of Deferred@439111928 after retry RPC after error@1630062599) -> (continuation of Deferred@697546222 after retry RPC after error@1392820322) -> (continuation of Deferred@735568234 after retry RPC after error@202927335) -> (continuation of Deferred@940610639 after retry RPC after error@1306674431) -> (continuation of Deferred@1495937176 after retry RPC after error@379191310) -> (continuation of Deferred@714366078 after retry RPC after error@1972252783) -> (continuation of Deferred@2108186806 after retry RPC after error@1005884797) -> (continuation of Deferred@864766417 after retry RPC after error@931269255) -> (continuation of Deferred@160526609 after retry RPC after error@374424099) -> (continuation of Deferred@2147304697 after retry RPC after error@1477226419)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.189:46677
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:06:17.516 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#1 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
08:06:17.518 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#1 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
08:06:17.521 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED on 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29344), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [25ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [31ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [52ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [53ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [125ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [151ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [154ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [155ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [174ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [189ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [190ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [191ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [192ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [192ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [201ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [202ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [202ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [203ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [221ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [223ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [264ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [266ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [267ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [267ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [323ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [324ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [324ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [325ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [384ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [385ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [385ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [385ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [400ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [402ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [403ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [404ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [404ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [583ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [584ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [585ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [585ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1177ms] refreshing cache from master, [1177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1180ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1181ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1182ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2601ms] refreshing cache from master, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2603ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2604ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2605ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2605ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [2606ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [4861ms] refreshing cache from master, [4861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [4862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [4863ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [4863ms] too many traces: truncated at 100 traces, [4863ms] too many traces: truncated at 100 traces, deferred=Deferred@1559393495(state=PENDING, result=null, callback=(continuation of Deferred@664450327 after retry RPC after error@839601677) -> (continuation of Deferred@1171956757 after retry RPC after error@172041397) -> (continuation of Deferred@2021726951 after retry RPC after error@278026460) -> (continuation of Deferred@7912663 after retry RPC after error@52380897) -> (continuation of Deferred@1941512263 after retry RPC after error@1911538260) -> (continuation of Deferred@875845306 after retry RPC after error@1299522705) -> (continuation of Deferred@2004127328 after retry RPC after error@2022051768) -> (continuation of Deferred@1855002516 after retry RPC after error@170190715) -> (continuation of Deferred@1500544977 after retry RPC after error@289624200) -> (continuation of Deferred@2005452931 after retry RPC after error@1513813558) -> (continuation of Deferred@15631447 after retry RPC after error@186799058) -> (continuation of Deferred@979324645 after retry RPC after error@928617694) -> (continuation of Deferred@1138844254 after retry RPC after error@1514411315) -> (continuation of Deferred@439111928 after retry RPC after error@1630062599) -> (continuation of Deferred@697546222 after retry RPC after error@1392820322) -> (continuation of Deferred@735568234 after retry RPC after error@202927335) -> (continuation of Deferred@940610639 after retry RPC after error@1306674431) -> (continuation of Deferred@1495937176 after retry RPC after error@379191310) -> (continuation of Deferred@714366078 after retry RPC after error@1972252783) -> (continuation of Deferred@2108186806 after retry RPC after error@1005884797) -> (continuation of Deferred@864766417 after retry RPC after error@931269255) -> (continuation of Deferred@160526609 after retry RPC after error@374424099) -> (continuation of Deferred@2147304697 after retry RPC after error@1477226419), errback=(continuation of Deferred@664450327 after retry RPC after error@839601677) -> (continuation of Deferred@1171956757 after retry RPC after error@172041397) -> (continuation of Deferred@2021726951 after retry RPC after error@278026460) -> (continuation of Deferred@7912663 after retry RPC after error@52380897) -> (continuation of Deferred@1941512263 after retry RPC after error@1911538260) -> (continuation of Deferred@875845306 after retry RPC after error@1299522705) -> (continuation of Deferred@2004127328 after retry RPC after error@2022051768) -> (continuation of Deferred@1855002516 after retry RPC after error@170190715) -> (continuation of Deferred@1500544977 after retry RPC after error@289624200) -> (continuation of Deferred@2005452931 after retry RPC after error@1513813558) -> (continuation of Deferred@15631447 after retry RPC after error@186799058) -> (continuation of Deferred@979324645 after retry RPC after error@928617694) -> (continuation of Deferred@1138844254 after retry RPC after error@1514411315) -> (continuation of Deferred@439111928 after retry RPC after error@1630062599) -> (continuation of Deferred@697546222 after retry RPC after error@1392820322) -> (continuation of Deferred@735568234 after retry RPC after error@202927335) -> (continuation of Deferred@940610639 after retry RPC after error@1306674431) -> (continuation of Deferred@1495937176 after retry RPC after error@379191310) -> (continuation of Deferred@714366078 after retry RPC after error@1972252783) -> (continuation of Deferred@2108186806 after retry RPC after error@1005884797) -> (continuation of Deferred@864766417 after retry RPC after error@931269255) -> (continuation of Deferred@160526609 after retry RPC after error@374424099) -> (continuation of Deferred@2147304697 after retry RPC after error@1477226419)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.189:46677
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:06:17.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:17.566921 29857 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:06:17.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:17.568683 29857 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.220.193
08:06:17.571 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:06:17.571 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#1) of source Source: KuduSource.
08:06:17.572 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
08:06:17.572 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (e26b904229418d0e047d5d94c5b9f905) switched from state RUNNING to RESTARTING.
08:06:17.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:17.596520 29835 catalog_manager.cc:1294] Loaded cluster ID: c418c155bba2494f8c69002395c57cb4
08:06:17.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:17.598431 29835 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 1dc49395a8864663a313fd133d34eb29: loading cluster ID for follower catalog manager: success
08:06:17.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:17.625284 29835 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 1dc49395a8864663a313fd133d34eb29: acquiring CA information for follower catalog manager: success
08:06:17.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:17.644059 29857 tablet_server_runner.cc:78] Tablet server non-default flags:
08:06:17.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:17.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.220.212:42111
08:06:17.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:17.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:06:17.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-0/data
08:06:17.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-0/wal
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.220.193:0
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-0/data/info.pb
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.220.193
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.220.254:37365,127.28.220.253:45079,127.28.220.252:33543
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.220.193
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-0/logs
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:06:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:06:17.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:17.646266 29857 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:06:17.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:17.648940 29857 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:06:17.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:17.649945 29835 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 1dc49395a8864663a313fd133d34eb29: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:06:17.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:17.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:17.680645 29863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:17.808 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:17.809 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:17.809 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:17.809 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:17.809 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:17.809 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:17.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:17.790166 29854 catalog_manager.cc:1294] Loaded cluster ID: c418c155bba2494f8c69002395c57cb4
08:06:17.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:17.799180 29854 catalog_manager.cc:1587] T 00000000000000000000000000000000 P af9631fd9f8049ab835ebbd3fc3dc8f6: loading cluster ID for follower catalog manager: success
08:06:17.810 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:17.810 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:17.810 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:17.811 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:17.811 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:17.811 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:17.811 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:17.812 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29648), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [25ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [42ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [50ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [50ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [98ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [109ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [112ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [121ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [122ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [141ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [163ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [170ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [171ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [173ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [173ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [184ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [185ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [185ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [202ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [202ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [206ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [206ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [223ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [243ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [244ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [244ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [343ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [344ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [344ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [345ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [464ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [464ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [465ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [465ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [941ms] refreshing cache from master, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [943ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [944ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [944ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [945ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1501ms] refreshing cache from master, [1502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1504ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1505ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1506ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1506ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1681ms] refreshing cache from master, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1683ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1684ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1685ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1685ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [4161ms] refreshing cache from master, [4161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [4162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [4162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [4163ms] too many traces: truncated at 100 traces, deferred=Deferred@579221462(state=PENDING, result=null, callback=(continuation of Deferred@865304167 after retry RPC after error@1718626520) -> (continuation of Deferred@1391356169 after retry RPC after error@1103481861) -> (continuation of Deferred@1770910236 after retry RPC after error@249311517) -> (continuation of Deferred@802924526 after retry RPC after error@1083302900) -> (continuation of Deferred@1175123176 after retry RPC after error@691106285) -> (continuation of Deferred@1529300978 after retry RPC after error@350654753) -> (continuation of Deferred@89823969 after retry RPC after error@658910654) -> (continuation of Deferred@1186981491 after retry RPC after error@1718618140) -> (continuation of Deferred@934026145 after retry RPC after error@563211063) -> (continuation of Deferred@405019912 after retry RPC after error@2129839864) -> (continuation of Deferred@701807508 after retry RPC after error@129119690) -> (continuation of Deferred@1061594217 after retry RPC after error@1475043455) -> (continuation of Deferred@1542420749 after retry RPC after error@1298467807) -> (continuation of Deferred@1191877622 after retry RPC after error@1273951216) -> (continuation of Deferred@1810488465 after retry RPC after error@238488000) -> (continuation of Deferred@494008027 after retry RPC after error@566028278) -> (continuation of Deferred@68467204 after retry RPC after error@853269071) -> (continuation of Deferred@537802209 after retry RPC after error@1716249921) -> (continuation of Deferred@1202628374 after retry RPC after error@726340622) -> (continuation of Deferred@2059111867 after retry RPC after error@1130565184) -> (continuation of Deferred@1900517165 after retry RPC after error@48174703) -> (continuation of Deferred@615486938 after retry RPC after error@2137366017) -> (continuation of Deferred@852922431 after retry RPC after error@1212191844) -> (continuation of Deferred@278514163 after retry RPC after error@1130350711) -> (continuation of Deferred@1166999371 after retry RPC after error@161591338) -> (continuation of Deferred@1470707388 after retry RPC after error@1778925646), errback=(continuation of Deferred@865304167 after retry RPC after error@1718626520) -> (continuation of Deferred@1391356169 after retry RPC after error@1103481861) -> (continuation of Deferred@1770910236 after retry RPC after error@249311517) -> (continuation of Deferred@802924526 after retry RPC after error@1083302900) -> (continuation of Deferred@1175123176 after retry RPC after error@691106285) -> (continuation of Deferred@1529300978 after retry RPC after error@350654753) -> (continuation of Deferred@89823969 after retry RPC after error@658910654) -> (continuation of Deferred@1186981491 after retry RPC after error@1718618140) -> (continuation of Deferred@934026145 after retry RPC after error@563211063) -> (continuation of Deferred@405019912 after retry RPC after error@2129839864) -> (continuation of Deferred@701807508 after retry RPC after error@129119690) -> (continuation of Deferred@1061594217 after retry RPC after error@1475043455) -> (continuation of Deferred@1542420749 after retry RPC after error@1298467807) -> (continuation of Deferred@1191877622 after retry RPC after error@1273951216) -> (continuation of Deferred@1810488465 after retry RPC after error@238488000) -> (continuation of Deferred@494008027 after retry RPC after error@566028278) -> (continuation of Deferred@68467204 after retry RPC after error@853269071) -> (continuation of Deferred@537802209 after retry RPC after error@1716249921) -> (continuation of Deferred@1202628374 after retry RPC after error@726340622) -> (continuation of Deferred@2059111867 after retry RPC after error@1130565184) -> (continuation of Deferred@1900517165 after retry RPC after error@48174703) -> (continuation of Deferred@615486938 after retry RPC after error@2137366017) -> (continuation of Deferred@852922431 after retry RPC after error@1212191844) -> (continuation of Deferred@278514163 after retry RPC after error@1130350711) -> (continuation of Deferred@1166999371 after retry RPC after error@161591338) -> (continuation of Deferred@1470707388 after retry RPC after error@1778925646)))
08:06:17.814 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
08:06:17.814 [WARN - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#1 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29648), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [25ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [42ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [50ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [50ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [98ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [109ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [112ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [121ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [122ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [141ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [163ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [170ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [171ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [173ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [173ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [184ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [185ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [185ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [202ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [202ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [206ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [206ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [223ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [243ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [244ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [244ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [343ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [344ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [344ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [345ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [464ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [464ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [465ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [465ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [941ms] refreshing cache from master, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [943ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [944ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [944ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [945ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1501ms] refreshing cache from master, [1502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1504ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1505ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1506ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1506ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1681ms] refreshing cache from master, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1683ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1684ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1685ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1685ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [4161ms] refreshing cache from master, [4161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [4162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [4162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [4163ms] too many traces: truncated at 100 traces, deferred=Deferred@579221462(state=PENDING, result=null, callback=(continuation of Deferred@865304167 after retry RPC after error@1718626520) -> (continuation of Deferred@1391356169 after retry RPC after error@1103481861) -> (continuation of Deferred@1770910236 after retry RPC after error@249311517) -> (continuation of Deferred@802924526 after retry RPC after error@1083302900) -> (continuation of Deferred@1175123176 after retry RPC after error@691106285) -> (continuation of Deferred@1529300978 after retry RPC after error@350654753) -> (continuation of Deferred@89823969 after retry RPC after error@658910654) -> (continuation of Deferred@1186981491 after retry RPC after error@1718618140) -> (continuation of Deferred@934026145 after retry RPC after error@563211063) -> (continuation of Deferred@405019912 after retry RPC after error@2129839864) -> (continuation of Deferred@701807508 after retry RPC after error@129119690) -> (continuation of Deferred@1061594217 after retry RPC after error@1475043455) -> (continuation of Deferred@1542420749 after retry RPC after error@1298467807) -> (continuation of Deferred@1191877622 after retry RPC after error@1273951216) -> (continuation of Deferred@1810488465 after retry RPC after error@238488000) -> (continuation of Deferred@494008027 after retry RPC after error@566028278) -> (continuation of Deferred@68467204 after retry RPC after error@853269071) -> (continuation of Deferred@537802209 after retry RPC after error@1716249921) -> (continuation of Deferred@1202628374 after retry RPC after error@726340622) -> (continuation of Deferred@2059111867 after retry RPC after error@1130565184) -> (continuation of Deferred@1900517165 after retry RPC after error@48174703) -> (continuation of Deferred@615486938 after retry RPC after error@2137366017) -> (continuation of Deferred@852922431 after retry RPC after error@1212191844) -> (continuation of Deferred@278514163 after retry RPC after error@1130350711) -> (continuation of Deferred@1166999371 after retry RPC after error@161591338) -> (continuation of Deferred@1470707388 after retry RPC after error@1778925646), errback=(continuation of Deferred@865304167 after retry RPC after error@1718626520) -> (continuation of Deferred@1391356169 after retry RPC after error@1103481861) -> (continuation of Deferred@1770910236 after retry RPC after error@249311517) -> (continuation of Deferred@802924526 after retry RPC after error@1083302900) -> (continuation of Deferred@1175123176 after retry RPC after error@691106285) -> (continuation of Deferred@1529300978 after retry RPC after error@350654753) -> (continuation of Deferred@89823969 after retry RPC after error@658910654) -> (continuation of Deferred@1186981491 after retry RPC after error@1718618140) -> (continuation of Deferred@934026145 after retry RPC after error@563211063) -> (continuation of Deferred@405019912 after retry RPC after error@2129839864) -> (continuation of Deferred@701807508 after retry RPC after error@129119690) -> (continuation of Deferred@1061594217 after retry RPC after error@1475043455) -> (continuation of Deferred@1542420749 after retry RPC after error@1298467807) -> (continuation of Deferred@1191877622 after retry RPC after error@1273951216) -> (continuation of Deferred@1810488465 after retry RPC after error@238488000) -> (continuation of Deferred@494008027 after retry RPC after error@566028278) -> (continuation of Deferred@68467204 after retry RPC after error@853269071) -> (continuation of Deferred@537802209 after retry RPC after error@1716249921) -> (continuation of Deferred@1202628374 after retry RPC after error@726340622) -> (continuation of Deferred@2059111867 after retry RPC after error@1130565184) -> (continuation of Deferred@1900517165 after retry RPC after error@48174703) -> (continuation of Deferred@615486938 after retry RPC after error@2137366017) -> (continuation of Deferred@852922431 after retry RPC after error@1212191844) -> (continuation of Deferred@278514163 after retry RPC after error@1130350711) -> (continuation of Deferred@1166999371 after retry RPC after error@161591338) -> (continuation of Deferred@1470707388 after retry RPC after error@1778925646)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.189:46677
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:06:17.817 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#1 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
08:06:17.820 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#1 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
08:06:17.823 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to FAILED on 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29648), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [25ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [42ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [50ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [50ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [98ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [109ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [112ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [121ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [122ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [141ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [163ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [170ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [171ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [173ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [173ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [184ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [185ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [185ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [202ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [202ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [206ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [206ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [223ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [243ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [244ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [244ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [343ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [344ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [344ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [345ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [464ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [464ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [465ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [465ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [941ms] refreshing cache from master, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [943ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [944ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [944ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [945ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1501ms] refreshing cache from master, [1502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1504ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1505ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1506ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1506ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1681ms] refreshing cache from master, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1683ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1684ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1685ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1685ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [4161ms] refreshing cache from master, [4161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [4162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [4162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [4163ms] too many traces: truncated at 100 traces, deferred=Deferred@579221462(state=PENDING, result=null, callback=(continuation of Deferred@865304167 after retry RPC after error@1718626520) -> (continuation of Deferred@1391356169 after retry RPC after error@1103481861) -> (continuation of Deferred@1770910236 after retry RPC after error@249311517) -> (continuation of Deferred@802924526 after retry RPC after error@1083302900) -> (continuation of Deferred@1175123176 after retry RPC after error@691106285) -> (continuation of Deferred@1529300978 after retry RPC after error@350654753) -> (continuation of Deferred@89823969 after retry RPC after error@658910654) -> (continuation of Deferred@1186981491 after retry RPC after error@1718618140) -> (continuation of Deferred@934026145 after retry RPC after error@563211063) -> (continuation of Deferred@405019912 after retry RPC after error@2129839864) -> (continuation of Deferred@701807508 after retry RPC after error@129119690) -> (continuation of Deferred@1061594217 after retry RPC after error@1475043455) -> (continuation of Deferred@1542420749 after retry RPC after error@1298467807) -> (continuation of Deferred@1191877622 after retry RPC after error@1273951216) -> (continuation of Deferred@1810488465 after retry RPC after error@238488000) -> (continuation of Deferred@494008027 after retry RPC after error@566028278) -> (continuation of Deferred@68467204 after retry RPC after error@853269071) -> (continuation of Deferred@537802209 after retry RPC after error@1716249921) -> (continuation of Deferred@1202628374 after retry RPC after error@726340622) -> (continuation of Deferred@2059111867 after retry RPC after error@1130565184) -> (continuation of Deferred@1900517165 after retry RPC after error@48174703) -> (continuation of Deferred@615486938 after retry RPC after error@2137366017) -> (continuation of Deferred@852922431 after retry RPC after error@1212191844) -> (continuation of Deferred@278514163 after retry RPC after error@1130350711) -> (continuation of Deferred@1166999371 after retry RPC after error@161591338) -> (continuation of Deferred@1470707388 after retry RPC after error@1778925646), errback=(continuation of Deferred@865304167 after retry RPC after error@1718626520) -> (continuation of Deferred@1391356169 after retry RPC after error@1103481861) -> (continuation of Deferred@1770910236 after retry RPC after error@249311517) -> (continuation of Deferred@802924526 after retry RPC after error@1083302900) -> (continuation of Deferred@1175123176 after retry RPC after error@691106285) -> (continuation of Deferred@1529300978 after retry RPC after error@350654753) -> (continuation of Deferred@89823969 after retry RPC after error@658910654) -> (continuation of Deferred@1186981491 after retry RPC after error@1718618140) -> (continuation of Deferred@934026145 after retry RPC after error@563211063) -> (continuation of Deferred@405019912 after retry RPC after error@2129839864) -> (continuation of Deferred@701807508 after retry RPC after error@129119690) -> (continuation of Deferred@1061594217 after retry RPC after error@1475043455) -> (continuation of Deferred@1542420749 after retry RPC after error@1298467807) -> (continuation of Deferred@1191877622 after retry RPC after error@1273951216) -> (continuation of Deferred@1810488465 after retry RPC after error@238488000) -> (continuation of Deferred@494008027 after retry RPC after error@566028278) -> (continuation of Deferred@68467204 after retry RPC after error@853269071) -> (continuation of Deferred@537802209 after retry RPC after error@1716249921) -> (continuation of Deferred@1202628374 after retry RPC after error@726340622) -> (continuation of Deferred@2059111867 after retry RPC after error@1130565184) -> (continuation of Deferred@1900517165 after retry RPC after error@48174703) -> (continuation of Deferred@615486938 after retry RPC after error@2137366017) -> (continuation of Deferred@852922431 after retry RPC after error@1212191844) -> (continuation of Deferred@278514163 after retry RPC after error@1130350711) -> (continuation of Deferred@1166999371 after retry RPC after error@161591338) -> (continuation of Deferred@1470707388 after retry RPC after error@1778925646)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.189:46677
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:06:17.826 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:06:17.827 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#1) of source Source: KuduSource.
08:06:17.829 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
08:06:17.851 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091577847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:17.863 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
08:06:17.864 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
08:06:17.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:17.865634 29854 catalog_manager.cc:1609] T 00000000000000000000000000000000 P af9631fd9f8049ab835ebbd3fc3dc8f6: acquiring CA information for follower catalog manager: success
08:06:17.890 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:17.890 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:17.890 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:17.891 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:17.892 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:17.892 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:17.892 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:17.892 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:17.892 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:17.893 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:17.893 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:17.893 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:17.893 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:17.894 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=27051), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [34ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [38ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [50ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [50ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [99ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [100ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [104ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [104ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [136ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [138ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [139ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [145ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [150ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [150ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [161ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [161ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [162ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [162ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [182ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [183ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [183ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [183ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [222ms] refreshing cache from master, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [224ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [224ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [231ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [231ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [302ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [302ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [304ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [304ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [380ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [382ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [382ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [383ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [384ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [482ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [483ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [484ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [484ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [543ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [544ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [544ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [545ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1244ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [2760ms] refreshing cache from master, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [2763ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2763ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [6680ms] refreshing cache from master, [6680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [6681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [6681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [6682ms] too many traces: truncated at 100 traces, deferred=Deferred@200785632(state=PENDING, result=null, callback=(continuation of Deferred@225865053 after retry RPC after error@603326861) -> (continuation of Deferred@1536710717 after retry RPC after error@1831795984) -> (continuation of Deferred@1393322349 after retry RPC after error@1076213984) -> (continuation of Deferred@1499810153 after retry RPC after error@1136257320) -> (continuation of Deferred@1942927155 after retry RPC after error@516027154) -> (continuation of Deferred@1830608802 after retry RPC after error@1642109824) -> (continuation of Deferred@1729224608 after retry RPC after error@1985603891) -> (continuation of Deferred@2108934549 after retry RPC after error@409624888) -> (continuation of Deferred@1903116618 after retry RPC after error@1220947493) -> (continuation of Deferred@735750601 after retry RPC after error@1618112043) -> (continuation of Deferred@1796998782 after retry RPC after error@307407422) -> (continuation of Deferred@1815666012 after retry RPC after error@524875206) -> (continuation of Deferred@342638503 after retry RPC after error@334001230) -> (continuation of Deferred@957389138 after retry RPC after error@1630453107) -> (continuation of Deferred@340408310 after retry RPC after error@1146125109) -> (continuation of Deferred@2033688804 after retry RPC after error@1835425684) -> (continuation of Deferred@685121609 after retry RPC after error@1872265141) -> (continuation of Deferred@736940578 after retry RPC after error@1948885556) -> (continuation of Deferred@1835270288 after retry RPC after error@1093517150) -> (continuation of Deferred@211617947 after retry RPC after error@891036478), errback=(continuation of Deferred@225865053 after retry RPC after error@603326861) -> (continuation of Deferred@1536710717 after retry RPC after error@1831795984) -> (continuation of Deferred@1393322349 after retry RPC after error@1076213984) -> (continuation of Deferred@1499810153 after retry RPC after error@1136257320) -> (continuation of Deferred@1942927155 after retry RPC after error@516027154) -> (continuation of Deferred@1830608802 after retry RPC after error@1642109824) -> (continuation of Deferred@1729224608 after retry RPC after error@1985603891) -> (continuation of Deferred@2108934549 after retry RPC after error@409624888) -> (continuation of Deferred@1903116618 after retry RPC after error@1220947493) -> (continuation of Deferred@735750601 after retry RPC after error@1618112043) -> (continuation of Deferred@1796998782 after retry RPC after error@307407422) -> (continuation of Deferred@1815666012 after retry RPC after error@524875206) -> (continuation of Deferred@342638503 after retry RPC after error@334001230) -> (continuation of Deferred@957389138 after retry RPC after error@1630453107) -> (continuation of Deferred@340408310 after retry RPC after error@1146125109) -> (continuation of Deferred@2033688804 after retry RPC after error@1835425684) -> (continuation of Deferred@685121609 after retry RPC after error@1872265141) -> (continuation of Deferred@736940578 after retry RPC after error@1948885556) -> (continuation of Deferred@1835270288 after retry RPC after error@1093517150) -> (continuation of Deferred@211617947 after retry RPC after error@891036478)))
08:06:17.895 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:17.895 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
08:06:17.896 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:17.896 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:17.896 [WARN - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#3 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=27051), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [34ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [38ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [50ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [50ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [99ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [100ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [104ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [104ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [136ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [138ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [139ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [145ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [150ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [150ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [161ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [161ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [162ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [162ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [182ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [183ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [183ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [183ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [222ms] refreshing cache from master, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [224ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [224ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [231ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [231ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [302ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [302ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [304ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [304ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [380ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [382ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [382ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [383ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [384ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [482ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [483ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [484ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [484ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [543ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [544ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [544ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [545ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1244ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [2760ms] refreshing cache from master, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [2763ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2763ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [6680ms] refreshing cache from master, [6680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [6681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [6681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [6682ms] too many traces: truncated at 100 traces, deferred=Deferred@200785632(state=PENDING, result=null, callback=(continuation of Deferred@225865053 after retry RPC after error@603326861) -> (continuation of Deferred@1536710717 after retry RPC after error@1831795984) -> (continuation of Deferred@1393322349 after retry RPC after error@1076213984) -> (continuation of Deferred@1499810153 after retry RPC after error@1136257320) -> (continuation of Deferred@1942927155 after retry RPC after error@516027154) -> (continuation of Deferred@1830608802 after retry RPC after error@1642109824) -> (continuation of Deferred@1729224608 after retry RPC after error@1985603891) -> (continuation of Deferred@2108934549 after retry RPC after error@409624888) -> (continuation of Deferred@1903116618 after retry RPC after error@1220947493) -> (continuation of Deferred@735750601 after retry RPC after error@1618112043) -> (continuation of Deferred@1796998782 after retry RPC after error@307407422) -> (continuation of Deferred@1815666012 after retry RPC after error@524875206) -> (continuation of Deferred@342638503 after retry RPC after error@334001230) -> (continuation of Deferred@957389138 after retry RPC after error@1630453107) -> (continuation of Deferred@340408310 after retry RPC after error@1146125109) -> (continuation of Deferred@2033688804 after retry RPC after error@1835425684) -> (continuation of Deferred@685121609 after retry RPC after error@1872265141) -> (continuation of Deferred@736940578 after retry RPC after error@1948885556) -> (continuation of Deferred@1835270288 after retry RPC after error@1093517150) -> (continuation of Deferred@211617947 after retry RPC after error@891036478), errback=(continuation of Deferred@225865053 after retry RPC after error@603326861) -> (continuation of Deferred@1536710717 after retry RPC after error@1831795984) -> (continuation of Deferred@1393322349 after retry RPC after error@1076213984) -> (continuation of Deferred@1499810153 after retry RPC after error@1136257320) -> (continuation of Deferred@1942927155 after retry RPC after error@516027154) -> (continuation of Deferred@1830608802 after retry RPC after error@1642109824) -> (continuation of Deferred@1729224608 after retry RPC after error@1985603891) -> (continuation of Deferred@2108934549 after retry RPC after error@409624888) -> (continuation of Deferred@1903116618 after retry RPC after error@1220947493) -> (continuation of Deferred@735750601 after retry RPC after error@1618112043) -> (continuation of Deferred@1796998782 after retry RPC after error@307407422) -> (continuation of Deferred@1815666012 after retry RPC after error@524875206) -> (continuation of Deferred@342638503 after retry RPC after error@334001230) -> (continuation of Deferred@957389138 after retry RPC after error@1630453107) -> (continuation of Deferred@340408310 after retry RPC after error@1146125109) -> (continuation of Deferred@2033688804 after retry RPC after error@1835425684) -> (continuation of Deferred@685121609 after retry RPC after error@1872265141) -> (continuation of Deferred@736940578 after retry RPC after error@1948885556) -> (continuation of Deferred@1835270288 after retry RPC after error@1093517150) -> (continuation of Deferred@211617947 after retry RPC after error@891036478)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:06:17.896 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:17.897 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:17.897 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:17.897 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:17.897 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:17.898 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:17.898 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:17.899 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:17.899 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:17.899 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:17.899 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#3 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
08:06:17.901 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#3 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_3.
08:06:17.903 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to FAILED on 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=27051), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [34ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [38ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [50ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [50ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [99ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [100ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [104ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [104ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [136ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [138ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [139ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [145ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [150ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [150ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [161ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [161ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [162ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [162ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [182ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [183ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [183ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [183ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [222ms] refreshing cache from master, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [224ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [224ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [231ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [231ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [302ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [302ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [304ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [304ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [380ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [382ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [382ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [383ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [384ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [482ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [483ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [484ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [484ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [543ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [544ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [544ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [545ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1244ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [2760ms] refreshing cache from master, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [2763ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2763ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [6680ms] refreshing cache from master, [6680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [6681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [6681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [6682ms] too many traces: truncated at 100 traces, deferred=Deferred@200785632(state=PENDING, result=null, callback=(continuation of Deferred@225865053 after retry RPC after error@603326861) -> (continuation of Deferred@1536710717 after retry RPC after error@1831795984) -> (continuation of Deferred@1393322349 after retry RPC after error@1076213984) -> (continuation of Deferred@1499810153 after retry RPC after error@1136257320) -> (continuation of Deferred@1942927155 after retry RPC after error@516027154) -> (continuation of Deferred@1830608802 after retry RPC after error@1642109824) -> (continuation of Deferred@1729224608 after retry RPC after error@1985603891) -> (continuation of Deferred@2108934549 after retry RPC after error@409624888) -> (continuation of Deferred@1903116618 after retry RPC after error@1220947493) -> (continuation of Deferred@735750601 after retry RPC after error@1618112043) -> (continuation of Deferred@1796998782 after retry RPC after error@307407422) -> (continuation of Deferred@1815666012 after retry RPC after error@524875206) -> (continuation of Deferred@342638503 after retry RPC after error@334001230) -> (continuation of Deferred@957389138 after retry RPC after error@1630453107) -> (continuation of Deferred@340408310 after retry RPC after error@1146125109) -> (continuation of Deferred@2033688804 after retry RPC after error@1835425684) -> (continuation of Deferred@685121609 after retry RPC after error@1872265141) -> (continuation of Deferred@736940578 after retry RPC after error@1948885556) -> (continuation of Deferred@1835270288 after retry RPC after error@1093517150) -> (continuation of Deferred@211617947 after retry RPC after error@891036478), errback=(continuation of Deferred@225865053 after retry RPC after error@603326861) -> (continuation of Deferred@1536710717 after retry RPC after error@1831795984) -> (continuation of Deferred@1393322349 after retry RPC after error@1076213984) -> (continuation of Deferred@1499810153 after retry RPC after error@1136257320) -> (continuation of Deferred@1942927155 after retry RPC after error@516027154) -> (continuation of Deferred@1830608802 after retry RPC after error@1642109824) -> (continuation of Deferred@1729224608 after retry RPC after error@1985603891) -> (continuation of Deferred@2108934549 after retry RPC after error@409624888) -> (continuation of Deferred@1903116618 after retry RPC after error@1220947493) -> (continuation of Deferred@735750601 after retry RPC after error@1618112043) -> (continuation of Deferred@1796998782 after retry RPC after error@307407422) -> (continuation of Deferred@1815666012 after retry RPC after error@524875206) -> (continuation of Deferred@342638503 after retry RPC after error@334001230) -> (continuation of Deferred@957389138 after retry RPC after error@1630453107) -> (continuation of Deferred@340408310 after retry RPC after error@1146125109) -> (continuation of Deferred@2033688804 after retry RPC after error@1835425684) -> (continuation of Deferred@685121609 after retry RPC after error@1872265141) -> (continuation of Deferred@736940578 after retry RPC after error@1948885556) -> (continuation of Deferred@1835270288 after retry RPC after error@1093517150) -> (continuation of Deferred@211617947 after retry RPC after error@891036478)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:06:17.907 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:06:17.909 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#3) of source Source: KuduSource.
08:06:17.909 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_3.
08:06:17.910 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (b42812d69c586178cf7556c3c92998f3) switched from state RUNNING to RESTARTING.
08:06:17.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:17.921424 29854 catalog_manager.cc:1637] T 00000000000000000000000000000000 P af9631fd9f8049ab835ebbd3fc3dc8f6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:06:18.349 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091578347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:18.360 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
08:06:18.365 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
08:06:18.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091578847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:18.861 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
08:06:18.863 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
08:06:19.204 [INFO - flink-pekko.actor.default-dispatcher-6] (CheckpointCoordinator.java:1805) Restoring job e26b904229418d0e047d5d94c5b9f905 from Checkpoint 76 @ 1779091546865 for e26b904229418d0e047d5d94c5b9f905 located at file:/tmp/junit16937918701930502306/checkpoints/e26b904229418d0e047d5d94c5b9f905/chk-76.
08:06:19.205 [INFO - flink-pekko.actor.default-dispatcher-6] (MasterHooks.java:201) No master state to restore
08:06:19.206 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 2 to checkpoint 76 for source Source: KuduSource to checkpoint.
08:06:19.206 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to SCHEDULED.
08:06:19.214 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:06:19.215 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from SCHEDULED to DEPLOYING.
08:06:19.215 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #2) with attempt id 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1) with allocation id 0f1066b174fb1f271b9fbb4939140659
08:06:19.215 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (e26b904229418d0e047d5d94c5b9f905) switched from state RESTARTING to RUNNING.
08:06:19.216 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 0f1066b174fb1f271b9fbb4939140659.
08:06:19.217 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#2 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_2), deploy into slot with allocation id 0f1066b174fb1f271b9fbb4939140659.
08:06:19.218 [INFO - flink-pekko.actor.default-dispatcher-6] (CheckpointCoordinator.java:1805) Restoring job e26b904229418d0e047d5d94c5b9f905 from Checkpoint 76 @ 1779091546865 for e26b904229418d0e047d5d94c5b9f905 located at file:/tmp/junit16937918701930502306/checkpoints/e26b904229418d0e047d5d94c5b9f905/chk-76.
08:06:19.218 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to DEPLOYING.
08:06:19.218 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#2 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_2) [DEPLOYING].
08:06:19.219 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@790014d6
08:06:19.219 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:06:19.219 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16937918701930502306/checkpoints")
08:06:19.220 [INFO - flink-pekko.actor.default-dispatcher-6] (MasterHooks.java:201) No master state to restore
08:06:19.220 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
08:06:19.220 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 76 for source Source: KuduSource to checkpoint.
08:06:19.220 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to SCHEDULED.
08:06:19.221 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:06:19.221 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from SCHEDULED to DEPLOYING.
08:06:19.221 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #2) with attempt id 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1) with allocation id bc35714883422bae5e4de5056d4b8678
08:06:19.221 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot bc35714883422bae5e4de5056d4b8678.
08:06:19.224 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#2 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_2), deploy into slot with allocation id bc35714883422bae5e4de5056d4b8678.
08:06:19.226 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to DEPLOYING.
08:06:19.226 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#2 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_2) [DEPLOYING].
08:06:19.227 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@13488f6f
08:06:19.227 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:06:19.227 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16937918701930502306/checkpoints")
08:06:19.230 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
08:06:19.231 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
08:06:19.233 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3650ddcd
08:06:19.236 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:19.237 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
08:06:19.240 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4ea0cea6
08:06:19.245 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:19.249 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:19.257 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:19.258 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.259 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.259 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.262 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:19.263 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:19.263 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:19.263 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:19.263 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:19.264 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:19.264 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:19.264 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:19.264 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:19.264 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:19.264 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:19.265 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:19.265 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:19.265 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28343), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [16ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [26ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [41ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [42ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [88ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [95ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [98ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [98ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [123ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [125ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [128ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [131ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [143ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [163ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [164ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [177ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [178ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [223ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [224ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [225ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [225ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [282ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [283ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [283ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [284ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [304ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [305ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [305ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [306ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [540ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [543ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [544ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [545ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [545ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [862ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [863ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [864ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [864ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1140ms] refreshing cache from master, [1140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1143ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1144ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1144ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1680ms] refreshing cache from master, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1683ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [3340ms] refreshing cache from master, [3341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [3341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [3343ms] too many traces: truncated at 100 traces, deferred=Deferred@949278426(state=PENDING, result=null, callback=(continuation of Deferred@183498931 after retry RPC after error@1346111058) -> (continuation of Deferred@1968933365 after retry RPC after error@1801958274) -> (continuation of Deferred@515433533 after retry RPC after error@772177710) -> (continuation of Deferred@121331514 after retry RPC after error@1360402428) -> (continuation of Deferred@139888879 after retry RPC after error@355756484) -> (continuation of Deferred@1219176151 after retry RPC after error@702771657) -> (continuation of Deferred@365856234 after retry RPC after error@587375838) -> (continuation of Deferred@848208887 after retry RPC after error@5370198) -> (continuation of Deferred@1632752995 after retry RPC after error@1464052163) -> (continuation of Deferred@278211015 after retry RPC after error@524399042) -> (continuation of Deferred@1884587396 after retry RPC after error@974333948) -> (continuation of Deferred@57801320 after retry RPC after error@296522853) -> (continuation of Deferred@1166035825 after retry RPC after error@1720690938) -> (continuation of Deferred@1788984569 after retry RPC after error@534450804) -> (continuation of Deferred@1481054525 after retry RPC after error@1133818551) -> (continuation of Deferred@607492168 after retry RPC after error@1664771592) -> (continuation of Deferred@55842211 after retry RPC after error@1697844852) -> (continuation of Deferred@1833712962 after retry RPC after error@1576410309) -> (continuation of Deferred@2116875221 after retry RPC after error@51446474) -> (continuation of Deferred@263952839 after retry RPC after error@1657187521) -> (continuation of Deferred@2079152407 after retry RPC after error@1893794802), errback=(continuation of Deferred@183498931 after retry RPC after error@1346111058) -> (continuation of Deferred@1968933365 after retry RPC after error@1801958274) -> (continuation of Deferred@515433533 after retry RPC after error@772177710) -> (continuation of Deferred@121331514 after retry RPC after error@1360402428) -> (continuation of Deferred@139888879 after retry RPC after error@355756484) -> (continuation of Deferred@1219176151 after retry RPC after error@702771657) -> (continuation of Deferred@365856234 after retry RPC after error@587375838) -> (continuation of Deferred@848208887 after retry RPC after error@5370198) -> (continuation of Deferred@1632752995 after retry RPC after error@1464052163) -> (continuation of Deferred@278211015 after retry RPC after error@524399042) -> (continuation of Deferred@1884587396 after retry RPC after error@974333948) -> (continuation of Deferred@57801320 after retry RPC after error@296522853) -> (continuation of Deferred@1166035825 after retry RPC after error@1720690938) -> (continuation of Deferred@1788984569 after retry RPC after error@534450804) -> (continuation of Deferred@1481054525 after retry RPC after error@1133818551) -> (continuation of Deferred@607492168 after retry RPC after error@1664771592) -> (continuation of Deferred@55842211 after retry RPC after error@1697844852) -> (continuation of Deferred@1833712962 after retry RPC after error@1576410309) -> (continuation of Deferred@2116875221 after retry RPC after error@51446474) -> (continuation of Deferred@263952839 after retry RPC after error@1657187521) -> (continuation of Deferred@2079152407 after retry RPC after error@1893794802)))
08:06:19.268 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
08:06:19.268 [WARN - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#3 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28343), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [16ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [26ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [41ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [42ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [88ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [95ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [98ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [98ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [123ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [125ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [128ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [131ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [143ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [163ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [164ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [177ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [178ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [223ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [224ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [225ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [225ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [282ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [283ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [283ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [284ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [304ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [305ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [305ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [306ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [540ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [543ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [544ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [545ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [545ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [862ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [863ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [864ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [864ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1140ms] refreshing cache from master, [1140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1143ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1144ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1144ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1680ms] refreshing cache from master, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1683ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [3340ms] refreshing cache from master, [3341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [3341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [3343ms] too many traces: truncated at 100 traces, deferred=Deferred@949278426(state=PENDING, result=null, callback=(continuation of Deferred@183498931 after retry RPC after error@1346111058) -> (continuation of Deferred@1968933365 after retry RPC after error@1801958274) -> (continuation of Deferred@515433533 after retry RPC after error@772177710) -> (continuation of Deferred@121331514 after retry RPC after error@1360402428) -> (continuation of Deferred@139888879 after retry RPC after error@355756484) -> (continuation of Deferred@1219176151 after retry RPC after error@702771657) -> (continuation of Deferred@365856234 after retry RPC after error@587375838) -> (continuation of Deferred@848208887 after retry RPC after error@5370198) -> (continuation of Deferred@1632752995 after retry RPC after error@1464052163) -> (continuation of Deferred@278211015 after retry RPC after error@524399042) -> (continuation of Deferred@1884587396 after retry RPC after error@974333948) -> (continuation of Deferred@57801320 after retry RPC after error@296522853) -> (continuation of Deferred@1166035825 after retry RPC after error@1720690938) -> (continuation of Deferred@1788984569 after retry RPC after error@534450804) -> (continuation of Deferred@1481054525 after retry RPC after error@1133818551) -> (continuation of Deferred@607492168 after retry RPC after error@1664771592) -> (continuation of Deferred@55842211 after retry RPC after error@1697844852) -> (continuation of Deferred@1833712962 after retry RPC after error@1576410309) -> (continuation of Deferred@2116875221 after retry RPC after error@51446474) -> (continuation of Deferred@263952839 after retry RPC after error@1657187521) -> (continuation of Deferred@2079152407 after retry RPC after error@1893794802), errback=(continuation of Deferred@183498931 after retry RPC after error@1346111058) -> (continuation of Deferred@1968933365 after retry RPC after error@1801958274) -> (continuation of Deferred@515433533 after retry RPC after error@772177710) -> (continuation of Deferred@121331514 after retry RPC after error@1360402428) -> (continuation of Deferred@139888879 after retry RPC after error@355756484) -> (continuation of Deferred@1219176151 after retry RPC after error@702771657) -> (continuation of Deferred@365856234 after retry RPC after error@587375838) -> (continuation of Deferred@848208887 after retry RPC after error@5370198) -> (continuation of Deferred@1632752995 after retry RPC after error@1464052163) -> (continuation of Deferred@278211015 after retry RPC after error@524399042) -> (continuation of Deferred@1884587396 after retry RPC after error@974333948) -> (continuation of Deferred@57801320 after retry RPC after error@296522853) -> (continuation of Deferred@1166035825 after retry RPC after error@1720690938) -> (continuation of Deferred@1788984569 after retry RPC after error@534450804) -> (continuation of Deferred@1481054525 after retry RPC after error@1133818551) -> (continuation of Deferred@607492168 after retry RPC after error@1664771592) -> (continuation of Deferred@55842211 after retry RPC after error@1697844852) -> (continuation of Deferred@1833712962 after retry RPC after error@1576410309) -> (continuation of Deferred@2116875221 after retry RPC after error@51446474) -> (continuation of Deferred@263952839 after retry RPC after error@1657187521) -> (continuation of Deferred@2079152407 after retry RPC after error@1893794802)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:06:19.270 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#3 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
08:06:19.272 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#3 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_3.
08:06:19.274 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:19.276 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to FAILED on 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28343), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [16ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [26ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [41ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [42ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [88ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [95ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [98ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [98ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [123ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [125ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [128ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [131ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [143ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [163ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [164ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [177ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [178ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [223ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [224ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [225ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [225ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [282ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [283ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [283ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [284ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [304ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [305ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [305ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [306ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [540ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [543ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [544ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [545ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [545ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [862ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [863ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [864ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [864ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1140ms] refreshing cache from master, [1140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1143ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1144ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1144ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1680ms] refreshing cache from master, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1683ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [3340ms] refreshing cache from master, [3341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [3341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [3343ms] too many traces: truncated at 100 traces, deferred=Deferred@949278426(state=PENDING, result=null, callback=(continuation of Deferred@183498931 after retry RPC after error@1346111058) -> (continuation of Deferred@1968933365 after retry RPC after error@1801958274) -> (continuation of Deferred@515433533 after retry RPC after error@772177710) -> (continuation of Deferred@121331514 after retry RPC after error@1360402428) -> (continuation of Deferred@139888879 after retry RPC after error@355756484) -> (continuation of Deferred@1219176151 after retry RPC after error@702771657) -> (continuation of Deferred@365856234 after retry RPC after error@587375838) -> (continuation of Deferred@848208887 after retry RPC after error@5370198) -> (continuation of Deferred@1632752995 after retry RPC after error@1464052163) -> (continuation of Deferred@278211015 after retry RPC after error@524399042) -> (continuation of Deferred@1884587396 after retry RPC after error@974333948) -> (continuation of Deferred@57801320 after retry RPC after error@296522853) -> (continuation of Deferred@1166035825 after retry RPC after error@1720690938) -> (continuation of Deferred@1788984569 after retry RPC after error@534450804) -> (continuation of Deferred@1481054525 after retry RPC after error@1133818551) -> (continuation of Deferred@607492168 after retry RPC after error@1664771592) -> (continuation of Deferred@55842211 after retry RPC after error@1697844852) -> (continuation of Deferred@1833712962 after retry RPC after error@1576410309) -> (continuation of Deferred@2116875221 after retry RPC after error@51446474) -> (continuation of Deferred@263952839 after retry RPC after error@1657187521) -> (continuation of Deferred@2079152407 after retry RPC after error@1893794802), errback=(continuation of Deferred@183498931 after retry RPC after error@1346111058) -> (continuation of Deferred@1968933365 after retry RPC after error@1801958274) -> (continuation of Deferred@515433533 after retry RPC after error@772177710) -> (continuation of Deferred@121331514 after retry RPC after error@1360402428) -> (continuation of Deferred@139888879 after retry RPC after error@355756484) -> (continuation of Deferred@1219176151 after retry RPC after error@702771657) -> (continuation of Deferred@365856234 after retry RPC after error@587375838) -> (continuation of Deferred@848208887 after retry RPC after error@5370198) -> (continuation of Deferred@1632752995 after retry RPC after error@1464052163) -> (continuation of Deferred@278211015 after retry RPC after error@524399042) -> (continuation of Deferred@1884587396 after retry RPC after error@974333948) -> (continuation of Deferred@57801320 after retry RPC after error@296522853) -> (continuation of Deferred@1166035825 after retry RPC after error@1720690938) -> (continuation of Deferred@1788984569 after retry RPC after error@534450804) -> (continuation of Deferred@1481054525 after retry RPC after error@1133818551) -> (continuation of Deferred@607492168 after retry RPC after error@1664771592) -> (continuation of Deferred@55842211 after retry RPC after error@1697844852) -> (continuation of Deferred@1833712962 after retry RPC after error@1576410309) -> (continuation of Deferred@2116875221 after retry RPC after error@51446474) -> (continuation of Deferred@263952839 after retry RPC after error@1657187521) -> (continuation of Deferred@2079152407 after retry RPC after error@1893794802)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:06:19.279 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:06:19.280 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#3) of source Source: KuduSource.
08:06:19.281 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_3.
08:06:19.291 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:19.292 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.293 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.293 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.294 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:19.295 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.295 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.296 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.302 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:19.302 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.302 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.303 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.310 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.312 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.312 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.312 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.312 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:19.316 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.316 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.316 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:19.319 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:19.329 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:19.333 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:19.333 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:19.334 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.335 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.337 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.338 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:19.339 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.339 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.339 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.347 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091579347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:19.348 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:19.349 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.349 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.349 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.357 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:19.359 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.361 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.361 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.360 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.361 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.361 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
08:06:19.362 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.362 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:19.362 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.362 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.362 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.362 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:19.363 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
08:06:19.369 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:19.373 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:19.373 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:19.374 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.374 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.374 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.376 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:19.376 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.376 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.377 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.377 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.377 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.377 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.377 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:19.388 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:19.389 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:19.389 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:19.389 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.389 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.390 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.390 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.390 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.389 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.390 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.390 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.390 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.390 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:19.394 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:19.395 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.395 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.395 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.403 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:19.403 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.403 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.403 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.409 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:19.409 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:19.409 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:19.410 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.410 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.410 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.410 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.410 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.410 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.410 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:19.410 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.410 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.410 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.411 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.411 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.411 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.411 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:19.413 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:19.413 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:19.414 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.414 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:19.414 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.414 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.414 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.414 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.414 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.414 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.414 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.414 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.414 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:19.429 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:19.429 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:19.430 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:19.430 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.430 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.431 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.431 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.431 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.431 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.432 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.432 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.432 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.432 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:19.433 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:19.433 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:19.434 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:19.434 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.434 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.434 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.434 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.434 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.434 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.435 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.435 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.435 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.435 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:19.448 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:19.449 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:19.449 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:19.450 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.450 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.450 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.450 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.451 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.451 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.451 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.451 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.451 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.451 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:19.469 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:19.469 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:19.469 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:19.470 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.470 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.470 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.471 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.471 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.471 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.471 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.471 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.472 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.472 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:19.473 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:19.473 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:19.473 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:19.474 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.474 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.474 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.474 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.474 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.474 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.475 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.475 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.476 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.476 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:19.513 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:19.514 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:19.514 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:19.515 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.515 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.515 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.515 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.515 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.515 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.516 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.516 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.516 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.516 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:19.548 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:19.549 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:19.549 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:19.550 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.550 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.550 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.550 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.550 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.551 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.551 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.551 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.551 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.551 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:19.613 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:19.614 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:19.614 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:19.615 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.615 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.615 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.615 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.615 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.615 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.615 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.615 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.615 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.615 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:19.674 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:19.674 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:19.675 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:19.675 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.675 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.676 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.676 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.676 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.676 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.676 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.676 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.677 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.677 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:19.820 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:19.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091579847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:19.856 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:19.857 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:19.857 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:19.859 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.859 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.860 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.860 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.861 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.861 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.861 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.862 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.862 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.862 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:19.873 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=23 ms, finalizationTime=2 ms).
08:06:19.877 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
08:06:19.953 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:19.954 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:19.954 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:19.955 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.956 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.956 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.956 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.956 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.957 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.957 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.957 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.957 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.957 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:19.989 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:19.989 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:19.989 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:19.990 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.990 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.990 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:19.990 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.991 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.991 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:19.991 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.991 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.991 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:19.991 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:20.322 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:20.348 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091580347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:20.360 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
08:06:20.362 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
08:06:20.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:19.074328 29862 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 29857
08:06:20.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:20.416967 29857 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.733s	user 0.820s	sys 1.349s
08:06:20.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:20.417656 29857 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.734s	user 0.820s	sys 1.350s
08:06:20.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:17.686410 29864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:20.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.430145 29857 server_base.cc:1061] running on GCE node
08:06:20.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:20.432724 29894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:20.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.434517 29857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:06:20.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.437722 29857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:06:20.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.439234 29857 hybrid_clock.cc:648] HybridClock initialized: now 1779091580439173 us; error 64 us; skew 500 ppm
08:06:20.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.440433 29857 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:06:20.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.455075 29857 webserver.cc:533] Webserver started at http://127.28.220.193:38829/ using document root <none> and password file <none>
08:06:20.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.456461 29857 fs_manager.cc:362] Metadata directory not provided
08:06:20.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.456743 29857 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:06:20.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.457331 29857 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:06:20.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.464377 29857 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-0/data/instance:
08:06:20.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9b230140dcab4f58b02a0b1939e65a5d"
08:06:20.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:20 on dist-test-slave-1jss"
08:06:20.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.466054 29857 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-0/wal/instance:
08:06:20.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9b230140dcab4f58b02a0b1939e65a5d"
08:06:20.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:20 on dist-test-slave-1jss"
08:06:20.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.477101 29857 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.005s	sys 0.005s
08:06:20.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.487996 29899 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:06:20.489 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:20.489 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:20.489 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:20.490 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:20.490 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:20.490 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:20.490 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:20.490 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:20.490 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:20.490 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:20.490 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:20.490 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:20.491 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:20.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.492388 29857 fs_manager.cc:730] Time spent opening block manager: real 0.010s	user 0.005s	sys 0.001s
08:06:20.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.493050 29857 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-0/wal
08:06:20.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9b230140dcab4f58b02a0b1939e65a5d"
08:06:20.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:20 on dist-test-slave-1jss"
08:06:20.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.493567 29857 fs_report.cc:389] FS layout report
08:06:20.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:06:20.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-0/wal
08:06:20.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-0/wal
08:06:20.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-0/data/data
08:06:20.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:06:20.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:06:20.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:06:20.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:06:20.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:06:20.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:06:20.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:06:20.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:06:20.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:06:20.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:06:20.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:06:20.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.577097 29857 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:06:20.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.579386 29857 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:06:20.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.580186 29857 kserver.cc:163] Server-wide thread pool size limit: 3276
08:06:20.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.590055 29857 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:06:20.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.605881 29857 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:06:20.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.606201 29857 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
08:06:20.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.606513 29857 ts_tablet_manager.cc:616] Registered 0 tablets
08:06:20.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.606711 29857 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:06:20.820 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:20.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091580847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:20.858 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
08:06:20.859 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
08:06:20.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.903726 29857 rpc_server.cc:307] RPC server started. Bound to: 127.28.220.193:36711
08:06:20.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.903909 30014 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.220.193:36711 every 8 connection(s)
08:06:20.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.907270 29857 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-0/data/info.pb
08:06:20.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.917168 29555 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 29857
08:06:20.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.918074 29555 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-0/wal/instance
08:06:20.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.951351 29555 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:06:20.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-1/wal
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-1/data
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-1/logs
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-1/data/info.pb
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.220.194:0
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.220.194
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.220.194
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.220.254:37365,127.28.220.253:45079,127.28.220.252:33543
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.220.212:42111
08:06:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:20.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:20.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:06:20.968 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:20.969 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:20.969 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:20.970 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:20.970 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:20.971 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:20.971 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:20.971 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:20.971 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:20.971 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:20.971 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:20.972 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:20.972 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:20.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.986584 30016 heartbeater.cc:344] Connected to a master server at 127.28.220.253:45079
08:06:20.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.987233 30016 heartbeater.cc:461] Registering TS with master...
08:06:20.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.988792 30016 heartbeater.cc:507] Master 127.28.220.253:45079 requested a full tablet report, sending...
08:06:20.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.992882 30015 heartbeater.cc:344] Connected to a master server at 127.28.220.252:33543
08:06:20.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.993103 29677 ts_manager.cc:194] Registered new tserver with Master: 9b230140dcab4f58b02a0b1939e65a5d (127.28.220.193:36711)
08:06:20.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.993278 30017 heartbeater.cc:344] Connected to a master server at 127.28.220.254:37365
08:06:20.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.993300 30015 heartbeater.cc:461] Registering TS with master...
08:06:20.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.993674 30017 heartbeater.cc:461] Registering TS with master...
08:06:20.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.994570 30017 heartbeater.cc:507] Master 127.28.220.254:37365 requested a full tablet report, sending...
08:06:20.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.994613 30015 heartbeater.cc:507] Master 127.28.220.252:33543 requested a full tablet report, sending...
08:06:21.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.998270 29757 ts_manager.cc:194] Registered new tserver with Master: 9b230140dcab4f58b02a0b1939e65a5d (127.28.220.193:36711)
08:06:21.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:20.999073 29600 ts_manager.cc:194] Registered new tserver with Master: 9b230140dcab4f58b02a0b1939e65a5d (127.28.220.193:36711)
08:06:21.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:21.001863 29757 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.220.193:41989
08:06:21.320 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:21.348 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091581347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:21.357 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
08:06:21.358 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
08:06:21.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:21.370425 30025 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:06:21.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:21.371083 30025 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:06:21.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:21.371537 30025 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:06:21.394 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:21.394 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:21.395 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:21.395 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:21.395 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:21.395 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:21.395 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:21.395 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:21.395 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:21.395 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:21.396 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:21.396 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:21.396 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:21.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:21.411849 30025 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:06:21.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:21.412840 30025 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.220.194
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:21.457491 30025 tablet_server_runner.cc:78] Tablet server non-default flags:
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.220.212:42111
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-1/data
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-1/wal
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.220.194:0
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-1/data/info.pb
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.220.194
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.220.254:37365,127.28.220.253:45079,127.28.220.252:33543
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.220.194
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-1/logs
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:06:21.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:06:21.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:21.459537 30025 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:06:21.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:21.461746 30025 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:06:21.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:21.478292 30032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:21.814 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:21.814 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:21.814 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:21.815 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:21.815 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:21.815 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:21.816 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:21.816 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:21.816 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:21.816 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:21.816 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:21.817 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:21.817 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:21.820 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:21.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091581847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:21.863 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
08:06:21.866 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
08:06:22.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:22.007097 30015 heartbeater.cc:499] Master 127.28.220.252:33543 was elected leader, sending a full tablet report...
08:06:22.319 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:22.349 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091582347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:22.361 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
08:06:22.363 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
08:06:22.613 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:22.614 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:22.614 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:22.615 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:22.615 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:22.615 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:22.616 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:22.616 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:22.616 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:22.616 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:22.617 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:22.617 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:22.617 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:22.754 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:22.754 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:22.754 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:22.755 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:22.755 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:22.756 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:22.756 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:22.756 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:22.756 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:22.757 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:22.757 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:22.757 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:22.757 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:22.820 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:22.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091582847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:22.858 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
08:06:22.859 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
08:06:22.974 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:22.975 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:22.975 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:22.975 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:22.975 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:22.975 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:22.975 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:22.976 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:22.976 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:22.975 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:22.976 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:22.976 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:22.976 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:22.879076 30031 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 30025
08:06:22.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:22.977623 30031 kernel_stack_watchdog.cc:198] Thread 30025 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 397ms:
08:06:22.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:06:22.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:06:22.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:06:22.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:06:22.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:22.978658 30025 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.499s	user 0.541s	sys 0.896s
08:06:22.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:21.479820 30033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:22.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:22.979455 30025 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.500s	user 0.541s	sys 0.896s
08:06:22.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:22.982700 30035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:22.990 [INFO - flink-pekko.actor.default-dispatcher-5] (CheckpointCoordinator.java:1805) Restoring job b42812d69c586178cf7556c3c92998f3 from Checkpoint 65 @ 1779091487380 for b42812d69c586178cf7556c3c92998f3 located at file:/tmp/junit1738461414297871817/checkpoints/b42812d69c586178cf7556c3c92998f3/chk-65.
08:06:22.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:22.990481 30025 server_base.cc:1061] running on GCE node
08:06:22.991 [INFO - flink-pekko.actor.default-dispatcher-5] (MasterHooks.java:201) No master state to restore
08:06:22.991 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to SCHEDULED.
08:06:22.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:22.992204 30025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:06:22.992 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:06:22.992 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from SCHEDULED to DEPLOYING.
08:06:22.992 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #4) with attempt id 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1) with allocation id 2f9a5ebd231a465571d2109e36591407
08:06:22.993 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (b42812d69c586178cf7556c3c92998f3) switched from state RESTARTING to RUNNING.
08:06:22.993 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 3 to checkpoint 65 for source Source: KuduSource to checkpoint.
08:06:22.993 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 2f9a5ebd231a465571d2109e36591407.
08:06:22.994 [INFO - flink-pekko.actor.default-dispatcher-5] (CheckpointCoordinator.java:1805) Restoring job b42812d69c586178cf7556c3c92998f3 from Checkpoint 65 @ 1779091487380 for b42812d69c586178cf7556c3c92998f3 located at file:/tmp/junit1738461414297871817/checkpoints/b42812d69c586178cf7556c3c92998f3/chk-65.
08:06:22.994 [INFO - flink-pekko.actor.default-dispatcher-5] (MasterHooks.java:201) No master state to restore
08:06:22.994 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 0 to checkpoint 65 for source Source: KuduSource to checkpoint.
08:06:22.994 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#4 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_4), deploy into slot with allocation id 2f9a5ebd231a465571d2109e36591407.
08:06:22.995 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to SCHEDULED.
08:06:22.996 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:06:22.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:22.995970 30025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:06:22.997 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from SCHEDULED to DEPLOYING.
08:06:22.997 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #4) with attempt id 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1) with allocation id 4c78869737ef27e21dadfe7d1a23010d
08:06:22.997 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 4c78869737ef27e21dadfe7d1a23010d.
08:06:22.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:22.997464 30025 hybrid_clock.cc:648] HybridClock initialized: now 1779091582997471 us; error 109 us; skew 500 ppm
08:06:22.997 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to DEPLOYING.
08:06:22.998 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#4 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_4) [DEPLOYING].
08:06:22.998 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@240921c6
08:06:22.998 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:06:22.999 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#4 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_4), deploy into slot with allocation id 4c78869737ef27e21dadfe7d1a23010d.
08:06:22.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:22.998966 30025 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:06:22.999 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit1738461414297871817/checkpoints")
08:06:22.999 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
08:06:22.999 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
08:06:23.002 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to DEPLOYING.
08:06:23.002 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#4 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_4) [DEPLOYING].
08:06:23.002 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@664c6dd3
08:06:23.003 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5fe01f2c
08:06:23.003 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:06:23.003 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit1738461414297871817/checkpoints")
08:06:23.003 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
08:06:23.004 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
08:06:23.006 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:23.007 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:23.008 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:23.009 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4e852bb
08:06:23.009 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.009 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.009 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.010 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:23.010 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.011 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.011 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.013 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:23.015 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.015 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.015 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.015 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:23.017 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:23.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.018208 30025 webserver.cc:533] Webserver started at http://127.28.220.194:44285/ using document root <none> and password file <none>
08:06:23.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.019356 30025 fs_manager.cc:362] Metadata directory not provided
08:06:23.019 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:23.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.019621 30025 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:06:23.020 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.020 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.020 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.020915 30025 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:06:23.024 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:23.024 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.024 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.024 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.025 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.025 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.025 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.025 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:23.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.027199 30025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-1/data/instance:
08:06:23.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e83b8a545bd54af99acd623fd123912f"
08:06:23.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:23 on dist-test-slave-1jss"
08:06:23.028 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:23.029 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:23.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.028851 30025 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-1/wal/instance:
08:06:23.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e83b8a545bd54af99acd623fd123912f"
08:06:23.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:23 on dist-test-slave-1jss"
08:06:23.029 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:23.030 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.030 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.030 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.030 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.030 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.030 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.031 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.031 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.031 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.031 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:23.037 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:23.037 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:23.038 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:23.038 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.039 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.039 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.039 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.039 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.039 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.040 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.040 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.040 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.040 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:23.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.040686 30025 fs_manager.cc:696] Time spent creating directory manager: real 0.011s	user 0.008s	sys 0.004s
08:06:23.048 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:23.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.048121 30062 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:06:23.048 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:23.049 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.049 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.049 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.050033 30025 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.006s	sys 0.000s
08:06:23.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.050433 30025 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-1/wal
08:06:23.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e83b8a545bd54af99acd623fd123912f"
08:06:23.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:23 on dist-test-slave-1jss"
08:06:23.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.050889 30025 fs_report.cc:389] FS layout report
08:06:23.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:06:23.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-1/wal
08:06:23.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-1/wal
08:06:23.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-1/data/data
08:06:23.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:06:23.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:06:23.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:06:23.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:06:23.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:06:23.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:06:23.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:06:23.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:06:23.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:06:23.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:06:23.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:06:23.054 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:23.055 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.055 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.055 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.055 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.055 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.055 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.055 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:23.057 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:23.058 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:23.058 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.058 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.059 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.059 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:23.059 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.060 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.060 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.060 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.060 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.060 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.060 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:23.068 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:23.068 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:23.068 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:23.068 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.068 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.068 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.068 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.068 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.068 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.069 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.069 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.069 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.069 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:23.078 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:23.078 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:23.078 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:23.078 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.078 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.079 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.079 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.079 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.079 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.079 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.079 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.079 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.079 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:23.088 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:23.088 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:23.088 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:23.089 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.089 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.089 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.089 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.089 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.089 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.090 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.090 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.090 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.091 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:23.097 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:23.098 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:23.098 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:23.098 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.098 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.098 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.098 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.098 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.098 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.098 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.098 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.098 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.099 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:23.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.113315 30025 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:06:23.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.115258 30025 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:06:23.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.115813 30025 kserver.cc:163] Server-wide thread pool size limit: 3276
08:06:23.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.119005 30025 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:06:23.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.124100 30025 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:06:23.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.124348 30025 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:06:23.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.124688 30025 ts_tablet_manager.cc:616] Registered 0 tablets
08:06:23.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.124893 30025 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:06:23.128 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:23.128 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:23.129 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:23.129 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.129 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.129 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.129 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.129 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.129 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.129 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.129 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.130 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.130 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:23.138 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:23.138 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:23.138 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.138 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.139 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.139 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.139 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:23.139 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.139 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.139 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.139 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.139 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.139 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:23.158 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:23.158 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:23.158 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:23.159 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.159 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.159 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.159 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.159 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.159 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.159 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.159 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.160 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.160 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:23.167 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:23.167 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:23.168 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:23.168 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.168 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.168 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.168 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.168 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.168 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.168 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.168 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.168 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.169 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:23.187 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:23.188 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:23.188 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:23.188 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.189 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.189 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.189 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.189 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.189 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.189 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.189 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.189 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.189 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:23.258 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:23.258 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:23.258 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:23.259 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.259 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.259 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.259 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.259 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.259 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.260 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.260 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.260 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.260 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:23.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.298377 30025 rpc_server.cc:307] RPC server started. Bound to: 127.28.220.194:39597
08:06:23.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.298478 30179 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.220.194:39597 every 8 connection(s)
08:06:23.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.301950 30025 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-1/data/info.pb
08:06:23.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.305853 29555 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 30025
08:06:23.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.306380 29555 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-1/wal/instance
08:06:23.320 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:23.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.320037 29555 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:06:23.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:06:23.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-2/wal
08:06:23.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-2/data
08:06:23.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:06:23.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:06:23.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:06:23.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:23.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:23.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:23.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-2/logs
08:06:23.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-2/data/info.pb
08:06:23.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:23.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:06:23.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:06:23.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:06:23.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:06:23.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:23.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:23.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:23.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:06:23.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:06:23.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.220.195:0
08:06:23.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.220.195
08:06:23.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.220.195
08:06:23.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:23.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.220.254:37365,127.28.220.253:45079,127.28.220.252:33543
08:06:23.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.220.212:42111
08:06:23.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:23.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:23.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:06:23.348 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091583347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:23.356 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
08:06:23.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.357911 30180 heartbeater.cc:344] Connected to a master server at 127.28.220.252:33543
08:06:23.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.358471 30180 heartbeater.cc:461] Registering TS with master...
08:06:23.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.360198 30180 heartbeater.cc:507] Master 127.28.220.252:33543 requested a full tablet report, sending...
08:06:23.361 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
08:06:23.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.362495 30181 heartbeater.cc:344] Connected to a master server at 127.28.220.253:45079
08:06:23.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.362751 30182 heartbeater.cc:344] Connected to a master server at 127.28.220.254:37365
08:06:23.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.363111 30182 heartbeater.cc:461] Registering TS with master...
08:06:23.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.363135 30181 heartbeater.cc:461] Registering TS with master...
08:06:23.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.364336 30181 heartbeater.cc:507] Master 127.28.220.253:45079 requested a full tablet report, sending...
08:06:23.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.364326 30182 heartbeater.cc:507] Master 127.28.220.254:37365 requested a full tablet report, sending...
08:06:23.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.364593 29757 ts_manager.cc:194] Registered new tserver with Master: e83b8a545bd54af99acd623fd123912f (127.28.220.194:39597)
08:06:23.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.366605 29757 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.220.194:60243
08:06:23.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.367620 29600 ts_manager.cc:194] Registered new tserver with Master: e83b8a545bd54af99acd623fd123912f (127.28.220.194:39597)
08:06:23.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.367774 29677 ts_manager.cc:194] Registered new tserver with Master: e83b8a545bd54af99acd623fd123912f (127.28.220.194:39597)
08:06:23.407 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:23.408 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:23.408 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:23.408 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.408 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.408 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.408 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.409 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.409 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.409 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.409 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.409 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.409 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:23.438 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:23.439 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:23.439 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.439 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.439 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:23.439 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.439 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.439 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.440 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.440 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.440 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.440 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.440 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:23.446 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:23.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:23.708634 30190 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:06:23.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:23.709414 30190 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:06:23.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:23.710094 30190 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:06:23.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:23.749253 30190 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:06:23.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:23.750298 30190 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.220.195
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.797549 30190 tablet_server_runner.cc:78] Tablet server non-default flags:
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.220.212:42111
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-2/data
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-2/wal
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.220.195:0
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-2/data/info.pb
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.220.195
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.220.254:37365,127.28.220.253:45079,127.28.220.252:33543
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.220.195
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-2/logs
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:06:23.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:06:23.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.799641 30190 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:06:23.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:23.802295 30190 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:06:23.820 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:23.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:23.821385 30196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:23.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091583847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:23.860 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
08:06:23.862 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
08:06:23.908 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:23.908 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:23.908 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:23.908 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.909 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.909 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.909 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.909 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.909 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.909 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.909 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.909 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.910 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:23.939 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:23.939 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:23.940 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:23.940 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.941 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.941 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:23.941 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.941 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.941 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:23.942 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.942 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.942 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:23.942 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:23.946 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:24.098 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:24.098 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:24.098 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:24.099 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:24.099 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:24.099 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:24.099 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:24.099 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:24.099 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:24.101 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:24.101 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:24.101 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:24.101 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:24.258 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:24.259 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:24.259 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:24.260 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:24.260 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:24.260 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:24.261 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:24.261 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:24.261 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:24.262 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:24.262 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:24.262 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:24.262 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:24.320 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:24.348 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091584347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:24.359 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
08:06:24.361 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
08:06:24.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:24.378144 30180 heartbeater.cc:499] Master 127.28.220.252:33543 was elected leader, sending a full tablet report...
08:06:24.446 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:24.489 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:24.490 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:24.490 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:24.491 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:24.491 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:24.492 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:24.492 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:24.492 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:24.492 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:24.493 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:24.493 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:24.493 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:24.493 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:24.754 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:24.755 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:24.755 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:24.758 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:24.758 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:24.758 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:24.759 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:24.759 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:24.759 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:24.760 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:24.760 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:24.760 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:24.760 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:24.820 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:24.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091584847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:24.863 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=14 ms, finalizationTime=2 ms).
08:06:24.865 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
08:06:24.927 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:24.928 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:24.928 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:24.930 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:24.930 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:24.930 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:24.931 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:24.931 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:24.931 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:24.932 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:24.932 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:24.932 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:24.932 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:24.946 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:25.274 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:25.274 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:25.275 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:25.275 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:25.276 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:25.276 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:25.276 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:25.277 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:25.277 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:25.277 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:25.278 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:25.278 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:25.278 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:25.320 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:25.334 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:25.334 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:25.334 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:25.335 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:25.335 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:25.335 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:25.335 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:25.335 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:25.335 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:25.335 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:25.336 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:25.335 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:25.336 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:25.348 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091585347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:25.359 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:06:25.361 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
08:06:25.446 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:25.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:25.225032 30195 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 30190
08:06:25.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:25.507287 30195 kernel_stack_watchdog.cc:198] Thread 30190 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 397ms:
08:06:25.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:06:25.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:06:25.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:06:25.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:06:25.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:23.823434 30197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:25.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:25.509172 30190 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.685s	user 0.002s	sys 0.001s
08:06:25.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:25.509593 30190 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.685s	user 0.002s	sys 0.001s
08:06:25.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:25.516752 30198 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1692 milliseconds
08:06:25.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:25.517304 30199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:25.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.517423 30190 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:06:25.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.518926 30190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:06:25.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.521376 30190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:06:25.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.522776 30190 hybrid_clock.cc:648] HybridClock initialized: now 1779091585522730 us; error 37 us; skew 500 ppm
08:06:25.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.523701 30190 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:06:25.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.532145 30190 webserver.cc:533] Webserver started at http://127.28.220.195:34409/ using document root <none> and password file <none>
08:06:25.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.533222 30190 fs_manager.cc:362] Metadata directory not provided
08:06:25.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.533420 30190 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:06:25.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.533972 30190 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:06:25.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.539211 30190 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-2/data/instance:
08:06:25.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4430d593fcee4c1fbd17a7aab7897238"
08:06:25.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:25 on dist-test-slave-1jss"
08:06:25.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.540593 30190 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-2/wal/instance:
08:06:25.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4430d593fcee4c1fbd17a7aab7897238"
08:06:25.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:25 on dist-test-slave-1jss"
08:06:25.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.551643 30190 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.011s	sys 0.001s
08:06:25.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.558568 30207 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:06:25.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.560060 30190 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
08:06:25.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.560443 30190 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-2/wal
08:06:25.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4430d593fcee4c1fbd17a7aab7897238"
08:06:25.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:25 on dist-test-slave-1jss"
08:06:25.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.560833 30190 fs_report.cc:389] FS layout report
08:06:25.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:06:25.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-2/wal
08:06:25.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-2/wal
08:06:25.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-2/data/data
08:06:25.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:06:25.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:06:25.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:06:25.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:06:25.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:06:25.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:06:25.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:06:25.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:06:25.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:06:25.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:06:25.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:06:25.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.625072 30190 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:06:25.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.627251 30190 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:06:25.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.627792 30190 kserver.cc:163] Server-wide thread pool size limit: 3276
08:06:25.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.631475 30190 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:06:25.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.637656 30190 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:06:25.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.637956 30190 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
08:06:25.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.638311 30190 ts_tablet_manager.cc:616] Registered 0 tablets
08:06:25.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.638499 30190 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:06:25.788 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:25.789 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:25.789 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:25.789 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:25.789 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:25.790 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:25.789 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:25.790 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:25.790 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:25.790 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:25.790 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:25.790 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:25.791 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:25.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.815503 30190 rpc_server.cc:307] RPC server started. Bound to: 127.28.220.195:37615
08:06:25.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.815582 30319 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.220.195:37615 every 8 connection(s)
08:06:25.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.819669 30190 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-2/data/info.pb
08:06:25.820 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:25.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.825248 29555 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 30190
08:06:25.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.825766 29555 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17542764166163292145/ts-2/wal/instance
08:06:25.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091585847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:25.857 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
08:06:25.859 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
08:06:25.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.863893 30321 heartbeater.cc:344] Connected to a master server at 127.28.220.253:45079
08:06:25.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.864513 30321 heartbeater.cc:461] Registering TS with master...
08:06:25.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.866330 30321 heartbeater.cc:507] Master 127.28.220.253:45079 requested a full tablet report, sending...
08:06:25.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.871678 29676 ts_manager.cc:194] Registered new tserver with Master: 4430d593fcee4c1fbd17a7aab7897238 (127.28.220.195:37615)
08:06:25.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.876483 30322 heartbeater.cc:344] Connected to a master server at 127.28.220.254:37365
08:06:25.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.876897 30322 heartbeater.cc:461] Registering TS with master...
08:06:25.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.877996 30322 heartbeater.cc:507] Master 127.28.220.254:37365 requested a full tablet report, sending...
08:06:25.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.880748 29600 ts_manager.cc:194] Registered new tserver with Master: 4430d593fcee4c1fbd17a7aab7897238 (127.28.220.195:37615)
08:06:25.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.881249 30320 heartbeater.cc:344] Connected to a master server at 127.28.220.252:33543
08:06:25.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.881631 30320 heartbeater.cc:461] Registering TS with master...
08:06:25.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.882416 30320 heartbeater.cc:507] Master 127.28.220.252:33543 requested a full tablet report, sending...
08:06:25.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.884452 29757 ts_manager.cc:194] Registered new tserver with Master: 4430d593fcee4c1fbd17a7aab7897238 (127.28.220.195:37615)
08:06:25.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.886405 29757 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.220.195:35311
08:06:25.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:25.897171 29555 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
08:06:25.914 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:06:25.914 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

08:06:25.916 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.28.220.254"
      port: 37365
    }
    bound_http_address {
      host: "127.28.220.254"
      port: 40533
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.28.220.253"
      port: 45079
    }
    bound_http_address {
      host: "127.28.220.253"
      port: 39225
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.28.220.252"
      port: 33543
    }
    bound_http_address {
      host: "127.28.220.252"
      port: 38841
    }
  }
}

08:06:25.916 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

08:06:25.917 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.28.220.193"
      port: 36711
    }
    bound_http_address {
      host: "127.28.220.193"
      port: 38829
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.28.220.194"
      port: 39597
    }
    bound_http_address {
      host: "127.28.220.194"
      port: 44285
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.28.220.195"
      port: 37615
    }
    bound_http_address {
      host: "127.28.220.195"
      port: 34409
    }
  }
}

08:06:25.917 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
08:06:25.919 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:25.920 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
08:06:25.920 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskk4_r_T/test-tmp
08:06:25.921 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
08:06:25.921 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskk4_r_T/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
08:06:25.924 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

08:06:25.946 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:26.117 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:26.118 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:26.118 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:26.118 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:26.118 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:26.118 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:26.119 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:26.119 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:26.119 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:26.119 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:26.119 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:26.119 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:26.119 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:26.177 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:26.177 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:26.178 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:26.178 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:26.178 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:26.178 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:26.178 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:26.178 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:26.178 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:26.178 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:26.178 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:26.178 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:26.178 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:26.312 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:06:26.312 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

08:06:26.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:26.317737 30330 mini_oidc.cc:150] Starting JWKS server
08:06:26.319 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:26.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:26.321913 30330 webserver.cc:533] Webserver started at http://127.0.0.1:35975/ using document root <none> and password file <none>
08:06:26.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:26.322389 30330 mini_oidc.cc:186] Starting OIDC Discovery server
08:06:26.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:26.324376 30330 webserver.cc:533] Webserver started at http://127.0.0.1:37165/ using document root <none> and password file <none>
08:06:26.348 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091586347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:26.357 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
08:06:26.358 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
08:06:26.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:06:26Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
08:06:26.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:06:26Z Disabled control of system clock
08:06:26.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:26.399092 30330 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:06:26.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:06:26.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-0/wal
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-0/data
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-0/logs
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-0/data/info.pb
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.29.158.190:38071
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.29.158.190
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.29.158.148:38871
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:06:26.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35975/jwks.json with env {}
08:06:26.446 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:26.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:26.777530 30342 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:06:26.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:26.778272 30342 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:06:26.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:26.778878 30342 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:06:26.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:26.819612 30342 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:06:26.820 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:26.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:26.820399 30342 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:06:26.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:26.820811 30342 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:06:26.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:26.821141 30342 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:06:26.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:26.821468 30342 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:06:26.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:26.821739 30342 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:35975/jwks.json
08:06:26.847 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091586847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:26.856 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
08:06:26.857 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
08:06:26.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:26.885610 30342 master_runner.cc:387] Master server non-default flags:
08:06:26.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:26.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.29.158.148:38871
08:06:26.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:26.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:06:26.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-0/data
08:06:26.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-0/wal
08:06:26.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:06:26.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061
08:06:26.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:26.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:26.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:06:26.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.29.158.190:38071
08:06:26.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:06:26.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:06:26.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:06:26.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35975/jwks.json
08:06:26.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:26.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:26.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-0/data/info.pb
08:06:26.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.29.158.190
08:06:26.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:26.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:06:26.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:26.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:06:26.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:06:26.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:26.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-0/logs
08:06:26.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:26.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:06:26.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:06:26.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:06:26.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:06:26.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:06:26.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:06:26.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:06:26.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:06:26.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:06:26.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:26.887610 30342 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:06:26.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:26.889642 30342 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:06:26.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:26.890194 30320 heartbeater.cc:499] Master 127.28.220.252:33543 was elected leader, sending a full tablet report...
08:06:26.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:26.921411 30348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:26.946 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:27.209 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:27.209 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:27.210 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:27.210 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:27.210 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:27.210 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:27.210 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:27.211 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:27.211 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:27.211 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:27.211 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:27.211 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:27.211 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:27.320 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:27.348 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091587347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:27.361 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
08:06:27.362 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
08:06:27.447 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:27.821 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:27.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091587847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:27.865 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
08:06:27.866 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
08:06:27.946 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:27.968 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:27.968 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:27.968 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:27.969 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:27.969 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:27.970 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:27.970 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:27.970 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:27.970 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:27.970 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:27.970 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:27.971 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:27.971 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:28.324 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:28.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:28.323422 30347 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 30342
08:06:28.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:28.341790 30342 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.423s	user 0.549s	sys 0.867s
08:06:28.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:28.342128 30342 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.424s	user 0.550s	sys 0.867s
08:06:28.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:26.923672 30349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:28.348 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091588347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:28.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:28.355074 30353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:28.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.355727 30342 server_base.cc:1061] running on GCE node
08:06:28.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.357283 30342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:06:28.358 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:06:28.359 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
08:06:28.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.361558 30342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:06:28.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.363155 30342 hybrid_clock.cc:648] HybridClock initialized: now 1779091588363121 us; error 77 us; skew 500 ppm
08:06:28.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.364482 30342 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:06:28.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.372300 30342 webserver.cc:533] Webserver started at http://127.29.158.190:33427/ using document root <none> and password file <none>
08:06:28.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.373589 30342 fs_manager.cc:362] Metadata directory not provided
08:06:28.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.373950 30342 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:06:28.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.374516 30342 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:06:28.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.379769 30342 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-0/data/instance:
08:06:28.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "198dd5119f904783ad3533bc4ae61acf"
08:06:28.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:28 on dist-test-slave-1jss"
08:06:28.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.381011 30342 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-0/wal/instance:
08:06:28.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "198dd5119f904783ad3533bc4ae61acf"
08:06:28.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:28 on dist-test-slave-1jss"
08:06:28.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.390004 30342 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.011s	sys 0.001s
08:06:28.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.397241 30359 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:06:28.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.398561 30342 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
08:06:28.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.398972 30342 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-0/wal
08:06:28.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "198dd5119f904783ad3533bc4ae61acf"
08:06:28.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:28 on dist-test-slave-1jss"
08:06:28.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.399355 30342 fs_report.cc:389] FS layout report
08:06:28.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:06:28.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-0/wal
08:06:28.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-0/wal
08:06:28.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-0/data/data
08:06:28.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:06:28.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:06:28.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:06:28.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:06:28.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:06:28.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:06:28.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:06:28.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:06:28.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:06:28.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:06:28.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:06:28.446 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:28.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.463873 30342 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:06:28.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.465751 30342 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:06:28.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.466367 30342 kserver.cc:163] Server-wide thread pool size limit: 3276
08:06:28.514 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:28.514 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:28.515 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:28.515 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:28.515 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:28.515 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:28.515 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:28.515 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:28.515 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:28.516 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:28.516 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:28.516 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:28.516 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:28.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.556902 30342 rpc_server.cc:307] RPC server started. Bound to: 127.29.158.190:38071
08:06:28.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.557089 30410 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.158.190:38071 every 8 connection(s)
08:06:28.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.560520 30342 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-0/data/info.pb
08:06:28.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.569656 30411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:28.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.570086 30330 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 30342
08:06:28.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.570628 30330 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-0/wal/instance
08:06:28.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.575577 30330 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:06:28.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:06:28.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-1/wal
08:06:28.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-1/data
08:06:28.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:06:28.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:06:28.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:06:28.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:28.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:28.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:28.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-1/logs
08:06:28.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-1/data/info.pb
08:06:28.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:28.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:06:28.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:06:28.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:06:28.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:06:28.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:28.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:28.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:28.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:06:28.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:06:28.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:06:28.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:06:28.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.29.158.189:41727
08:06:28.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.29.158.189
08:06:28.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:28.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.29.158.148:38871
08:06:28.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:28.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:28.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:06:28.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:06:28.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061
08:06:28.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:06:28.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35975/jwks.json with env {}
08:06:28.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.587855 30411 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.158.190" port: 38071 } has no permanent_uuid. Determining permanent_uuid...
08:06:28.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.628679 30411 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } has no permanent_uuid. Determining permanent_uuid...
08:06:28.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:28.631639 30362 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.158.189:41727: connect: Connection refused (error 111)
08:06:28.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:28.636538 30411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.158.189:41727: Network error: Client connection negotiation failed: client connection to 127.29.158.189:41727: connect: Connection refused (error 111)
08:06:28.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.686120 30411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } attempt: 1
08:06:28.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:28.691785 30411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.158.189:41727: Network error: Client connection negotiation failed: client connection to 127.29.158.189:41727: connect: Connection refused (error 111)
08:06:28.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.760277 30411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } attempt: 2
08:06:28.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:28.765141 30411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.158.189:41727: Network error: Client connection negotiation failed: client connection to 127.29.158.189:41727: connect: Connection refused (error 111)
08:06:28.769 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:28.769 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:28.769 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:28.770 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:28.770 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:28.770 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:28.770 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:28.770 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:28.771 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:28.771 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:28.771 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:28.771 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:28.771 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:28.794 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:28.794 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:28.794 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:28.795 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:28.795 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:28.795 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:28.795 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:28.795 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:28.795 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:28.795 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:28.795 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:28.795 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:28.796 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:28.820 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:28.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091588847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:28.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:28.856638 30411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } attempt: 3
08:06:28.858 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:06:28.859 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
08:06:28.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:28.862701 30411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.158.189:41727: Network error: Client connection negotiation failed: client connection to 127.29.158.189:41727: connect: Connection refused (error 111)
08:06:28.945 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:28.978 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:28.978 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:28.978 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:28.979 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:28.979 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:28.979 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:28.979 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:28.979 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:28.979 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:28.979 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:28.979 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:28.980 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:28.980 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:28.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:28.980468 30413 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:06:28.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:28.981137 30413 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:06:28.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:28.981619 30413 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:06:29.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:29.006170 30411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } attempt: 4
08:06:29.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:29.011416 30411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.158.189:41727: Network error: Client connection negotiation failed: client connection to 127.29.158.189:41727: connect: Connection refused (error 111)
08:06:29.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:29.023733 30413 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:06:29.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:29.024147 30413 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:06:29.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:29.024369 30413 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:06:29.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:29.024577 30413 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:06:29.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:29.024782 30413 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:06:29.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:29.024937 30413 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:35975/jwks.json
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:29.072466 30413 master_runner.cc:387] Master server non-default flags:
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.29.158.148:38871
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-1/data
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-1/wal
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.29.158.189:41727
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35975/jwks.json
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-1/data/info.pb
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.29.158.189
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-1/logs
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:06:29.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:06:29.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:29.074393 30413 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:06:29.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:29.076546 30413 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:06:29.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:29.090595 30423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:29.138 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:29.139 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:29.139 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:29.139 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:29.139 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:29.139 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:29.140 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:29.140 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:29.140 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:29.140 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:29.141 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:29.141 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:29.141 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:29.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:29.310889 30411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } attempt: 5
08:06:29.320 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:29.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:29.321429 30411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.158.189:41727: Network error: Client connection negotiation failed: client connection to 127.29.158.189:41727: connect: Connection refused (error 111)
08:06:29.348 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091589347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:29.362 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
08:06:29.363 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
08:06:29.446 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:29.694 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:29.694 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:29.695 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:29.695 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:29.696 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:29.696 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:29.696 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:29.696 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:29.696 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:29.696 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:29.697 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:29.697 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:29.697 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:29.820 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:29.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091589847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:29.864 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
08:06:29.866 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
08:06:29.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:29.869208 30411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } attempt: 6
08:06:29.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:29.913345 30411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.158.189:41727: Network error: Client connection negotiation failed: client connection to 127.29.158.189:41727: connect: Connection refused (error 111)
08:06:29.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:30.074 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:30.074 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:30.074 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:30.075 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:30.076 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:30.076 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:30.077 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:30.077 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:30.077 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:30.078 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:30.078 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:30.078 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:30.078 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:30.174 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:30.175 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:30.175 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:30.176 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:30.176 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:30.176 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:30.177 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:30.177 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:30.177 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:30.178 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:30.178 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:30.178 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:30.178 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:30.320 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:30.349 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091590347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:30.368 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
08:06:30.374 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
08:06:30.446 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:30.820 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:30.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091590847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:30.857 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
08:06:30.858 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
08:06:30.947 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:30.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:30.973896 30411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } attempt: 7
08:06:30.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:30.497515 30422 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 30413
08:06:30.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:30.986795 30413 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.895s	user 0.691s	sys 1.115s
08:06:30.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:30.987185 30413 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.896s	user 0.691s	sys 1.115s
08:06:30.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:29.093461 30424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:30.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:30.989835 30425 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1897 milliseconds
08:06:30.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:30.989745 30426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:30.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:30.990167 30413 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:06:30.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:30.994535 30411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.158.189:41727: Network error: Client connection negotiation failed: client connection to 127.29.158.189:41727: connect: Connection refused (error 111)
08:06:30.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:30.996315 30413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:06:31.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.000361 30413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:06:31.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.001936 30413 hybrid_clock.cc:648] HybridClock initialized: now 1779091591001880 us; error 57 us; skew 500 ppm
08:06:31.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.003281 30413 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:06:31.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.012730 30413 webserver.cc:533] Webserver started at http://127.29.158.189:38451/ using document root <none> and password file <none>
08:06:31.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.014187 30413 fs_manager.cc:362] Metadata directory not provided
08:06:31.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.014493 30413 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:06:31.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.015084 30413 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:06:31.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.020418 30413 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-1/data/instance:
08:06:31.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a47583bb75224a168d666246d3425efb"
08:06:31.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:31 on dist-test-slave-1jss"
08:06:31.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.021565 30413 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-1/wal/instance:
08:06:31.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a47583bb75224a168d666246d3425efb"
08:06:31.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:31 on dist-test-slave-1jss"
08:06:31.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.030335 30413 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.003s	sys 0.004s
08:06:31.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.036883 30440 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:06:31.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.038280 30413 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.007s	sys 0.000s
08:06:31.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.038651 30413 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-1/wal
08:06:31.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a47583bb75224a168d666246d3425efb"
08:06:31.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:31 on dist-test-slave-1jss"
08:06:31.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.039008 30413 fs_report.cc:389] FS layout report
08:06:31.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:06:31.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-1/wal
08:06:31.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-1/wal
08:06:31.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-1/data/data
08:06:31.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:06:31.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:06:31.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:06:31.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:06:31.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:06:31.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:06:31.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:06:31.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:06:31.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:06:31.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:06:31.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:06:31.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.107746 30413 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:06:31.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.109633 30413 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:06:31.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.110143 30413 kserver.cc:163] Server-wide thread pool size limit: 3276
08:06:31.138 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:31.138 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:31.139 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:31.139 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:31.139 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:31.139 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:31.139 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:31.140 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:31.140 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:31.140 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:31.140 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:31.140 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:31.140 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:31.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.214036 30413 rpc_server.cc:307] RPC server started. Bound to: 127.29.158.189:41727
08:06:31.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.214177 30491 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.158.189:41727 every 8 connection(s)
08:06:31.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.217298 30413 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-1/data/info.pb
08:06:31.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.225212 30492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:31.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.227463 30330 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 30413
08:06:31.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.227977 30330 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-1/wal/instance
08:06:31.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.231463 30330 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:06:31.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:06:31.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-2/wal
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-2/data
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-2/logs
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-2/data/info.pb
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.29.158.188:39061
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.29.158.188
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.29.158.148:38871
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:06:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35975/jwks.json with env {}
08:06:31.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.243211 30492 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.158.190" port: 38071 } has no permanent_uuid. Determining permanent_uuid...
08:06:31.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.274037 30492 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } has no permanent_uuid. Determining permanent_uuid...
08:06:31.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.291220 30492 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } has no permanent_uuid. Determining permanent_uuid...
08:06:31.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:31.293855 30443 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.158.188:39061: connect: Connection refused (error 111)
08:06:31.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:31.299940 30492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.158.188:39061: Network error: Client connection negotiation failed: client connection to 127.29.158.188:39061: connect: Connection refused (error 111)
08:06:31.320 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:31.348 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091591347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:31.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.349622 30492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } attempt: 1
08:06:31.358 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
08:06:31.360 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
08:06:31.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:31.364145 30492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.158.188:39061: Network error: Client connection negotiation failed: client connection to 127.29.158.188:39061: connect: Connection refused (error 111)
08:06:31.374 [DEBUG - pool-130-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30005), Traces: [0ms] sending RPC to server master-127.27.17.252:43595, [7ms] received response from server master-127.27.17.252:43595: OK, deferred=null) with no deferred attached!
08:06:31.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.432703 30492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } attempt: 2
08:06:31.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:31.437705 30492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.158.188:39061: Network error: Client connection negotiation failed: client connection to 127.29.158.188:39061: connect: Connection refused (error 111)
08:06:31.445 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:31.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.529516 30492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } attempt: 3
08:06:31.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:31.534113 30492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.158.188:39061: Network error: Client connection negotiation failed: client connection to 127.29.158.188:39061: connect: Connection refused (error 111)
08:06:31.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:31.630723 30494 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:06:31.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:31.631472 30494 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:06:31.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:31.631974 30494 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:06:31.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:31.671602 30494 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:06:31.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:31.672042 30494 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:06:31.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:31.672284 30494 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:06:31.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:31.672600 30494 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:06:31.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:31.672838 30494 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:06:31.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:31.672998 30494 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:35975/jwks.json
08:06:31.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.677591 30492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } attempt: 4
08:06:31.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:31.682651 30492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.158.188:39061: Network error: Client connection negotiation failed: client connection to 127.29.158.188:39061: connect: Connection refused (error 111)
08:06:31.718 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:31.718 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:31.718 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:31.719 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:31.719 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:31.719 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:31.719 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:31.719 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:31.719 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:31.720 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:31.720 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:31.720 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:31.720 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.721625 30494 master_runner.cc:387] Master server non-default flags:
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.29.158.148:38871
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-2/data
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-2/wal
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.29.158.188:39061
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35975/jwks.json
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-2/data/info.pb
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.29.158.188
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-2/logs
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:06:31.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:06:31.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.723519 30494 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:06:31.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.725559 30494 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:06:31.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:31.741029 30505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:31.820 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:31.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091591847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:31.868 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=18 ms, finalizationTime=2 ms).
08:06:31.870 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
08:06:31.936 [DEBUG - pool-132-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30016), Traces: [0ms] sending RPC to server master-127.27.200.125:46459, [8ms] received response from server master-127.27.200.125:46459: OK, deferred=null) with no deferred attached!
08:06:31.936 [DEBUG - pool-132-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30016), Traces: [0ms] sending RPC to server master-127.27.200.125:46459, [20ms] received response from server master-127.27.200.125:46459: OK, deferred=null) with no deferred attached!
08:06:31.936 [DEBUG - pool-132-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30016), Traces: [0ms] sending RPC to server master-127.27.200.125:46459, [21ms] received response from server master-127.27.200.125:46459: OK, deferred=null) with no deferred attached!
08:06:31.937 [DEBUG - pool-132-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30016), Traces: [0ms] sending RPC to server master-127.27.200.125:46459, [19ms] received response from server master-127.27.200.125:46459: OK, deferred=null) with no deferred attached!
08:06:31.937 [DEBUG - pool-132-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30016), Traces: [0ms] sending RPC to server master-127.27.200.125:46459, [22ms] received response from server master-127.27.200.125:46459: OK, deferred=null) with no deferred attached!
08:06:31.937 [DEBUG - pool-132-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30016), Traces: [0ms] sending RPC to server master-127.27.200.125:46459, [21ms] received response from server master-127.27.200.125:46459: OK, deferred=null) with no deferred attached!
08:06:31.937 [DEBUG - pool-132-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30016), Traces: [0ms] sending RPC to server master-127.27.200.125:46459, [25ms] received response from server master-127.27.200.125:46459: OK, deferred=null) with no deferred attached!
08:06:31.937 [DEBUG - pool-132-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30016), Traces: [0ms] sending RPC to server master-127.27.200.125:46459, [26ms] received response from server master-127.27.200.125:46459: OK, deferred=null) with no deferred attached!
08:06:31.945 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:31.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:31.982138 30492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } attempt: 5
08:06:31.987 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:31.988 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:31.988 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:31.989 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:31.990 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:31.990 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:31.990 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:31.991 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:31.991 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:31.991 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:31.991 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:31.991 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:31.991 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:32.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:31.999262 30492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.158.188:39061: Network error: Client connection negotiation failed: client connection to 127.29.158.188:39061: connect: Connection refused (error 111)
08:06:32.258 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:32.258 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:32.259 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:32.260 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:32.260 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:32.260 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:32.261 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:32.261 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:32.261 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:32.261 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:32.261 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:32.262 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:32.262 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:32.323 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:32.348 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091592347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:32.362 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
08:06:32.363 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
08:06:32.446 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:32.469 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:32.469 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:32.469 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:32.470 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:32.470 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:32.470 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:32.470 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:32.470 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:32.471 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:32.471 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:32.471 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:32.470 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:32.471 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:32.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:32.547187 30492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } attempt: 6
08:06:32.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:32.579746 30492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.158.188:39061: Network error: Client connection negotiation failed: client connection to 127.29.158.188:39061: connect: Connection refused (error 111)
08:06:32.821 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:32.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091592847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:32.863 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
08:06:32.865 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
08:06:32.946 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:32.987 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:32.988 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:32.988 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:32.989 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:32.989 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:32.989 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:32.989 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:32.989 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:32.989 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:32.990 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:32.990 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:32.990 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:32.990 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:33.027 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:33.028 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:33.028 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:33.028 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:33.029 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:33.029 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:33.029 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:33.029 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:33.030 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:33.030 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:33.030 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:33.030 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:33.030 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:33.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.085354 30411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } attempt: 8
08:06:33.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.120894 30411 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } has no permanent_uuid. Determining permanent_uuid...
08:06:33.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:33.130786 30411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.158.188:39061: Network error: Client connection negotiation failed: client connection to 127.29.158.188:39061: connect: Connection refused (error 111)
08:06:33.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.196393 30411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } attempt: 1
08:06:33.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:33.202448 30411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.158.188:39061: Network error: Client connection negotiation failed: client connection to 127.29.158.188:39061: connect: Connection refused (error 111)
08:06:33.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.256438 30411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } attempt: 2
08:06:33.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:31.743580 30506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:33.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:33.258105 30507 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1515 milliseconds
08:06:33.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.258677 30494 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:06:33.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:31.744783 30508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:33.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:33.263648 30411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.158.188:39061: Network error: Client connection negotiation failed: client connection to 127.29.158.188:39061: connect: Connection refused (error 111)
08:06:33.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.264526 30494 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:06:33.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.268266 30494 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:06:33.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.269759 30494 hybrid_clock.cc:648] HybridClock initialized: now 1779091593269623 us; error 95 us; skew 500 ppm
08:06:33.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.270874 30494 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:06:33.278 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:33.278 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:33.278 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:33.279 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:33.279 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:33.279 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:33.279 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:33.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.278791 30494 webserver.cc:533] Webserver started at http://127.29.158.188:40373/ using document root <none> and password file <none>
08:06:33.279 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:33.279 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:33.279 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:33.279 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:33.280 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:33.280 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:33.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.280736 30494 fs_manager.cc:362] Metadata directory not provided
08:06:33.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.280968 30494 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:06:33.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.281443 30494 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:06:33.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.287117 30494 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-2/data/instance:
08:06:33.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "946dd58e027d47ada0a510d16280ddd3"
08:06:33.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:33 on dist-test-slave-1jss"
08:06:33.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.288470 30494 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-2/wal/instance:
08:06:33.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "946dd58e027d47ada0a510d16280ddd3"
08:06:33.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:33 on dist-test-slave-1jss"
08:06:33.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.297662 30494 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.010s	sys 0.000s
08:06:33.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.305912 30521 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:06:33.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.307621 30494 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.007s	sys 0.000s
08:06:33.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.307988 30494 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-2/wal
08:06:33.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "946dd58e027d47ada0a510d16280ddd3"
08:06:33.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:33 on dist-test-slave-1jss"
08:06:33.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.308352 30494 fs_report.cc:389] FS layout report
08:06:33.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:06:33.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-2/wal
08:06:33.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-2/wal
08:06:33.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-2/data/data
08:06:33.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:06:33.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:06:33.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:06:33.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:06:33.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:06:33.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:06:33.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:06:33.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:06:33.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:06:33.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:06:33.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:06:33.319 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:33.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.340148 30411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } attempt: 3
08:06:33.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:33.345117 30411 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.158.188:39061: Network error: Client connection negotiation failed: client connection to 127.29.158.188:39061: connect: Connection refused (error 111)
08:06:33.348 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091593347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:33.361 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
08:06:33.362 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
08:06:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.378808 30494 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:06:33.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.380937 30494 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:06:33.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.381589 30494 kserver.cc:163] Server-wide thread pool size limit: 3276
08:06:33.446 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:33.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.479368 30494 rpc_server.cc:307] RPC server started. Bound to: 127.29.158.188:39061
08:06:33.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.479437 30572 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.158.188:39061 every 8 connection(s)
08:06:33.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.483078 30494 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-2/data/info.pb
08:06:33.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.484710 30330 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 30494
08:06:33.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.485293 30330 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/master-2/wal/instance
08:06:33.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.491336 30573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:33.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.500679 30411 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } attempt: 4
08:06:33.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.507573 30573 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.158.190" port: 38071 } has no permanent_uuid. Determining permanent_uuid...
08:06:33.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.535763 30573 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } has no permanent_uuid. Determining permanent_uuid...
08:06:33.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.546864 30411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 198dd5119f904783ad3533bc4ae61acf: Bootstrap starting.
08:06:33.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.552950 30573 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } has no permanent_uuid. Determining permanent_uuid...
08:06:33.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.582283 30411 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 198dd5119f904783ad3533bc4ae61acf: Neither blocks nor log segments found. Creating new log.
08:06:33.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.583585 30573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3: Bootstrap starting.
08:06:33.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.585551 30411 log.cc:826] T 00000000000000000000000000000000 P 198dd5119f904783ad3533bc4ae61acf: Log is configured to *not* fsync() on all Append() calls
08:06:33.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.595479 30573 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3: Neither blocks nor log segments found. Creating new log.
08:06:33.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.598134 30573 log.cc:826] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3: Log is configured to *not* fsync() on all Append() calls
08:06:33.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.599032 30411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 198dd5119f904783ad3533bc4ae61acf: No bootstrap required, opened a new log
08:06:33.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.612480 30573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3: No bootstrap required, opened a new log
08:06:33.613 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:33.614 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:33.614 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:33.614 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:33.614 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:33.615 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:33.615 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:33.615 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:33.615 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:33.615 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:33.615 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:33.615 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:33.615 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:33.617 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:33.618 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:33.618 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:33.618 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:33.618 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:33.618 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:33.619 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:33.619 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:33.619 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:33.620 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:33.620 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:33.620 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:33.620 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:33.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.639535 30573 raft_consensus.cc:359] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198dd5119f904783ad3533bc4ae61acf" member_type: VOTER last_known_addr { host: "127.29.158.190" port: 38071 } } peers { permanent_uuid: "a47583bb75224a168d666246d3425efb" member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } } peers { permanent_uuid: "946dd58e027d47ada0a510d16280ddd3" member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } }
08:06:33.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.639585 30411 raft_consensus.cc:359] T 00000000000000000000000000000000 P 198dd5119f904783ad3533bc4ae61acf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198dd5119f904783ad3533bc4ae61acf" member_type: VOTER last_known_addr { host: "127.29.158.190" port: 38071 } } peers { permanent_uuid: "a47583bb75224a168d666246d3425efb" member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } } peers { permanent_uuid: "946dd58e027d47ada0a510d16280ddd3" member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } }
08:06:33.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.640424 30573 raft_consensus.cc:385] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:33.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.640434 30411 raft_consensus.cc:385] T 00000000000000000000000000000000 P 198dd5119f904783ad3533bc4ae61acf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:33.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.640472 30492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } attempt: 7
08:06:33.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.640743 30411 raft_consensus.cc:740] T 00000000000000000000000000000000 P 198dd5119f904783ad3533bc4ae61acf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 198dd5119f904783ad3533bc4ae61acf, State: Initialized, Role: FOLLOWER
08:06:33.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.640734 30573 raft_consensus.cc:740] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 946dd58e027d47ada0a510d16280ddd3, State: Initialized, Role: FOLLOWER
08:06:33.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.641947 30573 consensus_queue.cc:260] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198dd5119f904783ad3533bc4ae61acf" member_type: VOTER last_known_addr { host: "127.29.158.190" port: 38071 } } peers { permanent_uuid: "a47583bb75224a168d666246d3425efb" member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } } peers { permanent_uuid: "946dd58e027d47ada0a510d16280ddd3" member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } }
08:06:33.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.642081 30411 consensus_queue.cc:260] T 00000000000000000000000000000000 P 198dd5119f904783ad3533bc4ae61acf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198dd5119f904783ad3533bc4ae61acf" member_type: VOTER last_known_addr { host: "127.29.158.190" port: 38071 } } peers { permanent_uuid: "a47583bb75224a168d666246d3425efb" member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } } peers { permanent_uuid: "946dd58e027d47ada0a510d16280ddd3" member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } }
08:06:33.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.646646 30584 sys_catalog.cc:455] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198dd5119f904783ad3533bc4ae61acf" member_type: VOTER last_known_addr { host: "127.29.158.190" port: 38071 } } peers { permanent_uuid: "a47583bb75224a168d666246d3425efb" member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } } peers { permanent_uuid: "946dd58e027d47ada0a510d16280ddd3" member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } } }
08:06:33.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.647888 30584 sys_catalog.cc:458] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [sys.catalog]: This master's current role is: FOLLOWER
08:06:33.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.648699 30573 sys_catalog.cc:565] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [sys.catalog]: configured and running, proceeding with master startup.
08:06:33.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.654135 30585 sys_catalog.cc:455] T 00000000000000000000000000000000 P 198dd5119f904783ad3533bc4ae61acf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198dd5119f904783ad3533bc4ae61acf" member_type: VOTER last_known_addr { host: "127.29.158.190" port: 38071 } } peers { permanent_uuid: "a47583bb75224a168d666246d3425efb" member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } } peers { permanent_uuid: "946dd58e027d47ada0a510d16280ddd3" member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } } }
08:06:33.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.655252 30585 sys_catalog.cc:458] T 00000000000000000000000000000000 P 198dd5119f904783ad3533bc4ae61acf [sys.catalog]: This master's current role is: FOLLOWER
08:06:33.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.656539 30411 sys_catalog.cc:565] T 00000000000000000000000000000000 P 198dd5119f904783ad3533bc4ae61acf [sys.catalog]: configured and running, proceeding with master startup.
08:06:33.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.665589 30584 raft_consensus.cc:493] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:06:33.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.666484 30584 raft_consensus.cc:515] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198dd5119f904783ad3533bc4ae61acf" member_type: VOTER last_known_addr { host: "127.29.158.190" port: 38071 } } peers { permanent_uuid: "a47583bb75224a168d666246d3425efb" member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } } peers { permanent_uuid: "946dd58e027d47ada0a510d16280ddd3" member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } }
08:06:33.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.676839 30386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "946dd58e027d47ada0a510d16280ddd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198dd5119f904783ad3533bc4ae61acf" is_pre_election: true
08:06:33.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.677287 30584 leader_election.cc:290] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 198dd5119f904783ad3533bc4ae61acf (127.29.158.190:38071), a47583bb75224a168d666246d3425efb (127.29.158.189:41727)
08:06:33.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.681357 30386 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 198dd5119f904783ad3533bc4ae61acf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 946dd58e027d47ada0a510d16280ddd3 in term 0.
08:06:33.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.683530 30524 leader_election.cc:304] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198dd5119f904783ad3533bc4ae61acf, 946dd58e027d47ada0a510d16280ddd3; no voters: 
08:06:33.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.684917 30584 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:06:33.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.685398 30584 raft_consensus.cc:493] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:06:33.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.685791 30584 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [term 0 FOLLOWER]: Advancing to term 1
08:06:33.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.696877 30492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a47583bb75224a168d666246d3425efb: Bootstrap starting.
08:06:33.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.698675 30584 raft_consensus.cc:515] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198dd5119f904783ad3533bc4ae61acf" member_type: VOTER last_known_addr { host: "127.29.158.190" port: 38071 } } peers { permanent_uuid: "a47583bb75224a168d666246d3425efb" member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } } peers { permanent_uuid: "946dd58e027d47ada0a510d16280ddd3" member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } }
08:06:33.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.704186 30584 leader_election.cc:290] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [CANDIDATE]: Term 1 election: Requested vote from peers 198dd5119f904783ad3533bc4ae61acf (127.29.158.190:38071), a47583bb75224a168d666246d3425efb (127.29.158.189:41727)
08:06:33.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.705443 30386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "946dd58e027d47ada0a510d16280ddd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198dd5119f904783ad3533bc4ae61acf"
08:06:33.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.706163 30386 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 198dd5119f904783ad3533bc4ae61acf [term 0 FOLLOWER]: Advancing to term 1
08:06:33.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.717326 30386 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 198dd5119f904783ad3533bc4ae61acf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946dd58e027d47ada0a510d16280ddd3 in term 1.
08:06:33.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.719085 30524 leader_election.cc:304] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198dd5119f904783ad3533bc4ae61acf, 946dd58e027d47ada0a510d16280ddd3; no voters: 
08:06:33.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.725364 30584 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [term 1 FOLLOWER]: Leader election won for term 1
08:06:33.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:33.730685 30365 tablet.cc:2404] T 00000000000000000000000000000000 P 198dd5119f904783ad3533bc4ae61acf: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:06:33.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:33.733151 30600 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:06:33.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:33.733717 30600 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:06:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.739853 30584 raft_consensus.cc:697] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [term 1 LEADER]: Becoming Leader. State: Replica: 946dd58e027d47ada0a510d16280ddd3, State: Running, Role: LEADER
08:06:33.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.741101 30584 consensus_queue.cc:237] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198dd5119f904783ad3533bc4ae61acf" member_type: VOTER last_known_addr { host: "127.29.158.190" port: 38071 } } peers { permanent_uuid: "a47583bb75224a168d666246d3425efb" member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } } peers { permanent_uuid: "946dd58e027d47ada0a510d16280ddd3" member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } }
08:06:33.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.763506 30492 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a47583bb75224a168d666246d3425efb: Neither blocks nor log segments found. Creating new log.
08:06:33.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.766876 30492 log.cc:826] T 00000000000000000000000000000000 P a47583bb75224a168d666246d3425efb: Log is configured to *not* fsync() on all Append() calls
08:06:33.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.778784 30604 sys_catalog.cc:455] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 946dd58e027d47ada0a510d16280ddd3. Latest consensus state: current_term: 1 leader_uuid: "946dd58e027d47ada0a510d16280ddd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198dd5119f904783ad3533bc4ae61acf" member_type: VOTER last_known_addr { host: "127.29.158.190" port: 38071 } } peers { permanent_uuid: "a47583bb75224a168d666246d3425efb" member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } } peers { permanent_uuid: "946dd58e027d47ada0a510d16280ddd3" member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } } }
08:06:33.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.780292 30604 sys_catalog.cc:458] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [sys.catalog]: This master's current role is: LEADER
08:06:33.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.791474 30612 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
08:06:33.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.804812 30492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a47583bb75224a168d666246d3425efb: No bootstrap required, opened a new log
08:06:33.820 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:33.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:33.841121 30611 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 198dd5119f904783ad3533bc4ae61acf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:06:33.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:33.843919 30611 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:06:33.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091593847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:33.861 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
08:06:33.862 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
08:06:33.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.854907 30612 catalog_manager.cc:1519] Initializing Kudu cluster ID...
08:06:33.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.873569 30492 raft_consensus.cc:359] T 00000000000000000000000000000000 P a47583bb75224a168d666246d3425efb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198dd5119f904783ad3533bc4ae61acf" member_type: VOTER last_known_addr { host: "127.29.158.190" port: 38071 } } peers { permanent_uuid: "a47583bb75224a168d666246d3425efb" member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } } peers { permanent_uuid: "946dd58e027d47ada0a510d16280ddd3" member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } }
08:06:33.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.874752 30492 raft_consensus.cc:385] T 00000000000000000000000000000000 P a47583bb75224a168d666246d3425efb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:33.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.875118 30492 raft_consensus.cc:740] T 00000000000000000000000000000000 P a47583bb75224a168d666246d3425efb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a47583bb75224a168d666246d3425efb, State: Initialized, Role: FOLLOWER
08:06:33.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.885331 30492 consensus_queue.cc:260] T 00000000000000000000000000000000 P a47583bb75224a168d666246d3425efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198dd5119f904783ad3533bc4ae61acf" member_type: VOTER last_known_addr { host: "127.29.158.190" port: 38071 } } peers { permanent_uuid: "a47583bb75224a168d666246d3425efb" member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } } peers { permanent_uuid: "946dd58e027d47ada0a510d16280ddd3" member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } }
08:06:33.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:33.889078 30527 tablet.cc:2404] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:06:33.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.894229 30615 sys_catalog.cc:455] T 00000000000000000000000000000000 P a47583bb75224a168d666246d3425efb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198dd5119f904783ad3533bc4ae61acf" member_type: VOTER last_known_addr { host: "127.29.158.190" port: 38071 } } peers { permanent_uuid: "a47583bb75224a168d666246d3425efb" member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } } peers { permanent_uuid: "946dd58e027d47ada0a510d16280ddd3" member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } } }
08:06:33.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.895253 30615 sys_catalog.cc:458] T 00000000000000000000000000000000 P a47583bb75224a168d666246d3425efb [sys.catalog]: This master's current role is: FOLLOWER
08:06:33.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.732786 30494 master_runner.cc:187] Error getting master registration for 127.29.158.190:38071: OK, instance_id { permanent_uuid: "198dd5119f904783ad3533bc4ae61acf" instance_seqno: 1779091588532760 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:06:33.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.899784 30492 sys_catalog.cc:565] T 00000000000000000000000000000000 P a47583bb75224a168d666246d3425efb [sys.catalog]: configured and running, proceeding with master startup.
08:06:33.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.899960 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "946dd58e027d47ada0a510d16280ddd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a47583bb75224a168d666246d3425efb" is_pre_election: true
08:06:33.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.905536 30466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "946dd58e027d47ada0a510d16280ddd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a47583bb75224a168d666246d3425efb"
08:06:33.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.908718 30467 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a47583bb75224a168d666246d3425efb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 946dd58e027d47ada0a510d16280ddd3 in term 0.
08:06:33.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.909335 30494 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:06:33.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.803067 30342 master_runner.cc:187] Error getting master registration for 127.29.158.189:41727: OK, instance_id { permanent_uuid: "a47583bb75224a168d666246d3425efb" instance_seqno: 1779091591186319 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:06:33.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.928834 30342 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:06:33.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.942863 30466 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a47583bb75224a168d666246d3425efb [term 0 FOLLOWER]: Advancing to term 1
08:06:33.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.943228 30386 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 198dd5119f904783ad3533bc4ae61acf [term 1 FOLLOWER]: Refusing update from remote peer 946dd58e027d47ada0a510d16280ddd3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:06:33.946 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:33.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.948662 30584 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198dd5119f904783ad3533bc4ae61acf" member_type: VOTER last_known_addr { host: "127.29.158.190" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:06:33.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.953189 30466 raft_consensus.cc:1275] T 00000000000000000000000000000000 P a47583bb75224a168d666246d3425efb [term 1 FOLLOWER]: Refusing update from remote peer 946dd58e027d47ada0a510d16280ddd3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:06:33.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:33.955582 30584 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a47583bb75224a168d666246d3425efb" member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:06:34.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.003449 30615 sys_catalog.cc:455] T 00000000000000000000000000000000 P a47583bb75224a168d666246d3425efb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 946dd58e027d47ada0a510d16280ddd3. Latest consensus state: current_term: 1 leader_uuid: "946dd58e027d47ada0a510d16280ddd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198dd5119f904783ad3533bc4ae61acf" member_type: VOTER last_known_addr { host: "127.29.158.190" port: 38071 } } peers { permanent_uuid: "a47583bb75224a168d666246d3425efb" member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } } peers { permanent_uuid: "946dd58e027d47ada0a510d16280ddd3" member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } } }
08:06:34.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.005519 30615 sys_catalog.cc:458] T 00000000000000000000000000000000 P a47583bb75224a168d666246d3425efb [sys.catalog]: This master's current role is: FOLLOWER
08:06:34.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.014149 30616 mvcc.cc:204] Tried to move back new op lower bound from 7287159168748503040 to 7287159167983509504. Current Snapshot: MvccSnapshot[applied={T|T < 7287159168748503040}]
08:06:34.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.020104 30585 sys_catalog.cc:455] T 00000000000000000000000000000000 P 198dd5119f904783ad3533bc4ae61acf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 946dd58e027d47ada0a510d16280ddd3. Latest consensus state: current_term: 1 leader_uuid: "946dd58e027d47ada0a510d16280ddd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198dd5119f904783ad3533bc4ae61acf" member_type: VOTER last_known_addr { host: "127.29.158.190" port: 38071 } } peers { permanent_uuid: "a47583bb75224a168d666246d3425efb" member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } } peers { permanent_uuid: "946dd58e027d47ada0a510d16280ddd3" member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } } }
08:06:34.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.021586 30585 sys_catalog.cc:458] T 00000000000000000000000000000000 P 198dd5119f904783ad3533bc4ae61acf [sys.catalog]: This master's current role is: FOLLOWER
08:06:34.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.026228 30584 sys_catalog.cc:455] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "946dd58e027d47ada0a510d16280ddd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198dd5119f904783ad3533bc4ae61acf" member_type: VOTER last_known_addr { host: "127.29.158.190" port: 38071 } } peers { permanent_uuid: "a47583bb75224a168d666246d3425efb" member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } } peers { permanent_uuid: "946dd58e027d47ada0a510d16280ddd3" member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } } }
08:06:34.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.027055 30584 sys_catalog.cc:458] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [sys.catalog]: This master's current role is: LEADER
08:06:34.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.033248 30612 catalog_manager.cc:1382] Generated new cluster ID: f0a44df1ae514b89b1e9d5a21fc08865
08:06:34.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.033586 30612 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
08:06:34.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.040609 30615 sys_catalog.cc:455] T 00000000000000000000000000000000 P a47583bb75224a168d666246d3425efb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "946dd58e027d47ada0a510d16280ddd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198dd5119f904783ad3533bc4ae61acf" member_type: VOTER last_known_addr { host: "127.29.158.190" port: 38071 } } peers { permanent_uuid: "a47583bb75224a168d666246d3425efb" member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } } peers { permanent_uuid: "946dd58e027d47ada0a510d16280ddd3" member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } } }
08:06:34.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.041468 30615 sys_catalog.cc:458] T 00000000000000000000000000000000 P a47583bb75224a168d666246d3425efb [sys.catalog]: This master's current role is: FOLLOWER
08:06:34.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.055529 30604 sys_catalog.cc:455] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "946dd58e027d47ada0a510d16280ddd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198dd5119f904783ad3533bc4ae61acf" member_type: VOTER last_known_addr { host: "127.29.158.190" port: 38071 } } peers { permanent_uuid: "a47583bb75224a168d666246d3425efb" member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } } peers { permanent_uuid: "946dd58e027d47ada0a510d16280ddd3" member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } } }
08:06:34.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.056351 30604 sys_catalog.cc:458] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3 [sys.catalog]: This master's current role is: LEADER
08:06:34.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.071825 30619 mvcc.cc:204] Tried to move back new op lower bound from 7287159168748503040 to 7287159167983509504. Current Snapshot: MvccSnapshot[applied={T|T < 7287159168748503040}]
08:06:34.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.081111 30585 sys_catalog.cc:455] T 00000000000000000000000000000000 P 198dd5119f904783ad3533bc4ae61acf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "946dd58e027d47ada0a510d16280ddd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198dd5119f904783ad3533bc4ae61acf" member_type: VOTER last_known_addr { host: "127.29.158.190" port: 38071 } } peers { permanent_uuid: "a47583bb75224a168d666246d3425efb" member_type: VOTER last_known_addr { host: "127.29.158.189" port: 41727 } } peers { permanent_uuid: "946dd58e027d47ada0a510d16280ddd3" member_type: VOTER last_known_addr { host: "127.29.158.188" port: 39061 } } }
08:06:34.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.081943 30585 sys_catalog.cc:458] T 00000000000000000000000000000000 P 198dd5119f904783ad3533bc4ae61acf [sys.catalog]: This master's current role is: FOLLOWER
08:06:34.114 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:34.115 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:34.115 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:34.116 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:34.116 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:34.116 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:34.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.111708 30636 catalog_manager.cc:1294] Loaded cluster ID: f0a44df1ae514b89b1e9d5a21fc08865
08:06:34.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.114015 30636 catalog_manager.cc:1587] T 00000000000000000000000000000000 P a47583bb75224a168d666246d3425efb: loading cluster ID for follower catalog manager: success
08:06:34.116 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:34.116 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:34.117 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:34.117 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:34.117 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:34.117 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:34.117 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:34.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:34.118996 30636 catalog_manager.cc:1611] T 00000000000000000000000000000000 P a47583bb75224a168d666246d3425efb: acquiring CA information for follower catalog manager: Not found: root CA entry not found
08:06:34.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:34.119385 30636 catalog_manager.cc:883] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
08:06:34.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.168947 30612 catalog_manager.cc:1405] Generated new certificate authority record
08:06:34.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.171661 30612 catalog_manager.cc:1539] Loading token signing keys...
08:06:34.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.222378 30612 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3: Generated new TSK 0
08:06:34.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.223744 30612 catalog_manager.cc:1549] Initializing in-progress tserver states...
08:06:34.254 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:34.255 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:34.255 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:34.255 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:34.255 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:34.255 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:34.255 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:34.255 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:34.255 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:34.255 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:34.255 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:34.255 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:34.255 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.254757 30330 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-0/wal
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-0/data
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-0/logs
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-0/data/info.pb
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.29.158.129:0
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.29.158.129
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.29.158.129
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061
08:06:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.29.158.148:38871
08:06:34.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:34.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:34.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:06:34.326 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:34.348 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 66 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091594347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:34.356 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 66 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
08:06:34.358 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 66 as completed for source Source: KuduSource.
08:06:34.446 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:34.627 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:34.628 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:34.628 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:34.628 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:34.628 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:34.628 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:34.629 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:34.629 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:34.629 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:34.629 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:34.629 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:34.630 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:34.630 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:34.820 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:34.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 67 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091594847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:34.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.853286 30611 catalog_manager.cc:1294] Loaded cluster ID: f0a44df1ae514b89b1e9d5a21fc08865
08:06:34.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.853603 30611 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 198dd5119f904783ad3533bc4ae61acf: loading cluster ID for follower catalog manager: success
08:06:34.860 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 67 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
08:06:34.863 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 67 as completed for source Source: KuduSource.
08:06:34.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.870580 30611 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 198dd5119f904783ad3533bc4ae61acf: acquiring CA information for follower catalog manager: success
08:06:34.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:34.881556 30639 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:06:34.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:34.882357 30639 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:06:34.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:34.882360 30611 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 198dd5119f904783ad3533bc4ae61acf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:06:34.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:34.883198 30639 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:06:34.914 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:34.915 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:34.915 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:34.916 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:34.916 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:34.916 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:34.917 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:34.917 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:34.917 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:34.917 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:34.917 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:34.917 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:34.917 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:34.945 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:34.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:34.954095 30639 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:06:34.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:34.956080 30639 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.158.129
08:06:35.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:35.038575 30639 tablet_server_runner.cc:78] Tablet server non-default flags:
08:06:35.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:35.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.29.158.148:38871
08:06:35.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:35.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:06:35.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-0/data
08:06:35.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-0/wal
08:06:35.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:35.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:35.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.29.158.129:0
08:06:35.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:06:35.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:35.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-0/data/info.pb
08:06:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.29.158.129
08:06:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061
08:06:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:06:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:06:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:06:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.29.158.129
08:06:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-0/logs
08:06:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:06:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:06:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:06:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:06:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:06:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:06:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:06:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:06:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:06:35.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:35.041031 30639 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:06:35.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:35.043779 30639 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:06:35.068 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:35.069 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:35.069 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:35.070 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:35.070 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:35.070 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:35.071 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:35.071 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:35.071 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:35.072 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:35.072 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:35.072 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:35.072 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:35.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:35.076486 30645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:35.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:35.130996 30636 catalog_manager.cc:1609] T 00000000000000000000000000000000 P a47583bb75224a168d666246d3425efb: acquiring CA information for follower catalog manager: success
08:06:35.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:35.143935 30636 catalog_manager.cc:1637] T 00000000000000000000000000000000 P a47583bb75224a168d666246d3425efb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:06:35.320 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:35.348 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 68 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091595347 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:35.356 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 68 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
08:06:35.359 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 68 as completed for source Source: KuduSource.
08:06:35.446 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:35.821 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:35.848 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 69 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091595847 for job 0d2ddb76420639a9ec06ca05e894cb50.
08:06:35.858 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 69 for job 0d2ddb76420639a9ec06ca05e894cb50 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
08:06:35.860 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 69 as completed for source Source: KuduSource.
08:06:35.946 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:36.033 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:36.034 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:36.034 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:36.035 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.035 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.036 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.036 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.036 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.036 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.037 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.037 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.037 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.037 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:36.038 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=33, TimeoutTracker(timeout=30000, elapsed=28760), Traces: [0ms] sending RPC to server master-127.27.17.252:43595, [5ms] received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [5ms] delaying RPC due to: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [17ms] refreshing cache from master, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [19ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [20ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [21ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [21ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [36ms] refreshing cache from master, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [38ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [39ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [38ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [39ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [56ms] refreshing cache from master, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [59ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [59ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [59ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [59ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [78ms] refreshing cache from master, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [80ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [82ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [116ms] refreshing cache from master, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [117ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [118ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [118ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [118ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [136ms] refreshing cache from master, [136ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [138ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [138ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [138ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [138ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [236ms] refreshing cache from master, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [238ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [238ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [238ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [238ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [456ms] refreshing cache from master, [456ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [457ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [457ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [458ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [458ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [458ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [458ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [736ms] refreshing cache from master, [736ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [737ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [737ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [738ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [738ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [738ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [738ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1216ms] refreshing cache from master, [1216ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1217ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1218ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1218ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1218ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2416ms] refreshing cache from master, [2417ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2418ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2418ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2418ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2421ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2422ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2422ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2516ms] refreshing cache from master, [2517ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2518ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2518ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2519ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2520ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2521ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2521ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [4617ms] refreshing cache from master, [4617ms] too many traces: truncated at 100 traces, deferred=Deferred@596932508(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$232/0x00007f7544330000@64324d16 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1827509302 after retry RPC after error@356981725) -> (continuation of Deferred@368027262 after retry RPC after error@1665340200) -> (continuation of Deferred@1670346578 after retry RPC after error@1312489741) -> (continuation of Deferred@638554850 after retry RPC after error@1571692376) -> (continuation of Deferred@1157875288 after retry RPC after error@1395033244) -> (continuation of Deferred@165971096 after retry RPC after error@614276643) -> (continuation of Deferred@2138521070 after retry RPC after error@412243192) -> (continuation of Deferred@905954102 after retry RPC after error@2044702636) -> (continuation of Deferred@1065448756 after retry RPC after error@901694376) -> (continuation of Deferred@2123579482 after retry RPC after error@2058691307) -> (continuation of Deferred@1311359068 after retry RPC after error@231336370) -> (continuation of Deferred@1773988289 after retry RPC after error@978136167) -> (continuation of Deferred@979775570 after retry RPC after error@2023807701) -> (continuation of Deferred@1985795809 after retry RPC after error@631370329) -> (continuation of Deferred@785297951 after retry RPC after error@1346806625) -> (continuation of Deferred@1086168150 after retry RPC after error@1789173026) -> (continuation of Deferred@824280099 after retry RPC after error@1410950349) -> (continuation of Deferred@2028604724 after retry RPC after error@921289350) -> (continuation of Deferred@190077156 after retry RPC after error@343177807) -> (continuation of Deferred@1021265496 after retry RPC after error@1146773175) -> (continuation of Deferred@1843441056 after retry RPC after error@1517360209) -> (continuation of Deferred@484074689 after retry RPC after error@174276107) -> (continuation of Deferred@1644564298 after retry RPC after error@814173383) -> (continuation of Deferred@2134170234 after retry RPC after error@1815355633) -> (continuation of Deferred@1041899106 after retry RPC after error@888249362) -> (continuation of Deferred@1842309116 after retry RPC after error@548532508) -> (continuation of Deferred@1312166502 after retry RPC after error@1981744830) -> (continuation of Deferred@1626963718 after retry RPC after error@1332697876) -> (continuation of Deferred@825542077 after retry RPC after error@1066409939) -> (continuation of Deferred@339363432 after retry RPC after error@557320192) -> (continuation of Deferred@917907639 after retry RPC after error@166184757), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1827509302 after retry RPC after error@356981725) -> (continuation of Deferred@368027262 after retry RPC after error@1665340200) -> (continuation of Deferred@1670346578 after retry RPC after error@1312489741) -> (continuation of Deferred@638554850 after retry RPC after error@1571692376) -> (continuation of Deferred@1157875288 after retry RPC after error@1395033244) -> (continuation of Deferred@165971096 after retry RPC after error@614276643) -> (continuation of Deferred@2138521070 after retry RPC after error@412243192) -> (continuation of Deferred@905954102 after retry RPC after error@2044702636) -> (continuation of Deferred@1065448756 after retry RPC after error@901694376) -> (continuation of Deferred@2123579482 after retry RPC after error@2058691307) -> (continuation of Deferred@1311359068 after retry RPC after error@231336370) -> (continuation of Deferred@1773988289 after retry RPC after error@978136167) -> (continuation of Deferred@979775570 after retry RPC after error@2023807701) -> (continuation of Deferred@1985795809 after retry RPC after error@631370329) -> (continuation of Deferred@785297951 after retry RPC after error@1346806625) -> (continuation of Deferred@1086168150 after retry RPC after error@1789173026) -> (continuation of Deferred@824280099 after retry RPC after error@1410950349) -> (continuation of Deferred@2028604724 after retry RPC after error@921289350) -> (continuation of Deferred@190077156 after retry RPC after error@343177807) -> (continuation of Deferred@1021265496 after retry RPC after error@1146773175) -> (continuation of Deferred@1843441056 after retry RPC after error@1517360209) -> (continuation of Deferred@484074689 after retry RPC after error@174276107) -> (continuation of Deferred@1644564298 after retry RPC after error@814173383) -> (continuation of Deferred@2134170234 after retry RPC after error@1815355633) -> (continuation of Deferred@1041899106 after retry RPC after error@888249362) -> (continuation of Deferred@1842309116 after retry RPC after error@548532508) -> (continuation of Deferred@1312166502 after retry RPC after error@1981744830) -> (continuation of Deferred@1626963718 after retry RPC after error@1332697876) -> (continuation of Deferred@825542077 after retry RPC after error@1066409939) -> (continuation of Deferred@339363432 after retry RPC after error@557320192) -> (continuation of Deferred@917907639 after retry RPC after error@166184757)))
08:06:36.043 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:36.044 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:36.044 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.044 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:36.044 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.044 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.044 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.044 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.045 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.045 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=33, TimeoutTracker(timeout=30000, elapsed=28760), Traces: [0ms] sending RPC to server master-127.27.17.252:43595, [5ms] received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [5ms] delaying RPC due to: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [17ms] refreshing cache from master, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [19ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [20ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [21ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [21ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [36ms] refreshing cache from master, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [38ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [39ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [38ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [39ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [56ms] refreshing cache from master, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [59ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [59ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [59ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [59ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [78ms] refreshing cache from master, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [80ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [82ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [116ms] refreshing cache from master, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [117ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [118ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [118ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [118ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [136ms] refreshing cache from master, [136ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [138ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [138ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [138ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [138ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [236ms] refreshing cache from master, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [238ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [238ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [238ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [238ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [456ms] refreshing cache from master, [456ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [457ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [457ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [458ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [458ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [458ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [458ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [736ms] refreshing cache from master, [736ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [737ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [737ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [738ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [738ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [738ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [738ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1216ms] refreshing cache from master, [1216ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1217ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1218ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1218ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1218ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2416ms] refreshing cache from master, [2417ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2418ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2418ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2418ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2421ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2422ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2422ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2516ms] refreshing cache from master, [2517ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2518ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2518ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2519ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2520ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2521ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2521ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [4617ms] refreshing cache from master, [4617ms] too many traces: truncated at 100 traces, deferred=Deferred@596932508(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$232/0x00007f7544330000@64324d16 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1827509302 after retry RPC after error@356981725) -> (continuation of Deferred@368027262 after retry RPC after error@1665340200) -> (continuation of Deferred@1670346578 after retry RPC after error@1312489741) -> (continuation of Deferred@638554850 after retry RPC after error@1571692376) -> (continuation of Deferred@1157875288 after retry RPC after error@1395033244) -> (continuation of Deferred@165971096 after retry RPC after error@614276643) -> (continuation of Deferred@2138521070 after retry RPC after error@412243192) -> (continuation of Deferred@905954102 after retry RPC after error@2044702636) -> (continuation of Deferred@1065448756 after retry RPC after error@901694376) -> (continuation of Deferred@2123579482 after retry RPC after error@2058691307) -> (continuation of Deferred@1311359068 after retry RPC after error@231336370) -> (continuation of Deferred@1773988289 after retry RPC after error@978136167) -> (continuation of Deferred@979775570 after retry RPC after error@2023807701) -> (continuation of Deferred@1985795809 after retry RPC after error@631370329) -> (continuation of Deferred@785297951 after retry RPC after error@1346806625) -> (continuation of Deferred@1086168150 after retry RPC after error@1789173026) -> (continuation of Deferred@824280099 after retry RPC after error@1410950349) -> (continuation of Deferred@2028604724 after retry RPC after error@921289350) -> (continuation of Deferred@190077156 after retry RPC after error@343177807) -> (continuation of Deferred@1021265496 after retry RPC after error@1146773175) -> (continuation of Deferred@1843441056 after retry RPC after error@1517360209) -> (continuation of Deferred@484074689 after retry RPC after error@174276107) -> (continuation of Deferred@1644564298 after retry RPC after error@814173383) -> (continuation of Deferred@2134170234 after retry RPC after error@1815355633) -> (continuation of Deferred@1041899106 after retry RPC after error@888249362) -> (continuation of Deferred@1842309116 after retry RPC after error@548532508) -> (continuation of Deferred@1312166502 after retry RPC after error@1981744830) -> (continuation of Deferred@1626963718 after retry RPC after error@1332697876) -> (continuation of Deferred@825542077 after retry RPC after error@1066409939) -> (continuation of Deferred@339363432 after retry RPC after error@557320192) -> (continuation of Deferred@917907639 after retry RPC after error@166184757), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1827509302 after retry RPC after error@356981725) -> (continuation of Deferred@368027262 after retry RPC after error@1665340200) -> (continuation of Deferred@1670346578 after retry RPC after error@1312489741) -> (continuation of Deferred@638554850 after retry RPC after error@1571692376) -> (continuation of Deferred@1157875288 after retry RPC after error@1395033244) -> (continuation of Deferred@165971096 after retry RPC after error@614276643) -> (continuation of Deferred@2138521070 after retry RPC after error@412243192) -> (continuation of Deferred@905954102 after retry RPC after error@2044702636) -> (continuation of Deferred@1065448756 after retry RPC after error@901694376) -> (continuation of Deferred@2123579482 after retry RPC after error@2058691307) -> (continuation of Deferred@1311359068 after retry RPC after error@231336370) -> (continuation of Deferred@1773988289 after retry RPC after error@978136167) -> (continuation of Deferred@979775570 after retry RPC after error@2023807701) -> (continuation of Deferred@1985795809 after retry RPC after error@631370329) -> (continuation of Deferred@785297951 after retry RPC after error@1346806625) -> (continuation of Deferred@1086168150 after retry RPC after error@1789173026) -> (continuation of Deferred@824280099 after retry RPC after error@1410950349) -> (continuation of Deferred@2028604724 after retry RPC after error@921289350) -> (continuation of Deferred@190077156 after retry RPC after error@343177807) -> (continuation of Deferred@1021265496 after retry RPC after error@1146773175) -> (continuation of Deferred@1843441056 after retry RPC after error@1517360209) -> (continuation of Deferred@484074689 after retry RPC after error@174276107) -> (continuation of Deferred@1644564298 after retry RPC after error@814173383) -> (continuation of Deferred@2134170234 after retry RPC after error@1815355633) -> (continuation of Deferred@1041899106 after retry RPC after error@888249362) -> (continuation of Deferred@1842309116 after retry RPC after error@548532508) -> (continuation of Deferred@1312166502 after retry RPC after error@1981744830) -> (continuation of Deferred@1626963718 after retry RPC after error@1332697876) -> (continuation of Deferred@825542077 after retry RPC after error@1066409939) -> (continuation of Deferred@339363432 after retry RPC after error@557320192) -> (continuation of Deferred@917907639 after retry RPC after error@166184757)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=33, TimeoutTracker(timeout=30000, elapsed=28760), Traces: [0ms] sending RPC to server master-127.27.17.252:43595, [5ms] received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [5ms] delaying RPC due to: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [17ms] refreshing cache from master, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [19ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [20ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [21ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [21ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [36ms] refreshing cache from master, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [38ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [39ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [38ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [39ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [56ms] refreshing cache from master, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [59ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [59ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [59ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [59ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [78ms] refreshing cache from master, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [80ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [82ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [116ms] refreshing cache from master, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [117ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [118ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [118ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [118ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [136ms] refreshing cache from master, [136ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [138ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [138ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [138ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [138ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [236ms] refreshing cache from master, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [238ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [238ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [238ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [238ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [456ms] refreshing cache from master, [456ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [457ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [457ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [458ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [458ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [458ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [458ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [736ms] refreshing cache from master, [736ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [737ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [737ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [738ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [738ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [738ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [738ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1216ms] refreshing cache from master, [1216ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1217ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1218ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1218ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1218ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2416ms] refreshing cache from master, [2417ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2418ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2418ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2418ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2421ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2422ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2422ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2516ms] refreshing cache from master, [2517ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2518ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2518ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2519ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2520ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2521ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2521ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [4617ms] refreshing cache from master, [4617ms] too many traces: truncated at 100 traces, deferred=Deferred@596932508(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$232/0x00007f7544330000@64324d16 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1827509302 after retry RPC after error@356981725) -> (continuation of Deferred@368027262 after retry RPC after error@1665340200) -> (continuation of Deferred@1670346578 after retry RPC after error@1312489741) -> (continuation of Deferred@638554850 after retry RPC after error@1571692376) -> (continuation of Deferred@1157875288 after retry RPC after error@1395033244) -> (continuation of Deferred@165971096 after retry RPC after error@614276643) -> (continuation of Deferred@2138521070 after retry RPC after error@412243192) -> (continuation of Deferred@905954102 after retry RPC after error@2044702636) -> (continuation of Deferred@1065448756 after retry RPC after error@901694376) -> (continuation of Deferred@2123579482 after retry RPC after error@2058691307) -> (continuation of Deferred@1311359068 after retry RPC after error@231336370) -> (continuation of Deferred@1773988289 after retry RPC after error@978136167) -> (continuation of Deferred@979775570 after retry RPC after error@2023807701) -> (continuation of Deferred@1985795809 after retry RPC after error@631370329) -> (continuation of Deferred@785297951 after retry RPC after error@1346806625) -> (continuation of Deferred@1086168150 after retry RPC after error@1789173026) -> (continuation of Deferred@824280099 after retry RPC after error@1410950349) -> (continuation of Deferred@2028604724 after retry RPC after error@921289350) -> (continuation of Deferred@190077156 after retry RPC after error@343177807) -> (continuation of Deferred@1021265496 after retry RPC after error@1146773175) -> (continuation of Deferred@1843441056 after retry RPC after error@1517360209) -> (continuation of Deferred@484074689 after retry RPC after error@174276107) -> (continuation of Deferred@1644564298 after retry RPC after error@814173383) -> (continuation of Deferred@2134170234 after retry RPC after error@1815355633) -> (continuation of Deferred@1041899106 after retry RPC after error@888249362) -> (continuation of Deferred@1842309116 after retry RPC after error@548532508) -> (continuation of Deferred@1312166502 after retry RPC after error@1981744830) -> (continuation of Deferred@1626963718 after retry RPC after error@1332697876) -> (continuation of Deferred@825542077 after retry RPC after error@1066409939) -> (continuation of Deferred@339363432 after retry RPC after error@557320192) -> (continuation of Deferred@917907639 after retry RPC after error@166184757), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1827509302 after retry RPC after error@356981725) -> (continuation of Deferred@368027262 after retry RPC after error@1665340200) -> (continuation of Deferred@1670346578 after retry RPC after error@1312489741) -> (continuation of Deferred@638554850 after retry RPC after error@1571692376) -> (continuation of Deferred@1157875288 after retry RPC after error@1395033244) -> (continuation of Deferred@165971096 after retry RPC after error@614276643) -> (continuation of Deferred@2138521070 after retry RPC after error@412243192) -> (continuation of Deferred@905954102 after retry RPC after error@2044702636) -> (continuation of Deferred@1065448756 after retry RPC after error@901694376) -> (continuation of Deferred@2123579482 after retry RPC after error@2058691307) -> (continuation of Deferred@1311359068 after retry RPC after error@231336370) -> (continuation of Deferred@1773988289 after retry RPC after error@978136167) -> (continuation of Deferred@979775570 after retry RPC after error@2023807701) -> (continuation of Deferred@1985795809 after retry RPC after error@631370329) -> (continuation of Deferred@785297951 after retry RPC after error@1346806625) -> (continuation of Deferred@1086168150 after retry RPC after error@1789173026) -> (continuation of Deferred@824280099 after retry RPC after error@1410950349) -> (continuation of Deferred@2028604724 after retry RPC after error@921289350) -> (continuation of Deferred@190077156 after retry RPC after error@343177807) -> (continuation of Deferred@1021265496 after retry RPC after error@1146773175) -> (continuation of Deferred@1843441056 after retry RPC after error@1517360209) -> (continuation of Deferred@484074689 after retry RPC after error@174276107) -> (continuation of Deferred@1644564298 after retry RPC after error@814173383) -> (continuation of Deferred@2134170234 after retry RPC after error@1815355633) -> (continuation of Deferred@1041899106 after retry RPC after error@888249362) -> (continuation of Deferred@1842309116 after retry RPC after error@548532508) -> (continuation of Deferred@1312166502 after retry RPC after error@1981744830) -> (continuation of Deferred@1626963718 after retry RPC after error@1332697876) -> (continuation of Deferred@825542077 after retry RPC after error@1066409939) -> (continuation of Deferred@339363432 after retry RPC after error@557320192) -> (continuation of Deferred@917907639 after retry RPC after error@166184757)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.17.253:37621
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:06:36.051 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.052 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.052 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.052 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:36.054 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:36.060 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:36.060 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:36.060 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.061 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.061 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.061 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.061 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.061 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.062 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.062 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.062 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.062 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:36.114 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:36.115 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:36.115 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:36.115 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.115 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.116 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.116 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.116 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.117 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.119 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.120 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.120 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.120 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:36.125 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=33, TimeoutTracker(timeout=30000, elapsed=28760), Traces: [0ms] sending RPC to server master-127.27.17.252:43595, [5ms] received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [5ms] delaying RPC due to: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [17ms] refreshing cache from master, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [19ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [20ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [21ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [21ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [36ms] refreshing cache from master, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [38ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [39ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [38ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [39ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [56ms] refreshing cache from master, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [59ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [59ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [59ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [59ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [78ms] refreshing cache from master, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [80ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [82ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [116ms] refreshing cache from master, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [117ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [118ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [118ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [118ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [136ms] refreshing cache from master, [136ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [138ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [138ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [138ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [138ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [236ms] refreshing cache from master, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [238ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [238ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [238ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [238ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [456ms] refreshing cache from master, [456ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [457ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [457ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [458ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [458ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [458ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [458ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [736ms] refreshing cache from master, [736ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [737ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [737ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [738ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [738ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [738ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [738ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1216ms] refreshing cache from master, [1216ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1217ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1218ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1218ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1218ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2416ms] refreshing cache from master, [2417ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2418ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2418ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2418ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2421ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2422ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2422ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2516ms] refreshing cache from master, [2517ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2518ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2518ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2519ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2520ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2521ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2521ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [4617ms] refreshing cache from master, [4617ms] too many traces: truncated at 100 traces, deferred=Deferred@596932508(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$232/0x00007f7544330000@64324d16 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1827509302 after retry RPC after error@356981725) -> (continuation of Deferred@368027262 after retry RPC after error@1665340200) -> (continuation of Deferred@1670346578 after retry RPC after error@1312489741) -> (continuation of Deferred@638554850 after retry RPC after error@1571692376) -> (continuation of Deferred@1157875288 after retry RPC after error@1395033244) -> (continuation of Deferred@165971096 after retry RPC after error@614276643) -> (continuation of Deferred@2138521070 after retry RPC after error@412243192) -> (continuation of Deferred@905954102 after retry RPC after error@2044702636) -> (continuation of Deferred@1065448756 after retry RPC after error@901694376) -> (continuation of Deferred@2123579482 after retry RPC after error@2058691307) -> (continuation of Deferred@1311359068 after retry RPC after error@231336370) -> (continuation of Deferred@1773988289 after retry RPC after error@978136167) -> (continuation of Deferred@979775570 after retry RPC after error@2023807701) -> (continuation of Deferred@1985795809 after retry RPC after error@631370329) -> (continuation of Deferred@785297951 after retry RPC after error@1346806625) -> (continuation of Deferred@1086168150 after retry RPC after error@1789173026) -> (continuation of Deferred@824280099 after retry RPC after error@1410950349) -> (continuation of Deferred@2028604724 after retry RPC after error@921289350) -> (continuation of Deferred@190077156 after retry RPC after error@343177807) -> (continuation of Deferred@1021265496 after retry RPC after error@1146773175) -> (continuation of Deferred@1843441056 after retry RPC after error@1517360209) -> (continuation of Deferred@484074689 after retry RPC after error@174276107) -> (continuation of Deferred@1644564298 after retry RPC after error@814173383) -> (continuation of Deferred@2134170234 after retry RPC after error@1815355633) -> (continuation of Deferred@1041899106 after retry RPC after error@888249362) -> (continuation of Deferred@1842309116 after retry RPC after error@548532508) -> (continuation of Deferred@1312166502 after retry RPC after error@1981744830) -> (continuation of Deferred@1626963718 after retry RPC after error@1332697876) -> (continuation of Deferred@825542077 after retry RPC after error@1066409939) -> (continuation of Deferred@339363432 after retry RPC after error@557320192) -> (continuation of Deferred@917907639 after retry RPC after error@166184757), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1827509302 after retry RPC after error@356981725) -> (continuation of Deferred@368027262 after retry RPC after error@1665340200) -> (continuation of Deferred@1670346578 after retry RPC after error@1312489741) -> (continuation of Deferred@638554850 after retry RPC after error@1571692376) -> (continuation of Deferred@1157875288 after retry RPC after error@1395033244) -> (continuation of Deferred@165971096 after retry RPC after error@614276643) -> (continuation of Deferred@2138521070 after retry RPC after error@412243192) -> (continuation of Deferred@905954102 after retry RPC after error@2044702636) -> (continuation of Deferred@1065448756 after retry RPC after error@901694376) -> (continuation of Deferred@2123579482 after retry RPC after error@2058691307) -> (continuation of Deferred@1311359068 after retry RPC after error@231336370) -> (continuation of Deferred@1773988289 after retry RPC after error@978136167) -> (continuation of Deferred@979775570 after retry RPC after error@2023807701) -> (continuation of Deferred@1985795809 after retry RPC after error@631370329) -> (continuation of Deferred@785297951 after retry RPC after error@1346806625) -> (continuation of Deferred@1086168150 after retry RPC after error@1789173026) -> (continuation of Deferred@824280099 after retry RPC after error@1410950349) -> (continuation of Deferred@2028604724 after retry RPC after error@921289350) -> (continuation of Deferred@190077156 after retry RPC after error@343177807) -> (continuation of Deferred@1021265496 after retry RPC after error@1146773175) -> (continuation of Deferred@1843441056 after retry RPC after error@1517360209) -> (continuation of Deferred@484074689 after retry RPC after error@174276107) -> (continuation of Deferred@1644564298 after retry RPC after error@814173383) -> (continuation of Deferred@2134170234 after retry RPC after error@1815355633) -> (continuation of Deferred@1041899106 after retry RPC after error@888249362) -> (continuation of Deferred@1842309116 after retry RPC after error@548532508) -> (continuation of Deferred@1312166502 after retry RPC after error@1981744830) -> (continuation of Deferred@1626963718 after retry RPC after error@1332697876) -> (continuation of Deferred@825542077 after retry RPC after error@1066409939) -> (continuation of Deferred@339363432 after retry RPC after error@557320192) -> (continuation of Deferred@917907639 after retry RPC after error@166184757)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=33, TimeoutTracker(timeout=30000, elapsed=28760), Traces: [0ms] sending RPC to server master-127.27.17.252:43595, [5ms] received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [5ms] delaying RPC due to: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [17ms] refreshing cache from master, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [19ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [20ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [21ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [21ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [36ms] refreshing cache from master, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [38ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [39ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [38ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [39ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [56ms] refreshing cache from master, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [59ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [59ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [59ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [59ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [78ms] refreshing cache from master, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [80ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [82ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [116ms] refreshing cache from master, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [117ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [118ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [118ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [118ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [136ms] refreshing cache from master, [136ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [138ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [138ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [138ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [138ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [236ms] refreshing cache from master, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [238ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [238ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [238ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [238ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [456ms] refreshing cache from master, [456ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [457ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [457ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [458ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [458ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [458ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [458ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [736ms] refreshing cache from master, [736ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [737ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [737ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [738ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [738ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [738ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [738ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1216ms] refreshing cache from master, [1216ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1217ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1218ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1218ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1218ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2416ms] refreshing cache from master, [2417ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2418ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2418ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2418ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2421ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2422ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2422ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2516ms] refreshing cache from master, [2517ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2518ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2518ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2519ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2520ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2521ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2521ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [4617ms] refreshing cache from master, [4617ms] too many traces: truncated at 100 traces, deferred=Deferred@596932508(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$232/0x00007f7544330000@64324d16 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1827509302 after retry RPC after error@356981725) -> (continuation of Deferred@368027262 after retry RPC after error@1665340200) -> (continuation of Deferred@1670346578 after retry RPC after error@1312489741) -> (continuation of Deferred@638554850 after retry RPC after error@1571692376) -> (continuation of Deferred@1157875288 after retry RPC after error@1395033244) -> (continuation of Deferred@165971096 after retry RPC after error@614276643) -> (continuation of Deferred@2138521070 after retry RPC after error@412243192) -> (continuation of Deferred@905954102 after retry RPC after error@2044702636) -> (continuation of Deferred@1065448756 after retry RPC after error@901694376) -> (continuation of Deferred@2123579482 after retry RPC after error@2058691307) -> (continuation of Deferred@1311359068 after retry RPC after error@231336370) -> (continuation of Deferred@1773988289 after retry RPC after error@978136167) -> (continuation of Deferred@979775570 after retry RPC after error@2023807701) -> (continuation of Deferred@1985795809 after retry RPC after error@631370329) -> (continuation of Deferred@785297951 after retry RPC after error@1346806625) -> (continuation of Deferred@1086168150 after retry RPC after error@1789173026) -> (continuation of Deferred@824280099 after retry RPC after error@1410950349) -> (continuation of Deferred@2028604724 after retry RPC after error@921289350) -> (continuation of Deferred@190077156 after retry RPC after error@343177807) -> (continuation of Deferred@1021265496 after retry RPC after error@1146773175) -> (continuation of Deferred@1843441056 after retry RPC after error@1517360209) -> (continuation of Deferred@484074689 after retry RPC after error@174276107) -> (continuation of Deferred@1644564298 after retry RPC after error@814173383) -> (continuation of Deferred@2134170234 after retry RPC after error@1815355633) -> (continuation of Deferred@1041899106 after retry RPC after error@888249362) -> (continuation of Deferred@1842309116 after retry RPC after error@548532508) -> (continuation of Deferred@1312166502 after retry RPC after error@1981744830) -> (continuation of Deferred@1626963718 after retry RPC after error@1332697876) -> (continuation of Deferred@825542077 after retry RPC after error@1066409939) -> (continuation of Deferred@339363432 after retry RPC after error@557320192) -> (continuation of Deferred@917907639 after retry RPC after error@166184757), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1827509302 after retry RPC after error@356981725) -> (continuation of Deferred@368027262 after retry RPC after error@1665340200) -> (continuation of Deferred@1670346578 after retry RPC after error@1312489741) -> (continuation of Deferred@638554850 after retry RPC after error@1571692376) -> (continuation of Deferred@1157875288 after retry RPC after error@1395033244) -> (continuation of Deferred@165971096 after retry RPC after error@614276643) -> (continuation of Deferred@2138521070 after retry RPC after error@412243192) -> (continuation of Deferred@905954102 after retry RPC after error@2044702636) -> (continuation of Deferred@1065448756 after retry RPC after error@901694376) -> (continuation of Deferred@2123579482 after retry RPC after error@2058691307) -> (continuation of Deferred@1311359068 after retry RPC after error@231336370) -> (continuation of Deferred@1773988289 after retry RPC after error@978136167) -> (continuation of Deferred@979775570 after retry RPC after error@2023807701) -> (continuation of Deferred@1985795809 after retry RPC after error@631370329) -> (continuation of Deferred@785297951 after retry RPC after error@1346806625) -> (continuation of Deferred@1086168150 after retry RPC after error@1789173026) -> (continuation of Deferred@824280099 after retry RPC after error@1410950349) -> (continuation of Deferred@2028604724 after retry RPC after error@921289350) -> (continuation of Deferred@190077156 after retry RPC after error@343177807) -> (continuation of Deferred@1021265496 after retry RPC after error@1146773175) -> (continuation of Deferred@1843441056 after retry RPC after error@1517360209) -> (continuation of Deferred@484074689 after retry RPC after error@174276107) -> (continuation of Deferred@1644564298 after retry RPC after error@814173383) -> (continuation of Deferred@2134170234 after retry RPC after error@1815355633) -> (continuation of Deferred@1041899106 after retry RPC after error@888249362) -> (continuation of Deferred@1842309116 after retry RPC after error@548532508) -> (continuation of Deferred@1312166502 after retry RPC after error@1981744830) -> (continuation of Deferred@1626963718 after retry RPC after error@1332697876) -> (continuation of Deferred@825542077 after retry RPC after error@1066409939) -> (continuation of Deferred@339363432 after retry RPC after error@557320192) -> (continuation of Deferred@917907639 after retry RPC after error@166184757)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.17.253:37621
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:06:36.133 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:36.134 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:36.134 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:36.134 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.135 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.135 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.135 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.135 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.135 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.134 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.136 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.136 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.137 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:36.154 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:36.154 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:36.154 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:36.154 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.155 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.155 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.155 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.155 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.155 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.155 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.155 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.155 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.155 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:36.158 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
08:06:36.158 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (0d2ddb76420639a9ec06ca05e894cb50) switched from state RUNNING to RESTARTING.
08:06:36.160 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#0) of source Source: KuduSource.
08:06:36.162 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
08:06:36.165 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
08:06:36.165 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
08:06:36.165 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
08:06:36.175 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.27.200.125:46459(127.27.200.125:46459)] disconnecting while in state TERMINATED
08:06:36.175 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.27.200.126:43511(127.27.200.126:43511)] disconnecting while in state TERMINATED
08:06:36.175 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.27.200.124:34439(127.27.200.124:34439)] disconnecting while in state TERMINATED
08:06:36.175 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:06:36.176 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:06:36.176 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-2
08:06:36.176 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
08:06:36.178 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#0) of source Source: KuduSource.
08:06:36.180 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
08:06:36.181 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
08:06:36.182 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
08:06:36.183 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
08:06:36.185 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
08:06:36.186 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
08:06:36.186 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
08:06:36.186 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
08:06:36.194 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:36.195 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:36.195 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:36.196 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.196 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.196 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.197 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.197 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.197 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.197 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.27.200.125:46459(127.27.200.125:46459)] disconnecting while in state TERMINATED
08:06:36.197 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.27.200.126:43511(127.27.200.126:43511)] disconnecting while in state TERMINATED
08:06:36.198 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.27.200.124:34439(127.27.200.124:34439)] disconnecting while in state TERMINATED
08:06:36.198 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:06:36.199 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
08:06:36.199 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-2
08:06:36.198 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
08:06:36.200 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
08:06:36.200 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
08:06:36.200 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.200 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.200 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.200 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:36.246 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
08:06:36.247 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
08:06:36.247 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
08:06:36.253 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
08:06:36.253 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
08:06:36.254 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
08:06:36.254 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:36.254 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:36.254 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.27.200.125:46459(127.27.200.125:46459)] disconnecting while in state TERMINATED
08:06:36.254 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.27.200.126:43511(127.27.200.126:43511)] disconnecting while in state TERMINATED
08:06:36.254 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:36.254 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.27.200.124:34439(127.27.200.124:34439)] disconnecting while in state TERMINATED
08:06:36.255 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
08:06:36.255 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:06:36.255 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.255 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.255 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.255 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.256 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
08:06:36.256 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.256 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.256 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.256 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.257 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.257 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:36.257 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:06:36.257 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-2
08:06:36.258 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
08:06:36.258 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
08:06:36.263 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
08:06:36.264 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
08:06:36.264 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
08:06:36.264 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
08:06:36.271 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.27.200.125:46459(127.27.200.125:46459)] disconnecting while in state TERMINATED
08:06:36.271 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 325c80ff728d4ecfb2fa78a1d106c164(127.27.200.65:36745)] disconnecting while in state TERMINATED
08:06:36.271 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.27.200.126:43511(127.27.200.126:43511)] disconnecting while in state TERMINATED
08:06:36.271 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.27.200.124:34439(127.27.200.124:34439)] disconnecting while in state TERMINATED
08:06:36.271 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:06:36.272 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:06:36.272 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-2
08:06:36.272 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-3
08:06:36.280 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#0 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_0.
08:06:36.281 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#0 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
08:06:36.281 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
08:06:36.282 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
08:06:36.283 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
08:06:36.283 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
08:06:36.284 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:06:36.284 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:06:36.284 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:06:36.293 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
08:06:36.293 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
08:06:36.294 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
08:06:36.294 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
08:06:36.295 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
08:06:36.295 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
08:06:36.297 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 0d2ddb76420639a9ec06ca05e894cb50
08:06:36.323 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:36.338 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:36.339 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:36.339 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:36.340 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:36.340 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:36.340 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:36.341 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:36.341 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:36.341 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:36.341 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:36.341 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:36.341 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:36.342 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:36.374 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:36.374 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:36.375 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:36.375 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.375 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.375 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.376 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.376 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.376 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.376 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.376 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.376 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.377 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:36.409 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:36.409 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:36.410 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:36.410 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:36.410 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:36.411 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:36.411 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:36.411 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:36.411 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:36.411 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:36.411 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:36.411 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:36.411 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:36.446 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:36.487 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:36.488 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:36.488 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:36.489 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:36.489 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:36.489 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:36.489 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:36.489 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:36.489 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:36.490 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:36.490 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:36.490 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:36.490 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:36.575 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:36.575 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:36.575 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:36.576 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.576 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.576 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.577 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.577 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.577 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.577 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.577 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.577 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.577 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:36.694 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:36.694 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:36.695 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:36.695 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.696 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.696 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:36.696 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.696 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.696 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:36.697 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.697 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.697 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:36.697 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:36.820 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:36.946 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:37.114 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:37.114 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:37.115 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:37.115 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:37.115 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:37.115 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:37.115 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:37.115 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:37.115 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:37.117 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:37.117 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:37.117 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:37.117 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:37.254 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:37.254 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:37.255 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:37.255 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.255 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.256 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.256 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.256 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.256 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.257 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.257 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.257 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.257 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:37.287 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (0d2ddb76420639a9ec06ca05e894cb50) switched from state RESTARTING to RUNNING.
08:06:37.288 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job 0d2ddb76420639a9ec06ca05e894cb50 from Checkpoint 69 @ 1779091595847 for 0d2ddb76420639a9ec06ca05e894cb50 located at file:/tmp/junit4405728108231754423/checkpoints/0d2ddb76420639a9ec06ca05e894cb50/chk-69.
08:06:37.289 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
08:06:37.291 [INFO - flink-pekko.actor.default-dispatcher-8] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
08:06:37.316 [INFO - Thread-26] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
08:06:37.316 [DEBUG - Thread-26] (Connection.java:575) [peer master-127.27.17.253:37621(127.27.17.253:37621)] disconnecting while in state TERMINATED
08:06:37.316 [DEBUG - Thread-26] (Connection.java:575) [peer master-127.27.17.252:43595(127.27.17.252:43595)] disconnecting while in state TERMINATED
08:06:37.316 [DEBUG - Thread-26] (Connection.java:575) [peer master-127.27.17.254:45447(127.27.17.254:45447)] disconnecting while in state TERMINATED
08:06:37.317 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:06:37.318 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
08:06:37.318 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-2
08:06:37.318 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-0
08:06:37.319 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:37.334 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to SCHEDULED.
08:06:37.335 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:06:37.338 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING.
08:06:37.339 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #1) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id 562b84b71b659c92bf587d4c4d45167a
08:06:37.340 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
08:06:37.340 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 562b84b71b659c92bf587d4c4d45167a.
08:06:37.342 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id 562b84b71b659c92bf587d4c4d45167a.
08:06:37.343 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:06:37.345 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
08:06:37.345 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id 23d75c1cae20f6d786d6e473edbc6825
08:06:37.345 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to SCHEDULED.
08:06:37.347 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:06:37.348 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from SCHEDULED to DEPLOYING.
08:06:37.348 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #1) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id 51ba13794eaa695dfcc17a66fc9521a4
08:06:37.350 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to SCHEDULED.
08:06:37.350 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:06:37.352 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from SCHEDULED to DEPLOYING.
08:06:37.352 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #1) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id e7235da53f93c0af3219c2857bfb1cae
08:06:37.354 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 23d75c1cae20f6d786d6e473edbc6825.
08:06:37.356 [INFO - Thread-26] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
08:06:37.356 [INFO - Thread-26] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
08:06:37.357 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id 23d75c1cae20f6d786d6e473edbc6825.
08:06:37.358 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
08:06:37.358 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
08:06:37.360 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5073f299
08:06:37.360 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:06:37.362 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:06:37.362 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
08:06:37.363 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
08:06:37.371 [DEBUG - Thread-26] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:37.372 [INFO - Thread-26] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
08:06:37.372 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 51ba13794eaa695dfcc17a66fc9521a4.
08:06:37.373 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
08:06:37.373 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
08:06:37.374 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2f6098cf
08:06:37.374 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:06:37.374 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_1), deploy into slot with allocation id 51ba13794eaa695dfcc17a66fc9521a4.
08:06:37.374 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:06:37.375 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
08:06:37.375 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
08:06:37.378 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1b95909a
08:06:37.378 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2da24e34
08:06:37.387 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:37.388 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:37.393 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:06:37.393 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:06:37.393 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:06:37.393 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:06:37.397 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot e7235da53f93c0af3219c2857bfb1cae.
08:06:37.401 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_1), deploy into slot with allocation id e7235da53f93c0af3219c2857bfb1cae.
08:06:37.401 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to DEPLOYING.
08:06:37.403 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_1) [DEPLOYING].
08:06:37.411 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@384e3788
08:06:37.411 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:06:37.411 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:06:37.412 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
08:06:37.412 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
08:06:37.413 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to DEPLOYING.
08:06:37.413 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_1) [DEPLOYING].
08:06:37.414 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@438358b
08:06:37.414 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:06:37.414 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:06:37.414 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
08:06:37.415 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
08:06:37.417 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.418 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@34c2b91d
08:06:37.421 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:37.436 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@75bbf03f
08:06:37.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:36.469784 30644 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 30639
08:06:37.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:35.082023 30646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:37.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:37.436183 30639 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.356s	user 0.434s	sys 0.693s
08:06:37.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:37.441835 30639 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.362s	user 0.434s	sys 0.693s
08:06:37.446 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:37.448 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.451 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:37.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:37.455391 30639 server_base.cc:1061] running on GCE node
08:06:37.459 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:37.460254 30682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:37.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:37.462029 30639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:06:37.466 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.466 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.466 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.470 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:37.495982 30639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:06:37.496 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.498 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.498 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.499 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:37.503925 30639 hybrid_clock.cc:648] HybridClock initialized: now 1779091597503846 us; error 85 us; skew 500 ppm
08:06:37.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:37.505321 30639 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:06:37.506 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.515 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.516 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.517 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:37.518 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.518 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.518 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.519 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.519 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.519 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.520 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.520 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.522 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.522 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.522 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.526 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.526 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.526 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:37.526394 30639 webserver.cc:533] Webserver started at http://127.29.158.129:36239/ using document root <none> and password file <none>
08:06:37.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:37.527990 30639 fs_manager.cc:362] Metadata directory not provided
08:06:37.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:37.528374 30639 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:06:37.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:37.529105 30639 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:06:37.529 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.530 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.530 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.531 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.535 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.535 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.535 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.535 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.537 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.543 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:37.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:37.542960 30639 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-0/data/instance:
08:06:37.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d6acb62062c54919acc5ee398d03f785"
08:06:37.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:37 on dist-test-slave-1jss"
08:06:37.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:37.544656 30639 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-0/wal/instance:
08:06:37.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d6acb62062c54919acc5ee398d03f785"
08:06:37.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:37 on dist-test-slave-1jss"
08:06:37.546 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.546 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.546 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.546 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.548 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:37.554 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.554 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.554 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:37.563839 30639 fs_manager.cc:696] Time spent creating directory manager: real 0.018s	user 0.009s	sys 0.009s
08:06:37.571 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.572 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.572 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.572 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:37.573 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.574 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.574 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.574 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.580 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:37.580612 30704 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:06:37.582 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.582 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.582 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:37.582545 30639 fs_manager.cc:730] Time spent opening block manager: real 0.013s	user 0.006s	sys 0.005s
08:06:37.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:37.583025 30639 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-0/wal
08:06:37.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d6acb62062c54919acc5ee398d03f785"
08:06:37.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:37 on dist-test-slave-1jss"
08:06:37.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:37.583546 30639 fs_report.cc:389] FS layout report
08:06:37.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:06:37.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-0/wal
08:06:37.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-0/wal
08:06:37.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-0/data/data
08:06:37.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:06:37.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:06:37.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:06:37.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:06:37.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:06:37.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:06:37.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:06:37.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:06:37.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:06:37.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:06:37.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:06:37.591 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.591 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.591 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.591 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.597 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.597 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:37.597 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.606 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.606 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.606 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.608 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.611 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.612 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.612 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.612 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.613 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.614 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.614 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.614 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.628 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.629 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.629 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.630 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.634 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:37.635 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.635 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.635 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.642 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:37.643 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.643 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.643 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.650 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.651 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.652 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.652 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.652 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:37.657 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:37.662 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.664 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.664 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.664 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.675 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.676 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.676 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.677 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.677 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.677 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.679 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.679 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.681 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.685 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.685 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.686 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:37.689296 30639 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:06:37.690 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.691 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.691 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.691 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:37.693931 30639 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:06:37.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:37.694641 30639 kserver.cc:163] Server-wide thread pool size limit: 3276
08:06:37.696 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.696 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.696 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.696 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.697 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.698 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.698 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.698 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.698 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.699 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.699 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.699 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.699 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.699 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.699 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.700 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.700 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.706 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.706 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:37.706437 30639 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:06:37.707 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.707 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.707 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.717 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.717 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.718 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.718 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.718 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.718 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.718 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.719 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.719 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.719 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.719 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.719 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.719 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.719 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.720 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.720 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.720 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:37.720369 30639 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:06:37.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:37.720722 30639 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:06:37.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:37.721076 30639 ts_tablet_manager.cc:616] Registered 0 tablets
08:06:37.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:37.721312 30639 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:06:37.721 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.721 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.721 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.721 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.722 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.723 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.723 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.723 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.728 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.729 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.730 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.730 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.730 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.735 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.736 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.737 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.737 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.737 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.738 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.738 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.738 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.739 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.739 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.739 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.739 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.739 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.740 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.740 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.740 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.740 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.741 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.743 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.744 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.744 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.751 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.752 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.752 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.752 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.753 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.753 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.754 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.754 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.754 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.754 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.755 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.755 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.755 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.757 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:37.766 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.766 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.767 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.767 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.767 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.767 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.767 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.768 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.767 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.767 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.768 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.768 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.768 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.768 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.768 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.768 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.768 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.768 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.768 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.769 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.769 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.769 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.770 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.770 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.770 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.770 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.771 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.771 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.771 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.772 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.772 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.772 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.772 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.778 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.778 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.778 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.779 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.779 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.779 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.779 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.779 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.779 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:37.780 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.780 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.780 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.780 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.780 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.781 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.781 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.781 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.786 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.787 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.787 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.787 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.787 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.787 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.787 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.787 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.787 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.787 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.787 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.788 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.788 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.788 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.789 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.789 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:37.789 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.789 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.789 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.789 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.789 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.789 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.789 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.790 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.790 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.790 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.790 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.790 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.791 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.791 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.791 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.791 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.792 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.792 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.792 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.792 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.792 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.792 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.792 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.793 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.793 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.793 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.793 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.793 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.793 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.793 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.793 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:37.806 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.807 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.807 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.808 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.808 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.808 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.809 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.809 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.809 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.809 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.809 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.809 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.809 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.810 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.810 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.810 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.810 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.810 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.811 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.811 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.811 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.811 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.811 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.811 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.812 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.812 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.812 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.812 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.813 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.813 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.813 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.813 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.814 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.814 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.817 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:37.817 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:37.818 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:37.818 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.818 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.818 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.818 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.818 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.818 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.818 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.818 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.819 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.819 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.819 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.819 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.819 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.820 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:37.820 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.820 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.820 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.820 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.820 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.820 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.820 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.822 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.822 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.822 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.822 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.822 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.822 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.823 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:37.823 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.831 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.831 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.831 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.832 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.832 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.833 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.833 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.833 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.833 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.833 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.834 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.834 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.834 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.837 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:37.837 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:37.837 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.838 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.838 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.838 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.838 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.838 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.837 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:37.838 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.839 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.839 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.839 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:37.847 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.847 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.847 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.848 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.848 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.848 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.848 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.848 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.848 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.849 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.849 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.849 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.849 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.850 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.850 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.850 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.851 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.852 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.852 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.852 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.852 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.852 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.853 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.853 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.853 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.853 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.857 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.859 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.859 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.860 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.860 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.860 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.861 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.861 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.861 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.861 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.861 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.861 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.861 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.868 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.869 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.869 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.870 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.870 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.870 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.870 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.870 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.870 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.871 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.871 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.871 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.871 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.871 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.872 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.872 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.872 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.872 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.872 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.873 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.873 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.873 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.873 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.873 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.874 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.874 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.877 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:37.877 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:37.877 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:37.877 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.877 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.877 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.878 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.878 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.878 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.878 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.878 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.878 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.878 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:37.898 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:37.898 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:37.898 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:37.899 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.899 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.899 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.900 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.900 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.900 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.900 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.900 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.900 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.900 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:37.909 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.909 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.909 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.910 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.910 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.910 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.911 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.911 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.911 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.911 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.912 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.912 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.912 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.912 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.912 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.912 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.913 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.913 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.913 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.913 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.913 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.913 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.914 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.914 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.914 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.914 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.917 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:37.917 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:37.917 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:37.918 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:37.918 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:37.918 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:37.918 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:37.918 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:37.918 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:37.918 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:37.918 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:37.918 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:37.918 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:37.926 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.927 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.927 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.927 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.927 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.927 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.927 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.928 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.928 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.928 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.928 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.928 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.928 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:37.937 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:37.938 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:37.938 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:37.938 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.939 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.939 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:37.939 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.939 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.939 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:37.940 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.940 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.940 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:37.940 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:37.946 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:37.988 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:37.988 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:37.988 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:37.989 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:37.989 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:37.990 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:37.991 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:37.991 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:37.991 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:37.992 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:37.992 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:37.992 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:37.992 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:37.994 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:37.994 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:37.994 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:37.994 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.994 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.995 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:37.995 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.995 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.995 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:37.996 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.996 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.996 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:37.996 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:38.014 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:38.014 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:38.015 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:38.015 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:38.015 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:38.015 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:38.016 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:38.016 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:38.016 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:38.016 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:38.016 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:38.017 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:38.017 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:38.097 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:38.098 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:38.098 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:38.098 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:38.098 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:38.099 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:38.099 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:38.099 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:38.099 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:38.099 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:38.099 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:38.099 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:38.099 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:38.108 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:38.108 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:38.109 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:38.109 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:38.109 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:38.110 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:38.110 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:38.110 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:38.110 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:38.111 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:38.111 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:38.111 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:38.111 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:38.151 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:38.151 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:38.152 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:38.152 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:38.153 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:38.153 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:38.153 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:38.153 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:38.153 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:38.154 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:38.154 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:38.154 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:38.154 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:38.166 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:38.167 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:38.167 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:38.168 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:38.168 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:38.168 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:38.168 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:38.169 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:38.169 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:38.169 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:38.169 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:38.169 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:38.169 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:38.170 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:38.170 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:38.170 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:38.171 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:38.171 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:38.171 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:38.171 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:38.171 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:38.172 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:38.172 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:38.172 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:38.172 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:38.172 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:38.258 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:38.277 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:38.277 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:38.278 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:38.278 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:38.279 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:38.279 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:38.279 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:38.279 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:38.279 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:38.280 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:38.280 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:38.280 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:38.280 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:38.323 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:38.397 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:38.397 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:38.397 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:38.398 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:38.398 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:38.398 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:38.399 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:38.399 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:38.399 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:38.401 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:38.401 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:38.401 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:38.401 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:38.446 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:38.487 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:38.487 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:38.488 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:38.488 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:38.489 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:38.489 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:38.489 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:38.489 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:38.489 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:38.490 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:38.490 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:38.490 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:38.490 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:38.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:38.737540 30639 rpc_server.cc:307] RPC server started. Bound to: 127.29.158.129:45149
08:06:38.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:38.737746 30849 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.158.129:45149 every 8 connection(s)
08:06:38.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:38.741724 30639 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-0/data/info.pb
08:06:38.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:38.751868 30330 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 30639
08:06:38.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:38.752555 30330 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-0/wal/instance
08:06:38.758 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:38.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:38.774701 30330 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:06:38.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:06:38.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-1/wal
08:06:38.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-1/data
08:06:38.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:06:38.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:06:38.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:06:38.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:38.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:38.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:38.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-1/logs
08:06:38.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-1/data/info.pb
08:06:38.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:38.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:06:38.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:06:38.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:06:38.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:06:38.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:38.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:38.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:38.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:06:38.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:06:38.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.29.158.130:0
08:06:38.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.29.158.130
08:06:38.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.29.158.130
08:06:38.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:38.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061
08:06:38.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.29.158.148:38871
08:06:38.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:38.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:38.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:06:38.820 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:38.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:38.814687 30850 heartbeater.cc:344] Connected to a master server at 127.29.158.188:39061
08:06:38.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:38.815333 30850 heartbeater.cc:461] Registering TS with master...
08:06:38.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:38.816823 30850 heartbeater.cc:507] Master 127.29.158.188:39061 requested a full tablet report, sending...
08:06:38.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:38.852356 30538 ts_manager.cc:194] Registered new tserver with Master: d6acb62062c54919acc5ee398d03f785 (127.29.158.129:45149)
08:06:38.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:38.855701 30538 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.158.129:56729
08:06:38.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:38.863674 30854 heartbeater.cc:344] Connected to a master server at 127.29.158.190:38071
08:06:38.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:38.864221 30854 heartbeater.cc:461] Registering TS with master...
08:06:38.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:38.865149 30854 heartbeater.cc:507] Master 127.29.158.190:38071 requested a full tablet report, sending...
08:06:38.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:38.872159 30376 ts_manager.cc:194] Registered new tserver with Master: d6acb62062c54919acc5ee398d03f785 (127.29.158.129:45149)
08:06:38.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:38.894110 30851 heartbeater.cc:344] Connected to a master server at 127.29.158.189:41727
08:06:38.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:38.894610 30851 heartbeater.cc:461] Registering TS with master...
08:06:38.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:38.895423 30851 heartbeater.cc:507] Master 127.29.158.189:41727 requested a full tablet report, sending...
08:06:38.897 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:38.898 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:38.898 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:38.899 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:38.899 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:38.899 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:38.899 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:38.899 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:38.899 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:38.900 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:38.900 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:38.900 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:38.900 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:38.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:38.899603 30456 ts_manager.cc:194] Registered new tserver with Master: d6acb62062c54919acc5ee398d03f785 (127.29.158.129:45149)
08:06:38.946 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:39.008 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:39.009 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:39.009 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:39.010 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:39.010 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:39.010 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:39.011 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:39.011 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:39.011 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:39.012 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:39.012 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:39.012 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:39.012 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:39.153 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:39.153 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:39.153 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:39.154 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:39.154 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:39.154 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:39.155 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:39.155 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:39.155 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:39.156 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:39.156 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:39.156 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:39.156 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:39.187 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:39.187 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:39.187 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:39.188 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:39.188 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:39.188 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:39.189 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:39.189 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:39.189 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:39.188 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:39.189 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:39.189 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:39.189 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:39.198 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:39.198 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:39.198 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:39.198 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:39.198 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:39.198 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:39.198 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:39.198 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:39.199 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:39.199 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:39.199 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:39.199 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:39.199 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:39.258 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:39.320 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:39.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:39.328737 30857 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:06:39.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:39.329483 30857 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:06:39.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:39.330190 30857 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:06:39.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:39.369885 30857 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:06:39.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:39.370908 30857 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.158.130
08:06:39.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:39.415634 30857 tablet_server_runner.cc:78] Tablet server non-default flags:
08:06:39.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:39.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.29.158.148:38871
08:06:39.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:39.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:06:39.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-1/data
08:06:39.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-1/wal
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.29.158.130:0
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-1/data/info.pb
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.29.158.130
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.29.158.130
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-1/logs
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:06:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:06:39.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:39.417727 30857 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:06:39.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:39.419948 30857 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:06:39.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:39.436996 30868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:39.446 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:39.598 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:39.598 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:39.599 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:39.600 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:39.600 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:39.600 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:39.602 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:39.602 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:39.602 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:39.602 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:39.602 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:39.602 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:39.602 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:39.758 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:39.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:39.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:39.863004 30850 heartbeater.cc:499] Master 127.29.158.188:39061 was elected leader, sending a full tablet report...
08:06:39.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:39.912276 30011 debug-util.cc:398] Leaking SignalData structure 0x7b08000b5080 after lost signal to thread 29858
08:06:39.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:39.914383 30011 debug-util.cc:398] Leaking SignalData structure 0x7b08000b9d00 after lost signal to thread 30014
08:06:39.946 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:40.159 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:40.159 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:40.160 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:40.161 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:40.161 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:40.161 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:40.162 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:40.162 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:40.162 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:40.163 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:40.163 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:40.163 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:40.163 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:40.250 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:40.251 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:40.251 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:40.252 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:40.252 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:40.253 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:40.254 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:40.254 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:40.254 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:40.256 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:40.256 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:40.256 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:40.256 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:40.258 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:40.325 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:40.330 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:40.331 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:40.332 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:40.332 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:40.333 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:40.334 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:40.334 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:40.334 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:40.334 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:40.336 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:40.336 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:40.336 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:40.336 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:40.446 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:40.514 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:40.515 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:40.515 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:40.517 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:40.517 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:40.517 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:40.518 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:40.518 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:40.518 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:40.519 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:40.519 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:40.519 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:40.519 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:40.648 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:40.649 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:40.649 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:40.649 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:40.649 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:40.650 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:40.650 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:40.650 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:40.650 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:40.650 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:40.650 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:40.651 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:40.651 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:40.759 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:40.820 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:40.837 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:40.838 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:40.838 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:40.839 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:40.839 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:40.839 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:40.841 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:40.841 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:40.841 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:40.841 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:40.841 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:40.841 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:40.842 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:40.946 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:41.008 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:41.008 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:41.009 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:41.009 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:41.009 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:41.009 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:41.010 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:41.010 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:41.010 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:41.010 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:41.010 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:41.011 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:41.011 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:41.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:39.439018 30869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:41.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:41.026414 30871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:41.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:41.032322 30870 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1588 milliseconds
08:06:41.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.032415 30857 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:06:41.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.040141 30857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:06:41.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.043540 30857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:06:41.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.045048 30857 hybrid_clock.cc:648] HybridClock initialized: now 1779091601044950 us; error 95 us; skew 500 ppm
08:06:41.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.046366 30857 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:06:41.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.055469 30857 webserver.cc:533] Webserver started at http://127.29.158.130:33773/ using document root <none> and password file <none>
08:06:41.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.056941 30857 fs_manager.cc:362] Metadata directory not provided
08:06:41.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.057267 30857 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:06:41.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.058005 30857 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:06:41.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.066313 30857 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-1/data/instance:
08:06:41.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3fd6ff86a84648679872c7b9c828d708"
08:06:41.067 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:41.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:41 on dist-test-slave-1jss"
08:06:41.067 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:41.067 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:41.068 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:41.068 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:41.068 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:41.068 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:41.068 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:41.068 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:41.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.068120 30857 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-1/wal/instance:
08:06:41.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3fd6ff86a84648679872c7b9c828d708"
08:06:41.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:41 on dist-test-slave-1jss"
08:06:41.069 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:41.069 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:41.069 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:41.069 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:41.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.079309 30857 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.011s	sys 0.001s
08:06:41.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.088722 30879 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:06:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.090642 30857 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.006s	sys 0.001s
08:06:41.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.091030 30857 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-1/wal
08:06:41.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3fd6ff86a84648679872c7b9c828d708"
08:06:41.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:41 on dist-test-slave-1jss"
08:06:41.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.091398 30857 fs_report.cc:389] FS layout report
08:06:41.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:06:41.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-1/wal
08:06:41.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-1/wal
08:06:41.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-1/data/data
08:06:41.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:06:41.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:06:41.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:06:41.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:06:41.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:06:41.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:06:41.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:06:41.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:06:41.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:06:41.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:06:41.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:06:41.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.161417 30857 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:06:41.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.163630 30857 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:06:41.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.164088 30857 kserver.cc:163] Server-wide thread pool size limit: 3276
08:06:41.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.169090 30857 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:06:41.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.175704 30857 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:06:41.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.175925 30857 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:06:41.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.176152 30857 ts_tablet_manager.cc:616] Registered 0 tablets
08:06:41.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.176290 30857 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:06:41.257 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:41.320 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:41.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.391644 30857 rpc_server.cc:307] RPC server started. Bound to: 127.29.158.130:33769
08:06:41.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.391805 30992 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.158.130:33769 every 8 connection(s)
08:06:41.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.396646 30857 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-1/data/info.pb
08:06:41.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.406582 30330 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 30857
08:06:41.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.407097 30330 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-1/wal/instance
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.438403 30330 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-2/wal
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-2/data
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-2/logs
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-2/data/info.pb
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.29.158.131:0
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.29.158.131
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.29.158.131
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.29.158.148:38871
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:06:41.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:41.474 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:41.474 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:41.474 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:41.474 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:41.475 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:41.475 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:41.475 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:41.475 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:41.475 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:41.475 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:41.475 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:41.476 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:41.476 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:41.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.499359 30995 heartbeater.cc:344] Connected to a master server at 127.29.158.190:38071
08:06:41.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.499998 30995 heartbeater.cc:461] Registering TS with master...
08:06:41.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.501585 30995 heartbeater.cc:507] Master 127.29.158.190:38071 requested a full tablet report, sending...
08:06:41.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.504319 30993 heartbeater.cc:344] Connected to a master server at 127.29.158.188:39061
08:06:41.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.504695 30993 heartbeater.cc:461] Registering TS with master...
08:06:41.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.505718 30993 heartbeater.cc:507] Master 127.29.158.188:39061 requested a full tablet report, sending...
08:06:41.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.506834 30376 ts_manager.cc:194] Registered new tserver with Master: 3fd6ff86a84648679872c7b9c828d708 (127.29.158.130:33769)
08:06:41.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.508421 30538 ts_manager.cc:194] Registered new tserver with Master: 3fd6ff86a84648679872c7b9c828d708 (127.29.158.130:33769)
08:06:41.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.510720 30994 heartbeater.cc:344] Connected to a master server at 127.29.158.189:41727
08:06:41.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.511078 30994 heartbeater.cc:461] Registering TS with master...
08:06:41.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.511957 30994 heartbeater.cc:507] Master 127.29.158.189:41727 requested a full tablet report, sending...
08:06:41.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.512410 30538 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.158.130:46353
08:06:41.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:41.514834 30456 ts_manager.cc:194] Registered new tserver with Master: 3fd6ff86a84648679872c7b9c828d708 (127.29.158.130:33769)
08:06:41.729 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:41.729 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:41.730 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:41.730 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:41.730 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:41.730 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:41.730 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:41.730 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:41.730 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:41.730 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:41.731 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:41.731 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:41.731 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:41.757 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:41.757 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:41.758 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:41.758 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:41.758 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:41.758 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:41.758 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:41.758 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:41.758 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:41.759 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:41.758 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:41.759 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:41.759 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:41.759 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:41.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:41.945 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:41.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:41.994452 31003 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:06:41.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:41.995018 31003 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:06:41.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:41.995566 31003 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:06:42.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:42.038079 31003 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:06:42.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:42.039170 31003 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.158.131
08:06:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:42.091019 31003 tablet_server_runner.cc:78] Tablet server non-default flags:
08:06:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.29.158.148:38871
08:06:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:06:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-2/data
08:06:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-2/wal
08:06:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.29.158.131:0
08:06:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:06:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-2/data/info.pb
08:06:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.29.158.131
08:06:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:42.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061
08:06:42.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:06:42.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:42.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:06:42.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:06:42.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:42.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.29.158.131
08:06:42.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-2/logs
08:06:42.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:42.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:06:42.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:06:42.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:06:42.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:06:42.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:06:42.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:06:42.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:06:42.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:06:42.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:06:42.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:42.093001 31003 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:06:42.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:42.095172 31003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:06:42.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:42.115690 31011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:42.258 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:42.313 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:42.314 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:42.314 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:42.315 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:42.315 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:42.315 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:42.316 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:42.316 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:42.316 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:42.317 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:42.317 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:42.317 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:42.317 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:42.320 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:42.446 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:42.517241 30993 heartbeater.cc:499] Master 127.29.158.188:39061 was elected leader, sending a full tablet report...
08:06:42.628 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:42.629 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:42.629 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:42.630 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:42.631 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:42.631 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:42.631 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:42.632 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:42.632 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:42.632 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:42.634 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:42.635 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:42.635 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:42.758 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:42.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:42.830 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:42.830 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:42.831 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:42.832 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:42.832 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:42.832 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:42.833 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:42.833 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:42.842 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:42.842 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:42.843 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:42.843 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:42.843 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:42.938 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:42.938 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:42.938 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:42.939 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:42.939 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:42.940 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:42.941 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:42.941 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:42.941 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:42.941 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:42.941 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:42.941 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:42.942 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:42.946 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:42.970 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:42.971 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:42.971 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:42.974 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:42.974 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:42.974 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:42.975 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:42.975 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:42.975 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:42.975 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:42.975 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:42.976 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:42.976 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:43.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:43.176426 29789 debug-util.cc:398] Leaking SignalData structure 0x7b0800039f20 after lost signal to thread 29721
08:06:43.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:43.177886 29789 debug-util.cc:398] Leaking SignalData structure 0x7b0800098480 after lost signal to thread 29792
08:06:43.258 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:43.320 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:43.451 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:43.758 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:43.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:42.134691 31012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:43.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:42.125365 31014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:43.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:43.819355 31013 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1689 milliseconds
08:06:43.820 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:43.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:43.819487 31003 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:06:43.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:43.821135 31003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:06:43.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:43.837487 31003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:06:43.838 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:43.838 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:43.838 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:43.839 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:43.839 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:43.839 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:43.839 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:43.839 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:43.839 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:43.840 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:43.840 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:43.840 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:43.840 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:43.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:43.845325 31003 hybrid_clock.cc:648] HybridClock initialized: now 1779091603845239 us; error 59 us; skew 500 ppm
08:06:43.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:43.846625 31003 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:06:43.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:43.859361 31003 webserver.cc:533] Webserver started at http://127.29.158.131:40659/ using document root <none> and password file <none>
08:06:43.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:43.860816 31003 fs_manager.cc:362] Metadata directory not provided
08:06:43.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:43.861124 31003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:06:43.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:43.861711 31003 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:06:43.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:43.868316 31003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-2/data/instance:
08:06:43.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7a55aa81ed1045bbb68d397395b9ae3f"
08:06:43.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:43 on dist-test-slave-1jss"
08:06:43.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:43.869968 31003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-2/wal/instance:
08:06:43.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7a55aa81ed1045bbb68d397395b9ae3f"
08:06:43.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:43 on dist-test-slave-1jss"
08:06:43.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:43.880414 31003 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.008s	sys 0.000s
08:06:43.887 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:43.888 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:43.888 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:43.890 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:43.890 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:43.890 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:43.890 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:43.890 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:43.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:43.891474 31025 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:06:43.892 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:43.893 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:43.893 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:43.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:43.893302 31003 fs_manager.cc:730] Time spent opening block manager: real 0.009s	user 0.004s	sys 0.006s
08:06:43.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:43.893749 31003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-2/wal
08:06:43.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7a55aa81ed1045bbb68d397395b9ae3f"
08:06:43.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:06:43 on dist-test-slave-1jss"
08:06:43.890 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:43.894 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:43.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:43.894309 31003 fs_report.cc:389] FS layout report
08:06:43.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:06:43.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-2/wal
08:06:43.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-2/wal
08:06:43.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-2/data/data
08:06:43.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:06:43.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:06:43.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:06:43.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:06:43.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:06:43.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:06:43.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:06:43.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:06:43.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:06:43.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:06:43.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:06:43.946 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:43.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:43.974802 31003 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:06:43.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:43.976722 31003 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:06:43.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:43.977201 31003 kserver.cc:163] Server-wide thread pool size limit: 3276
08:06:43.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:43.983563 31003 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:06:43.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:43.991253 31003 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:06:43.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:43.991489 31003 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:06:43.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:43.991708 31003 ts_tablet_manager.cc:616] Registered 0 tablets
08:06:43.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:43.991902 31003 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:06:44.148 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:44.149 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:44.149 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:44.149 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:44.150 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:44.150 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:44.150 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:44.150 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:44.150 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:44.150 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:44.151 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:44.151 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:44.151 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:44.171 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:44.171 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:44.172 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:44.172 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:44.172 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:44.172 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:44.172 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:44.172 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:44.173 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:44.173 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:44.173 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:44.173 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:44.174 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:44.177 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:44.178 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:44.178 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:44.178 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:44.178 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:44.178 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:44.178 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:44.178 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:44.178 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:44.179 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:44.179 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:44.179 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:44.179 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:44.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.230183 31003 rpc_server.cc:307] RPC server started. Bound to: 127.29.158.131:41421
08:06:44.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.230891 31137 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.158.131:41421 every 8 connection(s)
08:06:44.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.234254 31003 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-2/data/info.pb
08:06:44.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.242807 30330 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 31003
08:06:44.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.243474 30330 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17372650029020801697/ts-2/wal/instance
08:06:44.258 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:44.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.312134 31138 heartbeater.cc:344] Connected to a master server at 127.29.158.188:39061
08:06:44.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.312765 31138 heartbeater.cc:461] Registering TS with master...
08:06:44.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.314548 31138 heartbeater.cc:507] Master 127.29.158.188:39061 requested a full tablet report, sending...
08:06:44.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.317857 30538 ts_manager.cc:194] Registered new tserver with Master: 7a55aa81ed1045bbb68d397395b9ae3f (127.29.158.131:41421)
08:06:44.320 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:44.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.320433 30538 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.158.131:54947
08:06:44.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.328214 31139 heartbeater.cc:344] Connected to a master server at 127.29.158.189:41727
08:06:44.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.328699 31139 heartbeater.cc:461] Registering TS with master...
08:06:44.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.329478 31139 heartbeater.cc:507] Master 127.29.158.189:41727 requested a full tablet report, sending...
08:06:44.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.332412 30456 ts_manager.cc:194] Registered new tserver with Master: 7a55aa81ed1045bbb68d397395b9ae3f (127.29.158.131:41421)
08:06:44.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.337958 31141 heartbeater.cc:344] Connected to a master server at 127.29.158.190:38071
08:06:44.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.338375 31141 heartbeater.cc:461] Registering TS with master...
08:06:44.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.339129 31141 heartbeater.cc:507] Master 127.29.158.190:38071 requested a full tablet report, sending...
08:06:44.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.342653 30376 ts_manager.cc:194] Registered new tserver with Master: 7a55aa81ed1045bbb68d397395b9ae3f (127.29.158.131:41421)
08:06:44.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.359371 30330 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
08:06:44.375 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:06:44.375 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

08:06:44.376 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.29.158.190"
      port: 38071
    }
    bound_http_address {
      host: "127.29.158.190"
      port: 33427
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.29.158.189"
      port: 41727
    }
    bound_http_address {
      host: "127.29.158.189"
      port: 38451
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.29.158.188"
      port: 39061
    }
    bound_http_address {
      host: "127.29.158.188"
      port: 40373
    }
  }
}

08:06:44.377 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

08:06:44.378 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.29.158.129"
      port: 45149
    }
    bound_http_address {
      host: "127.29.158.129"
      port: 36239
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.29.158.130"
      port: 33769
    }
    bound_http_address {
      host: "127.29.158.130"
      port: 33773
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.29.158.131"
      port: 41421
    }
    bound_http_address {
      host: "127.29.158.131"
      port: 40659
    }
  }
}

08:06:44.378 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
08:06:44.380 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:44.382 [DEBUG - main] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:06:44.383 [DEBUG - main] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:06:44.383 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.28.220.253:45079(127.28.220.253:45079)] Successfully connected to peer
08:06:44.384 [DEBUG - main] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:06:44.385 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.28.220.254:37365(127.28.220.254:37365)] Successfully connected to peer
08:06:44.400 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.254
08:06:44.409 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.28.220.252:33543(127.28.220.252:33543)] Successfully connected to peer
08:06:44.413 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.253
08:06:44.419 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.252
08:06:44.420 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:44.425 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x10fd0ebf, L:/127.0.0.1:42650 - R:/127.28.220.254:37365] using SASL/PLAIN
08:06:44.430 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:44.433 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:44.439 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x4701dc9e, L:/127.0.0.1:54354 - R:/127.28.220.253:45079] using SASL/PLAIN
08:06:44.439 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x78405f3c, L:/127.0.0.1:34576 - R:/127.28.220.252:33543] using SASL/PLAIN
08:06:44.444 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:06:44.444 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=63), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [52ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: OK, [61ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: OK, [61ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: OK, deferred=null) after lookup
08:06:44.446 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:44.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.447507 29757 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34576:
08:06:44.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
08:06:44.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
08:06:44.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:06:44.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
08:06:44.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:06:44.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:06:44.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:06:44.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:06:44.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:06:44.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:06:44.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:06:44.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:06:44.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
08:06:44.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:06:44.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:06:44.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:06:44.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:06:44.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:06:44.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:06:44.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:06:44.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:06:44.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
08:06:44.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:06:44.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:06:44.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:06:44.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:06:44.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:06:44.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:06:44.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:06:44.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:06:44.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
08:06:44.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:06:44.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:06:44.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:06:44.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:06:44.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:06:44.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:06:44.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:06:44.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:06:44.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
08:06:44.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\004\0012\000\000\000\004\001\226\000\000\000"
08:06:44.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:06:44.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
08:06:44.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
08:06:44.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
08:06:44.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key2"
08:06:44.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:06:44.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
08:06:44.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
08:06:44.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:06:44.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
08:06:44.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
08:06:44.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
08:06:44.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:06:44.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:06:44.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:06:44.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:44.454037 29757 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
08:06:44.468 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:44.468 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:44.469 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:44.469 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:44.469 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:44.469 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:44.469 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:44.469 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:44.469 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:44.470 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:44.470 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:44.470 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:44.470 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:44.574 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8c252bac8ed749d288b155a27fae1849
08:06:44.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.700246 29948 tablet_service.cc:1511] Processing CreateTablet for tablet f0136ad45f0f476b999986635f720b8f (DEFAULT_TABLE table=replication_test_table [id=8c252bac8ed749d288b155a27fae1849]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
08:06:44.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.704571 29948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0136ad45f0f476b999986635f720b8f. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:44.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.700228 29947 tablet_service.cc:1511] Processing CreateTablet for tablet 1346ae47881b4c43b5c995d59d2a39a2 (DEFAULT_TABLE table=replication_test_table [id=8c252bac8ed749d288b155a27fae1849]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
08:06:44.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.700829 29949 tablet_service.cc:1511] Processing CreateTablet for tablet b06031ec130d4dad9efb2794fadd2b04 (DEFAULT_TABLE table=replication_test_table [id=8c252bac8ed749d288b155a27fae1849]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
08:06:44.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.708408 29947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1346ae47881b4c43b5c995d59d2a39a2. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:44.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.709260 29949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b06031ec130d4dad9efb2794fadd2b04. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:44.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.700255 29950 tablet_service.cc:1511] Processing CreateTablet for tablet 7c05024562a74973892ab2f3098ce916 (DEFAULT_TABLE table=replication_test_table [id=8c252bac8ed749d288b155a27fae1849]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
08:06:44.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.712934 29950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c05024562a74973892ab2f3098ce916. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:44.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.718109 30254 tablet_service.cc:1511] Processing CreateTablet for tablet b06031ec130d4dad9efb2794fadd2b04 (DEFAULT_TABLE table=replication_test_table [id=8c252bac8ed749d288b155a27fae1849]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
08:06:44.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.721462 30254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b06031ec130d4dad9efb2794fadd2b04. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:44.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.722618 30251 tablet_service.cc:1511] Processing CreateTablet for tablet f0135c5dce09400d8d90b12906c890c0 (DEFAULT_TABLE table=replication_test_table [id=8c252bac8ed749d288b155a27fae1849]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
08:06:44.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.722657 30112 tablet_service.cc:1511] Processing CreateTablet for tablet 1346ae47881b4c43b5c995d59d2a39a2 (DEFAULT_TABLE table=replication_test_table [id=8c252bac8ed749d288b155a27fae1849]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
08:06:44.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.724169 30111 tablet_service.cc:1511] Processing CreateTablet for tablet f0135c5dce09400d8d90b12906c890c0 (DEFAULT_TABLE table=replication_test_table [id=8c252bac8ed749d288b155a27fae1849]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
08:06:44.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.723313 30115 tablet_service.cc:1511] Processing CreateTablet for tablet 7c05024562a74973892ab2f3098ce916 (DEFAULT_TABLE table=replication_test_table [id=8c252bac8ed749d288b155a27fae1849]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
08:06:44.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.726716 30252 tablet_service.cc:1511] Processing CreateTablet for tablet 1346ae47881b4c43b5c995d59d2a39a2 (DEFAULT_TABLE table=replication_test_table [id=8c252bac8ed749d288b155a27fae1849]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
08:06:44.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.727466 30113 tablet_service.cc:1511] Processing CreateTablet for tablet f0136ad45f0f476b999986635f720b8f (DEFAULT_TABLE table=replication_test_table [id=8c252bac8ed749d288b155a27fae1849]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
08:06:44.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.727494 30110 tablet_service.cc:1511] Processing CreateTablet for tablet f4428ebcade5440ebc2d4803102193ed (DEFAULT_TABLE table=replication_test_table [id=8c252bac8ed749d288b155a27fae1849]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
08:06:44.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.728941 30253 tablet_service.cc:1511] Processing CreateTablet for tablet f0136ad45f0f476b999986635f720b8f (DEFAULT_TABLE table=replication_test_table [id=8c252bac8ed749d288b155a27fae1849]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
08:06:44.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.731325 30114 tablet_service.cc:1511] Processing CreateTablet for tablet b06031ec130d4dad9efb2794fadd2b04 (DEFAULT_TABLE table=replication_test_table [id=8c252bac8ed749d288b155a27fae1849]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
08:06:44.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.732527 30112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1346ae47881b4c43b5c995d59d2a39a2. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:44.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.732390 30250 tablet_service.cc:1511] Processing CreateTablet for tablet f4428ebcade5440ebc2d4803102193ed (DEFAULT_TABLE table=replication_test_table [id=8c252bac8ed749d288b155a27fae1849]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
08:06:44.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.733388 30110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4428ebcade5440ebc2d4803102193ed. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:44.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.734234 30114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b06031ec130d4dad9efb2794fadd2b04. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:44.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.735051 30255 tablet_service.cc:1511] Processing CreateTablet for tablet 7c05024562a74973892ab2f3098ce916 (DEFAULT_TABLE table=replication_test_table [id=8c252bac8ed749d288b155a27fae1849]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
08:06:44.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.738366 30113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0136ad45f0f476b999986635f720b8f. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:44.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.739184 30111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0135c5dce09400d8d90b12906c890c0. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:44.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.739527 30251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0135c5dce09400d8d90b12906c890c0. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:44.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.740442 30115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c05024562a74973892ab2f3098ce916. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:44.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.741629 30250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4428ebcade5440ebc2d4803102193ed. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:44.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.711436 29946 tablet_service.cc:1511] Processing CreateTablet for tablet f0135c5dce09400d8d90b12906c890c0 (DEFAULT_TABLE table=replication_test_table [id=8c252bac8ed749d288b155a27fae1849]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
08:06:44.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.737767 29945 tablet_service.cc:1511] Processing CreateTablet for tablet f4428ebcade5440ebc2d4803102193ed (DEFAULT_TABLE table=replication_test_table [id=8c252bac8ed749d288b155a27fae1849]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
08:06:44.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.749518 29945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4428ebcade5440ebc2d4803102193ed. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:44.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.751590 29946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0135c5dce09400d8d90b12906c890c0. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:44.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.746160 30255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c05024562a74973892ab2f3098ce916. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:44.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.755628 30253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0136ad45f0f476b999986635f720b8f. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:44.758 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:44.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.757897 30252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1346ae47881b4c43b5c995d59d2a39a2. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:44.767 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:44.767 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:44.767 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:44.768 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:44.768 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:44.768 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:44.768 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:44.768 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:44.768 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:44.769 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:44.769 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:44.769 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:44.769 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:44.820 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:44.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.868528 31173 tablet_bootstrap.cc:492] T f0136ad45f0f476b999986635f720b8f P e83b8a545bd54af99acd623fd123912f: Bootstrap starting.
08:06:44.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.899098 31173 tablet_bootstrap.cc:654] T f0136ad45f0f476b999986635f720b8f P e83b8a545bd54af99acd623fd123912f: Neither blocks nor log segments found. Creating new log.
08:06:44.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.902227 31173 log.cc:826] T f0136ad45f0f476b999986635f720b8f P e83b8a545bd54af99acd623fd123912f: Log is configured to *not* fsync() on all Append() calls
08:06:44.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.911012 31175 tablet_bootstrap.cc:492] T f4428ebcade5440ebc2d4803102193ed P 9b230140dcab4f58b02a0b1939e65a5d: Bootstrap starting.
08:06:44.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.937259 31173 tablet_bootstrap.cc:492] T f0136ad45f0f476b999986635f720b8f P e83b8a545bd54af99acd623fd123912f: No bootstrap required, opened a new log
08:06:44.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.937955 31173 ts_tablet_manager.cc:1403] T f0136ad45f0f476b999986635f720b8f P e83b8a545bd54af99acd623fd123912f: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.013s
08:06:44.945 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:44.948 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:44.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.948341 31175 tablet_bootstrap.cc:654] T f4428ebcade5440ebc2d4803102193ed P 9b230140dcab4f58b02a0b1939e65a5d: Neither blocks nor log segments found. Creating new log.
08:06:44.948 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:44.949 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:44.949 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:44.949 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:44.949 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:44.949 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:44.950 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:44.950 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:44.950 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:44.950 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:44.951 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:44.951 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:44.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.952306 31174 tablet_bootstrap.cc:492] T b06031ec130d4dad9efb2794fadd2b04 P 4430d593fcee4c1fbd17a7aab7897238: Bootstrap starting.
08:06:44.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.965469 31175 log.cc:826] T f4428ebcade5440ebc2d4803102193ed P 9b230140dcab4f58b02a0b1939e65a5d: Log is configured to *not* fsync() on all Append() calls
08:06:44.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.976980 31174 tablet_bootstrap.cc:654] T b06031ec130d4dad9efb2794fadd2b04 P 4430d593fcee4c1fbd17a7aab7897238: Neither blocks nor log segments found. Creating new log.
08:06:44.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.980309 31174 log.cc:826] T b06031ec130d4dad9efb2794fadd2b04 P 4430d593fcee4c1fbd17a7aab7897238: Log is configured to *not* fsync() on all Append() calls
08:06:44.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.981837 31173 raft_consensus.cc:359] T f0136ad45f0f476b999986635f720b8f P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:44.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.982988 31173 raft_consensus.cc:385] T f0136ad45f0f476b999986635f720b8f P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:44.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.983582 31175 tablet_bootstrap.cc:492] T f4428ebcade5440ebc2d4803102193ed P 9b230140dcab4f58b02a0b1939e65a5d: No bootstrap required, opened a new log
08:06:44.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.984259 31175 ts_tablet_manager.cc:1403] T f4428ebcade5440ebc2d4803102193ed P 9b230140dcab4f58b02a0b1939e65a5d: Time spent bootstrapping tablet: real 0.075s	user 0.018s	sys 0.003s
08:06:44.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.983407 31173 raft_consensus.cc:740] T f0136ad45f0f476b999986635f720b8f P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83b8a545bd54af99acd623fd123912f, State: Initialized, Role: FOLLOWER
08:06:44.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.986249 31173 consensus_queue.cc:260] T f0136ad45f0f476b999986635f720b8f P e83b8a545bd54af99acd623fd123912f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:44.991 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:44.991 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:44.991 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:44.992 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:44.992 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:44.992 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:44.993 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:44.993 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:44.993 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:44.993 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:44.994 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:44.994 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:44.994 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:44.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.997517 31174 tablet_bootstrap.cc:492] T b06031ec130d4dad9efb2794fadd2b04 P 4430d593fcee4c1fbd17a7aab7897238: No bootstrap required, opened a new log
08:06:44.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:44.998646 31174 ts_tablet_manager.cc:1403] T b06031ec130d4dad9efb2794fadd2b04 P 4430d593fcee4c1fbd17a7aab7897238: Time spent bootstrapping tablet: real 0.047s	user 0.022s	sys 0.005s
08:06:45.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.003844 31173 ts_tablet_manager.cc:1434] T f0136ad45f0f476b999986635f720b8f P e83b8a545bd54af99acd623fd123912f: Time spent starting tablet: real 0.062s	user 0.035s	sys 0.007s
08:06:45.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.021211 31173 tablet_bootstrap.cc:492] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f: Bootstrap starting.
08:06:45.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.028903 31173 tablet_bootstrap.cc:654] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f: Neither blocks nor log segments found. Creating new log.
08:06:45.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.042063 31173 tablet_bootstrap.cc:492] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f: No bootstrap required, opened a new log
08:06:45.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.042586 31173 ts_tablet_manager.cc:1403] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.010s
08:06:45.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.044305 31175 raft_consensus.cc:359] T f4428ebcade5440ebc2d4803102193ed P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.045358 31175 raft_consensus.cc:385] T f4428ebcade5440ebc2d4803102193ed P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:45.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.045668 31175 raft_consensus.cc:740] T f4428ebcade5440ebc2d4803102193ed P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b230140dcab4f58b02a0b1939e65a5d, State: Initialized, Role: FOLLOWER
08:06:45.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.045750 31173 raft_consensus.cc:359] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.046510 31173 raft_consensus.cc:385] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:45.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.046823 31173 raft_consensus.cc:740] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83b8a545bd54af99acd623fd123912f, State: Initialized, Role: FOLLOWER
08:06:45.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.047380 31175 consensus_queue.cc:260] T f4428ebcade5440ebc2d4803102193ed P 9b230140dcab4f58b02a0b1939e65a5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.047516 31173 consensus_queue.cc:260] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.050654 31173 ts_tablet_manager.cc:1434] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
08:06:45.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.060374 31173 tablet_bootstrap.cc:492] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f: Bootstrap starting.
08:06:45.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.067467 31173 tablet_bootstrap.cc:654] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f: Neither blocks nor log segments found. Creating new log.
08:06:45.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.069521 31174 raft_consensus.cc:359] T b06031ec130d4dad9efb2794fadd2b04 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.070797 31174 raft_consensus.cc:385] T b06031ec130d4dad9efb2794fadd2b04 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:45.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.071269 31174 raft_consensus.cc:740] T b06031ec130d4dad9efb2794fadd2b04 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4430d593fcee4c1fbd17a7aab7897238, State: Initialized, Role: FOLLOWER
08:06:45.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.071465 31175 ts_tablet_manager.cc:1434] T f4428ebcade5440ebc2d4803102193ed P 9b230140dcab4f58b02a0b1939e65a5d: Time spent starting tablet: real 0.087s	user 0.033s	sys 0.013s
08:06:45.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.073104 31174 consensus_queue.cc:260] T b06031ec130d4dad9efb2794fadd2b04 P 4430d593fcee4c1fbd17a7aab7897238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.086452 31175 tablet_bootstrap.cc:492] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d: Bootstrap starting.
08:06:45.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.088512 31174 ts_tablet_manager.cc:1434] T b06031ec130d4dad9efb2794fadd2b04 P 4430d593fcee4c1fbd17a7aab7897238: Time spent starting tablet: real 0.089s	user 0.030s	sys 0.013s
08:06:45.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.092442 31174 tablet_bootstrap.cc:492] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238: Bootstrap starting.
08:06:45.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.110623 31175 tablet_bootstrap.cc:654] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d: Neither blocks nor log segments found. Creating new log.
08:06:45.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.110692 31174 tablet_bootstrap.cc:654] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238: Neither blocks nor log segments found. Creating new log.
08:06:45.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.112178 31173 tablet_bootstrap.cc:492] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f: No bootstrap required, opened a new log
08:06:45.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.112916 31173 ts_tablet_manager.cc:1403] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.020s
08:06:45.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.116832 31173 raft_consensus.cc:359] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.118323 31173 raft_consensus.cc:385] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:45.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.118801 31173 raft_consensus.cc:740] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83b8a545bd54af99acd623fd123912f, State: Initialized, Role: FOLLOWER
08:06:45.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.119798 31173 consensus_queue.cc:260] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.122985 31173 ts_tablet_manager.cc:1434] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
08:06:45.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.128786 31173 tablet_bootstrap.cc:492] T 7c05024562a74973892ab2f3098ce916 P e83b8a545bd54af99acd623fd123912f: Bootstrap starting.
08:06:45.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:45.132771 30183 tablet.cc:2404] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:06:45.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.140894 31174 tablet_bootstrap.cc:492] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238: No bootstrap required, opened a new log
08:06:45.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.141446 31174 ts_tablet_manager.cc:1403] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.012s
08:06:45.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.143821 31173 tablet_bootstrap.cc:654] T 7c05024562a74973892ab2f3098ce916 P e83b8a545bd54af99acd623fd123912f: Neither blocks nor log segments found. Creating new log.
08:06:45.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.145042 31174 raft_consensus.cc:359] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.145751 31174 raft_consensus.cc:385] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:45.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:45.145852 30329 tablet.cc:2404] T b06031ec130d4dad9efb2794fadd2b04 P 4430d593fcee4c1fbd17a7aab7897238: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:06:45.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.146101 31174 raft_consensus.cc:740] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4430d593fcee4c1fbd17a7aab7897238, State: Initialized, Role: FOLLOWER
08:06:45.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.146831 31175 tablet_bootstrap.cc:492] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d: No bootstrap required, opened a new log
08:06:45.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.147318 31175 ts_tablet_manager.cc:1403] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.007s
08:06:45.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.147131 31174 consensus_queue.cc:260] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.153108 31173 tablet_bootstrap.cc:492] T 7c05024562a74973892ab2f3098ce916 P e83b8a545bd54af99acd623fd123912f: No bootstrap required, opened a new log
08:06:45.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.153561 31173 ts_tablet_manager.cc:1403] T 7c05024562a74973892ab2f3098ce916 P e83b8a545bd54af99acd623fd123912f: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.000s
08:06:45.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.154110 31174 ts_tablet_manager.cc:1434] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
08:06:45.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.155061 31174 tablet_bootstrap.cc:492] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238: Bootstrap starting.
08:06:45.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.157974 31173 raft_consensus.cc:359] T 7c05024562a74973892ab2f3098ce916 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } } peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } }
08:06:45.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.160066 31173 raft_consensus.cc:385] T 7c05024562a74973892ab2f3098ce916 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:45.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.160344 31173 raft_consensus.cc:740] T 7c05024562a74973892ab2f3098ce916 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83b8a545bd54af99acd623fd123912f, State: Initialized, Role: FOLLOWER
08:06:45.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.161041 31173 consensus_queue.cc:260] T 7c05024562a74973892ab2f3098ce916 P e83b8a545bd54af99acd623fd123912f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } } peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } }
08:06:45.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.162187 31174 tablet_bootstrap.cc:654] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238: Neither blocks nor log segments found. Creating new log.
08:06:45.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.167357 31173 ts_tablet_manager.cc:1434] T 7c05024562a74973892ab2f3098ce916 P e83b8a545bd54af99acd623fd123912f: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
08:06:45.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.169953 31173 tablet_bootstrap.cc:492] T f0135c5dce09400d8d90b12906c890c0 P e83b8a545bd54af99acd623fd123912f: Bootstrap starting.
08:06:45.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.175185 31174 tablet_bootstrap.cc:492] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238: No bootstrap required, opened a new log
08:06:45.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.175663 31174 ts_tablet_manager.cc:1403] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.005s
08:06:45.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.177927 31175 raft_consensus.cc:359] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.178717 31175 raft_consensus.cc:385] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:45.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.178601 31174 raft_consensus.cc:359] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } } peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } }
08:06:45.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.178998 31175 raft_consensus.cc:740] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b230140dcab4f58b02a0b1939e65a5d, State: Initialized, Role: FOLLOWER
08:06:45.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.179332 31174 raft_consensus.cc:385] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:45.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.179620 31174 raft_consensus.cc:740] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4430d593fcee4c1fbd17a7aab7897238, State: Initialized, Role: FOLLOWER
08:06:45.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.179906 31175 consensus_queue.cc:260] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.180450 31174 consensus_queue.cc:260] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } } peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } }
08:06:45.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.183260 31174 ts_tablet_manager.cc:1434] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.004s
08:06:45.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.184302 31174 tablet_bootstrap.cc:492] T f0136ad45f0f476b999986635f720b8f P 4430d593fcee4c1fbd17a7aab7897238: Bootstrap starting.
08:06:45.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.184509 31173 tablet_bootstrap.cc:654] T f0135c5dce09400d8d90b12906c890c0 P e83b8a545bd54af99acd623fd123912f: Neither blocks nor log segments found. Creating new log.
08:06:45.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.198139 31175 ts_tablet_manager.cc:1434] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.001s
08:06:45.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.199958 31174 tablet_bootstrap.cc:654] T f0136ad45f0f476b999986635f720b8f P 4430d593fcee4c1fbd17a7aab7897238: Neither blocks nor log segments found. Creating new log.
08:06:45.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.207317 31175 tablet_bootstrap.cc:492] T 1346ae47881b4c43b5c995d59d2a39a2 P 9b230140dcab4f58b02a0b1939e65a5d: Bootstrap starting.
08:06:45.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.216521 31175 tablet_bootstrap.cc:654] T 1346ae47881b4c43b5c995d59d2a39a2 P 9b230140dcab4f58b02a0b1939e65a5d: Neither blocks nor log segments found. Creating new log.
08:06:45.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.221328 31174 tablet_bootstrap.cc:492] T f0136ad45f0f476b999986635f720b8f P 4430d593fcee4c1fbd17a7aab7897238: No bootstrap required, opened a new log
08:06:45.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.221832 31174 ts_tablet_manager.cc:1403] T f0136ad45f0f476b999986635f720b8f P 4430d593fcee4c1fbd17a7aab7897238: Time spent bootstrapping tablet: real 0.038s	user 0.002s	sys 0.011s
08:06:45.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.224649 31174 raft_consensus.cc:359] T f0136ad45f0f476b999986635f720b8f P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.225363 31174 raft_consensus.cc:385] T f0136ad45f0f476b999986635f720b8f P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:45.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.225694 31174 raft_consensus.cc:740] T f0136ad45f0f476b999986635f720b8f P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4430d593fcee4c1fbd17a7aab7897238, State: Initialized, Role: FOLLOWER
08:06:45.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.226627 31174 consensus_queue.cc:260] T f0136ad45f0f476b999986635f720b8f P 4430d593fcee4c1fbd17a7aab7897238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.228742 31173 tablet_bootstrap.cc:492] T f0135c5dce09400d8d90b12906c890c0 P e83b8a545bd54af99acd623fd123912f: No bootstrap required, opened a new log
08:06:45.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.229463 31173 ts_tablet_manager.cc:1403] T f0135c5dce09400d8d90b12906c890c0 P e83b8a545bd54af99acd623fd123912f: Time spent bootstrapping tablet: real 0.060s	user 0.004s	sys 0.013s
08:06:45.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.232646 31173 raft_consensus.cc:359] T f0135c5dce09400d8d90b12906c890c0 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.233402 31173 raft_consensus.cc:385] T f0135c5dce09400d8d90b12906c890c0 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:45.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.233711 31173 raft_consensus.cc:740] T f0135c5dce09400d8d90b12906c890c0 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83b8a545bd54af99acd623fd123912f, State: Initialized, Role: FOLLOWER
08:06:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.239738 31174 ts_tablet_manager.cc:1434] T f0136ad45f0f476b999986635f720b8f P 4430d593fcee4c1fbd17a7aab7897238: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
08:06:45.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.243094 31173 consensus_queue.cc:260] T f0135c5dce09400d8d90b12906c890c0 P e83b8a545bd54af99acd623fd123912f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.252031 31173 ts_tablet_manager.cc:1434] T f0135c5dce09400d8d90b12906c890c0 P e83b8a545bd54af99acd623fd123912f: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
08:06:45.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.253142 31173 tablet_bootstrap.cc:492] T f4428ebcade5440ebc2d4803102193ed P e83b8a545bd54af99acd623fd123912f: Bootstrap starting.
08:06:45.258 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:45.258 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:45.258 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:45.259 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:45.259 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:45.259 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:45.259 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:45.260 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:45.260 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:45.260 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:45.261 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:45.261 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:45.261 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:45.261 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:45.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.261664 31174 tablet_bootstrap.cc:492] T 1346ae47881b4c43b5c995d59d2a39a2 P 4430d593fcee4c1fbd17a7aab7897238: Bootstrap starting.
08:06:45.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:45.264119 30020 tablet.cc:2404] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:06:45.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.269161 31174 tablet_bootstrap.cc:654] T 1346ae47881b4c43b5c995d59d2a39a2 P 4430d593fcee4c1fbd17a7aab7897238: Neither blocks nor log segments found. Creating new log.
08:06:45.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.273217 31175 tablet_bootstrap.cc:492] T 1346ae47881b4c43b5c995d59d2a39a2 P 9b230140dcab4f58b02a0b1939e65a5d: No bootstrap required, opened a new log
08:06:45.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.273825 31175 ts_tablet_manager.cc:1403] T 1346ae47881b4c43b5c995d59d2a39a2 P 9b230140dcab4f58b02a0b1939e65a5d: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.022s
08:06:45.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.276947 31175 raft_consensus.cc:359] T 1346ae47881b4c43b5c995d59d2a39a2 P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.277724 31175 raft_consensus.cc:385] T 1346ae47881b4c43b5c995d59d2a39a2 P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:45.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.278085 31175 raft_consensus.cc:740] T 1346ae47881b4c43b5c995d59d2a39a2 P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b230140dcab4f58b02a0b1939e65a5d, State: Initialized, Role: FOLLOWER
08:06:45.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.278822 31175 consensus_queue.cc:260] T 1346ae47881b4c43b5c995d59d2a39a2 P 9b230140dcab4f58b02a0b1939e65a5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.281240 31183 raft_consensus.cc:493] T f0136ad45f0f476b999986635f720b8f P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:06:45.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.282013 31174 tablet_bootstrap.cc:492] T 1346ae47881b4c43b5c995d59d2a39a2 P 4430d593fcee4c1fbd17a7aab7897238: No bootstrap required, opened a new log
08:06:45.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.281932 31183 raft_consensus.cc:515] T f0136ad45f0f476b999986635f720b8f P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.282500 31174 ts_tablet_manager.cc:1403] T 1346ae47881b4c43b5c995d59d2a39a2 P 4430d593fcee4c1fbd17a7aab7897238: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
08:06:45.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.283295 31181 raft_consensus.cc:493] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:06:45.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.283839 31181 raft_consensus.cc:515] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.288070 31183 leader_election.cc:290] T f0136ad45f0f476b999986635f720b8f P 4430d593fcee4c1fbd17a7aab7897238 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b230140dcab4f58b02a0b1939e65a5d (127.28.220.193:36711), e83b8a545bd54af99acd623fd123912f (127.28.220.194:39597)
08:06:45.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.288865 31183 raft_consensus.cc:493] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:06:45.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.289479 31183 raft_consensus.cc:515] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.292250 31183 leader_election.cc:290] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b230140dcab4f58b02a0b1939e65a5d (127.28.220.193:36711), e83b8a545bd54af99acd623fd123912f (127.28.220.194:39597)
08:06:45.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.297586 31181 leader_election.cc:290] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e83b8a545bd54af99acd623fd123912f (127.28.220.194:39597), 4430d593fcee4c1fbd17a7aab7897238 (127.28.220.195:37615)
08:06:45.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.300515 31175 ts_tablet_manager.cc:1434] T 1346ae47881b4c43b5c995d59d2a39a2 P 9b230140dcab4f58b02a0b1939e65a5d: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
08:06:45.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.306299 31179 raft_consensus.cc:493] T f0135c5dce09400d8d90b12906c890c0 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:06:45.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.306703 31175 tablet_bootstrap.cc:492] T f0136ad45f0f476b999986635f720b8f P 9b230140dcab4f58b02a0b1939e65a5d: Bootstrap starting.
08:06:45.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.307215 31179 raft_consensus.cc:515] T f0135c5dce09400d8d90b12906c890c0 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.316185 31179 leader_election.cc:290] T f0135c5dce09400d8d90b12906c890c0 P e83b8a545bd54af99acd623fd123912f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b230140dcab4f58b02a0b1939e65a5d (127.28.220.193:36711), 4430d593fcee4c1fbd17a7aab7897238 (127.28.220.195:37615)
08:06:45.320 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:45.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.325479 31175 tablet_bootstrap.cc:654] T f0136ad45f0f476b999986635f720b8f P 9b230140dcab4f58b02a0b1939e65a5d: Neither blocks nor log segments found. Creating new log.
08:06:45.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.326151 31138 heartbeater.cc:499] Master 127.29.158.188:39061 was elected leader, sending a full tablet report...
08:06:45.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.344213 31179 raft_consensus.cc:493] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:06:45.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.345225 31173 tablet_bootstrap.cc:654] T f4428ebcade5440ebc2d4803102193ed P e83b8a545bd54af99acd623fd123912f: Neither blocks nor log segments found. Creating new log.
08:06:45.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.346904 31175 tablet_bootstrap.cc:492] T f0136ad45f0f476b999986635f720b8f P 9b230140dcab4f58b02a0b1939e65a5d: No bootstrap required, opened a new log
08:06:45.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.347396 31175 ts_tablet_manager.cc:1403] T f0136ad45f0f476b999986635f720b8f P 9b230140dcab4f58b02a0b1939e65a5d: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.007s
08:06:45.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.344736 31179 raft_consensus.cc:515] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.350281 31179 leader_election.cc:290] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b230140dcab4f58b02a0b1939e65a5d (127.28.220.193:36711), 4430d593fcee4c1fbd17a7aab7897238 (127.28.220.195:37615)
08:06:45.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.354728 31175 raft_consensus.cc:359] T f0136ad45f0f476b999986635f720b8f P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.355525 31175 raft_consensus.cc:385] T f0136ad45f0f476b999986635f720b8f P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:45.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.355837 31175 raft_consensus.cc:740] T f0136ad45f0f476b999986635f720b8f P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b230140dcab4f58b02a0b1939e65a5d, State: Initialized, Role: FOLLOWER
08:06:45.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.356513 31175 consensus_queue.cc:260] T f0136ad45f0f476b999986635f720b8f P 9b230140dcab4f58b02a0b1939e65a5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.337139 31174 raft_consensus.cc:359] T 1346ae47881b4c43b5c995d59d2a39a2 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.360505 31174 raft_consensus.cc:385] T 1346ae47881b4c43b5c995d59d2a39a2 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:45.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.361208 31174 raft_consensus.cc:740] T 1346ae47881b4c43b5c995d59d2a39a2 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4430d593fcee4c1fbd17a7aab7897238, State: Initialized, Role: FOLLOWER
08:06:45.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.365008 31175 ts_tablet_manager.cc:1434] T f0136ad45f0f476b999986635f720b8f P 9b230140dcab4f58b02a0b1939e65a5d: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.004s
08:06:45.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.367481 31175 tablet_bootstrap.cc:492] T 7c05024562a74973892ab2f3098ce916 P 9b230140dcab4f58b02a0b1939e65a5d: Bootstrap starting.
08:06:45.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.362063 31174 consensus_queue.cc:260] T 1346ae47881b4c43b5c995d59d2a39a2 P 4430d593fcee4c1fbd17a7aab7897238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.376622 31174 ts_tablet_manager.cc:1434] T 1346ae47881b4c43b5c995d59d2a39a2 P 4430d593fcee4c1fbd17a7aab7897238: Time spent starting tablet: real 0.094s	user 0.006s	sys 0.000s
08:06:45.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.400259 31174 tablet_bootstrap.cc:492] T f0135c5dce09400d8d90b12906c890c0 P 4430d593fcee4c1fbd17a7aab7897238: Bootstrap starting.
08:06:45.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.408260 31173 tablet_bootstrap.cc:492] T f4428ebcade5440ebc2d4803102193ed P e83b8a545bd54af99acd623fd123912f: No bootstrap required, opened a new log
08:06:45.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.406272 31181 raft_consensus.cc:493] T f4428ebcade5440ebc2d4803102193ed P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:06:45.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.410701 31173 ts_tablet_manager.cc:1403] T f4428ebcade5440ebc2d4803102193ed P e83b8a545bd54af99acd623fd123912f: Time spent bootstrapping tablet: real 0.158s	user 0.014s	sys 0.002s
08:06:45.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.412835 31192 raft_consensus.cc:493] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:06:45.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.413434 31192 raft_consensus.cc:515] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } } peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } }
08:06:45.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.415823 31192 leader_election.cc:290] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b230140dcab4f58b02a0b1939e65a5d (127.28.220.193:36711), e83b8a545bd54af99acd623fd123912f (127.28.220.194:39597)
08:06:45.418 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:45.419 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:45.419 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:45.419 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:45.420 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:45.420 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:45.420 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:45.420 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:45.420 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:45.421 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:45.421 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:45.421 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:45.421 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:45.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.412073 31181 raft_consensus.cc:515] T f4428ebcade5440ebc2d4803102193ed P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.423059 31173 raft_consensus.cc:359] T f4428ebcade5440ebc2d4803102193ed P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.423918 31173 raft_consensus.cc:385] T f4428ebcade5440ebc2d4803102193ed P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:45.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.424738 31173 raft_consensus.cc:740] T f4428ebcade5440ebc2d4803102193ed P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83b8a545bd54af99acd623fd123912f, State: Initialized, Role: FOLLOWER
08:06:45.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.428381 31181 leader_election.cc:290] T f4428ebcade5440ebc2d4803102193ed P 9b230140dcab4f58b02a0b1939e65a5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e83b8a545bd54af99acd623fd123912f (127.28.220.194:39597), 4430d593fcee4c1fbd17a7aab7897238 (127.28.220.195:37615)
08:06:45.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.432138 31175 tablet_bootstrap.cc:654] T 7c05024562a74973892ab2f3098ce916 P 9b230140dcab4f58b02a0b1939e65a5d: Neither blocks nor log segments found. Creating new log.
08:06:45.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.425585 31173 consensus_queue.cc:260] T f4428ebcade5440ebc2d4803102193ed P e83b8a545bd54af99acd623fd123912f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.438607 31173 ts_tablet_manager.cc:1434] T f4428ebcade5440ebc2d4803102193ed P e83b8a545bd54af99acd623fd123912f: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
08:06:45.445 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:45.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.445729 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06031ec130d4dad9efb2794fadd2b04" candidate_uuid: "e83b8a545bd54af99acd623fd123912f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4430d593fcee4c1fbd17a7aab7897238" is_pre_election: true
08:06:45.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.446799 30274 raft_consensus.cc:2468] T b06031ec130d4dad9efb2794fadd2b04 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e83b8a545bd54af99acd623fd123912f in term 0.
08:06:45.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.448796 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0136ad45f0f476b999986635f720b8f" candidate_uuid: "4430d593fcee4c1fbd17a7aab7897238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b8a545bd54af99acd623fd123912f" is_pre_election: true
08:06:45.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.449476 30068 leader_election.cc:304] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4430d593fcee4c1fbd17a7aab7897238, e83b8a545bd54af99acd623fd123912f; no voters: 
08:06:45.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.449743 30135 raft_consensus.cc:2468] T f0136ad45f0f476b999986635f720b8f P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4430d593fcee4c1fbd17a7aab7897238 in term 0.
08:06:45.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.450654 31179 raft_consensus.cc:2804] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Leader pre-election won for term 1
08:06:45.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.451086 31179 raft_consensus.cc:493] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:06:45.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.451447 31179 raft_consensus.cc:3060] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Advancing to term 1
08:06:45.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.451542 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4428ebcade5440ebc2d4803102193ed" candidate_uuid: "4430d593fcee4c1fbd17a7aab7897238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b8a545bd54af99acd623fd123912f" is_pre_election: true
08:06:45.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.452399 30134 raft_consensus.cc:2468] T f4428ebcade5440ebc2d4803102193ed P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4430d593fcee4c1fbd17a7aab7897238 in term 0.
08:06:45.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.453764 30133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c05024562a74973892ab2f3098ce916" candidate_uuid: "4430d593fcee4c1fbd17a7aab7897238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b8a545bd54af99acd623fd123912f" is_pre_election: true
08:06:45.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.454509 30133 raft_consensus.cc:2468] T 7c05024562a74973892ab2f3098ce916 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4430d593fcee4c1fbd17a7aab7897238 in term 0.
08:06:45.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.461295 31174 tablet_bootstrap.cc:654] T f0135c5dce09400d8d90b12906c890c0 P 4430d593fcee4c1fbd17a7aab7897238: Neither blocks nor log segments found. Creating new log.
08:06:45.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.461695 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0135c5dce09400d8d90b12906c890c0" candidate_uuid: "e83b8a545bd54af99acd623fd123912f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4430d593fcee4c1fbd17a7aab7897238" is_pre_election: true
08:06:45.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.470927 30133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0135c5dce09400d8d90b12906c890c0" candidate_uuid: "9b230140dcab4f58b02a0b1939e65a5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b8a545bd54af99acd623fd123912f" is_pre_election: true
08:06:45.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.471812 30133 raft_consensus.cc:2468] T f0135c5dce09400d8d90b12906c890c0 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b230140dcab4f58b02a0b1939e65a5d in term 0.
08:06:45.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:45.473333 30068 leader_election.cc:343] T f0135c5dce09400d8d90b12906c890c0 P e83b8a545bd54af99acd623fd123912f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4430d593fcee4c1fbd17a7aab7897238 (127.28.220.195:37615): Illegal state: must be running to vote when last-logged opid is not known
08:06:45.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.474941 31179 raft_consensus.cc:515] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.478782 31179 leader_election.cc:290] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f [CANDIDATE]: Term 1 election: Requested vote from peers 9b230140dcab4f58b02a0b1939e65a5d (127.28.220.193:36711), 4430d593fcee4c1fbd17a7aab7897238 (127.28.220.195:37615)
08:06:45.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.483413 29970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0136ad45f0f476b999986635f720b8f" candidate_uuid: "4430d593fcee4c1fbd17a7aab7897238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b230140dcab4f58b02a0b1939e65a5d" is_pre_election: true
08:06:45.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.484251 29968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c05024562a74973892ab2f3098ce916" candidate_uuid: "4430d593fcee4c1fbd17a7aab7897238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b230140dcab4f58b02a0b1939e65a5d" is_pre_election: true
08:06:45.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.484501 29970 raft_consensus.cc:2468] T f0136ad45f0f476b999986635f720b8f P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4430d593fcee4c1fbd17a7aab7897238 in term 0.
08:06:45.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.491732 31179 raft_consensus.cc:493] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:06:45.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.491923 30133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4428ebcade5440ebc2d4803102193ed" candidate_uuid: "9b230140dcab4f58b02a0b1939e65a5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b8a545bd54af99acd623fd123912f" is_pre_election: true
08:06:45.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.492532 30133 raft_consensus.cc:2468] T f4428ebcade5440ebc2d4803102193ed P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b230140dcab4f58b02a0b1939e65a5d in term 0.
08:06:45.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.492291 31179 raft_consensus.cc:515] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.487149 29969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4428ebcade5440ebc2d4803102193ed" candidate_uuid: "4430d593fcee4c1fbd17a7aab7897238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b230140dcab4f58b02a0b1939e65a5d" is_pre_election: true
08:06:45.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.494328 31179 leader_election.cc:290] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b230140dcab4f58b02a0b1939e65a5d (127.28.220.193:36711), 4430d593fcee4c1fbd17a7aab7897238 (127.28.220.195:37615)
08:06:45.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.494059 29969 raft_consensus.cc:2468] T f4428ebcade5440ebc2d4803102193ed P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4430d593fcee4c1fbd17a7aab7897238 in term 0.
08:06:45.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.502239 29900 leader_election.cc:304] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b230140dcab4f58b02a0b1939e65a5d, e83b8a545bd54af99acd623fd123912f; no voters: 
08:06:45.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.503284 31181 raft_consensus.cc:2804] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Leader pre-election won for term 1
08:06:45.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.503695 31181 raft_consensus.cc:493] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:06:45.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.504065 31181 raft_consensus.cc:3060] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Advancing to term 1
08:06:45.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.503991 29900 leader_election.cc:304] T f4428ebcade5440ebc2d4803102193ed P 9b230140dcab4f58b02a0b1939e65a5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b230140dcab4f58b02a0b1939e65a5d, e83b8a545bd54af99acd623fd123912f; no voters: 
08:06:45.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.511246 30208 leader_election.cc:304] T f0136ad45f0f476b999986635f720b8f P 4430d593fcee4c1fbd17a7aab7897238 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4430d593fcee4c1fbd17a7aab7897238, e83b8a545bd54af99acd623fd123912f; no voters: 
08:06:45.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.515323 29967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1346ae47881b4c43b5c995d59d2a39a2" candidate_uuid: "e83b8a545bd54af99acd623fd123912f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b230140dcab4f58b02a0b1939e65a5d" is_pre_election: true
08:06:45.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.516157 29967 raft_consensus.cc:2468] T 1346ae47881b4c43b5c995d59d2a39a2 P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e83b8a545bd54af99acd623fd123912f in term 0.
08:06:45.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.516736 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0135c5dce09400d8d90b12906c890c0" candidate_uuid: "9b230140dcab4f58b02a0b1939e65a5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4430d593fcee4c1fbd17a7aab7897238" is_pre_election: true
08:06:45.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.517037 29969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0135c5dce09400d8d90b12906c890c0" candidate_uuid: "e83b8a545bd54af99acd623fd123912f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b230140dcab4f58b02a0b1939e65a5d" is_pre_election: true
08:06:45.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.517931 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4428ebcade5440ebc2d4803102193ed" candidate_uuid: "9b230140dcab4f58b02a0b1939e65a5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4430d593fcee4c1fbd17a7aab7897238" is_pre_election: true
08:06:45.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.518404 29970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06031ec130d4dad9efb2794fadd2b04" candidate_uuid: "e83b8a545bd54af99acd623fd123912f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b230140dcab4f58b02a0b1939e65a5d"
08:06:45.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.518536 30274 raft_consensus.cc:2468] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b230140dcab4f58b02a0b1939e65a5d in term 0.
08:06:45.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.515309 31192 raft_consensus.cc:2804] T f0136ad45f0f476b999986635f720b8f P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:06:45.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.514271 29968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06031ec130d4dad9efb2794fadd2b04" candidate_uuid: "e83b8a545bd54af99acd623fd123912f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b230140dcab4f58b02a0b1939e65a5d" is_pre_election: true
08:06:45.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.519438 31192 raft_consensus.cc:493] T f0136ad45f0f476b999986635f720b8f P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:06:45.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.519789 31192 raft_consensus.cc:3060] T f0136ad45f0f476b999986635f720b8f P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Advancing to term 1
08:06:45.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:45.522850 29901 leader_election.cc:343] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4430d593fcee4c1fbd17a7aab7897238 (127.28.220.195:37615): Illegal state: must be running to vote when last-logged opid is not known
08:06:45.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:45.529275 30210 leader_election.cc:343] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b230140dcab4f58b02a0b1939e65a5d (127.28.220.193:36711): Illegal state: must be running to vote when last-logged opid is not known
08:06:45.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.527823 30069 leader_election.cc:304] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b230140dcab4f58b02a0b1939e65a5d, e83b8a545bd54af99acd623fd123912f; no voters: 
08:06:45.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.530237 30208 leader_election.cc:304] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4430d593fcee4c1fbd17a7aab7897238, e83b8a545bd54af99acd623fd123912f; no voters: 
08:06:45.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.531114 30208 leader_election.cc:304] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4430d593fcee4c1fbd17a7aab7897238, e83b8a545bd54af99acd623fd123912f; no voters: 9b230140dcab4f58b02a0b1939e65a5d
08:06:45.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.531895 31183 raft_consensus.cc:2804] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:06:45.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.532217 31183 raft_consensus.cc:493] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:06:45.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.532495 31183 raft_consensus.cc:3060] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Advancing to term 1
08:06:45.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.534780 31179 raft_consensus.cc:2804] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Leader pre-election won for term 1
08:06:45.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.535192 31179 raft_consensus.cc:493] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:06:45.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.535539 31179 raft_consensus.cc:3060] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Advancing to term 1
08:06:45.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.525400 31181 raft_consensus.cc:515] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.540913 29969 raft_consensus.cc:2393] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e83b8a545bd54af99acd623fd123912f in current term 1: Already voted for candidate 9b230140dcab4f58b02a0b1939e65a5d in this term.
08:06:45.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.544320 31181 leader_election.cc:290] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d [CANDIDATE]: Term 1 election: Requested vote from peers e83b8a545bd54af99acd623fd123912f (127.28.220.194:39597), 4430d593fcee4c1fbd17a7aab7897238 (127.28.220.195:37615)
08:06:45.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.545042 31181 raft_consensus.cc:2804] T f4428ebcade5440ebc2d4803102193ed P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Leader pre-election won for term 1
08:06:45.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.545377 31181 raft_consensus.cc:493] T f4428ebcade5440ebc2d4803102193ed P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:06:45.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.545693 31181 raft_consensus.cc:3060] T f4428ebcade5440ebc2d4803102193ed P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Advancing to term 1
08:06:45.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.545914 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0135c5dce09400d8d90b12906c890c0" candidate_uuid: "9b230140dcab4f58b02a0b1939e65a5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4430d593fcee4c1fbd17a7aab7897238"
08:06:45.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:45.546203 30069 leader_election.cc:343] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b230140dcab4f58b02a0b1939e65a5d (127.28.220.193:36711): Illegal state: must be running to vote when last-logged opid is not known
08:06:45.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.545507 31179 raft_consensus.cc:515] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:45.547423 29901 leader_election.cc:343] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4430d593fcee4c1fbd17a7aab7897238 (127.28.220.195:37615): Illegal state: must be running to vote when last-logged opid is not known
08:06:45.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:45.548141 30069 leader_election.cc:343] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b230140dcab4f58b02a0b1939e65a5d (127.28.220.193:36711): Illegal state: must be running to vote when last-logged opid is not known
08:06:45.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.549942 31179 leader_election.cc:290] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f [CANDIDATE]: Term 1 election: Requested vote from peers 9b230140dcab4f58b02a0b1939e65a5d (127.28.220.193:36711), 4430d593fcee4c1fbd17a7aab7897238 (127.28.220.195:37615)
08:06:45.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.554785 31183 raft_consensus.cc:515] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.556530 31175 tablet_bootstrap.cc:492] T 7c05024562a74973892ab2f3098ce916 P 9b230140dcab4f58b02a0b1939e65a5d: No bootstrap required, opened a new log
08:06:45.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.566412 29969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4428ebcade5440ebc2d4803102193ed" candidate_uuid: "4430d593fcee4c1fbd17a7aab7897238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b230140dcab4f58b02a0b1939e65a5d"
08:06:45.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.556104 31192 raft_consensus.cc:515] T f0136ad45f0f476b999986635f720b8f P 4430d593fcee4c1fbd17a7aab7897238 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.562544 31174 tablet_bootstrap.cc:492] T f0135c5dce09400d8d90b12906c890c0 P 4430d593fcee4c1fbd17a7aab7897238: No bootstrap required, opened a new log
08:06:45.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.570029 29968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0136ad45f0f476b999986635f720b8f" candidate_uuid: "4430d593fcee4c1fbd17a7aab7897238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b230140dcab4f58b02a0b1939e65a5d"
08:06:45.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.570251 31174 ts_tablet_manager.cc:1403] T f0135c5dce09400d8d90b12906c890c0 P 4430d593fcee4c1fbd17a7aab7897238: Time spent bootstrapping tablet: real 0.170s	user 0.014s	sys 0.001s
08:06:45.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.570595 29968 raft_consensus.cc:3060] T f0136ad45f0f476b999986635f720b8f P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Advancing to term 1
08:06:45.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.572434 31183 leader_election.cc:290] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238 [CANDIDATE]: Term 1 election: Requested vote from peers 9b230140dcab4f58b02a0b1939e65a5d (127.28.220.193:36711), e83b8a545bd54af99acd623fd123912f (127.28.220.194:39597)
08:06:45.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.571806 31181 raft_consensus.cc:515] T f4428ebcade5440ebc2d4803102193ed P 9b230140dcab4f58b02a0b1939e65a5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.573681 29969 raft_consensus.cc:2393] T f4428ebcade5440ebc2d4803102193ed P 9b230140dcab4f58b02a0b1939e65a5d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4430d593fcee4c1fbd17a7aab7897238 in current term 1: Already voted for candidate 9b230140dcab4f58b02a0b1939e65a5d in this term.
08:06:45.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.550412 30069 leader_election.cc:304] T f0135c5dce09400d8d90b12906c890c0 P e83b8a545bd54af99acd623fd123912f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e83b8a545bd54af99acd623fd123912f; no voters: 4430d593fcee4c1fbd17a7aab7897238, 9b230140dcab4f58b02a0b1939e65a5d
08:06:45.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.576885 29969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1346ae47881b4c43b5c995d59d2a39a2" candidate_uuid: "e83b8a545bd54af99acd623fd123912f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b230140dcab4f58b02a0b1939e65a5d"
08:06:45.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.577466 29969 raft_consensus.cc:3060] T 1346ae47881b4c43b5c995d59d2a39a2 P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Advancing to term 1
08:06:45.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.577387 31179 raft_consensus.cc:3060] T f0135c5dce09400d8d90b12906c890c0 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Advancing to term 1
08:06:45.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.559034 31175 ts_tablet_manager.cc:1403] T 7c05024562a74973892ab2f3098ce916 P 9b230140dcab4f58b02a0b1939e65a5d: Time spent bootstrapping tablet: real 0.192s	user 0.020s	sys 0.016s
08:06:45.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.580544 31181 leader_election.cc:290] T f4428ebcade5440ebc2d4803102193ed P 9b230140dcab4f58b02a0b1939e65a5d [CANDIDATE]: Term 1 election: Requested vote from peers e83b8a545bd54af99acd623fd123912f (127.28.220.194:39597), 4430d593fcee4c1fbd17a7aab7897238 (127.28.220.195:37615)
08:06:45.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.584535 29968 raft_consensus.cc:2468] T f0136ad45f0f476b999986635f720b8f P 9b230140dcab4f58b02a0b1939e65a5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4430d593fcee4c1fbd17a7aab7897238 in term 1.
08:06:45.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.587762 30210 leader_election.cc:304] T f0136ad45f0f476b999986635f720b8f P 4430d593fcee4c1fbd17a7aab7897238 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4430d593fcee4c1fbd17a7aab7897238, 9b230140dcab4f58b02a0b1939e65a5d; no voters: 
08:06:45.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.590159 29969 raft_consensus.cc:2468] T 1346ae47881b4c43b5c995d59d2a39a2 P 9b230140dcab4f58b02a0b1939e65a5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83b8a545bd54af99acd623fd123912f in term 1.
08:06:45.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.591782 31192 leader_election.cc:290] T f0136ad45f0f476b999986635f720b8f P 4430d593fcee4c1fbd17a7aab7897238 [CANDIDATE]: Term 1 election: Requested vote from peers 9b230140dcab4f58b02a0b1939e65a5d (127.28.220.193:36711), e83b8a545bd54af99acd623fd123912f (127.28.220.194:39597)
08:06:45.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.596259 30069 leader_election.cc:304] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b230140dcab4f58b02a0b1939e65a5d, e83b8a545bd54af99acd623fd123912f; no voters: 
08:06:45.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:45.563859 29900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.220.194:39597, user_credentials={real_user=slave}} blocked reactor thread for 59961.6us
08:06:45.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.595337 31175 raft_consensus.cc:359] T 7c05024562a74973892ab2f3098ce916 P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } } peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } }
08:06:45.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.572999 31183 raft_consensus.cc:2804] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:06:45.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:45.600670 30208 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.220.194:39597, user_credentials={real_user=slave}} blocked reactor thread for 69611.5us
08:06:45.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.600440 31175 raft_consensus.cc:385] T 7c05024562a74973892ab2f3098ce916 P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:45.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.603762 31175 raft_consensus.cc:740] T 7c05024562a74973892ab2f3098ce916 P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b230140dcab4f58b02a0b1939e65a5d, State: Initialized, Role: FOLLOWER
08:06:45.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.604879 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06031ec130d4dad9efb2794fadd2b04" candidate_uuid: "e83b8a545bd54af99acd623fd123912f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4430d593fcee4c1fbd17a7aab7897238"
08:06:45.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.605723 30274 raft_consensus.cc:3060] T b06031ec130d4dad9efb2794fadd2b04 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Advancing to term 1
08:06:45.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.609723 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1346ae47881b4c43b5c995d59d2a39a2" candidate_uuid: "e83b8a545bd54af99acd623fd123912f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4430d593fcee4c1fbd17a7aab7897238" is_pre_election: true
08:06:45.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.600095 31192 raft_consensus.cc:493] T 1346ae47881b4c43b5c995d59d2a39a2 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:06:45.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.612059 31192 raft_consensus.cc:515] T 1346ae47881b4c43b5c995d59d2a39a2 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.613024 30275 raft_consensus.cc:2468] T 1346ae47881b4c43b5c995d59d2a39a2 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e83b8a545bd54af99acd623fd123912f in term 0.
08:06:45.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.599535 31183 raft_consensus.cc:493] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:06:45.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.615864 31183 raft_consensus.cc:3060] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Advancing to term 1
08:06:45.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.613495 31175 consensus_queue.cc:260] T 7c05024562a74973892ab2f3098ce916 P 9b230140dcab4f58b02a0b1939e65a5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } } peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } }
08:06:45.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.618631 31212 raft_consensus.cc:2804] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f [term 1 FOLLOWER]: Leader election won for term 1
08:06:45.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.621647 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4428ebcade5440ebc2d4803102193ed" candidate_uuid: "9b230140dcab4f58b02a0b1939e65a5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4430d593fcee4c1fbd17a7aab7897238"
08:06:45.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.623461 30275 raft_consensus.cc:2393] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b230140dcab4f58b02a0b1939e65a5d in current term 1: Already voted for candidate 4430d593fcee4c1fbd17a7aab7897238 in this term.
08:06:45.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.611606 30273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1346ae47881b4c43b5c995d59d2a39a2" candidate_uuid: "e83b8a545bd54af99acd623fd123912f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4430d593fcee4c1fbd17a7aab7897238"
08:06:45.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.626669 30273 raft_consensus.cc:3060] T 1346ae47881b4c43b5c995d59d2a39a2 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Advancing to term 1
08:06:45.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.594502 31174 raft_consensus.cc:359] T f0135c5dce09400d8d90b12906c890c0 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.638103 31174 raft_consensus.cc:385] T f0135c5dce09400d8d90b12906c890c0 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:45.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.619522 30133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4428ebcade5440ebc2d4803102193ed" candidate_uuid: "4430d593fcee4c1fbd17a7aab7897238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b8a545bd54af99acd623fd123912f"
08:06:45.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.640245 30133 raft_consensus.cc:3060] T f4428ebcade5440ebc2d4803102193ed P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Advancing to term 1
08:06:45.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.642735 31192 leader_election.cc:290] T 1346ae47881b4c43b5c995d59d2a39a2 P 4430d593fcee4c1fbd17a7aab7897238 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b230140dcab4f58b02a0b1939e65a5d (127.28.220.193:36711), e83b8a545bd54af99acd623fd123912f (127.28.220.194:39597)
08:06:45.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.620918 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0136ad45f0f476b999986635f720b8f" candidate_uuid: "4430d593fcee4c1fbd17a7aab7897238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b8a545bd54af99acd623fd123912f"
08:06:45.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.643508 30134 raft_consensus.cc:3060] T f0136ad45f0f476b999986635f720b8f P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Advancing to term 1
08:06:45.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.643700 29968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1346ae47881b4c43b5c995d59d2a39a2" candidate_uuid: "4430d593fcee4c1fbd17a7aab7897238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b230140dcab4f58b02a0b1939e65a5d" is_pre_election: true
08:06:45.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.644558 29968 raft_consensus.cc:2393] T 1346ae47881b4c43b5c995d59d2a39a2 P 9b230140dcab4f58b02a0b1939e65a5d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4430d593fcee4c1fbd17a7aab7897238 in current term 1: Already voted for candidate e83b8a545bd54af99acd623fd123912f in this term.
08:06:45.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.644902 30131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1346ae47881b4c43b5c995d59d2a39a2" candidate_uuid: "4430d593fcee4c1fbd17a7aab7897238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b8a545bd54af99acd623fd123912f" is_pre_election: true
08:06:45.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.622071 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0135c5dce09400d8d90b12906c890c0" candidate_uuid: "9b230140dcab4f58b02a0b1939e65a5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b8a545bd54af99acd623fd123912f"
08:06:45.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.623335 30132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4428ebcade5440ebc2d4803102193ed" candidate_uuid: "9b230140dcab4f58b02a0b1939e65a5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b8a545bd54af99acd623fd123912f"
08:06:45.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.647744 29900 leader_election.cc:304] T f4428ebcade5440ebc2d4803102193ed P 9b230140dcab4f58b02a0b1939e65a5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b230140dcab4f58b02a0b1939e65a5d; no voters: 4430d593fcee4c1fbd17a7aab7897238, e83b8a545bd54af99acd623fd123912f
08:06:45.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.649334 31181 raft_consensus.cc:2749] T f4428ebcade5440ebc2d4803102193ed P 9b230140dcab4f58b02a0b1939e65a5d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
08:06:45.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.653964 30134 raft_consensus.cc:2468] T f0136ad45f0f476b999986635f720b8f P e83b8a545bd54af99acd623fd123912f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4430d593fcee4c1fbd17a7aab7897238 in term 1.
08:06:45.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.656852 30133 raft_consensus.cc:2468] T f4428ebcade5440ebc2d4803102193ed P e83b8a545bd54af99acd623fd123912f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4430d593fcee4c1fbd17a7aab7897238 in term 1.
08:06:45.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.660508 30208 leader_election.cc:304] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4430d593fcee4c1fbd17a7aab7897238, e83b8a545bd54af99acd623fd123912f; no voters: 9b230140dcab4f58b02a0b1939e65a5d
08:06:45.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.661322 31192 raft_consensus.cc:2804] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238 [term 1 FOLLOWER]: Leader election won for term 1
08:06:45.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.638603 31174 raft_consensus.cc:740] T f0135c5dce09400d8d90b12906c890c0 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4430d593fcee4c1fbd17a7aab7897238, State: Initialized, Role: FOLLOWER
08:06:45.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.662858 31174 consensus_queue.cc:260] T f0135c5dce09400d8d90b12906c890c0 P 4430d593fcee4c1fbd17a7aab7897238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.664371 31192 raft_consensus.cc:697] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238 [term 1 LEADER]: Becoming Leader. State: Replica: 4430d593fcee4c1fbd17a7aab7897238, State: Running, Role: LEADER
08:06:45.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.665258 31174 ts_tablet_manager.cc:1434] T f0135c5dce09400d8d90b12906c890c0 P 4430d593fcee4c1fbd17a7aab7897238: Time spent starting tablet: real 0.095s	user 0.006s	sys 0.000s
08:06:45.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.666277 31192 consensus_queue.cc:237] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.672308 31175 ts_tablet_manager.cc:1434] T 7c05024562a74973892ab2f3098ce916 P 9b230140dcab4f58b02a0b1939e65a5d: Time spent starting tablet: real 0.093s	user 0.003s	sys 0.005s
08:06:45.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.674716 31183 raft_consensus.cc:515] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } } peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } }
08:06:45.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.621582 31179 raft_consensus.cc:2749] T f0135c5dce09400d8d90b12906c890c0 P e83b8a545bd54af99acd623fd123912f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
08:06:45.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.682835 30273 raft_consensus.cc:2468] T 1346ae47881b4c43b5c995d59d2a39a2 P 4430d593fcee4c1fbd17a7aab7897238 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83b8a545bd54af99acd623fd123912f in term 1.
08:06:45.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.691208 30135 raft_consensus.cc:2468] T f0135c5dce09400d8d90b12906c890c0 P e83b8a545bd54af99acd623fd123912f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b230140dcab4f58b02a0b1939e65a5d in term 1.
08:06:45.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.692085 29968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c05024562a74973892ab2f3098ce916" candidate_uuid: "4430d593fcee4c1fbd17a7aab7897238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b230140dcab4f58b02a0b1939e65a5d"
08:06:45.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.601641 31210 raft_consensus.cc:2804] T f0136ad45f0f476b999986635f720b8f P 4430d593fcee4c1fbd17a7aab7897238 [term 1 FOLLOWER]: Leader election won for term 1
08:06:45.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.692735 29968 raft_consensus.cc:3060] T 7c05024562a74973892ab2f3098ce916 P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Advancing to term 1
08:06:45.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.693142 31210 raft_consensus.cc:697] T f0136ad45f0f476b999986635f720b8f P 4430d593fcee4c1fbd17a7aab7897238 [term 1 LEADER]: Becoming Leader. State: Replica: 4430d593fcee4c1fbd17a7aab7897238, State: Running, Role: LEADER
08:06:45.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.694154 31210 consensus_queue.cc:237] T f0136ad45f0f476b999986635f720b8f P 4430d593fcee4c1fbd17a7aab7897238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.686923 30274 raft_consensus.cc:2468] T b06031ec130d4dad9efb2794fadd2b04 P 4430d593fcee4c1fbd17a7aab7897238 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83b8a545bd54af99acd623fd123912f in term 1.
08:06:45.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.696092 29900 leader_election.cc:304] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9b230140dcab4f58b02a0b1939e65a5d, e83b8a545bd54af99acd623fd123912f; no voters: 4430d593fcee4c1fbd17a7aab7897238
08:06:45.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.696961 30068 leader_election.cc:304] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4430d593fcee4c1fbd17a7aab7897238, e83b8a545bd54af99acd623fd123912f; no voters: 9b230140dcab4f58b02a0b1939e65a5d
08:06:45.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.697398 31181 raft_consensus.cc:2804] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d [term 1 FOLLOWER]: Leader election won for term 1
08:06:45.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.697901 31181 raft_consensus.cc:697] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d [term 1 LEADER]: Becoming Leader. State: Replica: 9b230140dcab4f58b02a0b1939e65a5d, State: Running, Role: LEADER
08:06:45.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.698760 31213 raft_consensus.cc:2804] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f [term 1 FOLLOWER]: Leader election won for term 1
08:06:45.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.699111 31181 consensus_queue.cc:237] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.705538 29968 raft_consensus.cc:2468] T 7c05024562a74973892ab2f3098ce916 P 9b230140dcab4f58b02a0b1939e65a5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4430d593fcee4c1fbd17a7aab7897238 in term 1.
08:06:45.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.696982 30133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c05024562a74973892ab2f3098ce916" candidate_uuid: "4430d593fcee4c1fbd17a7aab7897238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b8a545bd54af99acd623fd123912f"
08:06:45.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.706792 30133 raft_consensus.cc:3060] T 7c05024562a74973892ab2f3098ce916 P e83b8a545bd54af99acd623fd123912f [term 0 FOLLOWER]: Advancing to term 1
08:06:45.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.709134 31212 raft_consensus.cc:697] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f [term 1 LEADER]: Becoming Leader. State: Replica: e83b8a545bd54af99acd623fd123912f, State: Running, Role: LEADER
08:06:45.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.709203 30210 leader_election.cc:304] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4430d593fcee4c1fbd17a7aab7897238, 9b230140dcab4f58b02a0b1939e65a5d; no voters: 
08:06:45.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.710322 31211 raft_consensus.cc:2804] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238 [term 1 FOLLOWER]: Leader election won for term 1
08:06:45.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.710744 31183 leader_election.cc:290] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238 [CANDIDATE]: Term 1 election: Requested vote from peers 9b230140dcab4f58b02a0b1939e65a5d (127.28.220.193:36711), e83b8a545bd54af99acd623fd123912f (127.28.220.194:39597)
08:06:45.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.710415 31212 consensus_queue.cc:237] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.712504 31175 tablet_bootstrap.cc:492] T b06031ec130d4dad9efb2794fadd2b04 P 9b230140dcab4f58b02a0b1939e65a5d: Bootstrap starting.
08:06:45.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.716616 31213 raft_consensus.cc:697] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f [term 1 LEADER]: Becoming Leader. State: Replica: e83b8a545bd54af99acd623fd123912f, State: Running, Role: LEADER
08:06:45.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.717527 31213 consensus_queue.cc:237] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.718590 31211 raft_consensus.cc:697] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238 [term 1 LEADER]: Becoming Leader. State: Replica: 4430d593fcee4c1fbd17a7aab7897238, State: Running, Role: LEADER
08:06:45.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.719664 31211 consensus_queue.cc:237] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } } peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } }
08:06:45.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.745245 30133 raft_consensus.cc:2468] T 7c05024562a74973892ab2f3098ce916 P e83b8a545bd54af99acd623fd123912f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4430d593fcee4c1fbd17a7aab7897238 in term 1.
08:06:45.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.751708 29757 catalog_manager.cc:5696] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b230140dcab4f58b02a0b1939e65a5d (127.28.220.193). New cstate: current_term: 1 leader_uuid: "9b230140dcab4f58b02a0b1939e65a5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } health_report { overall_health: UNKNOWN } } }
08:06:45.758 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:45.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.806357 29756 catalog_manager.cc:5696] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4430d593fcee4c1fbd17a7aab7897238 (127.28.220.195). New cstate: current_term: 1 leader_uuid: "4430d593fcee4c1fbd17a7aab7897238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } health_report { overall_health: HEALTHY } } }
08:06:45.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:45.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.834174 31192 raft_consensus.cc:493] T f0135c5dce09400d8d90b12906c890c0 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:06:45.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.835000 31192 raft_consensus.cc:515] T f0135c5dce09400d8d90b12906c890c0 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.838306 29968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0135c5dce09400d8d90b12906c890c0" candidate_uuid: "4430d593fcee4c1fbd17a7aab7897238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b230140dcab4f58b02a0b1939e65a5d" is_pre_election: true
08:06:45.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.842187 31192 leader_election.cc:290] T f0135c5dce09400d8d90b12906c890c0 P 4430d593fcee4c1fbd17a7aab7897238 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b230140dcab4f58b02a0b1939e65a5d (127.28.220.193:36711), e83b8a545bd54af99acd623fd123912f (127.28.220.194:39597)
08:06:45.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.842869 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0135c5dce09400d8d90b12906c890c0" candidate_uuid: "4430d593fcee4c1fbd17a7aab7897238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b8a545bd54af99acd623fd123912f" is_pre_election: true
08:06:45.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.843992 30135 raft_consensus.cc:2393] T f0135c5dce09400d8d90b12906c890c0 P e83b8a545bd54af99acd623fd123912f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4430d593fcee4c1fbd17a7aab7897238 in current term 1: Already voted for candidate 9b230140dcab4f58b02a0b1939e65a5d in this term.
08:06:45.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.845934 30208 leader_election.cc:304] T f0135c5dce09400d8d90b12906c890c0 P 4430d593fcee4c1fbd17a7aab7897238 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4430d593fcee4c1fbd17a7aab7897238; no voters: 9b230140dcab4f58b02a0b1939e65a5d, e83b8a545bd54af99acd623fd123912f
08:06:45.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.847175 31210 raft_consensus.cc:3060] T f0135c5dce09400d8d90b12906c890c0 P 4430d593fcee4c1fbd17a7aab7897238 [term 0 FOLLOWER]: Advancing to term 1
08:06:45.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.855553 31210 raft_consensus.cc:2749] T f0135c5dce09400d8d90b12906c890c0 P 4430d593fcee4c1fbd17a7aab7897238 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
08:06:45.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.862164 31175 tablet_bootstrap.cc:654] T b06031ec130d4dad9efb2794fadd2b04 P 9b230140dcab4f58b02a0b1939e65a5d: Neither blocks nor log segments found. Creating new log.
08:06:45.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.877103 30208 leader_election.cc:304] T 1346ae47881b4c43b5c995d59d2a39a2 P 4430d593fcee4c1fbd17a7aab7897238 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4430d593fcee4c1fbd17a7aab7897238; no voters: 9b230140dcab4f58b02a0b1939e65a5d, e83b8a545bd54af99acd623fd123912f
08:06:45.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.878871 31211 raft_consensus.cc:2749] T 1346ae47881b4c43b5c995d59d2a39a2 P 4430d593fcee4c1fbd17a7aab7897238 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
08:06:45.887 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:45.887 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:45.887 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:45.888 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:45.888 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:45.888 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:45.888 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:45.888 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:45.889 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:45.893 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:45.893 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:45.893 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:45.893 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:45.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.897782 29757 catalog_manager.cc:5696] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f reported cstate change: term changed from 0 to 1, leader changed from <none> to e83b8a545bd54af99acd623fd123912f (127.28.220.194). New cstate: current_term: 1 leader_uuid: "e83b8a545bd54af99acd623fd123912f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } health_report { overall_health: UNKNOWN } } }
08:06:45.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.904662 29756 catalog_manager.cc:5696] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4430d593fcee4c1fbd17a7aab7897238 (127.28.220.195). New cstate: current_term: 1 leader_uuid: "4430d593fcee4c1fbd17a7aab7897238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } health_report { overall_health: UNKNOWN } } }
08:06:45.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.906985 29756 catalog_manager.cc:5696] T f0136ad45f0f476b999986635f720b8f P 4430d593fcee4c1fbd17a7aab7897238 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4430d593fcee4c1fbd17a7aab7897238 (127.28.220.195). New cstate: current_term: 1 leader_uuid: "4430d593fcee4c1fbd17a7aab7897238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } health_report { overall_health: HEALTHY } } }
08:06:45.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.945524 31175 tablet_bootstrap.cc:492] T b06031ec130d4dad9efb2794fadd2b04 P 9b230140dcab4f58b02a0b1939e65a5d: No bootstrap required, opened a new log
08:06:45.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.946096 31175 ts_tablet_manager.cc:1403] T b06031ec130d4dad9efb2794fadd2b04 P 9b230140dcab4f58b02a0b1939e65a5d: Time spent bootstrapping tablet: real 0.248s	user 0.009s	sys 0.007s
08:06:45.947 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:45.948 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:45.949 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:45.949 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:45.950 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:45.950 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:45.950 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:45.954 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:45.954 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:45.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.953677 31175 raft_consensus.cc:359] T b06031ec130d4dad9efb2794fadd2b04 P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.954 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:45.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.954471 31175 raft_consensus.cc:385] T b06031ec130d4dad9efb2794fadd2b04 P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:45.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.954766 31175 raft_consensus.cc:740] T b06031ec130d4dad9efb2794fadd2b04 P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b230140dcab4f58b02a0b1939e65a5d, State: Initialized, Role: FOLLOWER
08:06:45.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.955518 31175 consensus_queue.cc:260] T b06031ec130d4dad9efb2794fadd2b04 P 9b230140dcab4f58b02a0b1939e65a5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:45.957 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:45.957 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:45.958 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:45.958 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:45.958 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:45.958 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:45.958 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:45.959 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:45.959 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:45.959 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:45.959 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:45.959 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:45.959 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:45.959 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:45.959 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:45.960 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:45.960 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:45.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.975996 29757 catalog_manager.cc:5696] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f reported cstate change: term changed from 0 to 1, leader changed from <none> to e83b8a545bd54af99acd623fd123912f (127.28.220.194). New cstate: current_term: 1 leader_uuid: "e83b8a545bd54af99acd623fd123912f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } health_report { overall_health: UNKNOWN } } }
08:06:45.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:45.987058 31175 ts_tablet_manager.cc:1434] T b06031ec130d4dad9efb2794fadd2b04 P 9b230140dcab4f58b02a0b1939e65a5d: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.003s
08:06:46.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:46.096482 31181 consensus_queue.cc:1048] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:06:46.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:46.126803 31211 consensus_queue.cc:1048] T f0136ad45f0f476b999986635f720b8f P 4430d593fcee4c1fbd17a7aab7897238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:06:46.189 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:46.189 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:46.190 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:46.190 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:46.190 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:46.190 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:46.191 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:46.191 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:46.191 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:46.191 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:46.192 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:46.192 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:46.192 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:46.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:46.196055 31211 consensus_queue.cc:1048] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:06:46.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:46.223094 31181 consensus_queue.cc:1048] T f0135c5dce09400d8d90b12906c890c0 P 9b230140dcab4f58b02a0b1939e65a5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:06:46.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:46.235672 31211 consensus_queue.cc:1048] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:06:46.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:46.243613 31181 raft_consensus.cc:493] T b06031ec130d4dad9efb2794fadd2b04 P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:06:46.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:46.244151 31211 consensus_queue.cc:1048] T f4428ebcade5440ebc2d4803102193ed P 4430d593fcee4c1fbd17a7aab7897238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:06:46.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:46.244184 31181 raft_consensus.cc:515] T b06031ec130d4dad9efb2794fadd2b04 P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 } } peers { permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 } } peers { permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 } }
08:06:46.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:46.246632 31212 consensus_queue.cc:1048] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:06:46.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:46.248301 31212 consensus_queue.cc:1048] T 1346ae47881b4c43b5c995d59d2a39a2 P e83b8a545bd54af99acd623fd123912f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:06:46.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:46.255095 31181 leader_election.cc:290] T b06031ec130d4dad9efb2794fadd2b04 P 9b230140dcab4f58b02a0b1939e65a5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e83b8a545bd54af99acd623fd123912f (127.28.220.194:39597), 4430d593fcee4c1fbd17a7aab7897238 (127.28.220.195:37615)
08:06:46.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:46.256431 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06031ec130d4dad9efb2794fadd2b04" candidate_uuid: "9b230140dcab4f58b02a0b1939e65a5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4430d593fcee4c1fbd17a7aab7897238" is_pre_election: true
08:06:46.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:46.257301 30275 raft_consensus.cc:2393] T b06031ec130d4dad9efb2794fadd2b04 P 4430d593fcee4c1fbd17a7aab7897238 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b230140dcab4f58b02a0b1939e65a5d in current term 1: Already voted for candidate e83b8a545bd54af99acd623fd123912f in this term.
08:06:46.258 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:46.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:46.270570 31211 consensus_queue.cc:1048] T f0136ad45f0f476b999986635f720b8f P 4430d593fcee4c1fbd17a7aab7897238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:06:46.294 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:46.294 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:46.294 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:46.295 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:46.296 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:46.296 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:46.296 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:46.296 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:46.297 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:46.298 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:46.298 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:46.298 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:46.298 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:46.324 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:46.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:46.383663 31251 consensus_queue.cc:1048] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4430d593fcee4c1fbd17a7aab7897238" member_type: VOTER last_known_addr { host: "127.28.220.195" port: 37615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:06:46.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:46.410249 30069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.220.193:36711, user_credentials={real_user=slave}} blocked reactor thread for 163881us
08:06:46.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:46.416364 29970 raft_consensus.cc:3060] T b06031ec130d4dad9efb2794fadd2b04 P 9b230140dcab4f58b02a0b1939e65a5d [term 0 FOLLOWER]: Advancing to term 1
08:06:46.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:46.417045 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06031ec130d4dad9efb2794fadd2b04" candidate_uuid: "9b230140dcab4f58b02a0b1939e65a5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b8a545bd54af99acd623fd123912f" is_pre_election: true
08:06:46.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:46.432672 29900 leader_election.cc:304] T b06031ec130d4dad9efb2794fadd2b04 P 9b230140dcab4f58b02a0b1939e65a5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b230140dcab4f58b02a0b1939e65a5d; no voters: 4430d593fcee4c1fbd17a7aab7897238, e83b8a545bd54af99acd623fd123912f
08:06:46.439 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8c252bac8ed749d288b155a27fae1849
08:06:46.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:46.443084 31253 consensus_queue.cc:1048] T 7c05024562a74973892ab2f3098ce916 P 4430d593fcee4c1fbd17a7aab7897238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83b8a545bd54af99acd623fd123912f" member_type: VOTER last_known_addr { host: "127.28.220.194" port: 39597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:06:46.447 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:46.462 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 7c05024562a74973892ab2f3098ce916 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
08:06:46.462 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b06031ec130d4dad9efb2794fadd2b04 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
08:06:46.462 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f0136ad45f0f476b999986635f720b8f for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
08:06:46.462 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 1346ae47881b4c43b5c995d59d2a39a2 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
08:06:46.462 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f0135c5dce09400d8d90b12906c890c0 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
08:06:46.462 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f4428ebcade5440ebc2d4803102193ed for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
08:06:46.463 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=7c05024562a74973892ab2f3098ce916@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=b06031ec130d4dad9efb2794fadd2b04@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=f0136ad45f0f476b999986635f720b8f@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=1346ae47881b4c43b5c995d59d2a39a2@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=f0135c5dce09400d8d90b12906c890c0@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711)[L],e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=f4428ebcade5440ebc2d4803102193ed@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
08:06:46.463 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=23), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.220.252:33543, [22ms] Sub RPC GetTableLocations: received response from server master-127.28.220.252:33543: OK, deferred=null) after lookup
08:06:46.466 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)] connecting to peer
08:06:46.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:46.492339 31181 raft_consensus.cc:2749] T b06031ec130d4dad9efb2794fadd2b04 P 9b230140dcab4f58b02a0b1939e65a5d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
08:06:46.497 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)] Successfully connected to peer
08:06:46.551 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:46.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:46.553944 30069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.220.193:36711, user_credentials={real_user=slave}} blocked reactor thread for 49145.2us
08:06:46.561 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:46.561 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:46.561 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:46.562 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:46.563 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:46.563 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:46.563 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xa5d772db, L:/127.0.0.1:38834 - R:/127.28.220.195:37615] using TOKEN/null
08:06:46.566 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:46.566 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:46.566 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:46.566 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:46.567 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:46.567 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:46.567 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:46.570080 31252 consensus_queue.cc:1048] T b06031ec130d4dad9efb2794fadd2b04 P e83b8a545bd54af99acd623fd123912f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b230140dcab4f58b02a0b1939e65a5d" member_type: VOTER last_known_addr { host: "127.28.220.193" port: 36711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:06:46.676 [DEBUG - main] (Connection.java:748) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] connecting to peer
08:06:46.695 [DEBUG - kudu-nio-4] (Connection.java:757) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] Successfully connected to peer
08:06:46.760 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:46.768 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:46.768 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:46.769 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:46.769 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:46.769 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:46.769 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:46.769 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:46.769 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:46.769 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:46.770 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:46.770 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:46.770 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:46.770 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:46.788 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:46.820 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:46.828 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0xa6132978, L:/127.0.0.1:32948 - R:/127.28.220.194:39597] using TOKEN/null
08:06:46.929 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:46.929 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:46.936 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:46.936 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:46.936 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:46.937 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:46.937 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:46.937 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:46.939 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:46.939 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:46.939 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:46.939 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:46.939 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:46.946 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:47.028 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:47.028 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:47.028 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:47.029 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:47.029 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:47.030 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:47.030 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:47.030 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:47.030 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:47.030 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:47.030 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:47.031 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:47.031 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:47.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:47.149335 30316 debug-util.cc:398] Leaking SignalData structure 0x7b08000cb120 after lost signal to thread 30191
08:06:47.184 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:47.187 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:47.188 [DEBUG - main] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:06:47.189 [DEBUG - main] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:06:47.190 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.29.158.190:38071(127.29.158.190:38071)] Successfully connected to peer
08:06:47.194 [DEBUG - main] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:06:47.210 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.29.158.189:41727(127.29.158.189:41727)] Successfully connected to peer
08:06:47.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:47.214231 31134 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad540 after lost signal to thread 31005
08:06:47.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:47.216017 31134 debug-util.cc:398] Leaking SignalData structure 0x7b08000bad20 after lost signal to thread 31137
08:06:47.219 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.29.158.188:39061(127.29.158.188:39061)] Successfully connected to peer
08:06:47.225 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.29.158.190
08:06:47.236 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.29.158.188
08:06:47.244 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.29.158.189
08:06:47.248 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:47.255 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xb9abaf58, L:/127.0.0.1:37472 - R:/127.29.158.188:39061] using SASL/PLAIN
08:06:47.255 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:47.257 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:47.260 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:47.261 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa0956cb5, L:/127.0.0.1:39002 - R:/127.29.158.190:38071] using SASL/PLAIN
08:06:47.266 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xb410b2af, L:/127.0.0.1:40894 - R:/127.29.158.189:41727] using SASL/PLAIN
08:06:47.271 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:06:47.272 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=84), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [80ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: OK, [82ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: OK, [83ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: OK, deferred=null) after lookup
08:06:47.278 [DEBUG - main] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:06:47.279 [DEBUG - main] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:06:47.280 [DEBUG - main] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:06:47.286 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.28.220.252:33543(127.28.220.252:33543)] Successfully connected to peer
08:06:47.290 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.28.220.254:37365(127.28.220.254:37365)] Successfully connected to peer
08:06:47.295 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.28.220.253:45079(127.28.220.253:45079)] Successfully connected to peer
08:06:47.300 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.253
08:06:47.305 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.254
08:06:47.322 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:47.336 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.252
08:06:47.338 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:47.343 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xc6e3db45, L:/127.0.0.1:42658 - R:/127.28.220.254:37365] using SASL/PLAIN
08:06:47.353 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:47.358 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xb8f449ae, L:/127.0.0.1:34590 - R:/127.28.220.252:33543] using SASL/PLAIN
08:06:47.364 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:47.365 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:06:47.365 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=88), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [71ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: OK, [86ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: OK, deferred=null) after lookup
08:06:47.370 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8c252bac8ed749d288b155a27fae1849
08:06:47.373 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe424d7ff, L:/127.0.0.1:54368 - R:/127.28.220.253:45079] using SASL/PLAIN
08:06:47.381 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 7c05024562a74973892ab2f3098ce916 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
08:06:47.381 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b06031ec130d4dad9efb2794fadd2b04 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
08:06:47.381 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f0136ad45f0f476b999986635f720b8f for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
08:06:47.381 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 1346ae47881b4c43b5c995d59d2a39a2 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
08:06:47.381 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f0135c5dce09400d8d90b12906c890c0 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
08:06:47.382 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f4428ebcade5440ebc2d4803102193ed for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
08:06:47.382 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=7c05024562a74973892ab2f3098ce916@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=b06031ec130d4dad9efb2794fadd2b04@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=f0136ad45f0f476b999986635f720b8f@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=1346ae47881b4c43b5c995d59d2a39a2@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=f0135c5dce09400d8d90b12906c890c0@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711)[L],e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=f4428ebcade5440ebc2d4803102193ed@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:47.387697 30538 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37472:
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
08:06:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\000\007\0012\000\000\000"
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key2"
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:06:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
08:06:47.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:47.396507 30538 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
08:06:47.446 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:47.589 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:47.589 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:47.592 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:47.592 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:47.592 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:47.593 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:47.593 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:47.593 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:47.605 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:47.607 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:47.607 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:47.607 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:47.607 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:47.609 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 2c14e26d8166482b8cd1de88f1bf2d56
08:06:47.653 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:47.654 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:47.654 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:47.654 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:47.655 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:47.655 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:47.655 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:47.655 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:47.655 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:47.656 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:47.656 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:47.656 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:47.656 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:47.657 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28405), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [23ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [30ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [39ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [41ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [76ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [88ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [88ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [89ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [122ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [129ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [130ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [137ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [137ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [141ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [141ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [141ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [141ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [161ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [161ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [162ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [162ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [201ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [201ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [202ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [203ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [243ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [243ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [342ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [342ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [342ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [342ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [400ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [402ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [403ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [403ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [404ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [583ms] refreshing cache from master, [583ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [584ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [584ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [586ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [588ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [589ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [590ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [683ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [684ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [684ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [684ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2120ms] refreshing cache from master, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2123ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [5480ms] refreshing cache from master, [5481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [5481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [5482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [5485ms] too many traces: truncated at 100 traces, deferred=Deferred@1606432248(state=PENDING, result=null, callback=(continuation of Deferred@1017681111 after retry RPC after error@230462025) -> (continuation of Deferred@569887176 after retry RPC after error@2135316475) -> (continuation of Deferred@120613608 after retry RPC after error@1861717661) -> (continuation of Deferred@1909568258 after retry RPC after error@1021696844) -> (continuation of Deferred@948343058 after retry RPC after error@1792504825) -> (continuation of Deferred@383943682 after retry RPC after error@80679465) -> (continuation of Deferred@147656099 after retry RPC after error@1507127288) -> (continuation of Deferred@1536467540 after retry RPC after error@657894741) -> (continuation of Deferred@1198918661 after retry RPC after error@967016508) -> (continuation of Deferred@1205535582 after retry RPC after error@1435845365) -> (continuation of Deferred@578054758 after retry RPC after error@133409908) -> (continuation of Deferred@405642791 after retry RPC after error@1741747517) -> (continuation of Deferred@1719043323 after retry RPC after error@2088502349) -> (continuation of Deferred@148140355 after retry RPC after error@1749881977) -> (continuation of Deferred@978191575 after retry RPC after error@646717887) -> (continuation of Deferred@226038340 after retry RPC after error@219623758) -> (continuation of Deferred@1203102855 after retry RPC after error@7578647) -> (continuation of Deferred@1172139375 after retry RPC after error@1911859675) -> (continuation of Deferred@420342462 after retry RPC after error@71542420) -> (continuation of Deferred@718996838 after retry RPC after error@2125843351) -> (continuation of Deferred@144414437 after retry RPC after error@301332068) -> (continuation of Deferred@1677140233 after retry RPC after error@860796819), errback=(continuation of Deferred@1017681111 after retry RPC after error@230462025) -> (continuation of Deferred@569887176 after retry RPC after error@2135316475) -> (continuation of Deferred@120613608 after retry RPC after error@1861717661) -> (continuation of Deferred@1909568258 after retry RPC after error@1021696844) -> (continuation of Deferred@948343058 after retry RPC after error@1792504825) -> (continuation of Deferred@383943682 after retry RPC after error@80679465) -> (continuation of Deferred@147656099 after retry RPC after error@1507127288) -> (continuation of Deferred@1536467540 after retry RPC after error@657894741) -> (continuation of Deferred@1198918661 after retry RPC after error@967016508) -> (continuation of Deferred@1205535582 after retry RPC after error@1435845365) -> (continuation of Deferred@578054758 after retry RPC after error@133409908) -> (continuation of Deferred@405642791 after retry RPC after error@1741747517) -> (continuation of Deferred@1719043323 after retry RPC after error@2088502349) -> (continuation of Deferred@148140355 after retry RPC after error@1749881977) -> (continuation of Deferred@978191575 after retry RPC after error@646717887) -> (continuation of Deferred@226038340 after retry RPC after error@219623758) -> (continuation of Deferred@1203102855 after retry RPC after error@7578647) -> (continuation of Deferred@1172139375 after retry RPC after error@1911859675) -> (continuation of Deferred@420342462 after retry RPC after error@71542420) -> (continuation of Deferred@718996838 after retry RPC after error@2125843351) -> (continuation of Deferred@144414437 after retry RPC after error@301332068) -> (continuation of Deferred@1677140233 after retry RPC after error@860796819)))
08:06:47.659 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
08:06:47.659 [WARN - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#2 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28405), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [23ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [30ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [39ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [41ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [76ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [88ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [88ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [89ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [122ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [129ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [130ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [137ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [137ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [141ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [141ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [141ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [141ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [161ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [161ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [162ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [162ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [201ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [201ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [202ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [203ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [243ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [243ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [342ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [342ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [342ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [342ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [400ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [402ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [403ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [403ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [404ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [583ms] refreshing cache from master, [583ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [584ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [584ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [586ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [588ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [589ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [590ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [683ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [684ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [684ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [684ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2120ms] refreshing cache from master, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2123ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [5480ms] refreshing cache from master, [5481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [5481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [5482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [5485ms] too many traces: truncated at 100 traces, deferred=Deferred@1606432248(state=PENDING, result=null, callback=(continuation of Deferred@1017681111 after retry RPC after error@230462025) -> (continuation of Deferred@569887176 after retry RPC after error@2135316475) -> (continuation of Deferred@120613608 after retry RPC after error@1861717661) -> (continuation of Deferred@1909568258 after retry RPC after error@1021696844) -> (continuation of Deferred@948343058 after retry RPC after error@1792504825) -> (continuation of Deferred@383943682 after retry RPC after error@80679465) -> (continuation of Deferred@147656099 after retry RPC after error@1507127288) -> (continuation of Deferred@1536467540 after retry RPC after error@657894741) -> (continuation of Deferred@1198918661 after retry RPC after error@967016508) -> (continuation of Deferred@1205535582 after retry RPC after error@1435845365) -> (continuation of Deferred@578054758 after retry RPC after error@133409908) -> (continuation of Deferred@405642791 after retry RPC after error@1741747517) -> (continuation of Deferred@1719043323 after retry RPC after error@2088502349) -> (continuation of Deferred@148140355 after retry RPC after error@1749881977) -> (continuation of Deferred@978191575 after retry RPC after error@646717887) -> (continuation of Deferred@226038340 after retry RPC after error@219623758) -> (continuation of Deferred@1203102855 after retry RPC after error@7578647) -> (continuation of Deferred@1172139375 after retry RPC after error@1911859675) -> (continuation of Deferred@420342462 after retry RPC after error@71542420) -> (continuation of Deferred@718996838 after retry RPC after error@2125843351) -> (continuation of Deferred@144414437 after retry RPC after error@301332068) -> (continuation of Deferred@1677140233 after retry RPC after error@860796819), errback=(continuation of Deferred@1017681111 after retry RPC after error@230462025) -> (continuation of Deferred@569887176 after retry RPC after error@2135316475) -> (continuation of Deferred@120613608 after retry RPC after error@1861717661) -> (continuation of Deferred@1909568258 after retry RPC after error@1021696844) -> (continuation of Deferred@948343058 after retry RPC after error@1792504825) -> (continuation of Deferred@383943682 after retry RPC after error@80679465) -> (continuation of Deferred@147656099 after retry RPC after error@1507127288) -> (continuation of Deferred@1536467540 after retry RPC after error@657894741) -> (continuation of Deferred@1198918661 after retry RPC after error@967016508) -> (continuation of Deferred@1205535582 after retry RPC after error@1435845365) -> (continuation of Deferred@578054758 after retry RPC after error@133409908) -> (continuation of Deferred@405642791 after retry RPC after error@1741747517) -> (continuation of Deferred@1719043323 after retry RPC after error@2088502349) -> (continuation of Deferred@148140355 after retry RPC after error@1749881977) -> (continuation of Deferred@978191575 after retry RPC after error@646717887) -> (continuation of Deferred@226038340 after retry RPC after error@219623758) -> (continuation of Deferred@1203102855 after retry RPC after error@7578647) -> (continuation of Deferred@1172139375 after retry RPC after error@1911859675) -> (continuation of Deferred@420342462 after retry RPC after error@71542420) -> (continuation of Deferred@718996838 after retry RPC after error@2125843351) -> (continuation of Deferred@144414437 after retry RPC after error@301332068) -> (continuation of Deferred@1677140233 after retry RPC after error@860796819)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.188:41049
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:06:47.677 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#2 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
08:06:47.681 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#2 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
08:06:47.685 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to FAILED on 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28405), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [23ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [30ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [39ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [41ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [76ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [88ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [88ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [89ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [122ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [129ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [130ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [137ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [137ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [141ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [141ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [141ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [141ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [161ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [161ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [162ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [162ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [201ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [201ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [202ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [203ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [243ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [243ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [342ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [342ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [342ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [342ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [400ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [402ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [403ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [403ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [404ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [583ms] refreshing cache from master, [583ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [584ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [584ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [586ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [588ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [589ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [590ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [683ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [684ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [684ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [684ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2120ms] refreshing cache from master, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2123ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [5480ms] refreshing cache from master, [5481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [5481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [5482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [5485ms] too many traces: truncated at 100 traces, deferred=Deferred@1606432248(state=PENDING, result=null, callback=(continuation of Deferred@1017681111 after retry RPC after error@230462025) -> (continuation of Deferred@569887176 after retry RPC after error@2135316475) -> (continuation of Deferred@120613608 after retry RPC after error@1861717661) -> (continuation of Deferred@1909568258 after retry RPC after error@1021696844) -> (continuation of Deferred@948343058 after retry RPC after error@1792504825) -> (continuation of Deferred@383943682 after retry RPC after error@80679465) -> (continuation of Deferred@147656099 after retry RPC after error@1507127288) -> (continuation of Deferred@1536467540 after retry RPC after error@657894741) -> (continuation of Deferred@1198918661 after retry RPC after error@967016508) -> (continuation of Deferred@1205535582 after retry RPC after error@1435845365) -> (continuation of Deferred@578054758 after retry RPC after error@133409908) -> (continuation of Deferred@405642791 after retry RPC after error@1741747517) -> (continuation of Deferred@1719043323 after retry RPC after error@2088502349) -> (continuation of Deferred@148140355 after retry RPC after error@1749881977) -> (continuation of Deferred@978191575 after retry RPC after error@646717887) -> (continuation of Deferred@226038340 after retry RPC after error@219623758) -> (continuation of Deferred@1203102855 after retry RPC after error@7578647) -> (continuation of Deferred@1172139375 after retry RPC after error@1911859675) -> (continuation of Deferred@420342462 after retry RPC after error@71542420) -> (continuation of Deferred@718996838 after retry RPC after error@2125843351) -> (continuation of Deferred@144414437 after retry RPC after error@301332068) -> (continuation of Deferred@1677140233 after retry RPC after error@860796819), errback=(continuation of Deferred@1017681111 after retry RPC after error@230462025) -> (continuation of Deferred@569887176 after retry RPC after error@2135316475) -> (continuation of Deferred@120613608 after retry RPC after error@1861717661) -> (continuation of Deferred@1909568258 after retry RPC after error@1021696844) -> (continuation of Deferred@948343058 after retry RPC after error@1792504825) -> (continuation of Deferred@383943682 after retry RPC after error@80679465) -> (continuation of Deferred@147656099 after retry RPC after error@1507127288) -> (continuation of Deferred@1536467540 after retry RPC after error@657894741) -> (continuation of Deferred@1198918661 after retry RPC after error@967016508) -> (continuation of Deferred@1205535582 after retry RPC after error@1435845365) -> (continuation of Deferred@578054758 after retry RPC after error@133409908) -> (continuation of Deferred@405642791 after retry RPC after error@1741747517) -> (continuation of Deferred@1719043323 after retry RPC after error@2088502349) -> (continuation of Deferred@148140355 after retry RPC after error@1749881977) -> (continuation of Deferred@978191575 after retry RPC after error@646717887) -> (continuation of Deferred@226038340 after retry RPC after error@219623758) -> (continuation of Deferred@1203102855 after retry RPC after error@7578647) -> (continuation of Deferred@1172139375 after retry RPC after error@1911859675) -> (continuation of Deferred@420342462 after retry RPC after error@71542420) -> (continuation of Deferred@718996838 after retry RPC after error@2125843351) -> (continuation of Deferred@144414437 after retry RPC after error@301332068) -> (continuation of Deferred@1677140233 after retry RPC after error@860796819)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.188:41049
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:06:47.693 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#2) of source Source: KuduSource.
08:06:47.694 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
08:06:47.694 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (e26b904229418d0e047d5d94c5b9f905) switched from state RUNNING to RESTARTING.
08:06:47.695 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:06:47.758 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:47.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:47.795996 30488 debug-util.cc:398] Leaking SignalData structure 0x7b08000a0d40 after lost signal to thread 30417
08:06:47.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:47.796330 30926 tablet_service.cc:1511] Processing CreateTablet for tablet dc730dc733f34f3aa01cff8a03a1d64b (DEFAULT_TABLE table=replication_test_table [id=2c14e26d8166482b8cd1de88f1bf2d56]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
08:06:47.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:47.799269 30926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc730dc733f34f3aa01cff8a03a1d64b. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:47.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:47.803896 30927 tablet_service.cc:1511] Processing CreateTablet for tablet fcf422cfc5154d82ba8f03739eda8ff2 (DEFAULT_TABLE table=replication_test_table [id=2c14e26d8166482b8cd1de88f1bf2d56]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
08:06:47.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:47.805274 30927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf422cfc5154d82ba8f03739eda8ff2. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:47.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:47.843835 31072 tablet_service.cc:1511] Processing CreateTablet for tablet dc730dc733f34f3aa01cff8a03a1d64b (DEFAULT_TABLE table=replication_test_table [id=2c14e26d8166482b8cd1de88f1bf2d56]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
08:06:47.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:47.847054 31072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc730dc733f34f3aa01cff8a03a1d64b. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:47.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:47.848917 31073 tablet_service.cc:1511] Processing CreateTablet for tablet fcf422cfc5154d82ba8f03739eda8ff2 (DEFAULT_TABLE table=replication_test_table [id=2c14e26d8166482b8cd1de88f1bf2d56]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
08:06:47.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:47.850278 31073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf422cfc5154d82ba8f03739eda8ff2. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:47.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:47.858773 30784 tablet_service.cc:1511] Processing CreateTablet for tablet fcf422cfc5154d82ba8f03739eda8ff2 (DEFAULT_TABLE table=replication_test_table [id=2c14e26d8166482b8cd1de88f1bf2d56]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
08:06:47.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:47.862326 30784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf422cfc5154d82ba8f03739eda8ff2. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:47.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:47.866394 30783 tablet_service.cc:1511] Processing CreateTablet for tablet dc730dc733f34f3aa01cff8a03a1d64b (DEFAULT_TABLE table=replication_test_table [id=2c14e26d8166482b8cd1de88f1bf2d56]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
08:06:47.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:47.867779 30783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc730dc733f34f3aa01cff8a03a1d64b. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:47.945 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:47.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:47.988533 31299 tablet_bootstrap.cc:492] T fcf422cfc5154d82ba8f03739eda8ff2 P 3fd6ff86a84648679872c7b9c828d708: Bootstrap starting.
08:06:48.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.010555 31299 tablet_bootstrap.cc:654] T fcf422cfc5154d82ba8f03739eda8ff2 P 3fd6ff86a84648679872c7b9c828d708: Neither blocks nor log segments found. Creating new log.
08:06:48.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.015640 31299 log.cc:826] T fcf422cfc5154d82ba8f03739eda8ff2 P 3fd6ff86a84648679872c7b9c828d708: Log is configured to *not* fsync() on all Append() calls
08:06:48.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.024150 31300 tablet_bootstrap.cc:492] T dc730dc733f34f3aa01cff8a03a1d64b P 7a55aa81ed1045bbb68d397395b9ae3f: Bootstrap starting.
08:06:48.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.028650 31299 tablet_bootstrap.cc:492] T fcf422cfc5154d82ba8f03739eda8ff2 P 3fd6ff86a84648679872c7b9c828d708: No bootstrap required, opened a new log
08:06:48.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.030098 31299 ts_tablet_manager.cc:1403] T fcf422cfc5154d82ba8f03739eda8ff2 P 3fd6ff86a84648679872c7b9c828d708: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.008s
08:06:48.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.033700 31298 tablet_bootstrap.cc:492] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785: Bootstrap starting.
08:06:48.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.055979 31300 tablet_bootstrap.cc:654] T dc730dc733f34f3aa01cff8a03a1d64b P 7a55aa81ed1045bbb68d397395b9ae3f: Neither blocks nor log segments found. Creating new log.
08:06:48.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.059114 31300 log.cc:826] T dc730dc733f34f3aa01cff8a03a1d64b P 7a55aa81ed1045bbb68d397395b9ae3f: Log is configured to *not* fsync() on all Append() calls
08:06:48.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.060297 31299 raft_consensus.cc:359] T fcf422cfc5154d82ba8f03739eda8ff2 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } } peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } }
08:06:48.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.061359 31299 raft_consensus.cc:385] T fcf422cfc5154d82ba8f03739eda8ff2 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:48.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.061697 31299 raft_consensus.cc:740] T fcf422cfc5154d82ba8f03739eda8ff2 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fd6ff86a84648679872c7b9c828d708, State: Initialized, Role: FOLLOWER
08:06:48.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.062898 31299 consensus_queue.cc:260] T fcf422cfc5154d82ba8f03739eda8ff2 P 3fd6ff86a84648679872c7b9c828d708 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } } peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } }
08:06:48.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.068190 31298 tablet_bootstrap.cc:654] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785: Neither blocks nor log segments found. Creating new log.
08:06:48.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.073707 31299 ts_tablet_manager.cc:1434] T fcf422cfc5154d82ba8f03739eda8ff2 P 3fd6ff86a84648679872c7b9c828d708: Time spent starting tablet: real 0.043s	user 0.016s	sys 0.024s
08:06:48.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.074790 31299 tablet_bootstrap.cc:492] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708: Bootstrap starting.
08:06:48.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.081722 31299 tablet_bootstrap.cc:654] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708: Neither blocks nor log segments found. Creating new log.
08:06:48.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.094045 31299 tablet_bootstrap.cc:492] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708: No bootstrap required, opened a new log
08:06:48.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.094537 31299 ts_tablet_manager.cc:1403] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.012s
08:06:48.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.097572 31299 raft_consensus.cc:359] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:48.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.098322 31299 raft_consensus.cc:385] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:48.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.098611 31299 raft_consensus.cc:740] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fd6ff86a84648679872c7b9c828d708, State: Initialized, Role: FOLLOWER
08:06:48.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.099284 31299 consensus_queue.cc:260] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:48.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.102005 31299 ts_tablet_manager.cc:1434] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
08:06:48.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.109671 31302 raft_consensus.cc:493] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:06:48.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.110342 31302 raft_consensus.cc:515] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:48.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.114200 31302 leader_election.cc:290] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6acb62062c54919acc5ee398d03f785 (127.29.158.129:45149), 7a55aa81ed1045bbb68d397395b9ae3f (127.29.158.131:41421)
08:06:48.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.109077 31298 log.cc:826] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785: Log is configured to *not* fsync() on all Append() calls
08:06:48.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.128854 31300 tablet_bootstrap.cc:492] T dc730dc733f34f3aa01cff8a03a1d64b P 7a55aa81ed1045bbb68d397395b9ae3f: No bootstrap required, opened a new log
08:06:48.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.129750 31300 ts_tablet_manager.cc:1403] T dc730dc733f34f3aa01cff8a03a1d64b P 7a55aa81ed1045bbb68d397395b9ae3f: Time spent bootstrapping tablet: real 0.106s	user 0.021s	sys 0.000s
08:06:48.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.185129 31300 raft_consensus.cc:359] T dc730dc733f34f3aa01cff8a03a1d64b P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:48.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.186661 31300 raft_consensus.cc:385] T dc730dc733f34f3aa01cff8a03a1d64b P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:48.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.187136 31300 raft_consensus.cc:740] T dc730dc733f34f3aa01cff8a03a1d64b P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a55aa81ed1045bbb68d397395b9ae3f, State: Initialized, Role: FOLLOWER
08:06:48.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.188601 31300 consensus_queue.cc:260] T dc730dc733f34f3aa01cff8a03a1d64b P 7a55aa81ed1045bbb68d397395b9ae3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:48.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.202623 31298 tablet_bootstrap.cc:492] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785: No bootstrap required, opened a new log
08:06:48.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.206225 31298 ts_tablet_manager.cc:1403] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785: Time spent bootstrapping tablet: real 0.178s	user 0.021s	sys 0.017s
08:06:48.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:48.217787 31000 tablet.cc:2404] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:06:48.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.227141 31300 ts_tablet_manager.cc:1434] T dc730dc733f34f3aa01cff8a03a1d64b P 7a55aa81ed1045bbb68d397395b9ae3f: Time spent starting tablet: real 0.097s	user 0.038s	sys 0.006s
08:06:48.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.237128 31300 tablet_bootstrap.cc:492] T fcf422cfc5154d82ba8f03739eda8ff2 P 7a55aa81ed1045bbb68d397395b9ae3f: Bootstrap starting.
08:06:48.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.238348 31302 raft_consensus.cc:493] T fcf422cfc5154d82ba8f03739eda8ff2 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:06:48.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.238886 31302 raft_consensus.cc:515] T fcf422cfc5154d82ba8f03739eda8ff2 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } } peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } }
08:06:48.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.240962 31302 leader_election.cc:290] T fcf422cfc5154d82ba8f03739eda8ff2 P 3fd6ff86a84648679872c7b9c828d708 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a55aa81ed1045bbb68d397395b9ae3f (127.29.158.131:41421), d6acb62062c54919acc5ee398d03f785 (127.29.158.129:45149)
08:06:48.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.245247 31300 tablet_bootstrap.cc:654] T fcf422cfc5154d82ba8f03739eda8ff2 P 7a55aa81ed1045bbb68d397395b9ae3f: Neither blocks nor log segments found. Creating new log.
08:06:48.259 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:48.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.267925 31093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc730dc733f34f3aa01cff8a03a1d64b" candidate_uuid: "3fd6ff86a84648679872c7b9c828d708" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" is_pre_election: true
08:06:48.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.269299 31093 raft_consensus.cc:2468] T dc730dc733f34f3aa01cff8a03a1d64b P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fd6ff86a84648679872c7b9c828d708 in term 0.
08:06:48.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:48.270337 31143 tablet.cc:2404] T dc730dc733f34f3aa01cff8a03a1d64b P 7a55aa81ed1045bbb68d397395b9ae3f: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:06:48.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.272271 31092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf422cfc5154d82ba8f03739eda8ff2" candidate_uuid: "3fd6ff86a84648679872c7b9c828d708" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" is_pre_election: true
08:06:48.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:48.277256 30881 leader_election.cc:343] T fcf422cfc5154d82ba8f03739eda8ff2 P 3fd6ff86a84648679872c7b9c828d708 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a55aa81ed1045bbb68d397395b9ae3f (127.29.158.131:41421): Illegal state: must be running to vote when last-logged opid is not known
08:06:48.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.279558 30881 leader_election.cc:304] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fd6ff86a84648679872c7b9c828d708, 7a55aa81ed1045bbb68d397395b9ae3f; no voters: 
08:06:48.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.280929 31302 raft_consensus.cc:2804] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:06:48.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.281354 31302 raft_consensus.cc:493] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:06:48.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.281694 31302 raft_consensus.cc:3060] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Advancing to term 1
08:06:48.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.292181 31298 raft_consensus.cc:359] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } } peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } }
08:06:48.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.293394 31298 raft_consensus.cc:385] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:48.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.293841 31298 raft_consensus.cc:740] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6acb62062c54919acc5ee398d03f785, State: Initialized, Role: FOLLOWER
08:06:48.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.293653 31302 raft_consensus.cc:515] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:48.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.295221 31298 consensus_queue.cc:260] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } } peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } }
08:06:48.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.307765 31298 ts_tablet_manager.cc:1434] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785: Time spent starting tablet: real 0.101s	user 0.031s	sys 0.011s
08:06:48.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.308911 31298 tablet_bootstrap.cc:492] T dc730dc733f34f3aa01cff8a03a1d64b P d6acb62062c54919acc5ee398d03f785: Bootstrap starting.
08:06:48.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.322260 31298 tablet_bootstrap.cc:654] T dc730dc733f34f3aa01cff8a03a1d64b P d6acb62062c54919acc5ee398d03f785: Neither blocks nor log segments found. Creating new log.
08:06:48.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.341396 30804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc730dc733f34f3aa01cff8a03a1d64b" candidate_uuid: "3fd6ff86a84648679872c7b9c828d708" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6acb62062c54919acc5ee398d03f785" is_pre_election: true
08:06:48.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.344676 31310 raft_consensus.cc:493] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:06:48.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:48.350625 30881 leader_election.cc:343] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d6acb62062c54919acc5ee398d03f785 (127.29.158.129:45149): Illegal state: must be running to vote when last-logged opid is not known
08:06:48.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.349664 30803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf422cfc5154d82ba8f03739eda8ff2" candidate_uuid: "3fd6ff86a84648679872c7b9c828d708" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6acb62062c54919acc5ee398d03f785" is_pre_election: true
08:06:48.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.353652 31298 tablet_bootstrap.cc:492] T dc730dc733f34f3aa01cff8a03a1d64b P d6acb62062c54919acc5ee398d03f785: No bootstrap required, opened a new log
08:06:48.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.354163 31298 ts_tablet_manager.cc:1403] T dc730dc733f34f3aa01cff8a03a1d64b P d6acb62062c54919acc5ee398d03f785: Time spent bootstrapping tablet: real 0.045s	user 0.006s	sys 0.013s
08:06:48.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.345461 31310 raft_consensus.cc:515] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } } peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } }
08:06:48.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.358470 31298 raft_consensus.cc:359] T dc730dc733f34f3aa01cff8a03a1d64b P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:48.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.358938 30803 raft_consensus.cc:2468] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fd6ff86a84648679872c7b9c828d708 in term 0.
08:06:48.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.362545 31310 leader_election.cc:290] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fd6ff86a84648679872c7b9c828d708 (127.29.158.130:33769), 7a55aa81ed1045bbb68d397395b9ae3f (127.29.158.131:41421)
08:06:48.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.363104 31298 raft_consensus.cc:385] T dc730dc733f34f3aa01cff8a03a1d64b P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:48.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.363654 31298 raft_consensus.cc:740] T dc730dc733f34f3aa01cff8a03a1d64b P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6acb62062c54919acc5ee398d03f785, State: Initialized, Role: FOLLOWER
08:06:48.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.364661 31298 consensus_queue.cc:260] T dc730dc733f34f3aa01cff8a03a1d64b P d6acb62062c54919acc5ee398d03f785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:48.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.371505 31298 ts_tablet_manager.cc:1434] T dc730dc733f34f3aa01cff8a03a1d64b P d6acb62062c54919acc5ee398d03f785: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
08:06:48.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.388705 31093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc730dc733f34f3aa01cff8a03a1d64b" candidate_uuid: "3fd6ff86a84648679872c7b9c828d708" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a55aa81ed1045bbb68d397395b9ae3f"
08:06:48.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.389426 31093 raft_consensus.cc:3060] T dc730dc733f34f3aa01cff8a03a1d64b P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Advancing to term 1
08:06:48.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.401842 31302 leader_election.cc:290] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708 [CANDIDATE]: Term 1 election: Requested vote from peers d6acb62062c54919acc5ee398d03f785 (127.29.158.129:45149), 7a55aa81ed1045bbb68d397395b9ae3f (127.29.158.131:41421)
08:06:48.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.407859 30881 leader_election.cc:304] T fcf422cfc5154d82ba8f03739eda8ff2 P 3fd6ff86a84648679872c7b9c828d708 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fd6ff86a84648679872c7b9c828d708, d6acb62062c54919acc5ee398d03f785; no voters: 7a55aa81ed1045bbb68d397395b9ae3f
08:06:48.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.411895 30803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc730dc733f34f3aa01cff8a03a1d64b" candidate_uuid: "3fd6ff86a84648679872c7b9c828d708" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6acb62062c54919acc5ee398d03f785"
08:06:48.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.412731 30803 raft_consensus.cc:3060] T dc730dc733f34f3aa01cff8a03a1d64b P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Advancing to term 1
08:06:48.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.412883 30947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf422cfc5154d82ba8f03739eda8ff2" candidate_uuid: "d6acb62062c54919acc5ee398d03f785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fd6ff86a84648679872c7b9c828d708" is_pre_election: true
08:06:48.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.399330 31093 raft_consensus.cc:2468] T dc730dc733f34f3aa01cff8a03a1d64b P 7a55aa81ed1045bbb68d397395b9ae3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fd6ff86a84648679872c7b9c828d708 in term 1.
08:06:48.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.413861 30947 raft_consensus.cc:2468] T fcf422cfc5154d82ba8f03739eda8ff2 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6acb62062c54919acc5ee398d03f785 in term 0.
08:06:48.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.416113 30881 leader_election.cc:304] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fd6ff86a84648679872c7b9c828d708, 7a55aa81ed1045bbb68d397395b9ae3f; no voters: 
08:06:48.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.422384 30718 leader_election.cc:304] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fd6ff86a84648679872c7b9c828d708, d6acb62062c54919acc5ee398d03f785; no voters: 
08:06:48.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.424163 31310 raft_consensus.cc:2804] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:06:48.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.424503 31310 raft_consensus.cc:493] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:06:48.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.424808 31310 raft_consensus.cc:3060] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Advancing to term 1
08:06:48.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.427524 30803 raft_consensus.cc:2468] T dc730dc733f34f3aa01cff8a03a1d64b P d6acb62062c54919acc5ee398d03f785 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fd6ff86a84648679872c7b9c828d708 in term 1.
08:06:48.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.432000 31310 raft_consensus.cc:515] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } } peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } }
08:06:48.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.432720 31093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf422cfc5154d82ba8f03739eda8ff2" candidate_uuid: "d6acb62062c54919acc5ee398d03f785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" is_pre_election: true
08:06:48.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:48.434650 30715 leader_election.cc:343] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a55aa81ed1045bbb68d397395b9ae3f (127.29.158.131:41421): Illegal state: must be running to vote when last-logged opid is not known
08:06:48.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.434980 30947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf422cfc5154d82ba8f03739eda8ff2" candidate_uuid: "d6acb62062c54919acc5ee398d03f785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fd6ff86a84648679872c7b9c828d708"
08:06:48.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.435590 30947 raft_consensus.cc:3060] T fcf422cfc5154d82ba8f03739eda8ff2 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Advancing to term 1
08:06:48.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.438753 31302 raft_consensus.cc:2804] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708 [term 1 FOLLOWER]: Leader election won for term 1
08:06:48.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.439538 31302 raft_consensus.cc:697] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708 [term 1 LEADER]: Becoming Leader. State: Replica: 3fd6ff86a84648679872c7b9c828d708, State: Running, Role: LEADER
08:06:48.445 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:48.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.445113 31302 consensus_queue.cc:237] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:48.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.446521 31310 leader_election.cc:290] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785 [CANDIDATE]: Term 1 election: Requested vote from peers 3fd6ff86a84648679872c7b9c828d708 (127.29.158.130:33769), 7a55aa81ed1045bbb68d397395b9ae3f (127.29.158.131:41421)
08:06:48.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.448796 31092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf422cfc5154d82ba8f03739eda8ff2" candidate_uuid: "d6acb62062c54919acc5ee398d03f785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a55aa81ed1045bbb68d397395b9ae3f"
08:06:48.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:48.452046 30715 leader_election.cc:343] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7a55aa81ed1045bbb68d397395b9ae3f (127.29.158.131:41421): Illegal state: must be running to vote when last-logged opid is not known
08:06:48.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.444808 30947 raft_consensus.cc:2468] T fcf422cfc5154d82ba8f03739eda8ff2 P 3fd6ff86a84648679872c7b9c828d708 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6acb62062c54919acc5ee398d03f785 in term 1.
08:06:48.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.470366 30718 leader_election.cc:304] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fd6ff86a84648679872c7b9c828d708, d6acb62062c54919acc5ee398d03f785; no voters: 7a55aa81ed1045bbb68d397395b9ae3f
08:06:48.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.472162 31310 raft_consensus.cc:2804] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785 [term 1 FOLLOWER]: Leader election won for term 1
08:06:48.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.482910 31315 raft_consensus.cc:2764] T fcf422cfc5154d82ba8f03739eda8ff2 P 3fd6ff86a84648679872c7b9c828d708 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
08:06:48.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.487536 31310 raft_consensus.cc:697] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785 [term 1 LEADER]: Becoming Leader. State: Replica: d6acb62062c54919acc5ee398d03f785, State: Running, Role: LEADER
08:06:48.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:48.486902 30881 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.158.131:41421, user_credentials={real_user=slave}} blocked reactor thread for 70876.8us
08:06:48.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.489310 31310 consensus_queue.cc:237] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } } peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } }
08:06:48.498 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:48.498 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:48.498 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:48.498 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:48.499 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:48.499 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:48.499 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:48.499 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:48.499 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:48.499 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:48.499 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:48.499 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:48.499 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:48.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.523953 30538 catalog_manager.cc:5696] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785 reported cstate change: term changed from 0 to 1, leader changed from <none> to d6acb62062c54919acc5ee398d03f785 (127.29.158.129). New cstate: current_term: 1 leader_uuid: "d6acb62062c54919acc5ee398d03f785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } health_report { overall_health: HEALTHY } } }
08:06:48.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.528165 31300 tablet_bootstrap.cc:492] T fcf422cfc5154d82ba8f03739eda8ff2 P 7a55aa81ed1045bbb68d397395b9ae3f: No bootstrap required, opened a new log
08:06:48.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.528716 31300 ts_tablet_manager.cc:1403] T fcf422cfc5154d82ba8f03739eda8ff2 P 7a55aa81ed1045bbb68d397395b9ae3f: Time spent bootstrapping tablet: real 0.292s	user 0.063s	sys 0.069s
08:06:48.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.532564 31300 raft_consensus.cc:359] T fcf422cfc5154d82ba8f03739eda8ff2 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } } peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } }
08:06:48.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.533340 31300 raft_consensus.cc:385] T fcf422cfc5154d82ba8f03739eda8ff2 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:48.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.533603 31300 raft_consensus.cc:740] T fcf422cfc5154d82ba8f03739eda8ff2 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a55aa81ed1045bbb68d397395b9ae3f, State: Initialized, Role: FOLLOWER
08:06:48.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.543768 31300 consensus_queue.cc:260] T fcf422cfc5154d82ba8f03739eda8ff2 P 7a55aa81ed1045bbb68d397395b9ae3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } } peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } }
08:06:48.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:48.546567 30855 tablet.cc:2404] T dc730dc733f34f3aa01cff8a03a1d64b P d6acb62062c54919acc5ee398d03f785: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:06:48.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.560047 31300 ts_tablet_manager.cc:1434] T fcf422cfc5154d82ba8f03739eda8ff2 P 7a55aa81ed1045bbb68d397395b9ae3f: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
08:06:48.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.580603 30536 catalog_manager.cc:5696] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fd6ff86a84648679872c7b9c828d708 (127.29.158.130). New cstate: current_term: 1 leader_uuid: "3fd6ff86a84648679872c7b9c828d708" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } health_report { overall_health: UNKNOWN } } }
08:06:48.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.631402 31308 raft_consensus.cc:493] T fcf422cfc5154d82ba8f03739eda8ff2 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:06:48.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.631992 31308 raft_consensus.cc:515] T fcf422cfc5154d82ba8f03739eda8ff2 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } } peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } }
08:06:48.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.638341 31308 leader_election.cc:290] T fcf422cfc5154d82ba8f03739eda8ff2 P 7a55aa81ed1045bbb68d397395b9ae3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fd6ff86a84648679872c7b9c828d708 (127.29.158.130:33769), d6acb62062c54919acc5ee398d03f785 (127.29.158.129:45149)
08:06:48.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:48.662139 29631 debug-util.cc:398] Leaking SignalData structure 0x7b0800092e80 after lost signal to thread 29568
08:06:48.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:48.662952 29631 debug-util.cc:398] Leaking SignalData structure 0x7b0800095140 after lost signal to thread 29634
08:06:48.758 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:48.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.798908 30947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf422cfc5154d82ba8f03739eda8ff2" candidate_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fd6ff86a84648679872c7b9c828d708" is_pre_election: true
08:06:48.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.800004 30947 raft_consensus.cc:2393] T fcf422cfc5154d82ba8f03739eda8ff2 P 3fd6ff86a84648679872c7b9c828d708 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a55aa81ed1045bbb68d397395b9ae3f in current term 1: Already voted for candidate d6acb62062c54919acc5ee398d03f785 in this term.
08:06:48.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.835119 30536 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37472:
08:06:48.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "replication_test_table" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\0012\000\000\000\007\001\226\000\000\000" } } } schema { columns { name: "key1" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key2" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key3" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "data" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } }
08:06:48.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.871119 30803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf422cfc5154d82ba8f03739eda8ff2" candidate_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6acb62062c54919acc5ee398d03f785" is_pre_election: true
08:06:48.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.876657 31027 leader_election.cc:304] T fcf422cfc5154d82ba8f03739eda8ff2 P 7a55aa81ed1045bbb68d397395b9ae3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a55aa81ed1045bbb68d397395b9ae3f; no voters: 3fd6ff86a84648679872c7b9c828d708, d6acb62062c54919acc5ee398d03f785
08:06:48.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.878176 31308 raft_consensus.cc:3060] T fcf422cfc5154d82ba8f03739eda8ff2 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Advancing to term 1
08:06:48.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.901072 31308 raft_consensus.cc:2749] T fcf422cfc5154d82ba8f03739eda8ff2 P 7a55aa81ed1045bbb68d397395b9ae3f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
08:06:48.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.927642 31310 consensus_queue.cc:1048] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:06:48.929 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:48.930 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:48.930 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:48.930 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:48.931 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:48.931 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:48.931 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:48.932 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:48.932 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:48.932 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:48.932 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:48.932 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:48.932 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:48.933 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29696), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [11ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [45ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [68ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [68ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [89ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [91ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [114ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [114ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [126ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [129ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [129ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [129ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [142ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [142ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [142ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [142ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [162ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [162ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [163ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [163ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [180ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [183ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [184ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [185ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [202ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [203ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [203ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [203ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [224ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [302ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [303ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [742ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [743ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [743ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [743ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1240ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1243ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1720ms] refreshing cache from master, [1720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1722ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1723ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1723ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1724ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [5240ms] refreshing cache from master, [5241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [5242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [5242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [5243ms] too many traces: truncated at 100 traces, deferred=Deferred@1030580278(state=PENDING, result=null, callback=(continuation of Deferred@1236972321 after retry RPC after error@498952467) -> (continuation of Deferred@1076127260 after retry RPC after error@383687414) -> (continuation of Deferred@182522039 after retry RPC after error@2095187209) -> (continuation of Deferred@529897487 after retry RPC after error@2113845281) -> (continuation of Deferred@2132310913 after retry RPC after error@331277094) -> (continuation of Deferred@542655678 after retry RPC after error@686804772) -> (continuation of Deferred@337079755 after retry RPC after error@1892944828) -> (continuation of Deferred@306961580 after retry RPC after error@1141614382) -> (continuation of Deferred@1801319249 after retry RPC after error@998542445) -> (continuation of Deferred@2003208461 after retry RPC after error@1858957848) -> (continuation of Deferred@1779352555 after retry RPC after error@1970720035) -> (continuation of Deferred@916135009 after retry RPC after error@868480280) -> (continuation of Deferred@802060560 after retry RPC after error@1821554207) -> (continuation of Deferred@33871864 after retry RPC after error@776182165) -> (continuation of Deferred@1914270644 after retry RPC after error@197263782) -> (continuation of Deferred@803056689 after retry RPC after error@501221230) -> (continuation of Deferred@610096053 after retry RPC after error@1065986473) -> (continuation of Deferred@2104964685 after retry RPC after error@1622251002) -> (continuation of Deferred@784310946 after retry RPC after error@1544131133) -> (continuation of Deferred@403182255 after retry RPC after error@1962560017) -> (continuation of Deferred@654527646 after retry RPC after error@923515449) -> (continuation of Deferred@1875790621 after retry RPC after error@1229073975) -> (continuation of Deferred@1956183101 after retry RPC after error@505957093) -> (continuation of Deferred@61041822 after retry RPC after error@1539889483), errback=(continuation of Deferred@1236972321 after retry RPC after error@498952467) -> (continuation of Deferred@1076127260 after retry RPC after error@383687414) -> (continuation of Deferred@182522039 after retry RPC after error@2095187209) -> (continuation of Deferred@529897487 after retry RPC after error@2113845281) -> (continuation of Deferred@2132310913 after retry RPC after error@331277094) -> (continuation of Deferred@542655678 after retry RPC after error@686804772) -> (continuation of Deferred@337079755 after retry RPC after error@1892944828) -> (continuation of Deferred@306961580 after retry RPC after error@1141614382) -> (continuation of Deferred@1801319249 after retry RPC after error@998542445) -> (continuation of Deferred@2003208461 after retry RPC after error@1858957848) -> (continuation of Deferred@1779352555 after retry RPC after error@1970720035) -> (continuation of Deferred@916135009 after retry RPC after error@868480280) -> (continuation of Deferred@802060560 after retry RPC after error@1821554207) -> (continuation of Deferred@33871864 after retry RPC after error@776182165) -> (continuation of Deferred@1914270644 after retry RPC after error@197263782) -> (continuation of Deferred@803056689 after retry RPC after error@501221230) -> (continuation of Deferred@610096053 after retry RPC after error@1065986473) -> (continuation of Deferred@2104964685 after retry RPC after error@1622251002) -> (continuation of Deferred@784310946 after retry RPC after error@1544131133) -> (continuation of Deferred@403182255 after retry RPC after error@1962560017) -> (continuation of Deferred@654527646 after retry RPC after error@923515449) -> (continuation of Deferred@1875790621 after retry RPC after error@1229073975) -> (continuation of Deferred@1956183101 after retry RPC after error@505957093) -> (continuation of Deferred@61041822 after retry RPC after error@1539889483)))
08:06:48.936 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
08:06:48.936 [WARN - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#2 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29696), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [11ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [45ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [68ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [68ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [89ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [91ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [114ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [114ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [126ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [129ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [129ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [129ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [142ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [142ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [142ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [142ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [162ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [162ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [163ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [163ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [180ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [183ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [184ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [185ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [202ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [203ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [203ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [203ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [224ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [302ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [303ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [742ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [743ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [743ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [743ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1240ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1243ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1720ms] refreshing cache from master, [1720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1722ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1723ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1723ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1724ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [5240ms] refreshing cache from master, [5241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [5242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [5242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [5243ms] too many traces: truncated at 100 traces, deferred=Deferred@1030580278(state=PENDING, result=null, callback=(continuation of Deferred@1236972321 after retry RPC after error@498952467) -> (continuation of Deferred@1076127260 after retry RPC after error@383687414) -> (continuation of Deferred@182522039 after retry RPC after error@2095187209) -> (continuation of Deferred@529897487 after retry RPC after error@2113845281) -> (continuation of Deferred@2132310913 after retry RPC after error@331277094) -> (continuation of Deferred@542655678 after retry RPC after error@686804772) -> (continuation of Deferred@337079755 after retry RPC after error@1892944828) -> (continuation of Deferred@306961580 after retry RPC after error@1141614382) -> (continuation of Deferred@1801319249 after retry RPC after error@998542445) -> (continuation of Deferred@2003208461 after retry RPC after error@1858957848) -> (continuation of Deferred@1779352555 after retry RPC after error@1970720035) -> (continuation of Deferred@916135009 after retry RPC after error@868480280) -> (continuation of Deferred@802060560 after retry RPC after error@1821554207) -> (continuation of Deferred@33871864 after retry RPC after error@776182165) -> (continuation of Deferred@1914270644 after retry RPC after error@197263782) -> (continuation of Deferred@803056689 after retry RPC after error@501221230) -> (continuation of Deferred@610096053 after retry RPC after error@1065986473) -> (continuation of Deferred@2104964685 after retry RPC after error@1622251002) -> (continuation of Deferred@784310946 after retry RPC after error@1544131133) -> (continuation of Deferred@403182255 after retry RPC after error@1962560017) -> (continuation of Deferred@654527646 after retry RPC after error@923515449) -> (continuation of Deferred@1875790621 after retry RPC after error@1229073975) -> (continuation of Deferred@1956183101 after retry RPC after error@505957093) -> (continuation of Deferred@61041822 after retry RPC after error@1539889483), errback=(continuation of Deferred@1236972321 after retry RPC after error@498952467) -> (continuation of Deferred@1076127260 after retry RPC after error@383687414) -> (continuation of Deferred@182522039 after retry RPC after error@2095187209) -> (continuation of Deferred@529897487 after retry RPC after error@2113845281) -> (continuation of Deferred@2132310913 after retry RPC after error@331277094) -> (continuation of Deferred@542655678 after retry RPC after error@686804772) -> (continuation of Deferred@337079755 after retry RPC after error@1892944828) -> (continuation of Deferred@306961580 after retry RPC after error@1141614382) -> (continuation of Deferred@1801319249 after retry RPC after error@998542445) -> (continuation of Deferred@2003208461 after retry RPC after error@1858957848) -> (continuation of Deferred@1779352555 after retry RPC after error@1970720035) -> (continuation of Deferred@916135009 after retry RPC after error@868480280) -> (continuation of Deferred@802060560 after retry RPC after error@1821554207) -> (continuation of Deferred@33871864 after retry RPC after error@776182165) -> (continuation of Deferred@1914270644 after retry RPC after error@197263782) -> (continuation of Deferred@803056689 after retry RPC after error@501221230) -> (continuation of Deferred@610096053 after retry RPC after error@1065986473) -> (continuation of Deferred@2104964685 after retry RPC after error@1622251002) -> (continuation of Deferred@784310946 after retry RPC after error@1544131133) -> (continuation of Deferred@403182255 after retry RPC after error@1962560017) -> (continuation of Deferred@654527646 after retry RPC after error@923515449) -> (continuation of Deferred@1875790621 after retry RPC after error@1229073975) -> (continuation of Deferred@1956183101 after retry RPC after error@505957093) -> (continuation of Deferred@61041822 after retry RPC after error@1539889483)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.189:46677
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:06:48.938 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:48.940 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:48.940 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:48.940 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:48.940 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:48.940 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:48.940 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:48.940 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:48.940 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:48.940 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:48.940 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:48.941 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:48.941 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:48.945 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:48.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:48.946693 30536 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 66bf6eb9c7a64dd89a3abc089345e514 has no consensus state
08:06:48.944 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#2 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
08:06:48.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:48.954463 30536 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 71e73ef6d3514d87b02febae295f3921 has no consensus state
08:06:48.957 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#2 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_2.
08:06:48.959 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to FAILED on 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29696), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [11ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [45ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [68ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [68ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [89ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [91ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [114ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [114ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [126ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [129ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [129ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [129ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [142ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [142ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [142ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [142ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [162ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [162ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [163ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [163ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [180ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [183ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [184ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [185ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [202ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [203ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [203ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [203ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [224ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [302ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [303ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [742ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [743ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [743ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [743ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1240ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1243ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1720ms] refreshing cache from master, [1720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1722ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1723ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1723ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1724ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [5240ms] refreshing cache from master, [5241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [5242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [5242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [5243ms] too many traces: truncated at 100 traces, deferred=Deferred@1030580278(state=PENDING, result=null, callback=(continuation of Deferred@1236972321 after retry RPC after error@498952467) -> (continuation of Deferred@1076127260 after retry RPC after error@383687414) -> (continuation of Deferred@182522039 after retry RPC after error@2095187209) -> (continuation of Deferred@529897487 after retry RPC after error@2113845281) -> (continuation of Deferred@2132310913 after retry RPC after error@331277094) -> (continuation of Deferred@542655678 after retry RPC after error@686804772) -> (continuation of Deferred@337079755 after retry RPC after error@1892944828) -> (continuation of Deferred@306961580 after retry RPC after error@1141614382) -> (continuation of Deferred@1801319249 after retry RPC after error@998542445) -> (continuation of Deferred@2003208461 after retry RPC after error@1858957848) -> (continuation of Deferred@1779352555 after retry RPC after error@1970720035) -> (continuation of Deferred@916135009 after retry RPC after error@868480280) -> (continuation of Deferred@802060560 after retry RPC after error@1821554207) -> (continuation of Deferred@33871864 after retry RPC after error@776182165) -> (continuation of Deferred@1914270644 after retry RPC after error@197263782) -> (continuation of Deferred@803056689 after retry RPC after error@501221230) -> (continuation of Deferred@610096053 after retry RPC after error@1065986473) -> (continuation of Deferred@2104964685 after retry RPC after error@1622251002) -> (continuation of Deferred@784310946 after retry RPC after error@1544131133) -> (continuation of Deferred@403182255 after retry RPC after error@1962560017) -> (continuation of Deferred@654527646 after retry RPC after error@923515449) -> (continuation of Deferred@1875790621 after retry RPC after error@1229073975) -> (continuation of Deferred@1956183101 after retry RPC after error@505957093) -> (continuation of Deferred@61041822 after retry RPC after error@1539889483), errback=(continuation of Deferred@1236972321 after retry RPC after error@498952467) -> (continuation of Deferred@1076127260 after retry RPC after error@383687414) -> (continuation of Deferred@182522039 after retry RPC after error@2095187209) -> (continuation of Deferred@529897487 after retry RPC after error@2113845281) -> (continuation of Deferred@2132310913 after retry RPC after error@331277094) -> (continuation of Deferred@542655678 after retry RPC after error@686804772) -> (continuation of Deferred@337079755 after retry RPC after error@1892944828) -> (continuation of Deferred@306961580 after retry RPC after error@1141614382) -> (continuation of Deferred@1801319249 after retry RPC after error@998542445) -> (continuation of Deferred@2003208461 after retry RPC after error@1858957848) -> (continuation of Deferred@1779352555 after retry RPC after error@1970720035) -> (continuation of Deferred@916135009 after retry RPC after error@868480280) -> (continuation of Deferred@802060560 after retry RPC after error@1821554207) -> (continuation of Deferred@33871864 after retry RPC after error@776182165) -> (continuation of Deferred@1914270644 after retry RPC after error@197263782) -> (continuation of Deferred@803056689 after retry RPC after error@501221230) -> (continuation of Deferred@610096053 after retry RPC after error@1065986473) -> (continuation of Deferred@2104964685 after retry RPC after error@1622251002) -> (continuation of Deferred@784310946 after retry RPC after error@1544131133) -> (continuation of Deferred@403182255 after retry RPC after error@1962560017) -> (continuation of Deferred@654527646 after retry RPC after error@923515449) -> (continuation of Deferred@1875790621 after retry RPC after error@1229073975) -> (continuation of Deferred@1956183101 after retry RPC after error@505957093) -> (continuation of Deferred@61041822 after retry RPC after error@1539889483)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.189:46677
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:06:48.971 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:48.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.968668 31302 consensus_queue.cc:1048] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:06:48.975 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:48.975 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:48.977 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:48.977 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:48.977 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:48.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:48.978425 30523 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 66bf6eb9c7a64dd89a3abc089345e514 (table replication_test_table [id=2c14e26d8166482b8cd1de88f1bf2d56], current schema version=0) failed: Not found: failed to reset TS proxy: No leader found: Tablet 66bf6eb9c7a64dd89a3abc089345e514 has no consensus state
08:06:48.981 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:48.981 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:48.990 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:48.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:48.991159 31302 consensus_queue.cc:1048] T dc730dc733f34f3aa01cff8a03a1d64b P 3fd6ff86a84648679872c7b9c828d708 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:06:48.991 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:48.992 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:48.992 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:48.993 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:49.006 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:06:49.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.005350 30784 tablet_service.cc:1511] Processing CreateTablet for tablet 66bf6eb9c7a64dd89a3abc089345e514 (DEFAULT_TABLE table=replication_test_table [id=2c14e26d8166482b8cd1de88f1bf2d56]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
08:06:49.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.006894 30784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66bf6eb9c7a64dd89a3abc089345e514. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:49.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.058189 30927 tablet_service.cc:1511] Processing CreateTablet for tablet 66bf6eb9c7a64dd89a3abc089345e514 (DEFAULT_TABLE table=replication_test_table [id=2c14e26d8166482b8cd1de88f1bf2d56]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
08:06:49.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.069702 30783 tablet_service.cc:1511] Processing CreateTablet for tablet 71e73ef6d3514d87b02febae295f3921 (DEFAULT_TABLE table=replication_test_table [id=2c14e26d8166482b8cd1de88f1bf2d56]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
08:06:49.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.071223 30783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71e73ef6d3514d87b02febae295f3921. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:49.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:49.074221 31334 log.cc:927] Time spent T fcf422cfc5154d82ba8f03739eda8ff2 P 7a55aa81ed1045bbb68d397395b9ae3f: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
08:06:49.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.076869 31072 tablet_service.cc:1511] Processing CreateTablet for tablet 66bf6eb9c7a64dd89a3abc089345e514 (DEFAULT_TABLE table=replication_test_table [id=2c14e26d8166482b8cd1de88f1bf2d56]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
08:06:49.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.078826 30927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66bf6eb9c7a64dd89a3abc089345e514. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:49.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.083115 31072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66bf6eb9c7a64dd89a3abc089345e514. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:49.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.087662 31310 consensus_queue.cc:1048] T fcf422cfc5154d82ba8f03739eda8ff2 P d6acb62062c54919acc5ee398d03f785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:06:49.113 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#2) of source Source: KuduSource.
08:06:49.113 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_2.
08:06:49.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.119975 30926 tablet_service.cc:1511] Processing CreateTablet for tablet 71e73ef6d3514d87b02febae295f3921 (DEFAULT_TABLE table=replication_test_table [id=2c14e26d8166482b8cd1de88f1bf2d56]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
08:06:49.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.121577 30926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71e73ef6d3514d87b02febae295f3921. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:49.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.123265 31073 tablet_service.cc:1511] Processing CreateTablet for tablet 71e73ef6d3514d87b02febae295f3921 (DEFAULT_TABLE table=replication_test_table [id=2c14e26d8166482b8cd1de88f1bf2d56]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
08:06:49.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.124692 31073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71e73ef6d3514d87b02febae295f3921. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:49.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.249617 31348 tablet_bootstrap.cc:492] T 71e73ef6d3514d87b02febae295f3921 P 3fd6ff86a84648679872c7b9c828d708: Bootstrap starting.
08:06:49.258 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:49.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.295559 31343 tablet_bootstrap.cc:492] T 66bf6eb9c7a64dd89a3abc089345e514 P d6acb62062c54919acc5ee398d03f785: Bootstrap starting.
08:06:49.307 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:49.307 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:49.308 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:49.308 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:49.309 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:49.309 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:49.309 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:49.309 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:49.309 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:49.309 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:49.309 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:49.309 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:49.309 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:49.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.347316 31349 tablet_bootstrap.cc:492] T 66bf6eb9c7a64dd89a3abc089345e514 P 7a55aa81ed1045bbb68d397395b9ae3f: Bootstrap starting.
08:06:49.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.370227 31343 tablet_bootstrap.cc:654] T 66bf6eb9c7a64dd89a3abc089345e514 P d6acb62062c54919acc5ee398d03f785: Neither blocks nor log segments found. Creating new log.
08:06:49.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.378583 31348 tablet_bootstrap.cc:654] T 71e73ef6d3514d87b02febae295f3921 P 3fd6ff86a84648679872c7b9c828d708: Neither blocks nor log segments found. Creating new log.
08:06:49.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.393533 31349 tablet_bootstrap.cc:654] T 66bf6eb9c7a64dd89a3abc089345e514 P 7a55aa81ed1045bbb68d397395b9ae3f: Neither blocks nor log segments found. Creating new log.
08:06:49.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.396504 31348 tablet_bootstrap.cc:492] T 71e73ef6d3514d87b02febae295f3921 P 3fd6ff86a84648679872c7b9c828d708: No bootstrap required, opened a new log
08:06:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.397956 31348 ts_tablet_manager.cc:1403] T 71e73ef6d3514d87b02febae295f3921 P 3fd6ff86a84648679872c7b9c828d708: Time spent bootstrapping tablet: real 0.149s	user 0.011s	sys 0.008s
08:06:49.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.406101 31348 raft_consensus.cc:359] T 71e73ef6d3514d87b02febae295f3921 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:49.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.407402 31348 raft_consensus.cc:385] T 71e73ef6d3514d87b02febae295f3921 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:49.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.407855 31348 raft_consensus.cc:740] T 71e73ef6d3514d87b02febae295f3921 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fd6ff86a84648679872c7b9c828d708, State: Initialized, Role: FOLLOWER
08:06:49.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.408947 31348 consensus_queue.cc:260] T 71e73ef6d3514d87b02febae295f3921 P 3fd6ff86a84648679872c7b9c828d708 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:49.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.409899 31343 tablet_bootstrap.cc:492] T 66bf6eb9c7a64dd89a3abc089345e514 P d6acb62062c54919acc5ee398d03f785: No bootstrap required, opened a new log
08:06:49.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.410573 31343 ts_tablet_manager.cc:1403] T 66bf6eb9c7a64dd89a3abc089345e514 P d6acb62062c54919acc5ee398d03f785: Time spent bootstrapping tablet: real 0.116s	user 0.010s	sys 0.006s
08:06:49.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.417677 31343 raft_consensus.cc:359] T 66bf6eb9c7a64dd89a3abc089345e514 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:49.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.422001 31343 raft_consensus.cc:385] T 66bf6eb9c7a64dd89a3abc089345e514 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.424865 31343 raft_consensus.cc:740] T 66bf6eb9c7a64dd89a3abc089345e514 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6acb62062c54919acc5ee398d03f785, State: Initialized, Role: FOLLOWER
08:06:49.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.428834 31348 ts_tablet_manager.cc:1434] T 71e73ef6d3514d87b02febae295f3921 P 3fd6ff86a84648679872c7b9c828d708: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.001s
08:06:49.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.441473 31349 tablet_bootstrap.cc:492] T 66bf6eb9c7a64dd89a3abc089345e514 P 7a55aa81ed1045bbb68d397395b9ae3f: No bootstrap required, opened a new log
08:06:49.446 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:49.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.452008 31348 tablet_bootstrap.cc:492] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708: Bootstrap starting.
08:06:49.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.454537 31349 ts_tablet_manager.cc:1403] T 66bf6eb9c7a64dd89a3abc089345e514 P 7a55aa81ed1045bbb68d397395b9ae3f: Time spent bootstrapping tablet: real 0.115s	user 0.003s	sys 0.014s
08:06:49.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.427414 31343 consensus_queue.cc:260] T 66bf6eb9c7a64dd89a3abc089345e514 P d6acb62062c54919acc5ee398d03f785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:49.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.459380 31348 tablet_bootstrap.cc:654] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708: Neither blocks nor log segments found. Creating new log.
08:06:49.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.464589 31343 ts_tablet_manager.cc:1434] T 66bf6eb9c7a64dd89a3abc089345e514 P d6acb62062c54919acc5ee398d03f785: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.002s
08:06:49.471 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:49.471 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:49.471 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:49.472 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:49.472 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:49.472 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:49.474 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:49.474 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:49.477 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:49.478 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:49.479 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:49.479 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:49.479 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:49.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.483428 31349 raft_consensus.cc:359] T 66bf6eb9c7a64dd89a3abc089345e514 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:49.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.481170 31343 tablet_bootstrap.cc:492] T 71e73ef6d3514d87b02febae295f3921 P d6acb62062c54919acc5ee398d03f785: Bootstrap starting.
08:06:49.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.494359 31349 raft_consensus.cc:385] T 66bf6eb9c7a64dd89a3abc089345e514 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:49.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.494956 31349 raft_consensus.cc:740] T 66bf6eb9c7a64dd89a3abc089345e514 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a55aa81ed1045bbb68d397395b9ae3f, State: Initialized, Role: FOLLOWER
08:06:49.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.504338 31348 tablet_bootstrap.cc:492] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708: No bootstrap required, opened a new log
08:06:49.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.504868 31348 ts_tablet_manager.cc:1403] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.000s
08:06:49.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.507755 31348 raft_consensus.cc:359] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:49.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.508457 31348 raft_consensus.cc:385] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:49.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.508952 31348 raft_consensus.cc:740] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fd6ff86a84648679872c7b9c828d708, State: Initialized, Role: FOLLOWER
08:06:49.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.509752 31348 consensus_queue.cc:260] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:49.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.511217 31349 consensus_queue.cc:260] T 66bf6eb9c7a64dd89a3abc089345e514 P 7a55aa81ed1045bbb68d397395b9ae3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:49.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.524776 31348 ts_tablet_manager.cc:1434] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
08:06:49.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.529258 31349 ts_tablet_manager.cc:1434] T 66bf6eb9c7a64dd89a3abc089345e514 P 7a55aa81ed1045bbb68d397395b9ae3f: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.000s
08:06:49.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.535899 31349 tablet_bootstrap.cc:492] T 71e73ef6d3514d87b02febae295f3921 P 7a55aa81ed1045bbb68d397395b9ae3f: Bootstrap starting.
08:06:49.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.544539 31343 tablet_bootstrap.cc:654] T 71e73ef6d3514d87b02febae295f3921 P d6acb62062c54919acc5ee398d03f785: Neither blocks nor log segments found. Creating new log.
08:06:49.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.576059 31349 tablet_bootstrap.cc:654] T 71e73ef6d3514d87b02febae295f3921 P 7a55aa81ed1045bbb68d397395b9ae3f: Neither blocks nor log segments found. Creating new log.
08:06:49.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.590090 31343 tablet_bootstrap.cc:492] T 71e73ef6d3514d87b02febae295f3921 P d6acb62062c54919acc5ee398d03f785: No bootstrap required, opened a new log
08:06:49.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.591313 31343 ts_tablet_manager.cc:1403] T 71e73ef6d3514d87b02febae295f3921 P d6acb62062c54919acc5ee398d03f785: Time spent bootstrapping tablet: real 0.110s	user 0.014s	sys 0.003s
08:06:49.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.608242 31343 raft_consensus.cc:359] T 71e73ef6d3514d87b02febae295f3921 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:49.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.615355 31343 raft_consensus.cc:385] T 71e73ef6d3514d87b02febae295f3921 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:49.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.615912 31343 raft_consensus.cc:740] T 71e73ef6d3514d87b02febae295f3921 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6acb62062c54919acc5ee398d03f785, State: Initialized, Role: FOLLOWER
08:06:49.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.629863 31343 consensus_queue.cc:260] T 71e73ef6d3514d87b02febae295f3921 P d6acb62062c54919acc5ee398d03f785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:49.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.633594 31349 tablet_bootstrap.cc:492] T 71e73ef6d3514d87b02febae295f3921 P 7a55aa81ed1045bbb68d397395b9ae3f: No bootstrap required, opened a new log
08:06:49.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.634393 31349 ts_tablet_manager.cc:1403] T 71e73ef6d3514d87b02febae295f3921 P 7a55aa81ed1045bbb68d397395b9ae3f: Time spent bootstrapping tablet: real 0.099s	user 0.014s	sys 0.000s
08:06:49.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.643159 30537 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3: replication_test_table [id=2c14e26d8166482b8cd1de88f1bf2d56] alter complete (version 0)
08:06:49.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.644321 31349 raft_consensus.cc:359] T 71e73ef6d3514d87b02febae295f3921 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:49.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.645074 31349 raft_consensus.cc:385] T 71e73ef6d3514d87b02febae295f3921 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:49.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.645362 31349 raft_consensus.cc:740] T 71e73ef6d3514d87b02febae295f3921 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a55aa81ed1045bbb68d397395b9ae3f, State: Initialized, Role: FOLLOWER
08:06:49.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.648422 31343 ts_tablet_manager.cc:1434] T 71e73ef6d3514d87b02febae295f3921 P d6acb62062c54919acc5ee398d03f785: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
08:06:49.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.668524 31315 raft_consensus.cc:493] T 71e73ef6d3514d87b02febae295f3921 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:06:49.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.669122 31315 raft_consensus.cc:515] T 71e73ef6d3514d87b02febae295f3921 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:49.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.679427 31315 leader_election.cc:290] T 71e73ef6d3514d87b02febae295f3921 P 3fd6ff86a84648679872c7b9c828d708 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6acb62062c54919acc5ee398d03f785 (127.29.158.129:45149), 7a55aa81ed1045bbb68d397395b9ae3f (127.29.158.131:41421)
08:06:49.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.684329 31091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e73ef6d3514d87b02febae295f3921" candidate_uuid: "3fd6ff86a84648679872c7b9c828d708" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" is_pre_election: true
08:06:49.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.690541 30803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e73ef6d3514d87b02febae295f3921" candidate_uuid: "3fd6ff86a84648679872c7b9c828d708" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6acb62062c54919acc5ee398d03f785" is_pre_election: true
08:06:49.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.691264 30803 raft_consensus.cc:2468] T 71e73ef6d3514d87b02febae295f3921 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fd6ff86a84648679872c7b9c828d708 in term 0.
08:06:49.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.695771 30881 leader_election.cc:304] T 71e73ef6d3514d87b02febae295f3921 P 3fd6ff86a84648679872c7b9c828d708 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fd6ff86a84648679872c7b9c828d708, d6acb62062c54919acc5ee398d03f785; no voters: 
08:06:49.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.708719 31315 raft_consensus.cc:2804] T 71e73ef6d3514d87b02febae295f3921 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:06:49.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.709193 31315 raft_consensus.cc:493] T 71e73ef6d3514d87b02febae295f3921 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:06:49.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.709565 31315 raft_consensus.cc:3060] T 71e73ef6d3514d87b02febae295f3921 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Advancing to term 1
08:06:49.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.730296 31315 raft_consensus.cc:515] T 71e73ef6d3514d87b02febae295f3921 P 3fd6ff86a84648679872c7b9c828d708 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:49.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.732553 31315 leader_election.cc:290] T 71e73ef6d3514d87b02febae295f3921 P 3fd6ff86a84648679872c7b9c828d708 [CANDIDATE]: Term 1 election: Requested vote from peers d6acb62062c54919acc5ee398d03f785 (127.29.158.129:45149), 7a55aa81ed1045bbb68d397395b9ae3f (127.29.158.131:41421)
08:06:49.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.735061 30803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e73ef6d3514d87b02febae295f3921" candidate_uuid: "3fd6ff86a84648679872c7b9c828d708" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6acb62062c54919acc5ee398d03f785"
08:06:49.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.735671 30803 raft_consensus.cc:3060] T 71e73ef6d3514d87b02febae295f3921 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Advancing to term 1
08:06:49.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.738703 31093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e73ef6d3514d87b02febae295f3921" candidate_uuid: "3fd6ff86a84648679872c7b9c828d708" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a55aa81ed1045bbb68d397395b9ae3f"
08:06:49.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.745289 31344 raft_consensus.cc:493] T 66bf6eb9c7a64dd89a3abc089345e514 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:06:49.758 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:49.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.745769 31344 raft_consensus.cc:515] T 66bf6eb9c7a64dd89a3abc089345e514 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:49.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.722381 31349 consensus_queue.cc:260] T 71e73ef6d3514d87b02febae295f3921 P 7a55aa81ed1045bbb68d397395b9ae3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:49.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.748157 31344 leader_election.cc:290] T 66bf6eb9c7a64dd89a3abc089345e514 P d6acb62062c54919acc5ee398d03f785 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fd6ff86a84648679872c7b9c828d708 (127.29.158.130:33769), 7a55aa81ed1045bbb68d397395b9ae3f (127.29.158.131:41421)
08:06:49.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.751410 31315 raft_consensus.cc:493] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:06:49.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.751945 31315 raft_consensus.cc:515] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:49.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.755187 31349 ts_tablet_manager.cc:1434] T 71e73ef6d3514d87b02febae295f3921 P 7a55aa81ed1045bbb68d397395b9ae3f: Time spent starting tablet: real 0.120s	user 0.001s	sys 0.006s
08:06:49.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.762028 31091 raft_consensus.cc:2468] T 71e73ef6d3514d87b02febae295f3921 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fd6ff86a84648679872c7b9c828d708 in term 0.
08:06:49.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.771641 31315 leader_election.cc:290] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6acb62062c54919acc5ee398d03f785 (127.29.158.129:45149), 7a55aa81ed1045bbb68d397395b9ae3f (127.29.158.131:41421)
08:06:49.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.794413 30947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bf6eb9c7a64dd89a3abc089345e514" candidate_uuid: "d6acb62062c54919acc5ee398d03f785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fd6ff86a84648679872c7b9c828d708" is_pre_election: true
08:06:49.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.795217 30947 raft_consensus.cc:2468] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6acb62062c54919acc5ee398d03f785 in term 0.
08:06:49.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.811770 30718 leader_election.cc:304] T 66bf6eb9c7a64dd89a3abc089345e514 P d6acb62062c54919acc5ee398d03f785 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fd6ff86a84648679872c7b9c828d708, d6acb62062c54919acc5ee398d03f785; no voters: 
08:06:49.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.812983 30804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bf6eb9c7a64dd89a3abc089345e514" candidate_uuid: "3fd6ff86a84648679872c7b9c828d708" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6acb62062c54919acc5ee398d03f785" is_pre_election: true
08:06:49.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.813903 30804 raft_consensus.cc:2468] T 66bf6eb9c7a64dd89a3abc089345e514 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fd6ff86a84648679872c7b9c828d708 in term 0.
08:06:49.849 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:49.850 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:49.850 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:49.851 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:49.851 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:49.851 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:49.851 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:49.851 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:49.851 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:49.852 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:49.852 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:49.852 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:49.852 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:49.858 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:49.858 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:49.858 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:49.859 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:49.859 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:49.859 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:49.859 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:49.859 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:49.859 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:49.860 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:49.860 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:49.860 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:49.860 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:49.861 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=26846), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [7ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [8ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [9ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [22ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [22ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [23ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [23ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [42ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [43ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [43ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [43ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [62ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [62ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [62ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [62ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [81ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [81ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [81ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [82ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [122ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [143ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [242ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [242ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [243ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [243ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [422ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [423ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [423ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [423ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [921ms] refreshing cache from master, [922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [923ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [924ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [924ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [925ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [925ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1080ms] refreshing cache from master, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1084ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1084ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1240ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1245ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1245ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3100ms] refreshing cache from master, [3100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [3102ms] too many traces: truncated at 100 traces, deferred=Deferred@1696516909(state=PENDING, result=null, callback=(continuation of Deferred@1081605756 after retry RPC after error@753873919) -> (continuation of Deferred@892493081 after retry RPC after error@644263729) -> (continuation of Deferred@1495081375 after retry RPC after error@213422472) -> (continuation of Deferred@725995411 after retry RPC after error@952754925) -> (continuation of Deferred@141045170 after retry RPC after error@1075108326) -> (continuation of Deferred@1168682784 after retry RPC after error@838988786) -> (continuation of Deferred@2077052349 after retry RPC after error@493904075) -> (continuation of Deferred@497094122 after retry RPC after error@537060303) -> (continuation of Deferred@825488087 after retry RPC after error@794540546) -> (continuation of Deferred@973089886 after retry RPC after error@229358666) -> (continuation of Deferred@597709410 after retry RPC after error@1373202366) -> (continuation of Deferred@1778438919 after retry RPC after error@974744545) -> (continuation of Deferred@462097794 after retry RPC after error@32865754) -> (continuation of Deferred@1837178376 after retry RPC after error@481703482) -> (continuation of Deferred@1595068211 after retry RPC after error@1965257382) -> (continuation of Deferred@272061268 after retry RPC after error@1033744526) -> (continuation of Deferred@1950325593 after retry RPC after error@451371322) -> (continuation of Deferred@820001985 after retry RPC after error@1621750675) -> (continuation of Deferred@1757698444 after retry RPC after error@1225460511) -> (continuation of Deferred@2025599179 after retry RPC after error@1462137124) -> (continuation of Deferred@493111925 after retry RPC after error@203876661) -> (continuation of Deferred@352696850 after retry RPC after error@1909343943) -> (continuation of Deferred@1321639273 after retry RPC after error@1972550341) -> (continuation of Deferred@1300187983 after retry RPC after error@1317323865) -> (continuation of Deferred@886256949 after retry RPC after error@1417143800) -> (continuation of Deferred@1676011786 after retry RPC after error@187387683) -> (continuation of Deferred@654092782 after retry RPC after error@1305460972), errback=(continuation of Deferred@1081605756 after retry RPC after error@753873919) -> (continuation of Deferred@892493081 after retry RPC after error@644263729) -> (continuation of Deferred@1495081375 after retry RPC after error@213422472) -> (continuation of Deferred@725995411 after retry RPC after error@952754925) -> (continuation of Deferred@141045170 after retry RPC after error@1075108326) -> (continuation of Deferred@1168682784 after retry RPC after error@838988786) -> (continuation of Deferred@2077052349 after retry RPC after error@493904075) -> (continuation of Deferred@497094122 after retry RPC after error@537060303) -> (continuation of Deferred@825488087 after retry RPC after error@794540546) -> (continuation of Deferred@973089886 after retry RPC after error@229358666) -> (continuation of Deferred@597709410 after retry RPC after error@1373202366) -> (continuation of Deferred@1778438919 after retry RPC after error@974744545) -> (continuation of Deferred@462097794 after retry RPC after error@32865754) -> (continuation of Deferred@1837178376 after retry RPC after error@481703482) -> (continuation of Deferred@1595068211 after retry RPC after error@1965257382) -> (continuation of Deferred@272061268 after retry RPC after error@1033744526) -> (continuation of Deferred@1950325593 after retry RPC after error@451371322) -> (continuation of Deferred@820001985 after retry RPC after error@1621750675) -> (continuation of Deferred@1757698444 after retry RPC after error@1225460511) -> (continuation of Deferred@2025599179 after retry RPC after error@1462137124) -> (continuation of Deferred@493111925 after retry RPC after error@203876661) -> (continuation of Deferred@352696850 after retry RPC after error@1909343943) -> (continuation of Deferred@1321639273 after retry RPC after error@1972550341) -> (continuation of Deferred@1300187983 after retry RPC after error@1317323865) -> (continuation of Deferred@886256949 after retry RPC after error@1417143800) -> (continuation of Deferred@1676011786 after retry RPC after error@187387683) -> (continuation of Deferred@654092782 after retry RPC after error@1305460972)))
08:06:49.869 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
08:06:49.869 [WARN - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#4 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=26846), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [7ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [8ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [9ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [22ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [22ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [23ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [23ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [42ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [43ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [43ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [43ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [62ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [62ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [62ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [62ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [81ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [81ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [81ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [82ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [122ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [143ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [242ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [242ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [243ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [243ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [422ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [423ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [423ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [423ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [921ms] refreshing cache from master, [922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [923ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [924ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [924ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [925ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [925ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1080ms] refreshing cache from master, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1084ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1084ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1240ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1245ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1245ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3100ms] refreshing cache from master, [3100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [3102ms] too many traces: truncated at 100 traces, deferred=Deferred@1696516909(state=PENDING, result=null, callback=(continuation of Deferred@1081605756 after retry RPC after error@753873919) -> (continuation of Deferred@892493081 after retry RPC after error@644263729) -> (continuation of Deferred@1495081375 after retry RPC after error@213422472) -> (continuation of Deferred@725995411 after retry RPC after error@952754925) -> (continuation of Deferred@141045170 after retry RPC after error@1075108326) -> (continuation of Deferred@1168682784 after retry RPC after error@838988786) -> (continuation of Deferred@2077052349 after retry RPC after error@493904075) -> (continuation of Deferred@497094122 after retry RPC after error@537060303) -> (continuation of Deferred@825488087 after retry RPC after error@794540546) -> (continuation of Deferred@973089886 after retry RPC after error@229358666) -> (continuation of Deferred@597709410 after retry RPC after error@1373202366) -> (continuation of Deferred@1778438919 after retry RPC after error@974744545) -> (continuation of Deferred@462097794 after retry RPC after error@32865754) -> (continuation of Deferred@1837178376 after retry RPC after error@481703482) -> (continuation of Deferred@1595068211 after retry RPC after error@1965257382) -> (continuation of Deferred@272061268 after retry RPC after error@1033744526) -> (continuation of Deferred@1950325593 after retry RPC after error@451371322) -> (continuation of Deferred@820001985 after retry RPC after error@1621750675) -> (continuation of Deferred@1757698444 after retry RPC after error@1225460511) -> (continuation of Deferred@2025599179 after retry RPC after error@1462137124) -> (continuation of Deferred@493111925 after retry RPC after error@203876661) -> (continuation of Deferred@352696850 after retry RPC after error@1909343943) -> (continuation of Deferred@1321639273 after retry RPC after error@1972550341) -> (continuation of Deferred@1300187983 after retry RPC after error@1317323865) -> (continuation of Deferred@886256949 after retry RPC after error@1417143800) -> (continuation of Deferred@1676011786 after retry RPC after error@187387683) -> (continuation of Deferred@654092782 after retry RPC after error@1305460972), errback=(continuation of Deferred@1081605756 after retry RPC after error@753873919) -> (continuation of Deferred@892493081 after retry RPC after error@644263729) -> (continuation of Deferred@1495081375 after retry RPC after error@213422472) -> (continuation of Deferred@725995411 after retry RPC after error@952754925) -> (continuation of Deferred@141045170 after retry RPC after error@1075108326) -> (continuation of Deferred@1168682784 after retry RPC after error@838988786) -> (continuation of Deferred@2077052349 after retry RPC after error@493904075) -> (continuation of Deferred@497094122 after retry RPC after error@537060303) -> (continuation of Deferred@825488087 after retry RPC after error@794540546) -> (continuation of Deferred@973089886 after retry RPC after error@229358666) -> (continuation of Deferred@597709410 after retry RPC after error@1373202366) -> (continuation of Deferred@1778438919 after retry RPC after error@974744545) -> (continuation of Deferred@462097794 after retry RPC after error@32865754) -> (continuation of Deferred@1837178376 after retry RPC after error@481703482) -> (continuation of Deferred@1595068211 after retry RPC after error@1965257382) -> (continuation of Deferred@272061268 after retry RPC after error@1033744526) -> (continuation of Deferred@1950325593 after retry RPC after error@451371322) -> (continuation of Deferred@820001985 after retry RPC after error@1621750675) -> (continuation of Deferred@1757698444 after retry RPC after error@1225460511) -> (continuation of Deferred@2025599179 after retry RPC after error@1462137124) -> (continuation of Deferred@493111925 after retry RPC after error@203876661) -> (continuation of Deferred@352696850 after retry RPC after error@1909343943) -> (continuation of Deferred@1321639273 after retry RPC after error@1972550341) -> (continuation of Deferred@1300187983 after retry RPC after error@1317323865) -> (continuation of Deferred@886256949 after retry RPC after error@1417143800) -> (continuation of Deferred@1676011786 after retry RPC after error@187387683) -> (continuation of Deferred@654092782 after retry RPC after error@1305460972)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:06:49.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.816077 31093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bf6eb9c7a64dd89a3abc089345e514" candidate_uuid: "d6acb62062c54919acc5ee398d03f785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" is_pre_election: true
08:06:49.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.816738 31093 raft_consensus.cc:2468] T 66bf6eb9c7a64dd89a3abc089345e514 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6acb62062c54919acc5ee398d03f785 in term 0.
08:06:49.899 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job e26b904229418d0e047d5d94c5b9f905 from Checkpoint 76 @ 1779091546865 for e26b904229418d0e047d5d94c5b9f905 located at file:/tmp/junit16937918701930502306/checkpoints/e26b904229418d0e047d5d94c5b9f905/chk-76.
08:06:49.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.894255 30881 leader_election.cc:304] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fd6ff86a84648679872c7b9c828d708, d6acb62062c54919acc5ee398d03f785; no voters: 
08:06:49.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.895279 31315 raft_consensus.cc:2804] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:06:49.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.895705 31315 raft_consensus.cc:493] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:06:49.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.896088 31315 raft_consensus.cc:3060] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Advancing to term 1
08:06:49.900 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
08:06:49.900 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to SCHEDULED.
08:06:49.901 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:06:49.902 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 76 for source Source: KuduSource to checkpoint.
08:06:49.904 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from SCHEDULED to DEPLOYING.
08:06:49.904 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #3) with attempt id 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1) with allocation id 0f1066b174fb1f271b9fbb4939140659
08:06:49.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.903528 31091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bf6eb9c7a64dd89a3abc089345e514" candidate_uuid: "3fd6ff86a84648679872c7b9c828d708" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" is_pre_election: true
08:06:49.905 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 0f1066b174fb1f271b9fbb4939140659.
08:06:49.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.904425 31091 raft_consensus.cc:2468] T 66bf6eb9c7a64dd89a3abc089345e514 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fd6ff86a84648679872c7b9c828d708 in term 0.
08:06:49.907 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#3 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_3), deploy into slot with allocation id 0f1066b174fb1f271b9fbb4939140659.
08:06:49.908 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (e26b904229418d0e047d5d94c5b9f905) switched from state RESTARTING to RUNNING.
08:06:49.908 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job e26b904229418d0e047d5d94c5b9f905 from Checkpoint 76 @ 1779091546865 for e26b904229418d0e047d5d94c5b9f905 located at file:/tmp/junit16937918701930502306/checkpoints/e26b904229418d0e047d5d94c5b9f905/chk-76.
08:06:49.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.906708 31344 raft_consensus.cc:2804] T 66bf6eb9c7a64dd89a3abc089345e514 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:06:49.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.907074 31344 raft_consensus.cc:493] T 66bf6eb9c7a64dd89a3abc089345e514 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:06:49.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.907433 31344 raft_consensus.cc:3060] T 66bf6eb9c7a64dd89a3abc089345e514 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Advancing to term 1
08:06:49.910 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
08:06:49.910 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 2 to checkpoint 76 for source Source: KuduSource to checkpoint.
08:06:49.911 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to SCHEDULED.
08:06:49.911 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:06:49.912 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from SCHEDULED to DEPLOYING.
08:06:49.912 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #3) with attempt id 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1) with allocation id bc35714883422bae5e4de5056d4b8678
08:06:49.917 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot bc35714883422bae5e4de5056d4b8678.
08:06:49.918 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#3 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_3), deploy into slot with allocation id bc35714883422bae5e4de5056d4b8678.
08:06:49.919 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to DEPLOYING.
08:06:49.919 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#3 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_3) [DEPLOYING].
08:06:49.920 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@766bef33
08:06:49.920 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:06:49.921 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16937918701930502306/checkpoints")
08:06:49.921 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
08:06:49.921 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
08:06:49.928 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to DEPLOYING.
08:06:49.929 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#3 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_3) [DEPLOYING].
08:06:49.933 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@8a2f9d1
08:06:49.933 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:06:49.933 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16937918701930502306/checkpoints")
08:06:49.934 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
08:06:49.934 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
08:06:49.936 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#4 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
08:06:49.939 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#4 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_4.
08:06:49.941 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to FAILED on 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=26846), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [7ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [8ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [9ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [22ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [22ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [23ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [23ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [42ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [43ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [43ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [43ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [62ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [62ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [62ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [62ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [81ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [81ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [81ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [82ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [122ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [143ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [242ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [242ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [243ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [243ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [422ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [423ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [423ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [423ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [921ms] refreshing cache from master, [922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [923ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [924ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [924ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [925ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [925ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1080ms] refreshing cache from master, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1084ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1084ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1240ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1245ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1245ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3100ms] refreshing cache from master, [3100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [3102ms] too many traces: truncated at 100 traces, deferred=Deferred@1696516909(state=PENDING, result=null, callback=(continuation of Deferred@1081605756 after retry RPC after error@753873919) -> (continuation of Deferred@892493081 after retry RPC after error@644263729) -> (continuation of Deferred@1495081375 after retry RPC after error@213422472) -> (continuation of Deferred@725995411 after retry RPC after error@952754925) -> (continuation of Deferred@141045170 after retry RPC after error@1075108326) -> (continuation of Deferred@1168682784 after retry RPC after error@838988786) -> (continuation of Deferred@2077052349 after retry RPC after error@493904075) -> (continuation of Deferred@497094122 after retry RPC after error@537060303) -> (continuation of Deferred@825488087 after retry RPC after error@794540546) -> (continuation of Deferred@973089886 after retry RPC after error@229358666) -> (continuation of Deferred@597709410 after retry RPC after error@1373202366) -> (continuation of Deferred@1778438919 after retry RPC after error@974744545) -> (continuation of Deferred@462097794 after retry RPC after error@32865754) -> (continuation of Deferred@1837178376 after retry RPC after error@481703482) -> (continuation of Deferred@1595068211 after retry RPC after error@1965257382) -> (continuation of Deferred@272061268 after retry RPC after error@1033744526) -> (continuation of Deferred@1950325593 after retry RPC after error@451371322) -> (continuation of Deferred@820001985 after retry RPC after error@1621750675) -> (continuation of Deferred@1757698444 after retry RPC after error@1225460511) -> (continuation of Deferred@2025599179 after retry RPC after error@1462137124) -> (continuation of Deferred@493111925 after retry RPC after error@203876661) -> (continuation of Deferred@352696850 after retry RPC after error@1909343943) -> (continuation of Deferred@1321639273 after retry RPC after error@1972550341) -> (continuation of Deferred@1300187983 after retry RPC after error@1317323865) -> (continuation of Deferred@886256949 after retry RPC after error@1417143800) -> (continuation of Deferred@1676011786 after retry RPC after error@187387683) -> (continuation of Deferred@654092782 after retry RPC after error@1305460972), errback=(continuation of Deferred@1081605756 after retry RPC after error@753873919) -> (continuation of Deferred@892493081 after retry RPC after error@644263729) -> (continuation of Deferred@1495081375 after retry RPC after error@213422472) -> (continuation of Deferred@725995411 after retry RPC after error@952754925) -> (continuation of Deferred@141045170 after retry RPC after error@1075108326) -> (continuation of Deferred@1168682784 after retry RPC after error@838988786) -> (continuation of Deferred@2077052349 after retry RPC after error@493904075) -> (continuation of Deferred@497094122 after retry RPC after error@537060303) -> (continuation of Deferred@825488087 after retry RPC after error@794540546) -> (continuation of Deferred@973089886 after retry RPC after error@229358666) -> (continuation of Deferred@597709410 after retry RPC after error@1373202366) -> (continuation of Deferred@1778438919 after retry RPC after error@974744545) -> (continuation of Deferred@462097794 after retry RPC after error@32865754) -> (continuation of Deferred@1837178376 after retry RPC after error@481703482) -> (continuation of Deferred@1595068211 after retry RPC after error@1965257382) -> (continuation of Deferred@272061268 after retry RPC after error@1033744526) -> (continuation of Deferred@1950325593 after retry RPC after error@451371322) -> (continuation of Deferred@820001985 after retry RPC after error@1621750675) -> (continuation of Deferred@1757698444 after retry RPC after error@1225460511) -> (continuation of Deferred@2025599179 after retry RPC after error@1462137124) -> (continuation of Deferred@493111925 after retry RPC after error@203876661) -> (continuation of Deferred@352696850 after retry RPC after error@1909343943) -> (continuation of Deferred@1321639273 after retry RPC after error@1972550341) -> (continuation of Deferred@1300187983 after retry RPC after error@1317323865) -> (continuation of Deferred@886256949 after retry RPC after error@1417143800) -> (continuation of Deferred@1676011786 after retry RPC after error@187387683) -> (continuation of Deferred@654092782 after retry RPC after error@1305460972)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:06:49.941 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5b9e0bd6
08:06:49.946 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:06:49.947 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#4) of source Source: KuduSource.
08:06:49.948 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_4.
08:06:49.948 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (b42812d69c586178cf7556c3c92998f3) switched from state RUNNING to RESTARTING.
08:06:49.949 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:49.951 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:49.953 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@131f0a19
08:06:49.956 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:49.964 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:49.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.965600 30803 raft_consensus.cc:2468] T 71e73ef6d3514d87b02febae295f3921 P d6acb62062c54919acc5ee398d03f785 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fd6ff86a84648679872c7b9c828d708 in term 1.
08:06:49.966 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:49.985 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:49.985 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:49.985 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:49.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:49.985102 31315 raft_consensus.cc:515] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:49.985 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:49.986 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:49.988 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:49.988 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:49.988 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:49.993 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:49.993 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.001 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.002 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:50.003 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:50.006 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:50.006 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:50.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.005569 30881 leader_election.cc:304] T 71e73ef6d3514d87b02febae295f3921 P 3fd6ff86a84648679872c7b9c828d708 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fd6ff86a84648679872c7b9c828d708, d6acb62062c54919acc5ee398d03f785; no voters: 7a55aa81ed1045bbb68d397395b9ae3f
08:06:50.008 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.012 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.012 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.017 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:50.018 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.018 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.018 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.023 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.023 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.024 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.024 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:50.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.023622 31344 raft_consensus.cc:515] T 66bf6eb9c7a64dd89a3abc089345e514 P d6acb62062c54919acc5ee398d03f785 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:50.028 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:50.029 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.029 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.030 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.034 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:50.035 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.036 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.036 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.038446 31377 raft_consensus.cc:2804] T 71e73ef6d3514d87b02febae295f3921 P 3fd6ff86a84648679872c7b9c828d708 [term 1 FOLLOWER]: Leader election won for term 1
08:06:50.043 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:50.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.042043 30803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bf6eb9c7a64dd89a3abc089345e514" candidate_uuid: "3fd6ff86a84648679872c7b9c828d708" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6acb62062c54919acc5ee398d03f785"
08:06:50.043 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.043 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.043 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.043 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:50.046 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:50.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.055095 31091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bf6eb9c7a64dd89a3abc089345e514" candidate_uuid: "3fd6ff86a84648679872c7b9c828d708" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a55aa81ed1045bbb68d397395b9ae3f"
08:06:50.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.055923 31091 raft_consensus.cc:3060] T 66bf6eb9c7a64dd89a3abc089345e514 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Advancing to term 1
08:06:50.066 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:50.067 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.067 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.067 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.070 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:50.071 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.071 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.072 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.079 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.080 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.080 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.080 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:50.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.018260 31315 leader_election.cc:290] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708 [CANDIDATE]: Term 1 election: Requested vote from peers d6acb62062c54919acc5ee398d03f785 (127.29.158.129:45149), 7a55aa81ed1045bbb68d397395b9ae3f (127.29.158.131:41421)
08:06:50.083 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:50.089 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:50.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.085450 30947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bf6eb9c7a64dd89a3abc089345e514" candidate_uuid: "d6acb62062c54919acc5ee398d03f785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fd6ff86a84648679872c7b9c828d708"
08:06:50.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.086491 30947 raft_consensus.cc:2393] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d6acb62062c54919acc5ee398d03f785 in current term 1: Already voted for candidate 3fd6ff86a84648679872c7b9c828d708 in this term.
08:06:50.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.090317 30803 raft_consensus.cc:2393] T 66bf6eb9c7a64dd89a3abc089345e514 P d6acb62062c54919acc5ee398d03f785 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3fd6ff86a84648679872c7b9c828d708 in current term 1: Already voted for candidate d6acb62062c54919acc5ee398d03f785 in this term.
08:06:50.091 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.091 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.091 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:50.100497 30523 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 66bf6eb9c7a64dd89a3abc089345e514 (table replication_test_table [id=2c14e26d8166482b8cd1de88f1bf2d56], current schema version=0) failed: Not found: failed to reset TS proxy: No leader found: Tablet 66bf6eb9c7a64dd89a3abc089345e514 consensus state has no leader
08:06:50.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.065236 31091 raft_consensus.cc:2468] T 66bf6eb9c7a64dd89a3abc089345e514 P 7a55aa81ed1045bbb68d397395b9ae3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fd6ff86a84648679872c7b9c828d708 in term 1.
08:06:50.102 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:50.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.102394 30881 leader_election.cc:304] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fd6ff86a84648679872c7b9c828d708, 7a55aa81ed1045bbb68d397395b9ae3f; no voters: d6acb62062c54919acc5ee398d03f785
08:06:50.106 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.106 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.106 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.109 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:50.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.105983 31093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bf6eb9c7a64dd89a3abc089345e514" candidate_uuid: "d6acb62062c54919acc5ee398d03f785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a55aa81ed1045bbb68d397395b9ae3f"
08:06:50.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.106953 31093 raft_consensus.cc:2393] T 66bf6eb9c7a64dd89a3abc089345e514 P 7a55aa81ed1045bbb68d397395b9ae3f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d6acb62062c54919acc5ee398d03f785 in current term 1: Already voted for candidate 3fd6ff86a84648679872c7b9c828d708 in this term.
08:06:50.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.108407 30715 leader_election.cc:304] T 66bf6eb9c7a64dd89a3abc089345e514 P d6acb62062c54919acc5ee398d03f785 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6acb62062c54919acc5ee398d03f785; no voters: 3fd6ff86a84648679872c7b9c828d708, 7a55aa81ed1045bbb68d397395b9ae3f
08:06:50.109 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.109 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.109 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.111 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.111 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.111 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.111 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:50.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.114241 31377 raft_consensus.cc:697] T 71e73ef6d3514d87b02febae295f3921 P 3fd6ff86a84648679872c7b9c828d708 [term 1 LEADER]: Becoming Leader. State: Replica: 3fd6ff86a84648679872c7b9c828d708, State: Running, Role: LEADER
08:06:50.117 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:50.118 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.118 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.118 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.116385 31377 consensus_queue.cc:237] T 71e73ef6d3514d87b02febae295f3921 P 3fd6ff86a84648679872c7b9c828d708 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:50.118 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.118 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.118 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.118 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:50.123 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:50.123 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:50.124 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:50.124 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.124 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.124 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.124 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.125 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.125 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.125 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.125 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.125 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.125 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:50.126 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:50.127 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:50.127 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:50.127 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.127 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.127 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.128 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.128 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.128 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.128 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.128 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.128 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.128 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:50.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.128422 31391 raft_consensus.cc:2749] T 66bf6eb9c7a64dd89a3abc089345e514 P d6acb62062c54919acc5ee398d03f785 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
08:06:50.144 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:50.144 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:50.144 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:50.145 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.145 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.145 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.146 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.146 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.146 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.147 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.147 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.147 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.147 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:50.147 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:50.148 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:50.148 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:50.150 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.150 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.150 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.151 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.151 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.151 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.151 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.151 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.151 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.152 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:50.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:50.098628 29742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.220.253:45079, user_credentials={real_user=slave}} blocked reactor thread for 301567us
08:06:50.166 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:50.167 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:50.167 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:50.168 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.168 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.168 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.168 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.168 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.168 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.169 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.169 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.169 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.169 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:50.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.169667 31344 leader_election.cc:290] T 66bf6eb9c7a64dd89a3abc089345e514 P d6acb62062c54919acc5ee398d03f785 [CANDIDATE]: Term 1 election: Requested vote from peers 3fd6ff86a84648679872c7b9c828d708 (127.29.158.130:33769), 7a55aa81ed1045bbb68d397395b9ae3f (127.29.158.131:41421)
08:06:50.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.135878 31382 raft_consensus.cc:2804] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708 [term 1 FOLLOWER]: Leader election won for term 1
08:06:50.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.174765 31382 raft_consensus.cc:697] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708 [term 1 LEADER]: Becoming Leader. State: Replica: 3fd6ff86a84648679872c7b9c828d708, State: Running, Role: LEADER
08:06:50.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.177470 31382 consensus_queue.cc:237] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:50.183 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:50.183 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:50.183 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:50.184 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.184 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.184 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.185 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.185 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.185 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.185 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.185 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.185 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.185 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:50.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.202857 30536 catalog_manager.cc:5696] T 71e73ef6d3514d87b02febae295f3921 P 3fd6ff86a84648679872c7b9c828d708 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fd6ff86a84648679872c7b9c828d708 (127.29.158.130). New cstate: current_term: 1 leader_uuid: "3fd6ff86a84648679872c7b9c828d708" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } health_report { overall_health: UNKNOWN } } }
08:06:50.207 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:50.207 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:50.207 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:50.208 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.208 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.208 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.208 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.209 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.209 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.209 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.209 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.209 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.209 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:50.223 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:50.224 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:50.224 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:50.224 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.225 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.225 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.225 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.225 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.225 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.226 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.226 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.226 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.226 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:50.232 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:50.232 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:50.232 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:50.233 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:50.233 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:50.233 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:50.240 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:50.240 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:50.240 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:50.240 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:50.240 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:50.240 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:50.240 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:50.257 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:50.266 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:50.267 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:50.267 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:50.268 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.268 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.268 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.268 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.269 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.269 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.269 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.269 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.269 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.270 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:50.283 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:50.283 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:50.283 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:50.284 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.284 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.284 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.285 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.285 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.285 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.285 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.285 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.286 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.286 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:50.319 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:50.319 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:50.319 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:50.320 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:50.320 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:50.320 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:50.321 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:50.321 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:50.321 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:50.323 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:50.323 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:50.323 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:50.324 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:50.363 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:50.364 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:50.364 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:50.365 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.365 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.365 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.365 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.365 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.365 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.366 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.366 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.366 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.366 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:50.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.381423 30536 catalog_manager.cc:5696] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fd6ff86a84648679872c7b9c828d708 (127.29.158.130). New cstate: current_term: 1 leader_uuid: "3fd6ff86a84648679872c7b9c828d708" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } health_report { overall_health: UNKNOWN } } }
08:06:50.457 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:50.489 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:50.490 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:50.490 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:50.490 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.490 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.491 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.491 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.491 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.491 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.492 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.492 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.492 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.492 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:50.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.587762 31382 consensus_queue.cc:1048] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:06:50.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.627265 31315 consensus_queue.cc:1048] T 71e73ef6d3514d87b02febae295f3921 P 3fd6ff86a84648679872c7b9c828d708 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:06:50.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.633982 31315 consensus_queue.cc:1048] T 66bf6eb9c7a64dd89a3abc089345e514 P 3fd6ff86a84648679872c7b9c828d708 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:06:50.664 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:50.664 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:50.664 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:50.665 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.665 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.665 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.666 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.666 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.666 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.667 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.667 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.667 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.667 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:50.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.691756 31093 raft_consensus.cc:3060] T 71e73ef6d3514d87b02febae295f3921 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Advancing to term 1
08:06:50.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:50.722934 31408 consensus_queue.cc:1048] T 71e73ef6d3514d87b02febae295f3921 P 3fd6ff86a84648679872c7b9c828d708 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:06:50.758 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:50.790 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:50.791 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:50.791 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:50.792 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:50.792 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:50.792 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:50.793 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:50.793 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:50.793 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:50.794 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:50.794 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:50.794 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:50.794 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:50.827 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:50.827 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:50.827 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:50.830 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.830 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.831 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.831 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.831 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.831 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.832 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.832 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.832 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.832 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:50.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:50.967 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:50.967 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:50.967 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:50.968 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.968 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.968 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:50.969 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.969 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.969 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:50.973 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.973 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.973 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:50.973 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:51.009 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:51.009 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:51.009 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:51.010 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:51.010 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:51.011 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:51.011 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:51.011 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:51.011 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:51.012 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:51.012 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:51.012 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:51.012 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:51.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.157510 30537 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37472:
08:06:51.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "replication_test_table" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\001\226\000\000\000\007\000" } } } schema { columns { name: "key1" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key2" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key3" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "data" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } }
08:06:51.258 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:51.283 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:51.284 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:51.284 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:51.284 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:51.285 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:51.285 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:51.285 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:51.285 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:51.285 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:51.286 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:51.286 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:51.286 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:51.286 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:51.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:51.311040 30537 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 80406d7ef2e842c0b0a8f0ee45db6639 has no consensus state
08:06:51.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:51.322218 30537 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2ab829b4cc354ec6b972bd7bd1f9f105 has no consensus state
08:06:51.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:51.357077 30525 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 2ab829b4cc354ec6b972bd7bd1f9f105 (table replication_test_table [id=2c14e26d8166482b8cd1de88f1bf2d56], current schema version=0) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2ab829b4cc354ec6b972bd7bd1f9f105 has no consensus state
08:06:51.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.384846 30783 tablet_service.cc:1511] Processing CreateTablet for tablet 80406d7ef2e842c0b0a8f0ee45db6639 (DEFAULT_TABLE table=replication_test_table [id=2c14e26d8166482b8cd1de88f1bf2d56]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
08:06:51.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.386271 30783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80406d7ef2e842c0b0a8f0ee45db6639. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:51.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.414249 30926 tablet_service.cc:1511] Processing CreateTablet for tablet 80406d7ef2e842c0b0a8f0ee45db6639 (DEFAULT_TABLE table=replication_test_table [id=2c14e26d8166482b8cd1de88f1bf2d56]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
08:06:51.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.416033 30926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80406d7ef2e842c0b0a8f0ee45db6639. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:51.417 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:51.418 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:51.418 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:51.418 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:51.418 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:51.418 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:51.419 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:51.419 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:51.419 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:51.419 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:51.419 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:51.419 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:51.419 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:51.428 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:51.429 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:51.429 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:51.429 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:51.429 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:51.429 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:51.430 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:51.430 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:51.430 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:51.430 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:51.430 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:51.430 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:51.431 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:51.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.433857 30927 tablet_service.cc:1511] Processing CreateTablet for tablet 2ab829b4cc354ec6b972bd7bd1f9f105 (DEFAULT_TABLE table=replication_test_table [id=2c14e26d8166482b8cd1de88f1bf2d56]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
08:06:51.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.435279 30927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ab829b4cc354ec6b972bd7bd1f9f105. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:51.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.437033 31073 tablet_service.cc:1511] Processing CreateTablet for tablet 2ab829b4cc354ec6b972bd7bd1f9f105 (DEFAULT_TABLE table=replication_test_table [id=2c14e26d8166482b8cd1de88f1bf2d56]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
08:06:51.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.439890 30784 tablet_service.cc:1511] Processing CreateTablet for tablet 2ab829b4cc354ec6b972bd7bd1f9f105 (DEFAULT_TABLE table=replication_test_table [id=2c14e26d8166482b8cd1de88f1bf2d56]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
08:06:51.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.441179 30784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ab829b4cc354ec6b972bd7bd1f9f105. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:51.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.429554 31072 tablet_service.cc:1511] Processing CreateTablet for tablet 80406d7ef2e842c0b0a8f0ee45db6639 (DEFAULT_TABLE table=replication_test_table [id=2c14e26d8166482b8cd1de88f1bf2d56]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
08:06:51.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.443325 31072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80406d7ef2e842c0b0a8f0ee45db6639. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:51.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.447149 31073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ab829b4cc354ec6b972bd7bd1f9f105. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:51.457 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:51.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.508502 31422 tablet_bootstrap.cc:492] T 80406d7ef2e842c0b0a8f0ee45db6639 P d6acb62062c54919acc5ee398d03f785: Bootstrap starting.
08:06:51.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.520146 31423 tablet_bootstrap.cc:492] T 80406d7ef2e842c0b0a8f0ee45db6639 P 3fd6ff86a84648679872c7b9c828d708: Bootstrap starting.
08:06:51.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.555400 31424 tablet_bootstrap.cc:492] T 80406d7ef2e842c0b0a8f0ee45db6639 P 7a55aa81ed1045bbb68d397395b9ae3f: Bootstrap starting.
08:06:51.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.556068 31423 tablet_bootstrap.cc:654] T 80406d7ef2e842c0b0a8f0ee45db6639 P 3fd6ff86a84648679872c7b9c828d708: Neither blocks nor log segments found. Creating new log.
08:06:51.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.558000 31422 tablet_bootstrap.cc:654] T 80406d7ef2e842c0b0a8f0ee45db6639 P d6acb62062c54919acc5ee398d03f785: Neither blocks nor log segments found. Creating new log.
08:06:51.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.571237 31423 tablet_bootstrap.cc:492] T 80406d7ef2e842c0b0a8f0ee45db6639 P 3fd6ff86a84648679872c7b9c828d708: No bootstrap required, opened a new log
08:06:51.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.571822 31423 ts_tablet_manager.cc:1403] T 80406d7ef2e842c0b0a8f0ee45db6639 P 3fd6ff86a84648679872c7b9c828d708: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.009s
08:06:51.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.575152 31423 raft_consensus.cc:359] T 80406d7ef2e842c0b0a8f0ee45db6639 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:51.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.575839 31423 raft_consensus.cc:385] T 80406d7ef2e842c0b0a8f0ee45db6639 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:51.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.576115 31423 raft_consensus.cc:740] T 80406d7ef2e842c0b0a8f0ee45db6639 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fd6ff86a84648679872c7b9c828d708, State: Initialized, Role: FOLLOWER
08:06:51.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.583135 31424 tablet_bootstrap.cc:654] T 80406d7ef2e842c0b0a8f0ee45db6639 P 7a55aa81ed1045bbb68d397395b9ae3f: Neither blocks nor log segments found. Creating new log.
08:06:51.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.576921 31423 consensus_queue.cc:260] T 80406d7ef2e842c0b0a8f0ee45db6639 P 3fd6ff86a84648679872c7b9c828d708 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:51.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.598626 31422 tablet_bootstrap.cc:492] T 80406d7ef2e842c0b0a8f0ee45db6639 P d6acb62062c54919acc5ee398d03f785: No bootstrap required, opened a new log
08:06:51.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.599309 31422 ts_tablet_manager.cc:1403] T 80406d7ef2e842c0b0a8f0ee45db6639 P d6acb62062c54919acc5ee398d03f785: Time spent bootstrapping tablet: real 0.101s	user 0.006s	sys 0.009s
08:06:51.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.606034 31422 raft_consensus.cc:359] T 80406d7ef2e842c0b0a8f0ee45db6639 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:51.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.609995 31422 raft_consensus.cc:385] T 80406d7ef2e842c0b0a8f0ee45db6639 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:51.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.610427 31422 raft_consensus.cc:740] T 80406d7ef2e842c0b0a8f0ee45db6639 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6acb62062c54919acc5ee398d03f785, State: Initialized, Role: FOLLOWER
08:06:51.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.611182 31422 consensus_queue.cc:260] T 80406d7ef2e842c0b0a8f0ee45db6639 P d6acb62062c54919acc5ee398d03f785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:51.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.616705 31424 tablet_bootstrap.cc:492] T 80406d7ef2e842c0b0a8f0ee45db6639 P 7a55aa81ed1045bbb68d397395b9ae3f: No bootstrap required, opened a new log
08:06:51.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.617323 31424 ts_tablet_manager.cc:1403] T 80406d7ef2e842c0b0a8f0ee45db6639 P 7a55aa81ed1045bbb68d397395b9ae3f: Time spent bootstrapping tablet: real 0.062s	user 0.004s	sys 0.009s
08:06:51.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.621351 31424 raft_consensus.cc:359] T 80406d7ef2e842c0b0a8f0ee45db6639 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:51.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.624624 31422 ts_tablet_manager.cc:1434] T 80406d7ef2e842c0b0a8f0ee45db6639 P d6acb62062c54919acc5ee398d03f785: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
08:06:51.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.630748 31422 tablet_bootstrap.cc:492] T 2ab829b4cc354ec6b972bd7bd1f9f105 P d6acb62062c54919acc5ee398d03f785: Bootstrap starting.
08:06:51.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.635237 31424 raft_consensus.cc:385] T 80406d7ef2e842c0b0a8f0ee45db6639 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:51.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.635824 31424 raft_consensus.cc:740] T 80406d7ef2e842c0b0a8f0ee45db6639 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a55aa81ed1045bbb68d397395b9ae3f, State: Initialized, Role: FOLLOWER
08:06:51.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.640304 31424 consensus_queue.cc:260] T 80406d7ef2e842c0b0a8f0ee45db6639 P 7a55aa81ed1045bbb68d397395b9ae3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:51.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.649713 31422 tablet_bootstrap.cc:654] T 2ab829b4cc354ec6b972bd7bd1f9f105 P d6acb62062c54919acc5ee398d03f785: Neither blocks nor log segments found. Creating new log.
08:06:51.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.656770 31424 ts_tablet_manager.cc:1434] T 80406d7ef2e842c0b0a8f0ee45db6639 P 7a55aa81ed1045bbb68d397395b9ae3f: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.002s
08:06:51.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.663947 31423 ts_tablet_manager.cc:1434] T 80406d7ef2e842c0b0a8f0ee45db6639 P 3fd6ff86a84648679872c7b9c828d708: Time spent starting tablet: real 0.092s	user 0.002s	sys 0.005s
08:06:51.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.696780 31424 tablet_bootstrap.cc:492] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 7a55aa81ed1045bbb68d397395b9ae3f: Bootstrap starting.
08:06:51.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.710881 31424 tablet_bootstrap.cc:654] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 7a55aa81ed1045bbb68d397395b9ae3f: Neither blocks nor log segments found. Creating new log.
08:06:51.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.725369 31422 tablet_bootstrap.cc:492] T 2ab829b4cc354ec6b972bd7bd1f9f105 P d6acb62062c54919acc5ee398d03f785: No bootstrap required, opened a new log
08:06:51.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.726346 31422 ts_tablet_manager.cc:1403] T 2ab829b4cc354ec6b972bd7bd1f9f105 P d6acb62062c54919acc5ee398d03f785: Time spent bootstrapping tablet: real 0.096s	user 0.008s	sys 0.007s
08:06:51.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.729982 31422 raft_consensus.cc:359] T 2ab829b4cc354ec6b972bd7bd1f9f105 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:51.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.735404 31422 raft_consensus.cc:385] T 2ab829b4cc354ec6b972bd7bd1f9f105 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:51.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.735994 31422 raft_consensus.cc:740] T 2ab829b4cc354ec6b972bd7bd1f9f105 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6acb62062c54919acc5ee398d03f785, State: Initialized, Role: FOLLOWER
08:06:51.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.737111 31422 consensus_queue.cc:260] T 2ab829b4cc354ec6b972bd7bd1f9f105 P d6acb62062c54919acc5ee398d03f785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:51.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.738071 31423 tablet_bootstrap.cc:492] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 3fd6ff86a84648679872c7b9c828d708: Bootstrap starting.
08:06:51.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.741017 31422 ts_tablet_manager.cc:1434] T 2ab829b4cc354ec6b972bd7bd1f9f105 P d6acb62062c54919acc5ee398d03f785: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
08:06:51.758 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:51.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.759174 31424 tablet_bootstrap.cc:492] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 7a55aa81ed1045bbb68d397395b9ae3f: No bootstrap required, opened a new log
08:06:51.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.760054 31424 ts_tablet_manager.cc:1403] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 7a55aa81ed1045bbb68d397395b9ae3f: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.000s
08:06:51.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.766028 31424 raft_consensus.cc:359] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:51.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.768757 31424 raft_consensus.cc:385] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:51.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.769614 31424 raft_consensus.cc:740] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a55aa81ed1045bbb68d397395b9ae3f, State: Initialized, Role: FOLLOWER
08:06:51.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.770629 31424 consensus_queue.cc:260] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 7a55aa81ed1045bbb68d397395b9ae3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:51.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.790005 31423 tablet_bootstrap.cc:654] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 3fd6ff86a84648679872c7b9c828d708: Neither blocks nor log segments found. Creating new log.
08:06:51.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.795188 31424 ts_tablet_manager.cc:1434] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 7a55aa81ed1045bbb68d397395b9ae3f: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.002s
08:06:51.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.834209 31423 tablet_bootstrap.cc:492] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 3fd6ff86a84648679872c7b9c828d708: No bootstrap required, opened a new log
08:06:51.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.834740 31423 ts_tablet_manager.cc:1403] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 3fd6ff86a84648679872c7b9c828d708: Time spent bootstrapping tablet: real 0.115s	user 0.005s	sys 0.008s
08:06:51.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.847117 31423 raft_consensus.cc:359] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:51.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.854121 31423 raft_consensus.cc:385] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:06:51.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.854463 31423 raft_consensus.cc:740] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fd6ff86a84648679872c7b9c828d708, State: Initialized, Role: FOLLOWER
08:06:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.855212 31423 consensus_queue.cc:260] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 3fd6ff86a84648679872c7b9c828d708 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.860778 31344 raft_consensus.cc:493] T 80406d7ef2e842c0b0a8f0ee45db6639 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:06:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.861332 31344 raft_consensus.cc:515] T 80406d7ef2e842c0b0a8f0ee45db6639 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.862353 31423 ts_tablet_manager.cc:1434] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 3fd6ff86a84648679872c7b9c828d708: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
08:06:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.863471 31344 leader_election.cc:290] T 80406d7ef2e842c0b0a8f0ee45db6639 P d6acb62062c54919acc5ee398d03f785 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fd6ff86a84648679872c7b9c828d708 (127.29.158.130:33769), 7a55aa81ed1045bbb68d397395b9ae3f (127.29.158.131:41421)
08:06:51.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.868078 31091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80406d7ef2e842c0b0a8f0ee45db6639" candidate_uuid: "d6acb62062c54919acc5ee398d03f785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" is_pre_election: true
08:06:51.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.868778 31091 raft_consensus.cc:2468] T 80406d7ef2e842c0b0a8f0ee45db6639 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6acb62062c54919acc5ee398d03f785 in term 0.
08:06:51.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.872727 30715 leader_election.cc:304] T 80406d7ef2e842c0b0a8f0ee45db6639 P d6acb62062c54919acc5ee398d03f785 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a55aa81ed1045bbb68d397395b9ae3f, d6acb62062c54919acc5ee398d03f785; no voters: 
08:06:51.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.874370 31344 raft_consensus.cc:2804] T 80406d7ef2e842c0b0a8f0ee45db6639 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:06:51.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.874742 31344 raft_consensus.cc:493] T 80406d7ef2e842c0b0a8f0ee45db6639 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:06:51.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.875102 31344 raft_consensus.cc:3060] T 80406d7ef2e842c0b0a8f0ee45db6639 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Advancing to term 1
08:06:51.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.927430 31433 raft_consensus.cc:493] T 2ab829b4cc354ec6b972bd7bd1f9f105 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:06:51.930 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:51.930 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:51.931 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:51.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.930624 31433 raft_consensus.cc:515] T 2ab829b4cc354ec6b972bd7bd1f9f105 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:51.931 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:51.931 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:51.931 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:51.931 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:51.932 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:51.932 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:51.932 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:51.931 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:51.932 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:51.932 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:51.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.933753 30947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80406d7ef2e842c0b0a8f0ee45db6639" candidate_uuid: "d6acb62062c54919acc5ee398d03f785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fd6ff86a84648679872c7b9c828d708" is_pre_election: true
08:06:51.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.934461 30947 raft_consensus.cc:2468] T 80406d7ef2e842c0b0a8f0ee45db6639 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6acb62062c54919acc5ee398d03f785 in term 0.
08:06:51.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.933082 31433 leader_election.cc:290] T 2ab829b4cc354ec6b972bd7bd1f9f105 P d6acb62062c54919acc5ee398d03f785 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fd6ff86a84648679872c7b9c828d708 (127.29.158.130:33769), 7a55aa81ed1045bbb68d397395b9ae3f (127.29.158.131:41421)
08:06:51.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.943867 31091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab829b4cc354ec6b972bd7bd1f9f105" candidate_uuid: "d6acb62062c54919acc5ee398d03f785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" is_pre_election: true
08:06:51.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.944512 31091 raft_consensus.cc:2468] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6acb62062c54919acc5ee398d03f785 in term 0.
08:06:51.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.945415 31436 raft_consensus.cc:493] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:06:51.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.946082 31436 raft_consensus.cc:515] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:51.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.952126 30715 leader_election.cc:304] T 2ab829b4cc354ec6b972bd7bd1f9f105 P d6acb62062c54919acc5ee398d03f785 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a55aa81ed1045bbb68d397395b9ae3f, d6acb62062c54919acc5ee398d03f785; no voters: 
08:06:51.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.953356 31433 raft_consensus.cc:2804] T 2ab829b4cc354ec6b972bd7bd1f9f105 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:06:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.954154 31433 raft_consensus.cc:493] T 2ab829b4cc354ec6b972bd7bd1f9f105 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:06:51.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.954607 31433 raft_consensus.cc:3060] T 2ab829b4cc354ec6b972bd7bd1f9f105 P d6acb62062c54919acc5ee398d03f785 [term 0 FOLLOWER]: Advancing to term 1
08:06:51.956 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:51.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:51.956372 30208 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.220.194:39597, user_credentials={real_user=slave}} blocked reactor thread for 94786us
08:06:51.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.972779 31433 raft_consensus.cc:515] T 2ab829b4cc354ec6b972bd7bd1f9f105 P d6acb62062c54919acc5ee398d03f785 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:51.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.974502 31436 leader_election.cc:290] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 3fd6ff86a84648679872c7b9c828d708 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6acb62062c54919acc5ee398d03f785 (127.29.158.129:45149), 7a55aa81ed1045bbb68d397395b9ae3f (127.29.158.131:41421)
08:06:51.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.976696 31091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab829b4cc354ec6b972bd7bd1f9f105" candidate_uuid: "3fd6ff86a84648679872c7b9c828d708" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" is_pre_election: true
08:06:51.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.977371 31091 raft_consensus.cc:2468] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fd6ff86a84648679872c7b9c828d708 in term 0.
08:06:51.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.978889 30881 leader_election.cc:304] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 3fd6ff86a84648679872c7b9c828d708 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fd6ff86a84648679872c7b9c828d708, 7a55aa81ed1045bbb68d397395b9ae3f; no voters: 
08:06:51.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.980595 31436 raft_consensus.cc:2804] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:06:51.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.981197 31436 raft_consensus.cc:493] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:06:51.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.981647 31436 raft_consensus.cc:3060] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Advancing to term 1
08:06:51.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:51.999289 31433 leader_election.cc:290] T 2ab829b4cc354ec6b972bd7bd1f9f105 P d6acb62062c54919acc5ee398d03f785 [CANDIDATE]: Term 1 election: Requested vote from peers 3fd6ff86a84648679872c7b9c828d708 (127.29.158.130:33769), 7a55aa81ed1045bbb68d397395b9ae3f (127.29.158.131:41421)
08:06:52.003 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:52.004 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:52.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.003523 31344 raft_consensus.cc:515] T 80406d7ef2e842c0b0a8f0ee45db6639 P d6acb62062c54919acc5ee398d03f785 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:52.004 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:52.004 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:52.005 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:52.005 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:52.005 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:52.005 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:52.005 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:52.006 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:52.006 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:52.006 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:52.006 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:52.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.010586 31436 raft_consensus.cc:515] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 3fd6ff86a84648679872c7b9c828d708 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:52.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.023293 31436 leader_election.cc:290] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 3fd6ff86a84648679872c7b9c828d708 [CANDIDATE]: Term 1 election: Requested vote from peers d6acb62062c54919acc5ee398d03f785 (127.29.158.129:45149), 7a55aa81ed1045bbb68d397395b9ae3f (127.29.158.131:41421)
08:06:52.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.030382 30536 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 946dd58e027d47ada0a510d16280ddd3: replication_test_table [id=2c14e26d8166482b8cd1de88f1bf2d56] alter complete (version 0)
08:06:52.043 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:52.043 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:52.043 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:52.044 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:52.044 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:52.044 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:52.044 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:52.045 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:52.045 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:52.045 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:52.045 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:52.045 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:52.045 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:52.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.064903 30947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab829b4cc354ec6b972bd7bd1f9f105" candidate_uuid: "d6acb62062c54919acc5ee398d03f785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fd6ff86a84648679872c7b9c828d708" is_pre_election: true
08:06:52.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.065088 31090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80406d7ef2e842c0b0a8f0ee45db6639" candidate_uuid: "d6acb62062c54919acc5ee398d03f785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a55aa81ed1045bbb68d397395b9ae3f"
08:06:52.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.065995 30947 raft_consensus.cc:2393] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 3fd6ff86a84648679872c7b9c828d708 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6acb62062c54919acc5ee398d03f785 in current term 1: Already voted for candidate 3fd6ff86a84648679872c7b9c828d708 in this term.
08:06:52.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.066304 31090 raft_consensus.cc:3060] T 80406d7ef2e842c0b0a8f0ee45db6639 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Advancing to term 1
08:06:52.067 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:52.067 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:52.067 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:52.067 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:52.067 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:52.068 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:52.068 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:52.068 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:52.068 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:52.068 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:52.068 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:52.068 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:52.068 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:52.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.060737 31344 leader_election.cc:290] T 80406d7ef2e842c0b0a8f0ee45db6639 P d6acb62062c54919acc5ee398d03f785 [CANDIDATE]: Term 1 election: Requested vote from peers 3fd6ff86a84648679872c7b9c828d708 (127.29.158.130:33769), 7a55aa81ed1045bbb68d397395b9ae3f (127.29.158.131:41421)
08:06:52.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.079447 31090 raft_consensus.cc:2468] T 80406d7ef2e842c0b0a8f0ee45db6639 P 7a55aa81ed1045bbb68d397395b9ae3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6acb62062c54919acc5ee398d03f785 in term 1.
08:06:52.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.081017 30715 leader_election.cc:304] T 80406d7ef2e842c0b0a8f0ee45db6639 P d6acb62062c54919acc5ee398d03f785 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a55aa81ed1045bbb68d397395b9ae3f, d6acb62062c54919acc5ee398d03f785; no voters: 
08:06:52.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.085029 31092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab829b4cc354ec6b972bd7bd1f9f105" candidate_uuid: "d6acb62062c54919acc5ee398d03f785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a55aa81ed1045bbb68d397395b9ae3f"
08:06:52.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.085428 30947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab829b4cc354ec6b972bd7bd1f9f105" candidate_uuid: "d6acb62062c54919acc5ee398d03f785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fd6ff86a84648679872c7b9c828d708"
08:06:52.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.085757 31092 raft_consensus.cc:3060] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 7a55aa81ed1045bbb68d397395b9ae3f [term 0 FOLLOWER]: Advancing to term 1
08:06:52.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.086241 30947 raft_consensus.cc:2393] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 3fd6ff86a84648679872c7b9c828d708 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d6acb62062c54919acc5ee398d03f785 in current term 1: Already voted for candidate 3fd6ff86a84648679872c7b9c828d708 in this term.
08:06:52.094 [DEBUG - main] (Connection.java:575) [peer master-127.28.220.253:45079(127.28.220.253:45079)] disconnecting while in state READY
08:06:52.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.094726 31092 raft_consensus.cc:2468] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 7a55aa81ed1045bbb68d397395b9ae3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6acb62062c54919acc5ee398d03f785 in term 1.
08:06:52.095 [DEBUG - main] (Connection.java:575) [peer master-127.28.220.254:37365(127.28.220.254:37365)] disconnecting while in state READY
08:06:52.095 [DEBUG - main] (Connection.java:575) [peer master-127.28.220.252:33543(127.28.220.252:33543)] disconnecting while in state READY
08:06:52.095 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:06:52.096 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.28.220.254:37365(127.28.220.254:37365)] handling channelInactive
08:06:52.096 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.28.220.252:33543(127.28.220.252:33543)] handling channelInactive
08:06:52.096 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state READY due to: connection closed
08:06:52.096 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state READY due to: connection closed
08:06:52.103 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-2
08:06:52.112 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:52.112 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:52.112 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:52.114 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:52.114 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:52.114 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:52.115 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:52.115 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:52.115 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:52.115 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:52.115 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:52.116 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:52.116 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:52.116 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29109), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [4ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [8ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [9ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [23ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [23ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [24ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [24ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [42ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [48ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [48ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [48ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [61ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [61ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [62ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [62ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [84ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [123ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [123ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [161ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [161ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [161ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [162ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [182ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [182ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [182ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [182ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [402ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [402ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [402ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [402ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [900ms] refreshing cache from master, [900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [902ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [902ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [902ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [903ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1920ms] refreshing cache from master, [1920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1923ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1924ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1925ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1925ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [2780ms] refreshing cache from master, [2781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [2783ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [2783ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [2783ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2784ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [4960ms] refreshing cache from master, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [4961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [4961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [4962ms] too many traces: truncated at 100 traces, deferred=Deferred@129160403(state=PENDING, result=null, callback=(continuation of Deferred@138727398 after retry RPC after error@1029016261) -> (continuation of Deferred@933009608 after retry RPC after error@639223460) -> (continuation of Deferred@135009918 after retry RPC after error@429827608) -> (continuation of Deferred@1243031355 after retry RPC after error@575927355) -> (continuation of Deferred@1241823721 after retry RPC after error@642152663) -> (continuation of Deferred@1427881435 after retry RPC after error@1758755183) -> (continuation of Deferred@124804717 after retry RPC after error@308612756) -> (continuation of Deferred@446209126 after retry RPC after error@1372356955) -> (continuation of Deferred@1414151737 after retry RPC after error@1851886474) -> (continuation of Deferred@818172300 after retry RPC after error@87546006) -> (continuation of Deferred@9012735 after retry RPC after error@1658221503) -> (continuation of Deferred@1879840344 after retry RPC after error@1271169959) -> (continuation of Deferred@128864605 after retry RPC after error@1454670236) -> (continuation of Deferred@1176171460 after retry RPC after error@699173147) -> (continuation of Deferred@1551696330 after retry RPC after error@783799224) -> (continuation of Deferred@1059225977 after retry RPC after error@1913336791) -> (continuation of Deferred@1187778317 after retry RPC after error@1450589823) -> (continuation of Deferred@2104771713 after retry RPC after error@1447708019) -> (continuation of Deferred@1893244112 after retry RPC after error@389730674) -> (continuation of Deferred@1211486040 after retry RPC after error@1280342768) -> (continuation of Deferred@2027573686 after retry RPC after error@967491230) -> (continuation of Deferred@1594096124 after retry RPC after error@273391382) -> (continuation of Deferred@976628552 after retry RPC after error@1443118302) -> (continuation of Deferred@369681403 after retry RPC after error@1526164739) -> (continuation of Deferred@1360032126 after retry RPC after error@646272334), errback=(continuation of Deferred@138727398 after retry RPC after error@1029016261) -> (continuation of Deferred@933009608 after retry RPC after error@639223460) -> (continuation of Deferred@135009918 after retry RPC after error@429827608) -> (continuation of Deferred@1243031355 after retry RPC after error@575927355) -> (continuation of Deferred@1241823721 after retry RPC after error@642152663) -> (continuation of Deferred@1427881435 after retry RPC after error@1758755183) -> (continuation of Deferred@124804717 after retry RPC after error@308612756) -> (continuation of Deferred@446209126 after retry RPC after error@1372356955) -> (continuation of Deferred@1414151737 after retry RPC after error@1851886474) -> (continuation of Deferred@818172300 after retry RPC after error@87546006) -> (continuation of Deferred@9012735 after retry RPC after error@1658221503) -> (continuation of Deferred@1879840344 after retry RPC after error@1271169959) -> (continuation of Deferred@128864605 after retry RPC after error@1454670236) -> (continuation of Deferred@1176171460 after retry RPC after error@699173147) -> (continuation of Deferred@1551696330 after retry RPC after error@783799224) -> (continuation of Deferred@1059225977 after retry RPC after error@1913336791) -> (continuation of Deferred@1187778317 after retry RPC after error@1450589823) -> (continuation of Deferred@2104771713 after retry RPC after error@1447708019) -> (continuation of Deferred@1893244112 after retry RPC after error@389730674) -> (continuation of Deferred@1211486040 after retry RPC after error@1280342768) -> (continuation of Deferred@2027573686 after retry RPC after error@967491230) -> (continuation of Deferred@1594096124 after retry RPC after error@273391382) -> (continuation of Deferred@976628552 after retry RPC after error@1443118302) -> (continuation of Deferred@369681403 after retry RPC after error@1526164739) -> (continuation of Deferred@1360032126 after retry RPC after error@646272334)))
08:06:52.119 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
08:06:52.119 [WARN - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#4 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29109), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [4ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [8ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [9ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [23ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [23ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [24ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [24ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [42ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [48ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [48ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [48ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [61ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [61ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [62ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [62ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [84ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [123ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [123ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [161ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [161ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [161ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [162ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [182ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [182ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [182ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [182ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [402ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [402ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [402ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [402ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [900ms] refreshing cache from master, [900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [902ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [902ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [902ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [903ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1920ms] refreshing cache from master, [1920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1923ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1924ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1925ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1925ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [2780ms] refreshing cache from master, [2781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [2783ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [2783ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [2783ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2784ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [4960ms] refreshing cache from master, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [4961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [4961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [4962ms] too many traces: truncated at 100 traces, deferred=Deferred@129160403(state=PENDING, result=null, callback=(continuation of Deferred@138727398 after retry RPC after error@1029016261) -> (continuation of Deferred@933009608 after retry RPC after error@639223460) -> (continuation of Deferred@135009918 after retry RPC after error@429827608) -> (continuation of Deferred@1243031355 after retry RPC after error@575927355) -> (continuation of Deferred@1241823721 after retry RPC after error@642152663) -> (continuation of Deferred@1427881435 after retry RPC after error@1758755183) -> (continuation of Deferred@124804717 after retry RPC after error@308612756) -> (continuation of Deferred@446209126 after retry RPC after error@1372356955) -> (continuation of Deferred@1414151737 after retry RPC after error@1851886474) -> (continuation of Deferred@818172300 after retry RPC after error@87546006) -> (continuation of Deferred@9012735 after retry RPC after error@1658221503) -> (continuation of Deferred@1879840344 after retry RPC after error@1271169959) -> (continuation of Deferred@128864605 after retry RPC after error@1454670236) -> (continuation of Deferred@1176171460 after retry RPC after error@699173147) -> (continuation of Deferred@1551696330 after retry RPC after error@783799224) -> (continuation of Deferred@1059225977 after retry RPC after error@1913336791) -> (continuation of Deferred@1187778317 after retry RPC after error@1450589823) -> (continuation of Deferred@2104771713 after retry RPC after error@1447708019) -> (continuation of Deferred@1893244112 after retry RPC after error@389730674) -> (continuation of Deferred@1211486040 after retry RPC after error@1280342768) -> (continuation of Deferred@2027573686 after retry RPC after error@967491230) -> (continuation of Deferred@1594096124 after retry RPC after error@273391382) -> (continuation of Deferred@976628552 after retry RPC after error@1443118302) -> (continuation of Deferred@369681403 after retry RPC after error@1526164739) -> (continuation of Deferred@1360032126 after retry RPC after error@646272334), errback=(continuation of Deferred@138727398 after retry RPC after error@1029016261) -> (continuation of Deferred@933009608 after retry RPC after error@639223460) -> (continuation of Deferred@135009918 after retry RPC after error@429827608) -> (continuation of Deferred@1243031355 after retry RPC after error@575927355) -> (continuation of Deferred@1241823721 after retry RPC after error@642152663) -> (continuation of Deferred@1427881435 after retry RPC after error@1758755183) -> (continuation of Deferred@124804717 after retry RPC after error@308612756) -> (continuation of Deferred@446209126 after retry RPC after error@1372356955) -> (continuation of Deferred@1414151737 after retry RPC after error@1851886474) -> (continuation of Deferred@818172300 after retry RPC after error@87546006) -> (continuation of Deferred@9012735 after retry RPC after error@1658221503) -> (continuation of Deferred@1879840344 after retry RPC after error@1271169959) -> (continuation of Deferred@128864605 after retry RPC after error@1454670236) -> (continuation of Deferred@1176171460 after retry RPC after error@699173147) -> (continuation of Deferred@1551696330 after retry RPC after error@783799224) -> (continuation of Deferred@1059225977 after retry RPC after error@1913336791) -> (continuation of Deferred@1187778317 after retry RPC after error@1450589823) -> (continuation of Deferred@2104771713 after retry RPC after error@1447708019) -> (continuation of Deferred@1893244112 after retry RPC after error@389730674) -> (continuation of Deferred@1211486040 after retry RPC after error@1280342768) -> (continuation of Deferred@2027573686 after retry RPC after error@967491230) -> (continuation of Deferred@1594096124 after retry RPC after error@273391382) -> (continuation of Deferred@976628552 after retry RPC after error@1443118302) -> (continuation of Deferred@369681403 after retry RPC after error@1526164739) -> (continuation of Deferred@1360032126 after retry RPC after error@646272334)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:06:52.121 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
08:06:52.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.098067 31093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab829b4cc354ec6b972bd7bd1f9f105" candidate_uuid: "3fd6ff86a84648679872c7b9c828d708" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a55aa81ed1045bbb68d397395b9ae3f"
08:06:52.122 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.28.220.253:45079(127.28.220.253:45079)] handling channelInactive
08:06:52.122 [DEBUG - main] (Connection.java:575) [peer master-127.29.158.189:41727(127.29.158.189:41727)] disconnecting while in state READY
08:06:52.123 [DEBUG - main] (Connection.java:575) [peer master-127.29.158.190:38071(127.29.158.190:38071)] disconnecting while in state READY
08:06:52.123 [DEBUG - main] (Connection.java:575) [peer master-127.29.158.188:39061(127.29.158.188:39061)] disconnecting while in state READY
08:06:52.123 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.29.158.189:41727(127.29.158.189:41727)] handling channelInactive
08:06:52.124 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.29.158.190:38071(127.29.158.190:38071)] handling channelInactive
08:06:52.124 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#4 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_4).
08:06:52.125 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state READY due to: connection closed
08:06:52.125 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:06:52.126 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#4 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_4.
08:06:52.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.098148 30715 leader_election.cc:304] T 2ab829b4cc354ec6b972bd7bd1f9f105 P d6acb62062c54919acc5ee398d03f785 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a55aa81ed1045bbb68d397395b9ae3f, d6acb62062c54919acc5ee398d03f785; no voters: 
08:06:52.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.098977 31093 raft_consensus.cc:2393] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 7a55aa81ed1045bbb68d397395b9ae3f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3fd6ff86a84648679872c7b9c828d708 in current term 1: Already voted for candidate d6acb62062c54919acc5ee398d03f785 in this term.
08:06:52.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.099001 31433 raft_consensus.cc:2804] T 80406d7ef2e842c0b0a8f0ee45db6639 P d6acb62062c54919acc5ee398d03f785 [term 1 FOLLOWER]: Leader election won for term 1
08:06:52.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.109467 31344 raft_consensus.cc:2804] T 2ab829b4cc354ec6b972bd7bd1f9f105 P d6acb62062c54919acc5ee398d03f785 [term 1 FOLLOWER]: Leader election won for term 1
08:06:52.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.109973 31344 raft_consensus.cc:697] T 2ab829b4cc354ec6b972bd7bd1f9f105 P d6acb62062c54919acc5ee398d03f785 [term 1 LEADER]: Becoming Leader. State: Replica: d6acb62062c54919acc5ee398d03f785, State: Running, Role: LEADER
08:06:52.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.110803 31344 consensus_queue.cc:237] T 2ab829b4cc354ec6b972bd7bd1f9f105 P d6acb62062c54919acc5ee398d03f785 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:52.127 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state READY due to: connection closed
08:06:52.127 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state READY due to: connection closed
08:06:52.128 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:06:52.128 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to FAILED on 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29109), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [4ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [8ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [9ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [23ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [23ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [24ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [24ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [42ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [48ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [48ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [48ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [61ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [61ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [62ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [62ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [83ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [84ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [123ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [123ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [161ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [161ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [161ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [162ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [182ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [182ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [182ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [182ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [402ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [402ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [402ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [402ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [900ms] refreshing cache from master, [900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [902ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [902ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [902ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [903ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1920ms] refreshing cache from master, [1920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1923ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1924ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1925ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1925ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [2780ms] refreshing cache from master, [2781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [2783ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [2783ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [2783ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2784ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [4960ms] refreshing cache from master, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [4961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [4961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [4962ms] too many traces: truncated at 100 traces, deferred=Deferred@129160403(state=PENDING, result=null, callback=(continuation of Deferred@138727398 after retry RPC after error@1029016261) -> (continuation of Deferred@933009608 after retry RPC after error@639223460) -> (continuation of Deferred@135009918 after retry RPC after error@429827608) -> (continuation of Deferred@1243031355 after retry RPC after error@575927355) -> (continuation of Deferred@1241823721 after retry RPC after error@642152663) -> (continuation of Deferred@1427881435 after retry RPC after error@1758755183) -> (continuation of Deferred@124804717 after retry RPC after error@308612756) -> (continuation of Deferred@446209126 after retry RPC after error@1372356955) -> (continuation of Deferred@1414151737 after retry RPC after error@1851886474) -> (continuation of Deferred@818172300 after retry RPC after error@87546006) -> (continuation of Deferred@9012735 after retry RPC after error@1658221503) -> (continuation of Deferred@1879840344 after retry RPC after error@1271169959) -> (continuation of Deferred@128864605 after retry RPC after error@1454670236) -> (continuation of Deferred@1176171460 after retry RPC after error@699173147) -> (continuation of Deferred@1551696330 after retry RPC after error@783799224) -> (continuation of Deferred@1059225977 after retry RPC after error@1913336791) -> (continuation of Deferred@1187778317 after retry RPC after error@1450589823) -> (continuation of Deferred@2104771713 after retry RPC after error@1447708019) -> (continuation of Deferred@1893244112 after retry RPC after error@389730674) -> (continuation of Deferred@1211486040 after retry RPC after error@1280342768) -> (continuation of Deferred@2027573686 after retry RPC after error@967491230) -> (continuation of Deferred@1594096124 after retry RPC after error@273391382) -> (continuation of Deferred@976628552 after retry RPC after error@1443118302) -> (continuation of Deferred@369681403 after retry RPC after error@1526164739) -> (continuation of Deferred@1360032126 after retry RPC after error@646272334), errback=(continuation of Deferred@138727398 after retry RPC after error@1029016261) -> (continuation of Deferred@933009608 after retry RPC after error@639223460) -> (continuation of Deferred@135009918 after retry RPC after error@429827608) -> (continuation of Deferred@1243031355 after retry RPC after error@575927355) -> (continuation of Deferred@1241823721 after retry RPC after error@642152663) -> (continuation of Deferred@1427881435 after retry RPC after error@1758755183) -> (continuation of Deferred@124804717 after retry RPC after error@308612756) -> (continuation of Deferred@446209126 after retry RPC after error@1372356955) -> (continuation of Deferred@1414151737 after retry RPC after error@1851886474) -> (continuation of Deferred@818172300 after retry RPC after error@87546006) -> (continuation of Deferred@9012735 after retry RPC after error@1658221503) -> (continuation of Deferred@1879840344 after retry RPC after error@1271169959) -> (continuation of Deferred@128864605 after retry RPC after error@1454670236) -> (continuation of Deferred@1176171460 after retry RPC after error@699173147) -> (continuation of Deferred@1551696330 after retry RPC after error@783799224) -> (continuation of Deferred@1059225977 after retry RPC after error@1913336791) -> (continuation of Deferred@1187778317 after retry RPC after error@1450589823) -> (continuation of Deferred@2104771713 after retry RPC after error@1447708019) -> (continuation of Deferred@1893244112 after retry RPC after error@389730674) -> (continuation of Deferred@1211486040 after retry RPC after error@1280342768) -> (continuation of Deferred@2027573686 after retry RPC after error@967491230) -> (continuation of Deferred@1594096124 after retry RPC after error@273391382) -> (continuation of Deferred@976628552 after retry RPC after error@1443118302) -> (continuation of Deferred@369681403 after retry RPC after error@1526164739) -> (continuation of Deferred@1360032126 after retry RPC after error@646272334)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:06:52.130 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:06:52.131 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-1
08:06:52.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.138900 31433 raft_consensus.cc:697] T 80406d7ef2e842c0b0a8f0ee45db6639 P d6acb62062c54919acc5ee398d03f785 [term 1 LEADER]: Becoming Leader. State: Replica: d6acb62062c54919acc5ee398d03f785, State: Running, Role: LEADER
08:06:52.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.140166 31433 consensus_queue.cc:237] T 80406d7ef2e842c0b0a8f0ee45db6639 P d6acb62062c54919acc5ee398d03f785 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } }
08:06:52.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:52.061399 29742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.220.253:45079, user_credentials={real_user=slave}} blocked reactor thread for 141642us
08:06:52.273 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#4) of source Source: KuduSource.
08:06:52.273 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_4.
08:06:52.274 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:52.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.183670 30536 catalog_manager.cc:5696] T 80406d7ef2e842c0b0a8f0ee45db6639 P d6acb62062c54919acc5ee398d03f785 reported cstate change: term changed from 0 to 1, leader changed from <none> to d6acb62062c54919acc5ee398d03f785 (127.29.158.129). New cstate: current_term: 1 leader_uuid: "d6acb62062c54919acc5ee398d03f785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } health_report { overall_health: UNKNOWN } } }
08:06:52.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.186343 30536 catalog_manager.cc:5696] T 2ab829b4cc354ec6b972bd7bd1f9f105 P d6acb62062c54919acc5ee398d03f785 reported cstate change: term changed from 0 to 1, leader changed from <none> to d6acb62062c54919acc5ee398d03f785 (127.29.158.129). New cstate: current_term: 1 leader_uuid: "d6acb62062c54919acc5ee398d03f785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6acb62062c54919acc5ee398d03f785" member_type: VOTER last_known_addr { host: "127.29.158.129" port: 45149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 } health_report { overall_health: UNKNOWN } } }
08:06:52.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.191962 30947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80406d7ef2e842c0b0a8f0ee45db6639" candidate_uuid: "d6acb62062c54919acc5ee398d03f785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fd6ff86a84648679872c7b9c828d708"
08:06:52.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.192682 30947 raft_consensus.cc:3060] T 80406d7ef2e842c0b0a8f0ee45db6639 P 3fd6ff86a84648679872c7b9c828d708 [term 0 FOLLOWER]: Advancing to term 1
08:06:52.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.263665 30947 raft_consensus.cc:2468] T 80406d7ef2e842c0b0a8f0ee45db6639 P 3fd6ff86a84648679872c7b9c828d708 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6acb62062c54919acc5ee398d03f785 in term 1.
08:06:52.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.265519 30804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab829b4cc354ec6b972bd7bd1f9f105" candidate_uuid: "3fd6ff86a84648679872c7b9c828d708" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6acb62062c54919acc5ee398d03f785" is_pre_election: true
08:06:52.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.269258 30804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab829b4cc354ec6b972bd7bd1f9f105" candidate_uuid: "3fd6ff86a84648679872c7b9c828d708" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6acb62062c54919acc5ee398d03f785"
08:06:52.275 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:06:52.278 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.29.158.188:39061(127.29.158.188:39061)] handling channelInactive
08:06:52.278 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state READY due to: connection closed
08:06:52.278 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-2
08:06:52.281 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:06:52.284 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
08:06:52.285 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
08:06:52.285 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:06:52.285 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:06:52.285 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:06:52.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.290565 30881 leader_election.cc:304] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 3fd6ff86a84648679872c7b9c828d708 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fd6ff86a84648679872c7b9c828d708; no voters: 7a55aa81ed1045bbb68d397395b9ae3f, d6acb62062c54919acc5ee398d03f785
08:06:52.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.292009 31436 raft_consensus.cc:2749] T 2ab829b4cc354ec6b972bd7bd1f9f105 P 3fd6ff86a84648679872c7b9c828d708 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
08:06:52.338 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
08:06:52.338 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
08:06:52.339 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
08:06:52.339 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
08:06:52.339 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
08:06:52.339 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
08:06:52.339 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
08:06:52.377 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:52.378 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:52.378 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:52.378 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:52.379 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:52.379 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:52.380 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:52.380 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:52.380 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:52.381 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:52.381 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:52.381 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:52.381 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:52.456 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:52.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.624852 31433 consensus_queue.cc:1048] T 80406d7ef2e842c0b0a8f0ee45db6639 P d6acb62062c54919acc5ee398d03f785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:06:52.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.647966 31433 consensus_queue.cc:1048] T 2ab829b4cc354ec6b972bd7bd1f9f105 P d6acb62062c54919acc5ee398d03f785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:06:52.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.671368 31433 consensus_queue.cc:1048] T 80406d7ef2e842c0b0a8f0ee45db6639 P d6acb62062c54919acc5ee398d03f785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fd6ff86a84648679872c7b9c828d708" member_type: VOTER last_known_addr { host: "127.29.158.130" port: 33769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:06:52.758 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:52.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:52.759485 31433 consensus_queue.cc:1048] T 2ab829b4cc354ec6b972bd7bd1f9f105 P d6acb62062c54919acc5ee398d03f785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a55aa81ed1045bbb68d397395b9ae3f" member_type: VOTER last_known_addr { host: "127.29.158.131" port: 41421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:06:52.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:52.784643 30718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.158.130:33769, user_credentials={real_user=slave}} blocked reactor thread for 84662.4us
08:06:52.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:52.818152 30715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.158.131:41421, user_credentials={real_user=slave}} blocked reactor thread for 89910.5us
08:06:52.890 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:52.891 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:52.891 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:52.892 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:52.892 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:52.892 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:52.892 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:52.893 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:52.893 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:52.893 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:52.893 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:52.893 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:52.894 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:52.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:53.084 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:53.084 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:53.084 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:53.086 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:53.086 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:53.086 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:53.087 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:53.087 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:53.087 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:53.087 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:53.087 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:53.087 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:53.087 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:53.240 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
08:06:53.257 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:53.457 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:53.493 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
08:06:53.493 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
08:06:53.493 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
08:06:53.561 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
08:06:53.643 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:53.644 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:53.644 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:53.644 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:53.644 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:53.645 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:53.645 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:53.645 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:53.645 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:53.646 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:53.646 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:53.646 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:53.646 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:53.757 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:53.947 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:53.947 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:53.947 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:53.948 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:53.948 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:53.949 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:53.950 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:53.950 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:53.950 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:53.951 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:53.951 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:53.951 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:53.952 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:53.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:54.186 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:54.187 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:54.187 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:54.187 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:54.188 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:54.188 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:54.188 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:54.188 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:54.188 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:54.188 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:54.188 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:54.188 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:54.188 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:54.258 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:54.457 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:54.568 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:54.569 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:54.569 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:54.569 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:54.569 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:54.570 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:54.570 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:54.570 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:54.570 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:54.570 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:54.570 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:54.570 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:54.571 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:54.758 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:54.849 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:54.850 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:54.850 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:54.851 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:54.851 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:54.851 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:54.852 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:54.852 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:54.852 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:54.853 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:54.853 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:54.853 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:54.853 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:54.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:55.057 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:55.058 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:55.058 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:55.059 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:55.059 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:55.059 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:55.059 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:55.059 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:55.059 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:55.059 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:55.059 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:55.059 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:55.059 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:55.258 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:55.328 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:55.329 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:55.329 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:55.330 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:55.330 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:55.330 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:55.331 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:55.331 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:55.331 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:55.331 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:55.331 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:55.331 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:55.331 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:55.457 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:55.512 [INFO - flink-pekko.actor.default-dispatcher-4] (Slf4jLogger.scala:117) Slf4jLogger started
08:06:55.717 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
08:06:55.758 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:55.760 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
08:06:55.813 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
08:06:55.841 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
08:06:55.877 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:55.878 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:55.878 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:55.878 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:55.878 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:55.879 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:55.879 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:55.879 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:55.879 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:55.879 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:55.879 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:55.879 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:55.879 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:55.887 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
08:06:55.893 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
08:06:55.895 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
08:06:55.895 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
08:06:55.895 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
08:06:55.896 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
08:06:55.896 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
08:06:55.896 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
08:06:55.896 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
08:06:55.897 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
08:06:55.897 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
08:06:55.897 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
08:06:55.898 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
08:06:55.898 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
08:06:55.898 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
08:06:55.898 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
08:06:55.898 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
08:06:55.898 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
08:06:55.898 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
08:06:55.898 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
08:06:55.898 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
08:06:55.898 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
08:06:55.899 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
08:06:55.899 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
08:06:55.899 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
08:06:55.899 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_a6be1ecf49c458691451466394be6a26/blobStorage
08:06:55.900 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:33995 - max concurrent requests: 50 - max backlog: 1000
08:06:55.901 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_a6be1ecf49c458691451466394be6a26/blobStorage
08:06:55.903 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_a6be1ecf49c458691451466394be6a26/blobStorage
08:06:55.904 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
08:06:55.905 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: b6dd0119-1e0e-426b-ad00-c348de2a598b
08:06:55.907 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 37 GB (77.08% usable)
08:06:55.910 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-efcec07c-6240-470b-9b99-6965271545d0
08:06:55.912 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-1ac3a07f-3e39-4fe9-b4ce-f4a63b88fb56
08:06:55.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:56.146 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
08:06:56.146 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
08:06:56.146 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
08:06:56.146 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
08:06:56.148 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
08:06:56.153 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_12 .
08:06:56.161 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultJobLeaderService.java:127) Start job leader service.
08:06:56.162 [INFO - flink-pekko.actor.default-dispatcher-4] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-427f611a-5a5c-4580-904e-74f821b49077
08:06:56.163 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
08:06:56.163 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
08:06:56.172 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
08:06:56.172 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
08:06:56.186 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:34703
08:06:56.187 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
08:06:56.189 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
08:06:56.190 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:34703 was granted leadership with leaderSessionID=8736f68f-6a5f-4e5b-88e6-a6dc3407172e
08:06:56.190 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:34703 , session=8736f68f-6a5f-4e5b-88e6-a6dc3407172e
08:06:56.190 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
08:06:56.190 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
08:06:56.191 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id a1feb7bd-1529-4b2f-9528-59b4dbfdbd84. Creating new DispatcherLeaderProcess.
08:06:56.191 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
08:06:56.192 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
08:06:56.197 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
08:06:56.197 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
08:06:56.200 [INFO - mini-cluster-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_13 .
08:06:56.205 [INFO - pool-177-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id df52696b-244f-4d86-8149-82a7b3003690.
08:06:56.206 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_13 , session=a1feb7bd-1529-4b2f-9528-59b4dbfdbd84
08:06:56.209 [INFO - pool-177-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_14 .
08:06:56.221 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:253) Starting the resource manager.
08:06:56.222 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:212) Starting the slot manager.
08:06:56.222 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:308) Starting tokens update task
08:06:56.222 [WARN - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
08:06:56.222 [WARN - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
08:06:56.223 [INFO - mini-cluster-io-thread-3] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_14 , session=df52696b-244f-4d86-8149-82a7b3003690
08:06:56.223 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_14(814982a7b3003690df52696b244f4d86).
08:06:56.246 [INFO - flink-pekko.actor.default-dispatcher-7] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
08:06:56.262 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:56.266 [INFO - flink-pekko.actor.default-dispatcher-6] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (a72e6b48022ef36361b5eef11ee7c683).
08:06:56.267 [INFO - flink-pekko.actor.default-dispatcher-6] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (a72e6b48022ef36361b5eef11ee7c683).
08:06:56.267 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:1080) Registering TaskManager with ResourceID b6dd0119-1e0e-426b-ad00-c348de2a598b (pekko://flink/user/rpc/taskmanager_12) at ResourceManager
08:06:56.267 [INFO - flink-pekko.actor.default-dispatcher-6] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-a72e6b48022ef36361b5eef11ee7c683'.
08:06:56.268 [INFO - mini-cluster-io-thread-3] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job a72e6b48022ef36361b5eef11ee7c683 was granted leadership with leader id f3c41756-5760-469d-a410-175be8a962c5. Creating new JobMasterServiceProcess.
08:06:56.268 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_14 under registration id 6e8f66e6dcdb6faf8dfb9b9556e586fc.
08:06:56.270 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:344) Registering task executor b6dd0119-1e0e-426b-ad00-c348de2a598b under 6e8f66e6dcdb6faf8dfb9b9556e586fc at the slot manager.
08:06:56.271 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_15 .
08:06:56.275 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (a72e6b48022ef36361b5eef11ee7c683).
08:06:56.276 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (a72e6b48022ef36361b5eef11ee7c683).
08:06:56.278 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph 135652f4f6003b96813527d569fde750 for job a72e6b48022ef36361b5eef11ee7c683.
08:06:56.278 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (a72e6b48022ef36361b5eef11ee7c683).
08:06:56.278 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
08:06:56.279 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
08:06:56.279 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@51f60aa4
08:06:56.279 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:06:56.280 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13140095929423248446/checkpoints")
08:06:56.281 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
08:06:56.281 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@57217c2f for Flink Streaming Job (a72e6b48022ef36361b5eef11ee7c683).
08:06:56.282 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_15 , session=f3c41756-5760-469d-a410-175be8a962c5
08:06:56.284 [INFO - flink-pekko.actor.default-dispatcher-7] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (a72e6b48022ef36361b5eef11ee7c683) under job master id a410175be8a962c5f3c417565760469d.
08:06:56.284 [INFO - flink-pekko.actor.default-dispatcher-7] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
08:06:56.287 [DEBUG - flink-pekko.actor.default-dispatcher-7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:56.287 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
08:06:56.287 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (a72e6b48022ef36361b5eef11ee7c683) switched from state CREATED to RUNNING.
08:06:56.289 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
08:06:56.289 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
08:06:56.290 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:06:56.290 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
08:06:56.291 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
08:06:56.291 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:06:56.291 [INFO - flink-pekko.actor.default-dispatcher-7] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_14(814982a7b3003690df52696b244f4d86)
08:06:56.294 [INFO - flink-pekko.actor.default-dispatcher-4] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
08:06:56.294 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:390) Registering job manager a410175be8a962c5f3c417565760469d@pekko://flink/user/rpc/jobmanager_15 for job a72e6b48022ef36361b5eef11ee7c683.
08:06:56.297 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.28.220.253:45079(127.28.220.253:45079)] Successfully connected to peer
08:06:56.298 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:06:56.299 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.28.220.254:37365(127.28.220.254:37365)] Successfully connected to peer
08:06:56.301 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.28.220.252:33543(127.28.220.252:33543)] Successfully connected to peer
08:06:56.301 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:1015) Registered job manager a410175be8a962c5f3c417565760469d@pekko://flink/user/rpc/jobmanager_15 for job a72e6b48022ef36361b5eef11ee7c683.
08:06:56.303 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: 814982a7b3003690df52696b244f4d86.
08:06:56.304 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:06:56.307 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.253
08:06:56.338 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.252
08:06:56.346 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job a72e6b48022ef36361b5eef11ee7c683
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager b6dd0119-1e0e-426b-ad00-c348de2a598b
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
08:06:56.348 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 68aed56532af9c33564af146c662175d from b6dd0119-1e0e-426b-ad00-c348de2a598b for job a72e6b48022ef36361b5eef11ee7c683 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:06:56.377 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:56.382 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:56.382 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 4d91c4a4289e885e1ccd40283ee9eec0 from b6dd0119-1e0e-426b-ad00-c348de2a598b for job a72e6b48022ef36361b5eef11ee7c683 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:06:56.382 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:56.382 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:56.382 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 0a17552dd40f187ff1067ce2b4829466 from b6dd0119-1e0e-426b-ad00-c348de2a598b for job a72e6b48022ef36361b5eef11ee7c683 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:06:56.383 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1149) Receive slot request 68aed56532af9c33564af146c662175d for job a72e6b48022ef36361b5eef11ee7c683 from resource manager with leader id 814982a7b3003690df52696b244f4d86.
08:06:56.383 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:56.383 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:321) Allocated slot for 68aed56532af9c33564af146c662175d with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:06:56.383 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:56.383 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:56.384 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:56.384 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:56.384 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:56.384 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:56.384 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:56.384 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:56.387 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 99f4948912648970d945ee4b7d180287 from b6dd0119-1e0e-426b-ad00-c348de2a598b for job a72e6b48022ef36361b5eef11ee7c683 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:06:56.398 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.254
08:06:56.398 [DEBUG - main] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:06:56.400 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:56.405 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:56.409 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xbad89499, L:/127.0.0.1:52174 - R:/127.28.220.253:45079] using SASL/PLAIN
08:06:56.415 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x40d99798, L:/127.0.0.1:60872 - R:/127.28.220.252:33543] using SASL/PLAIN
08:06:56.423 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:06:56.423 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=134), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [128ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: OK, [133ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: OK, deferred=null) after lookup
08:06:56.423 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:56.426 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultJobLeaderService.java:192) Add job a72e6b48022ef36361b5eef11ee7c683 for job leader monitoring.
08:06:56.426 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1149) Receive slot request 4d91c4a4289e885e1ccd40283ee9eec0 for job a72e6b48022ef36361b5eef11ee7c683 from resource manager with leader id 814982a7b3003690df52696b244f4d86.
08:06:56.427 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:321) Allocated slot for 4d91c4a4289e885e1ccd40283ee9eec0 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:06:56.427 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1149) Receive slot request 0a17552dd40f187ff1067ce2b4829466 for job a72e6b48022ef36361b5eef11ee7c683 from resource manager with leader id 814982a7b3003690df52696b244f4d86.
08:06:56.427 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:321) Allocated slot for 0a17552dd40f187ff1067ce2b4829466 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:06:56.428 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1149) Receive slot request 99f4948912648970d945ee4b7d180287 for job a72e6b48022ef36361b5eef11ee7c683 from resource manager with leader id 814982a7b3003690df52696b244f4d86.
08:06:56.429 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:321) Allocated slot for 99f4948912648970d945ee4b7d180287 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:06:56.430 [INFO - mini-cluster-io-thread-3] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_15 with leader id f3c41756-5760-469d-a410-175be8a962c5.
08:06:56.432 [INFO - flink-pekko.actor.default-dispatcher-6] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
08:06:56.433 [DEBUG - main] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:06:56.433 [DEBUG - main] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:06:56.434 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_15 for job a72e6b48022ef36361b5eef11ee7c683.
08:06:56.435 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1783) Establish JobManager connection for job a72e6b48022ef36361b5eef11ee7c683.
08:06:56.435 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1633) Offer reserved slots to the leader of job a72e6b48022ef36361b5eef11ee7c683.
08:06:56.435 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8c252bac8ed749d288b155a27fae1849
08:06:56.438 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
08:06:56.438 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1) with allocation id 99f4948912648970d945ee4b7d180287
08:06:56.439 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.29.158.189:41727(127.29.158.189:41727)] Successfully connected to peer
08:06:56.440 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.29.158.190:38071(127.29.158.190:38071)] Successfully connected to peer
08:06:56.440 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x21c6477c, L:/127.0.0.1:35208 - R:/127.28.220.254:37365] using SASL/PLAIN
08:06:56.441 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 99f4948912648970d945ee4b7d180287.
08:06:56.448 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job a72e6b48022ef36361b5eef11ee7c683.
08:06:56.448 [INFO - flink-pekko.actor.default-dispatcher-7] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
08:06:56.448 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id a72e6b48022ef36361b5eef11ee7c683
08:06:56.449 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.29.158.188:39061(127.29.158.188:39061)] Successfully connected to peer
08:06:56.456 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:56.460 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.29.158.189
08:06:56.460 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
08:06:56.460 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1) with allocation id 4d91c4a4289e885e1ccd40283ee9eec0
08:06:56.461 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 99f4948912648970d945ee4b7d180287.
08:06:56.461 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
08:06:56.461 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1) with allocation id 0a17552dd40f187ff1067ce2b4829466
08:06:56.462 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 7c05024562a74973892ab2f3098ce916 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
08:06:56.462 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b06031ec130d4dad9efb2794fadd2b04 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
08:06:56.462 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f0136ad45f0f476b999986635f720b8f for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
08:06:56.462 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 1346ae47881b4c43b5c995d59d2a39a2 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
08:06:56.462 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f0135c5dce09400d8d90b12906c890c0 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
08:06:56.462 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f4428ebcade5440ebc2d4803102193ed for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
08:06:56.462 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=7c05024562a74973892ab2f3098ce916@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=b06031ec130d4dad9efb2794fadd2b04@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=f0136ad45f0f476b999986635f720b8f@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=1346ae47881b4c43b5c995d59d2a39a2@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=f0135c5dce09400d8d90b12906c890c0@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711)[L],e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=f4428ebcade5440ebc2d4803102193ed@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
08:06:56.463 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.29.158.188
08:06:56.469 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 4d91c4a4289e885e1ccd40283ee9eec0.
08:06:56.472 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.29.158.190
08:06:56.475 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:56.479 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
08:06:56.479 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1) with allocation id 68aed56532af9c33564af146c662175d
08:06:56.479 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
08:06:56.479 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
08:06:56.484 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:56.485 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id 4d91c4a4289e885e1ccd40283ee9eec0.
08:06:56.489 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2b8461cc
08:06:56.490 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:06:56.490 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13140095929423248446/checkpoints")
08:06:56.490 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x7c742e0e, L:/127.0.0.1:44068 - R:/127.29.158.188:39061] using SASL/PLAIN
08:06:56.490 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
08:06:56.491 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
08:06:56.497 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 0a17552dd40f187ff1067ce2b4829466.
08:06:56.500 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:06:56.500 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=124), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [101ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: OK, deferred=null) after lookup
08:06:56.505 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
08:06:56.505 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
08:06:56.505 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 2c14e26d8166482b8cd1de88f1bf2d56
08:06:56.506 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id 0a17552dd40f187ff1067ce2b4829466.
08:06:56.509 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4eafb7a5
08:06:56.510 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:06:56.510 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13140095929423248446/checkpoints")
08:06:56.513 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
08:06:56.513 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x51cd3b16, L:/127.0.0.1:47680 - R:/127.29.158.190:38071] using SASL/PLAIN
08:06:56.514 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet fcf422cfc5154d82ba8f03739eda8ff2 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
08:06:56.514 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 66bf6eb9c7a64dd89a3abc089345e514 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
08:06:56.514 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 80406d7ef2e842c0b0a8f0ee45db6639 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
08:06:56.514 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet dc730dc733f34f3aa01cff8a03a1d64b for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
08:06:56.514 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 71e73ef6d3514d87b02febae295f3921 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
08:06:56.514 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2ab829b4cc354ec6b972bd7bd1f9f105 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
08:06:56.515 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=fcf422cfc5154d82ba8f03739eda8ff2@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769),7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=66bf6eb9c7a64dd89a3abc089345e514@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=80406d7ef2e842c0b0a8f0ee45db6639@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769),7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)[L]]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=dc730dc733f34f3aa01cff8a03a1d64b@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=71e73ef6d3514d87b02febae295f3921@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=2ab829b4cc354ec6b972bd7bd1f9f105@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769),7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
08:06:56.516 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@48c9e9d
08:06:56.516 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=9), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.29.158.188:39061, [8ms] Sub RPC GetTableLocations: received response from server master-127.29.158.188:39061: OK, deferred=null)) after lookup
08:06:56.516 [DEBUG - kudu-nio-2] (Connection.java:748) [peer d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)] connecting to peer
08:06:56.518 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
08:06:56.518 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 99f4948912648970d945ee4b7d180287.
08:06:56.518 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 4d91c4a4289e885e1ccd40283ee9eec0.
08:06:56.518 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 0a17552dd40f187ff1067ce2b4829466.
08:06:56.518 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 68aed56532af9c33564af146c662175d.
08:06:56.518 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 68aed56532af9c33564af146c662175d.
08:06:56.523 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
08:06:56.523 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
08:06:56.524 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@bb0f8b7
08:06:56.524 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:06:56.524 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13140095929423248446/checkpoints")
08:06:56.525 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
08:06:56.525 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
08:06:56.527 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id 68aed56532af9c33564af146c662175d.
08:06:56.528 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@79409fb9
08:06:56.529 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:56.533 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:56.535 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:56.535 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@307b229
08:06:56.540 [DEBUG - kudu-nio-3] (Connection.java:757) [peer d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)] Successfully connected to peer
08:06:56.541 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:56.542 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xa7c966a9, L:/127.0.0.1:50386 - R:/127.29.158.189:41727] using SASL/PLAIN
08:06:56.559 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
08:06:56.559 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
08:06:56.561 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:06:56.562 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@66653da0
08:06:56.562 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:06:56.562 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13140095929423248446/checkpoints")
08:06:56.566 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:06:56.566 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
08:06:56.567 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
08:06:56.581 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:56.590 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xa2428a39, L:/127.0.0.1:49394 - R:/127.29.158.129:45149] using TOKEN/null
08:06:56.594 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@43eb944c
08:06:56.612 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:56.615 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:06:56.619 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:56.623 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:06:56.629 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.29.158.190:38071(127.29.158.190:38071)] Successfully connected to peer
08:06:56.630 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:56.631 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:56.631 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:56.631 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:56.631 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:56.632 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:56.633 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fcf422cfc5154d82ba8f03739eda8ff2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:56.633 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fcf422cfc5154d82ba8f03739eda8ff2 for partition [0x00000000, 0x0000000080000032) with scanner id null
08:06:56.634 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:56.634 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:56.634 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:56.635 [DEBUG - main] (Connection.java:748) [peer 3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)] connecting to peer
08:06:56.638 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:56.638 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:56.638 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:56.638 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:56.647 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.29.158.190
08:06:56.648 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:06:56.657 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:56.658 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:56.658 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:56.658 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:56.658 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:56.658 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:56.659 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:56.659 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:06:56.659 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:56.659 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:56.659 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:56.658 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:56.659 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.29.158.189:41727(127.29.158.189:41727)] Successfully connected to peer
08:06:56.660 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:56.660 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:56.666 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:56.666 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:56.666 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:56.667 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:56.668 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:56.668 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:56.668 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:06:56.668 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:56.668 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:56.668 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:56.669 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:56.669 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:56.669 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:56.669 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:56.672 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:06:56.673 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.29.158.189:41727(127.29.158.189:41727)] Successfully connected to peer
08:06:56.683 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.29.158.188:39061(127.29.158.188:39061)] Successfully connected to peer
08:06:56.688 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.29.158.190:38071(127.29.158.190:38071)] Successfully connected to peer
08:06:56.690 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.29.158.189
08:06:56.690 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.29.158.189
08:06:56.690 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.29.158.188
08:06:56.708 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.29.158.188:39061(127.29.158.188:39061)] Successfully connected to peer
08:06:56.709 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.29.158.190
08:06:56.715 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:56.735 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:06:56.737 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.29.158.190:38071(127.29.158.190:38071)] Successfully connected to peer
08:06:56.748 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:56.753 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:06:56.757 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.29.158.190
08:06:56.761 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.29.158.189:41727(127.29.158.189:41727)] Successfully connected to peer
08:06:56.758 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:56.771 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x35a1400e, L:/127.0.0.1:50394 - R:/127.29.158.189:41727] using SASL/PLAIN
08:06:56.789 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.29.158.189
08:06:56.798 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:56.801 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:56.802 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:56.811 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x886ce72d, L:/127.0.0.1:47690 - R:/127.29.158.190:38071] using SASL/PLAIN
08:06:56.816 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.29.158.188
08:06:56.818 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.29.158.188:39061(127.29.158.188:39061)] Successfully connected to peer
08:06:56.823 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:56.819 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x4693ba8d, L:/127.0.0.1:44084 - R:/127.29.158.188:39061] using SASL/PLAIN
08:06:56.826 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:56.827 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:06:56.828 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.29.158.190:38071(127.29.158.190:38071)] Successfully connected to peer
08:06:56.832 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:06:56.834 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.29.158.189:41727(127.29.158.189:41727)] Successfully connected to peer
08:06:56.839 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd82df7a8, L:/127.0.0.1:47700 - R:/127.29.158.190:38071] using SASL/PLAIN
08:06:56.840 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:06:56.841 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=299), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [168ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: OK, [226ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: OK, deferred=null) after lookup
08:06:56.841 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.29.158.189
08:06:56.843 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.29.158.188:39061(127.29.158.188:39061)] Successfully connected to peer
08:06:56.846 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xe2e96146, L:/127.0.0.1:50408 - R:/127.29.158.189:41727] using SASL/PLAIN
08:06:56.849 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.29.158.190
08:06:56.851 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)] Successfully connected to peer
08:06:56.858 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa46afd25, L:/127.0.0.1:47696 - R:/127.29.158.190:38071] using SASL/PLAIN
08:06:56.868 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.29.158.188
08:06:56.874 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x3654465b, L:/127.0.0.1:50392 - R:/127.29.158.189:41727] using SASL/PLAIN
08:06:56.884 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 2c14e26d8166482b8cd1de88f1bf2d56
08:06:56.892 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.29.158.188
08:06:56.902 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 2c14e26d8166482b8cd1de88f1bf2d56
08:06:56.903 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4c104640
08:06:56.905 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
08:06:56.905 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
08:06:56.922 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:56.930 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:56.936 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x052f2d2d, L:/127.0.0.1:47712 - R:/127.29.158.190:38071] using SASL/PLAIN
08:06:56.937 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x097911cd, L:/127.0.0.1:50414 - R:/127.29.158.189:41727] using SASL/PLAIN
08:06:56.939 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:56.941 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:56.948 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:56.950 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x5a772050, L:/127.0.0.1:44116 - R:/127.29.158.188:39061] using SASL/PLAIN
08:06:56.958 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:56.959 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:06:56.959 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=424), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [267ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [380ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: OK, [392ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: OK, deferred=null) after lookup
08:06:56.960 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0xeac6dae8, L:/127.0.0.1:35790 - R:/127.29.158.130:33769] using TOKEN/null
08:06:56.978 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 2c14e26d8166482b8cd1de88f1bf2d56
08:06:56.983 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 2c14e26d8166482b8cd1de88f1bf2d56
08:06:56.984 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@150b5187
08:06:56.986 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
08:06:56.986 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
08:06:56.996 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x2807ca7a, L:/127.0.0.1:44098 - R:/127.29.158.188:39061] using SASL/PLAIN
08:06:57.006 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
08:06:57.007 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='012347152e98b8970da225d7046eda9aed044960288e7aeae7fae4d85a5d8d27'}]
08:06:57.010 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:57.016 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
08:06:57.017 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='86f0628ef2d374a412994dfa9f14c3cba14b3baaf292d32ec7f02919fd0175f3'}]
08:06:57.019 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=66bf6eb9c7a64dd89a3abc089345e514, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.019 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:57.020 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 66bf6eb9c7a64dd89a3abc089345e514 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
08:06:57.031 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:06:57.031 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=497), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [279ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: OK, [341ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: OK, [470ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: OK, deferred=null) after lookup
08:06:57.033 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:06:57.034 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=80406d7ef2e842c0b0a8f0ee45db6639, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.034 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 80406d7ef2e842c0b0a8f0ee45db6639 for partition [0x0000000080000096, 0x00000001) with scanner id null
08:06:57.034 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299997, tablet=b06031ec130d4dad9efb2794fadd2b04@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)[L]]}]
08:06:57.043 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 2c14e26d8166482b8cd1de88f1bf2d56
08:06:57.043 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:57.051 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 2c14e26d8166482b8cd1de88f1bf2d56
08:06:57.051 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@475c01e0
08:06:57.051 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x408bf28a, L:/127.0.0.1:44108 - R:/127.29.158.188:39061] using SASL/PLAIN
08:06:57.057 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
08:06:57.060 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:06:57.060 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=447), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [201ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: OK, [224ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: OK, [400ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: OK, deferred=null) after lookup
08:06:57.066 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 2c14e26d8166482b8cd1de88f1bf2d56
08:06:57.070 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 2c14e26d8166482b8cd1de88f1bf2d56
08:06:57.070 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@72edcacf
08:06:57.073 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=dc730dc733f34f3aa01cff8a03a1d64b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.074 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet dc730dc733f34f3aa01cff8a03a1d64b for partition [0x00000001, 0x0000000180000032) with scanner id null
08:06:57.079 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
08:06:57.081 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
08:06:57.081 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
08:06:57.082 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
08:06:57.082 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
08:06:57.103 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:57.104 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:57.104 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:57.104 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:57.104 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:57.104 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:57.104 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:57.104 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:57.105 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:57.105 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:57.105 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:57.105 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:57.106 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:57.108 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=71e73ef6d3514d87b02febae295f3921, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.109 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 71e73ef6d3514d87b02febae295f3921 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
08:06:57.112 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:06:57.114 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299997, tablet=7c05024562a74973892ab2f3098ce916@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}]
08:06:57.118 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] connecting to peer
08:06:57.119 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:57.122 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] connecting to peer
08:06:57.123 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] Successfully connected to peer
08:06:57.126 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ab829b4cc354ec6b972bd7bd1f9f105, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.127 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
08:06:57.128 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ab829b4cc354ec6b972bd7bd1f9f105 for partition [0x0000000180000096, 0x00000002) with scanner id null
08:06:57.129 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='d3582a2d4ed0dc30dcbeb2b3c3fe4719baf60af226fc63c7dfe0dd0060157d5d'}]
08:06:57.132 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:57.138 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
08:06:57.138 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='da0ef73d88c13e7d77070f9330c34da6b00d94665e8ebc2e7fe7483926707ee2'}]
08:06:57.140 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:57.151 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.194
08:06:57.163 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] Successfully connected to peer
08:06:57.179 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
08:06:57.180 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
08:06:57.195 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:57.196 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.194
08:06:57.202 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fcf422cfc5154d82ba8f03739eda8ff2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.202 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fcf422cfc5154d82ba8f03739eda8ff2 for partition [0x00000000, 0x0000000080000032) with scanner id null
08:06:57.203 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:06:57.208 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=66bf6eb9c7a64dd89a3abc089345e514, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.210 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 66bf6eb9c7a64dd89a3abc089345e514 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
08:06:57.213 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299997, tablet=1346ae47881b4c43b5c995d59d2a39a2@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)[L]]}]
08:06:57.225 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x899d2545, L:/127.0.0.1:55382 - R:/127.28.220.194:39597] using SASL/PLAIN
08:06:57.226 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=80406d7ef2e842c0b0a8f0ee45db6639, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.226 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 80406d7ef2e842c0b0a8f0ee45db6639 for partition [0x0000000080000096, 0x00000001) with scanner id null
08:06:57.239 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=dc730dc733f34f3aa01cff8a03a1d64b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.240 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet dc730dc733f34f3aa01cff8a03a1d64b for partition [0x00000001, 0x0000000180000032) with scanner id null
08:06:57.249 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=71e73ef6d3514d87b02febae295f3921, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.249 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 71e73ef6d3514d87b02febae295f3921 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
08:06:57.256 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ab829b4cc354ec6b972bd7bd1f9f105, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.256 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ab829b4cc354ec6b972bd7bd1f9f105 for partition [0x0000000180000096, 0x00000002) with scanner id null
08:06:57.257 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:57.261 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:57.269 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7b7ceced, L:/127.0.0.1:55394 - R:/127.28.220.194:39597] using SASL/PLAIN
08:06:57.271 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:06:57.271 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] connecting to peer
08:06:57.272 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299997, tablet=f0136ad45f0f476b999986635f720b8f@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711)[L],e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}]
08:06:57.300 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159260315648001) for scanner KuduScanner(table=replication_test_table, tablet=b06031ec130d4dad9efb2794fadd2b04, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.301 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [86f0628ef2d374a412994dfa9f14c3cba14b3baaf292d32ec7f02919fd0175f3]
08:06:57.302 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [86f0628ef2d374a412994dfa9f14c3cba14b3baaf292d32ec7f02919fd0175f3]
08:06:57.303 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
08:06:57.303 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
08:06:57.305 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 86f0628ef2d374a412994dfa9f14c3cba14b3baaf292d32ec7f02919fd0175f3 finished by subtask 1; deferring removal (restored in pending)
08:06:57.310 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] disconnecting while in state READY
08:06:57.311 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='b82a2c8a469c85cd459f07e12442aeef6f5c89e36fbee509ab8b8e6bd7a07813'}]
08:06:57.313 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false, responseScanTimestamp = 7287159260315648001) for scanner KuduScanner(table=replication_test_table, tablet=7c05024562a74973892ab2f3098ce916, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.314 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [012347152e98b8970da225d7046eda9aed044960288e7aeae7fae4d85a5d8d27]
08:06:57.315 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
08:06:57.320 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:57.324 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fcf422cfc5154d82ba8f03739eda8ff2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.324 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fcf422cfc5154d82ba8f03739eda8ff2 for partition [0x00000000, 0x0000000080000032) with scanner id null
08:06:57.328 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:06:57.333 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduClient.java:2538) Learned about tablet fcf422cfc5154d82ba8f03739eda8ff2 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
08:06:57.333 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduClient.java:2538) Learned about tablet 66bf6eb9c7a64dd89a3abc089345e514 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
08:06:57.333 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduClient.java:2538) Learned about tablet 80406d7ef2e842c0b0a8f0ee45db6639 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
08:06:57.333 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduClient.java:2538) Learned about tablet dc730dc733f34f3aa01cff8a03a1d64b for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
08:06:57.334 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduClient.java:2538) Learned about tablet 71e73ef6d3514d87b02febae295f3921 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
08:06:57.338 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=66bf6eb9c7a64dd89a3abc089345e514, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.339 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 66bf6eb9c7a64dd89a3abc089345e514 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
08:06:57.340 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduClient.java:2538) Learned about tablet 2ab829b4cc354ec6b972bd7bd1f9f105 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
08:06:57.341 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=fcf422cfc5154d82ba8f03739eda8ff2@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769),7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=66bf6eb9c7a64dd89a3abc089345e514@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=80406d7ef2e842c0b0a8f0ee45db6639@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769),7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)[L]]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=dc730dc733f34f3aa01cff8a03a1d64b@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=71e73ef6d3514d87b02febae295f3921@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=2ab829b4cc354ec6b972bd7bd1f9f105@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769),7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
08:06:57.343 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [012347152e98b8970da225d7046eda9aed044960288e7aeae7fae4d85a5d8d27]
08:06:57.345 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 012347152e98b8970da225d7046eda9aed044960288e7aeae7fae4d85a5d8d27 finished by subtask 2; deferring removal (restored in pending)
08:06:57.345 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
08:06:57.346 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
08:06:57.346 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] disconnecting while in state READY
08:06:57.347 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:06:57.348 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='d06478a60a2d857702d571c2f28764d1a116a68217a1dbd5e8f226a477559430'}]
08:06:57.351 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:57.372 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] connecting to peer
08:06:57.373 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=80406d7ef2e842c0b0a8f0ee45db6639, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.373 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 80406d7ef2e842c0b0a8f0ee45db6639 for partition [0x0000000080000096, 0x00000001) with scanner id null
08:06:57.373 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
08:06:57.376 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299996, tablet=f0135c5dce09400d8d90b12906c890c0@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}]
08:06:57.376 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] Successfully connected to peer
08:06:57.388 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.194
08:06:57.390 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=dc730dc733f34f3aa01cff8a03a1d64b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.390 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet dc730dc733f34f3aa01cff8a03a1d64b for partition [0x00000001, 0x0000000180000032) with scanner id null
08:06:57.399 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:57.410 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x3e5daf97, L:/127.0.0.1:42682 - R:/127.28.220.194:39597] using SASL/PLAIN
08:06:57.412 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:57.413 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:57.413 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:57.415 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:57.415 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:57.415 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:57.416 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:57.416 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:57.416 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:57.416 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:57.416 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:57.416 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:57.417 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:57.418 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=71e73ef6d3514d87b02febae295f3921, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.419 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 71e73ef6d3514d87b02febae295f3921 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
08:06:57.426 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ab829b4cc354ec6b972bd7bd1f9f105, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.426 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ab829b4cc354ec6b972bd7bd1f9f105 for partition [0x0000000180000096, 0x00000002) with scanner id null
08:06:57.438 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false, responseScanTimestamp = 7287159260315648001) for scanner KuduScanner(table=replication_test_table, tablet=1346ae47881b4c43b5c995d59d2a39a2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.439 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [d3582a2d4ed0dc30dcbeb2b3c3fe4719baf60af226fc63c7dfe0dd0060157d5d]
08:06:57.442 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
08:06:57.456 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:57.457 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] handling channelInactive
08:06:57.458 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] cleaning up while in state READY due to: connection closed
08:06:57.458 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
08:06:57.458 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
08:06:57.465 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [d3582a2d4ed0dc30dcbeb2b3c3fe4719baf60af226fc63c7dfe0dd0060157d5d]
08:06:57.467 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet dc730dc733f34f3aa01cff8a03a1d64b for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
08:06:57.467 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 71e73ef6d3514d87b02febae295f3921 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
08:06:57.467 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2ab829b4cc354ec6b972bd7bd1f9f105 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
08:06:57.467 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=dc730dc733f34f3aa01cff8a03a1d64b@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=71e73ef6d3514d87b02febae295f3921@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=2ab829b4cc354ec6b972bd7bd1f9f105@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769),7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
08:06:57.468 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] handling channelInactive
08:06:57.469 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] cleaning up while in state READY due to: connection closed
08:06:57.469 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split d3582a2d4ed0dc30dcbeb2b3c3fe4719baf60af226fc63c7dfe0dd0060157d5d finished by subtask 3; deferring removal (restored in pending)
08:06:57.469 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
08:06:57.469 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
08:06:57.470 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
08:06:57.470 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
08:06:57.470 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] disconnecting while in state READY
08:06:57.471 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:06:57.475 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] Successfully connected to peer
08:06:57.479 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet dc730dc733f34f3aa01cff8a03a1d64b for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
08:06:57.479 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 71e73ef6d3514d87b02febae295f3921 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
08:06:57.479 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2ab829b4cc354ec6b972bd7bd1f9f105 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
08:06:57.479 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=dc730dc733f34f3aa01cff8a03a1d64b@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=71e73ef6d3514d87b02febae295f3921@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=2ab829b4cc354ec6b972bd7bd1f9f105@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769),7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
08:06:57.481 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet dc730dc733f34f3aa01cff8a03a1d64b for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
08:06:57.481 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 71e73ef6d3514d87b02febae295f3921 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
08:06:57.481 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2ab829b4cc354ec6b972bd7bd1f9f105 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
08:06:57.481 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=dc730dc733f34f3aa01cff8a03a1d64b@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=71e73ef6d3514d87b02febae295f3921@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=2ab829b4cc354ec6b972bd7bd1f9f105@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769),7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
08:06:57.486 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.194
08:06:57.486 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] connecting to peer
08:06:57.486 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:57.488 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:57.488 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:57.488 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:57.488 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:57.489 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:57.489 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:57.489 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:57.489 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:57.490 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:57.490 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:57.490 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:57.490 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:57.491 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fcf422cfc5154d82ba8f03739eda8ff2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.492 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fcf422cfc5154d82ba8f03739eda8ff2 for partition [0x00000000, 0x0000000080000032) with scanner id null
08:06:57.495 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet dc730dc733f34f3aa01cff8a03a1d64b for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
08:06:57.495 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 71e73ef6d3514d87b02febae295f3921 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
08:06:57.495 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2ab829b4cc354ec6b972bd7bd1f9f105 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
08:06:57.495 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=dc730dc733f34f3aa01cff8a03a1d64b@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=71e73ef6d3514d87b02febae295f3921@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=2ab829b4cc354ec6b972bd7bd1f9f105@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769),7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
08:06:57.496 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet dc730dc733f34f3aa01cff8a03a1d64b for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
08:06:57.497 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 71e73ef6d3514d87b02febae295f3921 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
08:06:57.497 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2ab829b4cc354ec6b972bd7bd1f9f105 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
08:06:57.497 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=dc730dc733f34f3aa01cff8a03a1d64b@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=71e73ef6d3514d87b02febae295f3921@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=2ab829b4cc354ec6b972bd7bd1f9f105@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769),7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
08:06:57.501 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet dc730dc733f34f3aa01cff8a03a1d64b for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
08:06:57.501 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 71e73ef6d3514d87b02febae295f3921 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
08:06:57.501 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2ab829b4cc354ec6b972bd7bd1f9f105 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
08:06:57.501 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=dc730dc733f34f3aa01cff8a03a1d64b@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=71e73ef6d3514d87b02febae295f3921@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=2ab829b4cc354ec6b972bd7bd1f9f105@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769),7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
08:06:57.504 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=66bf6eb9c7a64dd89a3abc089345e514, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.504 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 66bf6eb9c7a64dd89a3abc089345e514 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
08:06:57.507 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet dc730dc733f34f3aa01cff8a03a1d64b for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
08:06:57.507 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 71e73ef6d3514d87b02febae295f3921 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
08:06:57.507 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2ab829b4cc354ec6b972bd7bd1f9f105 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
08:06:57.508 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=dc730dc733f34f3aa01cff8a03a1d64b@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=71e73ef6d3514d87b02febae295f3921@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=2ab829b4cc354ec6b972bd7bd1f9f105@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769),7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
08:06:57.513 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=80406d7ef2e842c0b0a8f0ee45db6639, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.514 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 80406d7ef2e842c0b0a8f0ee45db6639 for partition [0x0000000080000096, 0x00000001) with scanner id null
08:06:57.517 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet dc730dc733f34f3aa01cff8a03a1d64b for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
08:06:57.517 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 71e73ef6d3514d87b02febae295f3921 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
08:06:57.517 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2ab829b4cc354ec6b972bd7bd1f9f105 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
08:06:57.517 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=dc730dc733f34f3aa01cff8a03a1d64b@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=71e73ef6d3514d87b02febae295f3921@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=2ab829b4cc354ec6b972bd7bd1f9f105@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769),7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
08:06:57.530 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:57.542 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xdf81fc1d, L:/127.0.0.1:42688 - R:/127.28.220.194:39597] using SASL/PLAIN
08:06:57.554 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159260315648001) for scanner KuduScanner(table=replication_test_table, tablet=f0136ad45f0f476b999986635f720b8f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.554 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [da0ef73d88c13e7d77070f9330c34da6b00d94665e8ebc2e7fe7483926707ee2]
08:06:57.555 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [da0ef73d88c13e7d77070f9330c34da6b00d94665e8ebc2e7fe7483926707ee2]
08:06:57.555 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
08:06:57.555 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
08:06:57.556 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] disconnecting while in state READY
08:06:57.556 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split da0ef73d88c13e7d77070f9330c34da6b00d94665e8ebc2e7fe7483926707ee2 finished by subtask 0; deferring removal (restored in pending)
08:06:57.557 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:06:57.599 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=dc730dc733f34f3aa01cff8a03a1d64b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.600 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet dc730dc733f34f3aa01cff8a03a1d64b for partition [0x00000001, 0x0000000180000032) with scanner id null
08:06:57.615 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=71e73ef6d3514d87b02febae295f3921, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.615 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 71e73ef6d3514d87b02febae295f3921 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
08:06:57.616 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
08:06:57.617 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299997, tablet=f4428ebcade5440ebc2d4803102193ed@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711)[L],e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}]
08:06:57.618 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091617617 for job a72e6b48022ef36361b5eef11ee7c683.
08:06:57.623 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=4, operationSize=253, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@3d17d873, flushNotification=Deferred@180820678(state=PENDING, result=null, callback=<none>, errback=<none>)}
08:06:57.624 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)] connecting to peer
08:06:57.625 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=8, operationSize=505, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@ef9858b, flushNotification=Deferred@391496106(state=PENDING, result=null, callback=<none>, errback=<none>)}
08:06:57.625 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)] connecting to peer
08:06:57.627 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ab829b4cc354ec6b972bd7bd1f9f105, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.627 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ab829b4cc354ec6b972bd7bd1f9f105 for partition [0x0000000180000096, 0x00000002) with scanner id null
08:06:57.667 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] handling channelInactive
08:06:57.668 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] cleaning up while in state READY due to: connection closed
08:06:57.668 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:06:57.668 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
08:06:57.688 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fcf422cfc5154d82ba8f03739eda8ff2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.688 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fcf422cfc5154d82ba8f03739eda8ff2 for partition [0x00000000, 0x0000000080000032) with scanner id null
08:06:57.692 [DEBUG - kudu-nio-3] (Connection.java:757) [peer d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)] Successfully connected to peer
08:06:57.701 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)] Successfully connected to peer
08:06:57.722 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=66bf6eb9c7a64dd89a3abc089345e514, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.722 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 66bf6eb9c7a64dd89a3abc089345e514 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
08:06:57.731 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=80406d7ef2e842c0b0a8f0ee45db6639, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.732 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 80406d7ef2e842c0b0a8f0ee45db6639 for partition [0x0000000080000096, 0x00000001) with scanner id null
08:06:57.752 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] connecting to peer
08:06:57.755 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=dc730dc733f34f3aa01cff8a03a1d64b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.755 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet dc730dc733f34f3aa01cff8a03a1d64b for partition [0x00000001, 0x0000000180000032) with scanner id null
08:06:57.759 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:57.765 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=71e73ef6d3514d87b02febae295f3921, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.765 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 71e73ef6d3514d87b02febae295f3921 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
08:06:57.776 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ab829b4cc354ec6b972bd7bd1f9f105, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.778 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ab829b4cc354ec6b972bd7bd1f9f105 for partition [0x0000000180000096, 0x00000002) with scanner id null
08:06:57.786 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] Successfully connected to peer
08:06:57.796 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.194
08:06:57.806 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:57.832 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x94dfbfe6, L:/127.0.0.1:36528 - R:/127.29.158.129:45149] using TOKEN/null
08:06:57.833 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:57.838 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fcf422cfc5154d82ba8f03739eda8ff2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.838 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fcf422cfc5154d82ba8f03739eda8ff2 for partition [0x00000000, 0x0000000080000032) with scanner id null
08:06:57.851 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] handling channelInactive
08:06:57.851 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=66bf6eb9c7a64dd89a3abc089345e514, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.851 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] cleaning up while in state READY due to: connection closed
08:06:57.852 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 66bf6eb9c7a64dd89a3abc089345e514 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
08:06:57.852 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:06:57.852 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
08:06:57.860 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] Successfully connected to peer
08:06:57.865 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=80406d7ef2e842c0b0a8f0ee45db6639, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.865 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 80406d7ef2e842c0b0a8f0ee45db6639 for partition [0x0000000080000096, 0x00000001) with scanner id null
08:06:57.866 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job b42812d69c586178cf7556c3c92998f3 from Checkpoint 65 @ 1779091487380 for b42812d69c586178cf7556c3c92998f3 located at file:/tmp/junit1738461414297871817/checkpoints/b42812d69c586178cf7556c3c92998f3/chk-65.
08:06:57.867 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
08:06:57.868 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CREATED to SCHEDULED.
08:06:57.869 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:06:57.870 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 0 to checkpoint 65 for source Source: KuduSource to checkpoint.
08:06:57.880 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from SCHEDULED to DEPLOYING.
08:06:57.880 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #5) with attempt id 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1) with allocation id 2f9a5ebd231a465571d2109e36591407
08:06:57.881 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 2f9a5ebd231a465571d2109e36591407.
08:06:57.882 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.194
08:06:57.883 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#5 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_5), deploy into slot with allocation id 2f9a5ebd231a465571d2109e36591407.
08:06:57.884 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (b42812d69c586178cf7556c3c92998f3) switched from state RESTARTING to RUNNING.
08:06:57.884 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job b42812d69c586178cf7556c3c92998f3 from Checkpoint 65 @ 1779091487380 for b42812d69c586178cf7556c3c92998f3 located at file:/tmp/junit1738461414297871817/checkpoints/b42812d69c586178cf7556c3c92998f3/chk-65.
08:06:57.885 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
08:06:57.885 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 3 to checkpoint 65 for source Source: KuduSource to checkpoint.
08:06:57.885 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CREATED to SCHEDULED.
08:06:57.886 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x792a3467, L:/127.0.0.1:42692 - R:/127.28.220.194:39597] using SASL/PLAIN
08:06:57.886 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:06:57.887 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from SCHEDULED to DEPLOYING.
08:06:57.887 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #5) with attempt id 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1) with allocation id 4c78869737ef27e21dadfe7d1a23010d
08:06:57.892 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:57.893 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:57.898 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xe8338e0f, L:/127.0.0.1:51114 - R:/127.29.158.130:33769] using TOKEN/null
08:06:57.904 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x2f24bb04, L:/127.0.0.1:42702 - R:/127.28.220.194:39597] using SASL/PLAIN
08:06:57.927 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:57.928 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:57.928 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:57.929 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:57.929 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:57.929 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:57.930 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:57.930 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:57.930 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:57.931 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:57.931 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:57.931 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:57.931 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:57.934 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 4c78869737ef27e21dadfe7d1a23010d.
08:06:57.936 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#5 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_5), deploy into slot with allocation id 4c78869737ef27e21dadfe7d1a23010d.
08:06:57.939 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CREATED to DEPLOYING.
08:06:57.939 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#5 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_5) [DEPLOYING].
08:06:57.940 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@495384ce
08:06:57.940 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:06:57.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:57.960 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=dc730dc733f34f3aa01cff8a03a1d64b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.960 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet dc730dc733f34f3aa01cff8a03a1d64b for partition [0x00000001, 0x0000000180000032) with scanner id null
08:06:57.968 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:57.968 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:57.968 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:57.969 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:57.969 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:57.969 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:57.970 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:57.970 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:57.970 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:57.970 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:57.970 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:57.970 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:57.970 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:57.975 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit1738461414297871817/checkpoints")
08:06:57.976 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from DEPLOYING to INITIALIZING.
08:06:57.976 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from DEPLOYING to INITIALIZING.
08:06:57.982 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CREATED to DEPLOYING.
08:06:57.982 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#5 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_5) [DEPLOYING].
08:06:57.986 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159260315648001) for scanner KuduScanner(table=replication_test_table, tablet=f0135c5dce09400d8d90b12906c890c0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:57.987 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [b82a2c8a469c85cd459f07e12442aeef6f5c89e36fbee509ab8b8e6bd7a07813]
08:06:57.987 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [b82a2c8a469c85cd459f07e12442aeef6f5c89e36fbee509ab8b8e6bd7a07813]
08:06:57.987 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
08:06:57.988 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
08:06:57.989 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split b82a2c8a469c85cd459f07e12442aeef6f5c89e36fbee509ab8b8e6bd7a07813 finished by subtask 1; deferring removal (restored in pending)
08:06:57.990 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] disconnecting while in state READY
08:06:57.990 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:06:58.004 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5f48bedd
08:06:58.004 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:06:58.005 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159260315648001) for scanner KuduScanner(table=replication_test_table, tablet=f4428ebcade5440ebc2d4803102193ed, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.005 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit1738461414297871817/checkpoints")
08:06:58.005 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [d06478a60a2d857702d571c2f28764d1a116a68217a1dbd5e8f226a477559430]
08:06:58.020 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@18bd3b09
08:06:58.023 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:58.005 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from DEPLOYING to INITIALIZING.
08:06:58.024 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from DEPLOYING to INITIALIZING.
08:06:58.035 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=71e73ef6d3514d87b02febae295f3921, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.035 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 71e73ef6d3514d87b02febae295f3921 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
08:06:58.044 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ab829b4cc354ec6b972bd7bd1f9f105, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.044 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ab829b4cc354ec6b972bd7bd1f9f105 for partition [0x0000000180000096, 0x00000002) with scanner id null
08:06:58.067 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@41a2759b
08:06:58.079 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:06:58.082 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
08:06:58.082 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] handling channelInactive
08:06:58.082 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] cleaning up while in state READY due to: connection closed
08:06:58.082 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:06:58.092 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:58.108 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fcf422cfc5154d82ba8f03739eda8ff2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.109 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fcf422cfc5154d82ba8f03739eda8ff2 for partition [0x00000000, 0x0000000080000032) with scanner id null
08:06:58.134 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=66bf6eb9c7a64dd89a3abc089345e514, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.134 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 66bf6eb9c7a64dd89a3abc089345e514 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
08:06:58.143 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=80406d7ef2e842c0b0a8f0ee45db6639, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.144 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 80406d7ef2e842c0b0a8f0ee45db6639 for partition [0x0000000080000096, 0x00000001) with scanner id null
08:06:58.163 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:58.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:58.174844 31652 log.cc:927] Time spent T dc730dc733f34f3aa01cff8a03a1d64b P 7a55aa81ed1045bbb68d397395b9ae3f: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
08:06:58.181 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:58.184 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.184 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.184 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.197 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [d06478a60a2d857702d571c2f28764d1a116a68217a1dbd5e8f226a477559430]
08:06:58.197 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
08:06:58.197 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
08:06:58.199 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] disconnecting while in state READY
08:06:58.199 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split d06478a60a2d857702d571c2f28764d1a116a68217a1dbd5e8f226a477559430 finished by subtask 2; deferring removal (restored in pending)
08:06:58.200 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:06:58.202 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=dc730dc733f34f3aa01cff8a03a1d64b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.203 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet dc730dc733f34f3aa01cff8a03a1d64b for partition [0x00000001, 0x0000000180000032) with scanner id null
08:06:58.213 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=71e73ef6d3514d87b02febae295f3921, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.214 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 71e73ef6d3514d87b02febae295f3921 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
08:06:58.221 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ab829b4cc354ec6b972bd7bd1f9f105, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.221 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ab829b4cc354ec6b972bd7bd1f9f105 for partition [0x0000000180000096, 0x00000002) with scanner id null
08:06:58.258 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:58.276 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:58.284 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:58.287 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.287 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.287 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.291 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:58.293 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.293 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.293 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.295 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.295 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fcf422cfc5154d82ba8f03739eda8ff2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.295 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.296 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fcf422cfc5154d82ba8f03739eda8ff2 for partition [0x00000000, 0x0000000080000032) with scanner id null
08:06:58.296 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.296 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:58.301 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] handling channelInactive
08:06:58.301 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
08:06:58.302 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] cleaning up while in state READY due to: connection closed
08:06:58.302 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:06:58.304 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=66bf6eb9c7a64dd89a3abc089345e514, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.305 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 66bf6eb9c7a64dd89a3abc089345e514 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
08:06:58.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:58.312915 30881 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.158.131:41421, user_credentials={real_user=slave}} blocked reactor thread for 50834.6us
08:06:58.318 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:58.320 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=80406d7ef2e842c0b0a8f0ee45db6639, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.320 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 80406d7ef2e842c0b0a8f0ee45db6639 for partition [0x0000000080000096, 0x00000001) with scanner id null
08:06:58.345 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=dc730dc733f34f3aa01cff8a03a1d64b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.346 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet dc730dc733f34f3aa01cff8a03a1d64b for partition [0x00000001, 0x0000000180000032) with scanner id null
08:06:58.364 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:58.380 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=71e73ef6d3514d87b02febae295f3921, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.380 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 71e73ef6d3514d87b02febae295f3921 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
08:06:58.383 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.383 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.383 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.388 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ab829b4cc354ec6b972bd7bd1f9f105, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.388 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ab829b4cc354ec6b972bd7bd1f9f105 for partition [0x0000000180000096, 0x00000002) with scanner id null
08:06:58.396 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8c252bac8ed749d288b155a27fae1849
08:06:58.400 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.400 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.402 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 2c14e26d8166482b8cd1de88f1bf2d56
08:06:58.404 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job a72e6b48022ef36361b5eef11ee7c683 (4964 bytes, checkpointDuration=786 ms, finalizationTime=0 ms).
08:06:58.405 [INFO - Checkpoint Timer] (CheckpointRequestDecider.java:220) checkpoint request time in queue: 286
08:06:58.407 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
08:06:58.410 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8c252bac8ed749d288b155a27fae1849
08:06:58.414 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 86f0628ef2d374a412994dfa9f14c3cba14b3baaf292d32ec7f02919fd0175f3 from pending
08:06:58.414 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split da0ef73d88c13e7d77070f9330c34da6b00d94665e8ebc2e7fe7483926707ee2 from pending
08:06:58.414 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 012347152e98b8970da225d7046eda9aed044960288e7aeae7fae4d85a5d8d27 from pending
08:06:58.414 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split d3582a2d4ed0dc30dcbeb2b3c3fe4719baf60af226fc63c7dfe0dd0060157d5d from pending
08:06:58.414 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split d06478a60a2d857702d571c2f28764d1a116a68217a1dbd5e8f226a477559430 from pending
08:06:58.414 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split b82a2c8a469c85cd459f07e12442aeef6f5c89e36fbee509ab8b8e6bd7a07813 from pending
08:06:58.414 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 6 finished splits from enumerator state
08:06:58.415 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091618405 for job a72e6b48022ef36361b5eef11ee7c683.
08:06:58.426 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.426 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:58.429 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:58.430 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 2c14e26d8166482b8cd1de88f1bf2d56
08:06:58.434 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=28 ms, finalizationTime=0 ms).
08:06:58.436 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:58.437 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 7c05024562a74973892ab2f3098ce916 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
08:06:58.437 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b06031ec130d4dad9efb2794fadd2b04 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
08:06:58.437 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f0136ad45f0f476b999986635f720b8f for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
08:06:58.437 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 1346ae47881b4c43b5c995d59d2a39a2 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
08:06:58.438 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f0135c5dce09400d8d90b12906c890c0 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
08:06:58.438 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
08:06:58.438 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f4428ebcade5440ebc2d4803102193ed for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
08:06:58.439 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=7c05024562a74973892ab2f3098ce916@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=b06031ec130d4dad9efb2794fadd2b04@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=f0136ad45f0f476b999986635f720b8f@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=1346ae47881b4c43b5c995d59d2a39a2@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=f0135c5dce09400d8d90b12906c890c0@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711)[L],e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=f4428ebcade5440ebc2d4803102193ed@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
08:06:58.442 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:58.443 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.443 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.444 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.454 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.454 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.454 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.455 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet fcf422cfc5154d82ba8f03739eda8ff2 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
08:06:58.455 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 66bf6eb9c7a64dd89a3abc089345e514 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
08:06:58.455 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 80406d7ef2e842c0b0a8f0ee45db6639 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
08:06:58.455 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet dc730dc733f34f3aa01cff8a03a1d64b for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
08:06:58.455 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 71e73ef6d3514d87b02febae295f3921 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
08:06:58.455 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2ab829b4cc354ec6b972bd7bd1f9f105 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
08:06:58.455 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=fcf422cfc5154d82ba8f03739eda8ff2@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769),7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=66bf6eb9c7a64dd89a3abc089345e514@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=80406d7ef2e842c0b0a8f0ee45db6639@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769),7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)[L]]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=dc730dc733f34f3aa01cff8a03a1d64b@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=71e73ef6d3514d87b02febae295f3921@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=2ab829b4cc354ec6b972bd7bd1f9f105@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769),7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
08:06:58.457 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:58.462 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8c252bac8ed749d288b155a27fae1849
08:06:58.469 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 2c14e26d8166482b8cd1de88f1bf2d56
08:06:58.476 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 7c05024562a74973892ab2f3098ce916 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
08:06:58.476 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b06031ec130d4dad9efb2794fadd2b04 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
08:06:58.476 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f0136ad45f0f476b999986635f720b8f for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
08:06:58.476 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 1346ae47881b4c43b5c995d59d2a39a2 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
08:06:58.476 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f0135c5dce09400d8d90b12906c890c0 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
08:06:58.476 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f4428ebcade5440ebc2d4803102193ed for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
08:06:58.476 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=7c05024562a74973892ab2f3098ce916@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=b06031ec130d4dad9efb2794fadd2b04@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=f0136ad45f0f476b999986635f720b8f@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=1346ae47881b4c43b5c995d59d2a39a2@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=f0135c5dce09400d8d90b12906c890c0@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711)[L],e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=f4428ebcade5440ebc2d4803102193ed@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
08:06:58.477 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=7), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.220.252:33543, [6ms] Sub RPC GetTableLocations: received response from server master-127.28.220.252:33543: OK, deferred=null)) after lookup
08:06:58.477 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.478 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.478 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.476 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:58.490 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.490 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.490 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.491 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:58.492 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:58.493 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:58.494 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.494 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.494 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.509 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.510 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.510 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.510 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:58.516 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:58.523 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7c05024562a74973892ab2f3098ce916, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.524 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7c05024562a74973892ab2f3098ce916 for partition [0x00000000, 0x0000000080000032) with scanner id null
08:06:58.524 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:58.525 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.525 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.526 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.531 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b06031ec130d4dad9efb2794fadd2b04, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.531 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet b06031ec130d4dad9efb2794fadd2b04 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
08:06:58.538 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f0136ad45f0f476b999986635f720b8f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.538 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet f0136ad45f0f476b999986635f720b8f for partition [0x0000000080000096, 0x00000001) with scanner id null
08:06:58.565 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:58.567 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.567 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.567 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.568 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.568 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.572 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.572 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:58.575 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1346ae47881b4c43b5c995d59d2a39a2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.576 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 1346ae47881b4c43b5c995d59d2a39a2 for partition [0x00000001, 0x0000000180000032) with scanner id null
08:06:58.576 [DEBUG - main] (Connection.java:748) [peer 9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711)] connecting to peer
08:06:58.592 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:58.593 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:58.593 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:58.594 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.594 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.594 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.595 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.595 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.595 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.595 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.595 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.595 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.596 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:58.598 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:58.599 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.599 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.599 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.613 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:58.613 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:58.613 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:58.614 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.614 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.614 [DEBUG - kudu-nio-5] (Connection.java:757) [peer 9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711)] Successfully connected to peer
08:06:58.614 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.614 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.615 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.615 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.615 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.615 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.615 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.615 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:58.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091618618 for job a72e6b48022ef36361b5eef11ee7c683.
08:06:58.622 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:58.622 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.622 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.622 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.623 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.623 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.623 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.623 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:58.635 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:58.636 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
08:06:58.636 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:58.636 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:58.636 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.636 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.636 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.637 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.637 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.637 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.637 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.637 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.637 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.637 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:58.638 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
08:06:58.652 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:58.653 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:58.653 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:58.654 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.654 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.654 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.655 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.655 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.655 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.655 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:58.655 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.655 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.655 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:58.655 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.655 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:58.656 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.656 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.656 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.656 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:58.656 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.656 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.656 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.656 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.656 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.656 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.656 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:58.662 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:58.681 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:06:58.691 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0xa91b4006, L:/127.0.0.1:49544 - R:/127.28.220.193:36711] using TOKEN/null
08:06:58.695 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:58.696 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:58.696 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:58.696 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.696 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.696 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.696 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.696 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.697 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.697 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.697 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.697 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.697 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:58.712 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:58.713 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:58.713 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:58.714 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.714 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.714 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.715 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.715 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.715 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.715 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.715 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.715 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.715 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:58.736 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:58.736 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:58.736 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:58.737 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.737 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.737 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.738 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.738 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.738 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.738 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.738 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.738 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.739 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:58.744 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f0135c5dce09400d8d90b12906c890c0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.746 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet f0135c5dce09400d8d90b12906c890c0 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
08:06:58.760 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:58.763 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f4428ebcade5440ebc2d4803102193ed, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.764 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet f4428ebcade5440ebc2d4803102193ed for partition [0x0000000180000096, 0x00000002) with scanner id null
08:06:58.773 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet fcf422cfc5154d82ba8f03739eda8ff2 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
08:06:58.773 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 66bf6eb9c7a64dd89a3abc089345e514 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
08:06:58.773 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 80406d7ef2e842c0b0a8f0ee45db6639 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
08:06:58.773 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet dc730dc733f34f3aa01cff8a03a1d64b for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
08:06:58.774 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 71e73ef6d3514d87b02febae295f3921 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
08:06:58.774 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2ab829b4cc354ec6b972bd7bd1f9f105 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
08:06:58.774 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=fcf422cfc5154d82ba8f03739eda8ff2@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769),7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=66bf6eb9c7a64dd89a3abc089345e514@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=80406d7ef2e842c0b0a8f0ee45db6639@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769),7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)[L]]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=dc730dc733f34f3aa01cff8a03a1d64b@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=71e73ef6d3514d87b02febae295f3921@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)[L],7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=2ab829b4cc354ec6b972bd7bd1f9f105@[3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769),7a55aa81ed1045bbb68d397395b9ae3f(127.29.158.131:41421),d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
08:06:58.775 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=10), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.29.158.188:39061, [9ms] Sub RPC GetTableLocations: received response from server master-127.29.158.188:39061: OK, deferred=null)) after lookup
08:06:58.791 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fcf422cfc5154d82ba8f03739eda8ff2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.792 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fcf422cfc5154d82ba8f03739eda8ff2 for partition [0x00000000, 0x0000000080000032) with scanner id null
08:06:58.801 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=66bf6eb9c7a64dd89a3abc089345e514, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.802 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 66bf6eb9c7a64dd89a3abc089345e514 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
08:06:58.830 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=80406d7ef2e842c0b0a8f0ee45db6639, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.830 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 80406d7ef2e842c0b0a8f0ee45db6639 for partition [0x0000000080000096, 0x00000001) with scanner id null
08:06:58.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:58.844456 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.220.195:37615, user_credentials={real_user=slave}} blocked reactor thread for 78113us
08:06:58.852 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:58.853 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:58.853 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:58.853 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.854 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.854 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.854 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.854 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.854 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.854 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.854 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.854 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.854 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:58.855 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:58.855 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:58.856 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.856 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:58.856 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.856 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.856 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.856 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.856 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.857 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.857 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.858 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.858 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:58.880 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=dc730dc733f34f3aa01cff8a03a1d64b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.881 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet dc730dc733f34f3aa01cff8a03a1d64b for partition [0x00000001, 0x0000000180000032) with scanner id null
08:06:58.892 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=71e73ef6d3514d87b02febae295f3921, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.893 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 71e73ef6d3514d87b02febae295f3921 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
08:06:58.910 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ab829b4cc354ec6b972bd7bd1f9f105, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.910 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ab829b4cc354ec6b972bd7bd1f9f105 for partition [0x0000000180000096, 0x00000002) with scanner id null
08:06:58.916 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:58.917 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:58.917 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:58.918 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.918 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.918 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:58.918 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.919 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.919 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:58.919 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.919 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.919 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:58.919 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:58.940 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7c05024562a74973892ab2f3098ce916, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.940 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 7c05024562a74973892ab2f3098ce916 for partition [0x00000000, 0x0000000080000032) with scanner id null
08:06:58.951 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b06031ec130d4dad9efb2794fadd2b04, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.952 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet b06031ec130d4dad9efb2794fadd2b04 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
08:06:58.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:58.969 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f0136ad45f0f476b999986635f720b8f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:58.970 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet f0136ad45f0f476b999986635f720b8f for partition [0x0000000080000096, 0x00000001) with scanner id null
08:06:59.016 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:59.017 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:59.017 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:59.018 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1346ae47881b4c43b5c995d59d2a39a2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:59.018 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 1346ae47881b4c43b5c995d59d2a39a2 for partition [0x00000001, 0x0000000180000032) with scanner id null
08:06:59.018 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:59.019 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:59.019 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:59.020 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:59.020 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:59.020 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:59.020 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:59.021 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:59.021 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:59.021 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:59.029 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f0135c5dce09400d8d90b12906c890c0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:59.030 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet f0135c5dce09400d8d90b12906c890c0 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
08:06:59.054 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f4428ebcade5440ebc2d4803102193ed, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:59.055 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet f4428ebcade5440ebc2d4803102193ed for partition [0x0000000180000096, 0x00000002) with scanner id null
08:06:59.091 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fcf422cfc5154d82ba8f03739eda8ff2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:59.092 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fcf422cfc5154d82ba8f03739eda8ff2 for partition [0x00000000, 0x0000000080000032) with scanner id null
08:06:59.095 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:59.096 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:59.096 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:59.097 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:59.097 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:59.097 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:59.097 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:59.097 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:59.097 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:59.097 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:59.097 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:59.097 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:59.097 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:59.116 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=66bf6eb9c7a64dd89a3abc089345e514, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:59.116 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 66bf6eb9c7a64dd89a3abc089345e514 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
08:06:59.121 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091619120 for job a72e6b48022ef36361b5eef11ee7c683.
08:06:59.136 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=80406d7ef2e842c0b0a8f0ee45db6639, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:59.137 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 80406d7ef2e842c0b0a8f0ee45db6639 for partition [0x0000000080000096, 0x00000001) with scanner id null
08:06:59.156 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=36 ms, finalizationTime=0 ms).
08:06:59.158 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:06:59.158 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:06:59.159 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:06:59.160 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:59.160 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:59.160 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:06:59.160 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:59.160 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:59.160 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:06:59.161 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:59.161 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:59.161 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:06:59.161 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:06:59.162 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:59.163 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
08:06:59.212 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:59.213 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:59.213 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:59.214 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:59.214 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:59.214 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:59.214 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:59.214 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:59.215 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:59.215 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:59.215 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:59.215 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:59.215 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:59.220 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=dc730dc733f34f3aa01cff8a03a1d64b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:59.220 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet dc730dc733f34f3aa01cff8a03a1d64b for partition [0x00000001, 0x0000000180000032) with scanner id null
08:06:59.259 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:59.266 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=71e73ef6d3514d87b02febae295f3921, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:59.266 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 71e73ef6d3514d87b02febae295f3921 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
08:06:59.281 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ab829b4cc354ec6b972bd7bd1f9f105, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:06:59.281 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ab829b4cc354ec6b972bd7bd1f9f105 for partition [0x0000000180000096, 0x00000002) with scanner id null
08:06:59.282 [DEBUG - main] (Connection.java:575) [peer d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)] disconnecting while in state READY
08:06:59.282 [DEBUG - main] (Connection.java:575) [peer master-127.29.158.189:41727(127.29.158.189:41727)] disconnecting while in state READY
08:06:59.282 [DEBUG - main] (Connection.java:575) [peer 3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)] disconnecting while in state READY
08:06:59.282 [DEBUG - main] (Connection.java:575) [peer master-127.29.158.190:38071(127.29.158.190:38071)] disconnecting while in state READY
08:06:59.283 [DEBUG - main] (Connection.java:575) [peer master-127.29.158.188:39061(127.29.158.188:39061)] disconnecting while in state READY
08:06:59.283 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.29.158.189:41727(127.29.158.189:41727)] handling channelInactive
08:06:59.283 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.29.158.190:38071(127.29.158.190:38071)] handling channelInactive
08:06:59.284 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state READY due to: connection closed
08:06:59.284 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state READY due to: connection closed
08:06:59.284 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)] handling channelInactive
08:06:59.284 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)] cleaning up while in state READY due to: connection closed
08:06:59.285 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.29.158.188:39061(127.29.158.188:39061)] handling channelInactive
08:06:59.285 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state READY due to: connection closed
08:06:59.291 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:06:59.292 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:06:59.292 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-2
08:06:59.293 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-4
08:06:59.293 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-1
08:06:59.312 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:59.312 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:59.312 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:59.313 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:59.314 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:59.314 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:59.314 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:59.314 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:59.314 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:59.314 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:59.313 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:59.315 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:59.315 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:59.341 [DEBUG - kudu-nio-3] (Connection.java:239) [peer d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)] handling channelInactive
08:06:59.341 [DEBUG - kudu-nio-3] (Connection.java:709) [peer d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)] cleaning up while in state READY due to: connection closed
08:06:59.342 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
08:06:59.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:59.345014 30330 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 30639
08:06:59.397 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:06:59.398 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:06:59.398 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:06:59.398 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:59.399 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:59.399 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:06:59.399 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:59.399 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:59.399 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:06:59.399 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:59.400 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:59.400 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:06:59.400 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:06:59.457 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:59.493 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:06:59.494 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:06:59.494 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:06:59.495 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:59.495 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:59.495 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:06:59.495 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:59.496 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:59.496 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:06:59.496 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:59.496 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:59.496 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:06:59.496 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:06:59.520 [DEBUG - kudu-nio-3] (Connection.java:239) [peer d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)] handling channelInactive
08:06:59.520 [DEBUG - kudu-nio-3] (Connection.java:709) [peer d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)] cleaning up while in state READY due to: connection closed
08:06:59.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:59.526773 30881 connection.cc:582] client connection to 127.29.158.129:45149 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:06:59.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:59.527623 30881 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:06:59.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:06:59.534327 30361 connection.cc:582] server connection from 127.29.158.129:38601 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:06:59.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:59.542375 30330 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 30857
08:06:59.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091619618 for job a72e6b48022ef36361b5eef11ee7c683.
08:06:59.631 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
08:06:59.632 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
08:06:59.663 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:59.757 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:06:59.792 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)] handling channelInactive
08:06:59.793 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)] cleaning up while in state READY due to: connection closed
08:06:59.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:59.818060 30330 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 31003
08:06:59.887 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:06:59.887 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:06:59.887 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:06:59.888 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:59.888 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:59.889 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:06:59.889 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:59.889 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:59.890 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:06:59.890 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:59.890 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:59.890 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:06:59.891 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:06:59.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:06:59.937278 30330 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 30342
08:06:59.956 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:00.015 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:00.018 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:00.018 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:00.018 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:00.018 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:00.018 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:00.018 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:00.018 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:00.018 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:00.019 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:00.019 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:00.019 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:00.019 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:00.036 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.29.158.190:38071(127.29.158.190:38071)] handling channelInactive
08:07:00.036 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.29.158.190:38071(127.29.158.190:38071)] handling channelInactive
08:07:00.036 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state READY due to: connection closed
08:07:00.036 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state READY due to: connection closed
08:07:00.036 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.29.158.190:38071(127.29.158.190:38071)] handling channelInactive
08:07:00.037 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.29.158.190:38071(127.29.158.190:38071)] handling channelInactive
08:07:00.037 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state READY due to: connection closed
08:07:00.037 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state READY due to: connection closed
08:07:00.038 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:00.038 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:00.038 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:00.039 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:00.039 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:00.039 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:00.042 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:00.042 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:00.042 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:00.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:00.041898 30330 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 30413
08:07:00.043 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:00.043 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:00.043 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:00.044 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:00.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091620118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:00.126 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:00.127 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:00.127 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:00.132 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:00.132 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:00.132 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:00.132 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:00.133 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:00.133 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:00.133 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:00.133 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:00.133 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:00.133 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:00.150 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=31 ms, finalizationTime=1 ms).
08:07:00.155 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
08:07:00.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:00.157469 30524 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.158.190:38071: connect: Connection refused (error 111)
08:07:00.162 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:00.172 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.29.158.189:41727(127.29.158.189:41727)] handling channelInactive
08:07:00.172 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.29.158.189:41727(127.29.158.189:41727)] handling channelInactive
08:07:00.172 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.29.158.189:41727(127.29.158.189:41727)] handling channelInactive
08:07:00.172 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state READY due to: connection closed
08:07:00.172 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state READY due to: connection closed
08:07:00.172 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state READY due to: connection closed
08:07:00.173 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.29.158.189:41727(127.29.158.189:41727)] handling channelInactive
08:07:00.173 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state READY due to: connection closed
08:07:00.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:00.177296 30330 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 30494
08:07:00.183 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:00.183 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:00.183 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:00.185 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:00.185 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:00.185 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:00.185 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:00.185 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:00.186 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:00.186 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:00.186 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:00.186 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:00.186 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:00.236 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:00.237 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:00.237 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:00.238 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:00.238 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:00.238 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:00.239 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:00.239 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:00.239 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:00.239 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:00.239 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:00.239 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:00.239 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:00.257 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:00.294 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8c252bac8ed749d288b155a27fae1849
08:07:00.303 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 7c05024562a74973892ab2f3098ce916 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
08:07:00.304 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b06031ec130d4dad9efb2794fadd2b04 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
08:07:00.304 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f0136ad45f0f476b999986635f720b8f for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
08:07:00.304 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 1346ae47881b4c43b5c995d59d2a39a2 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
08:07:00.304 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f0135c5dce09400d8d90b12906c890c0 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
08:07:00.304 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f4428ebcade5440ebc2d4803102193ed for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
08:07:00.304 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=7c05024562a74973892ab2f3098ce916@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=b06031ec130d4dad9efb2794fadd2b04@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=f0136ad45f0f476b999986635f720b8f@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=1346ae47881b4c43b5c995d59d2a39a2@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=f0135c5dce09400d8d90b12906c890c0@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711)[L],e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=f4428ebcade5440ebc2d4803102193ed@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
08:07:00.309 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='3690d27edf04f9b2e704c5345dd8cd289847576c3925715693d2b4de716a05ab'}]
08:07:00.312 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:00.312 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
08:07:00.313 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299997, tablet=7c05024562a74973892ab2f3098ce916@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}]
08:07:00.314 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='dc1729cb2550547e0826df5d16d770f3f2c26dc05df2d18a974c3acf92ecda00'}]
08:07:00.315 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:00.316 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='79abab4e1fb569ef6ef23fc4e6d5fe1c8e4474e1499d5d36fbc834d013c52179'}]
08:07:00.318 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='2d47d975d7b85bc7809ed677ced6ccd6a500ffca3548ba0e0928eeb639cea19d'}]
08:07:00.319 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
08:07:00.319 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299997, tablet=b06031ec130d4dad9efb2794fadd2b04@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)[L]]}]
08:07:00.321 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:00.321 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
08:07:00.322 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299997, tablet=f0136ad45f0f476b999986635f720b8f@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711)[L],e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}]
08:07:00.323 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:00.323 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
08:07:00.324 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299997, tablet=1346ae47881b4c43b5c995d59d2a39a2@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)[L]]}]
08:07:00.324 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] connecting to peer
08:07:00.328 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.29.158.188:39061(127.29.158.188:39061)] handling channelInactive
08:07:00.329 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state READY due to: connection closed
08:07:00.330 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] connecting to peer
08:07:00.331 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.29.158.188:39061(127.29.158.188:39061)] handling channelInactive
08:07:00.331 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state READY due to: connection closed
08:07:00.332 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.29.158.188:39061(127.29.158.188:39061)] handling channelInactive
08:07:00.332 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state READY due to: connection closed
08:07:00.332 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.29.158.188:39061(127.29.158.188:39061)] handling channelInactive
08:07:00.333 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state READY due to: connection closed
08:07:00.350 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] connecting to peer
08:07:00.360 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] connecting to peer
08:07:00.361 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] Successfully connected to peer
08:07:00.368 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] Successfully connected to peer
08:07:00.385 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.194
08:07:00.398 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:00.399 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] Successfully connected to peer
08:07:00.401 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xce8c7a84, L:/127.0.0.1:42718 - R:/127.28.220.194:39597] using SASL/PLAIN
08:07:00.423 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.194
08:07:00.424 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.194
08:07:00.434 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] Successfully connected to peer
08:07:00.456 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:00.456 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:00.462 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x1150bc52, L:/127.0.0.1:42722 - R:/127.28.220.194:39597] using SASL/PLAIN
08:07:00.463 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:00.470 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.194
08:07:00.490 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:00.491 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:00.491 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:00.491 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:00.491 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:00.491 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:00.491 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:00.491 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:00.492 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:00.492 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:00.492 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:00.491 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:00.492 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:00.495 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa6fc0a31, L:/127.0.0.1:42736 - R:/127.28.220.194:39597] using SASL/PLAIN
08:07:00.498 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:00.506 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x33e7775e, L:/127.0.0.1:42738 - R:/127.28.220.194:39597] using SASL/PLAIN
08:07:00.521 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159276699648001) for scanner KuduScanner(table=replication_test_table, tablet=1346ae47881b4c43b5c995d59d2a39a2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:00.521 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [2d47d975d7b85bc7809ed677ced6ccd6a500ffca3548ba0e0928eeb639cea19d]
08:07:00.522 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [2d47d975d7b85bc7809ed677ced6ccd6a500ffca3548ba0e0928eeb639cea19d]
08:07:00.522 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
08:07:00.522 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
08:07:00.524 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 2d47d975d7b85bc7809ed677ced6ccd6a500ffca3548ba0e0928eeb639cea19d finished by subtask 2; deferring removal (restored in pending)
08:07:00.525 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] disconnecting while in state READY
08:07:00.525 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='98669fc989e662815704f9ecd394545055f13469e6adc519ca975ddabbd36171'}]
08:07:00.529 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:00.530 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
08:07:00.531 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299997, tablet=f0135c5dce09400d8d90b12906c890c0@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}]
08:07:00.532 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159276699648001) for scanner KuduScanner(table=replication_test_table, tablet=b06031ec130d4dad9efb2794fadd2b04, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:00.533 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [dc1729cb2550547e0826df5d16d770f3f2c26dc05df2d18a974c3acf92ecda00]
08:07:00.533 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [dc1729cb2550547e0826df5d16d770f3f2c26dc05df2d18a974c3acf92ecda00]
08:07:00.533 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
08:07:00.533 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
08:07:00.534 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split dc1729cb2550547e0826df5d16d770f3f2c26dc05df2d18a974c3acf92ecda00 finished by subtask 0; deferring removal (restored in pending)
08:07:00.535 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] disconnecting while in state READY
08:07:00.535 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] connecting to peer
08:07:00.535 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='3c7ad98cc154e87378668fbd1afd60e0a10815138683134cbb9d6cc84489535f'}]
08:07:00.537 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:00.539 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:00.539 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:00.546 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] Successfully connected to peer
08:07:00.549 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.194
08:07:00.560 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:00.560 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
08:07:00.562 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299997, tablet=f4428ebcade5440ebc2d4803102193ed@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711)[L],e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}]
08:07:00.564 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x337ad000, L:/127.0.0.1:42748 - R:/127.28.220.194:39597] using SASL/PLAIN
08:07:00.570 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
08:07:00.570 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] handling channelInactive
08:07:00.570 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] cleaning up while in state READY due to: connection closed
08:07:00.571 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:07:00.603 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] handling channelInactive
08:07:00.603 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] cleaning up while in state READY due to: connection closed
08:07:00.603 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:07:00.603 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
08:07:00.609 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159276699648001) for scanner KuduScanner(table=replication_test_table, tablet=7c05024562a74973892ab2f3098ce916, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:00.610 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [3690d27edf04f9b2e704c5345dd8cd289847576c3925715693d2b4de716a05ab]
08:07:00.612 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [3690d27edf04f9b2e704c5345dd8cd289847576c3925715693d2b4de716a05ab]
08:07:00.613 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
08:07:00.613 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
08:07:00.614 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] disconnecting while in state READY
08:07:00.614 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 3690d27edf04f9b2e704c5345dd8cd289847576c3925715693d2b4de716a05ab finished by subtask 3; deferring removal (restored in pending)
08:07:00.616 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:00.616 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:00.616 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:00.616 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:00.617 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:00.617 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:00.617 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:00.617 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:00.617 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:00.617 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:00.617 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:00.617 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:00.617 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:00.617 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:00.618 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091620617 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:00.630 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job a72e6b48022ef36361b5eef11ee7c683 (5024 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
08:07:00.632 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
08:07:00.632 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 7 complete: removed split dc1729cb2550547e0826df5d16d770f3f2c26dc05df2d18a974c3acf92ecda00 from pending
08:07:00.632 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 7 complete: removed split 2d47d975d7b85bc7809ed677ced6ccd6a500ffca3548ba0e0928eeb639cea19d from pending
08:07:00.632 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 7 complete: removed split 3690d27edf04f9b2e704c5345dd8cd289847576c3925715693d2b4de716a05ab from pending
08:07:00.632 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 7 complete: removed 3 finished splits from enumerator state
08:07:00.662 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:00.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:00.661681 30208 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.220.194:39597, user_credentials={real_user=slave}} blocked reactor thread for 64481.2us
08:07:00.671 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159276699648001) for scanner KuduScanner(table=replication_test_table, tablet=f0136ad45f0f476b999986635f720b8f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:00.672 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [79abab4e1fb569ef6ef23fc4e6d5fe1c8e4474e1499d5d36fbc834d013c52179]
08:07:00.672 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [79abab4e1fb569ef6ef23fc4e6d5fe1c8e4474e1499d5d36fbc834d013c52179]
08:07:00.673 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
08:07:00.673 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
08:07:00.673 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] disconnecting while in state READY
08:07:00.674 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 79abab4e1fb569ef6ef23fc4e6d5fe1c8e4474e1499d5d36fbc834d013c52179 finished by subtask 1; deferring removal (restored in pending)
08:07:00.677 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:00.691 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] connecting to peer
08:07:00.742 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] handling channelInactive
08:07:00.742 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] cleaning up while in state READY due to: connection closed
08:07:00.743 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
08:07:00.743 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
08:07:00.757 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:00.760 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] Successfully connected to peer
08:07:00.770 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.194
08:07:00.809 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] handling channelInactive
08:07:00.809 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] cleaning up while in state READY due to: connection closed
08:07:00.810 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:07:00.810 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
08:07:00.825 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:00.848 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159276699648001) for scanner KuduScanner(table=replication_test_table, tablet=f0135c5dce09400d8d90b12906c890c0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:00.849 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [98669fc989e662815704f9ecd394545055f13469e6adc519ca975ddabbd36171]
08:07:00.849 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [98669fc989e662815704f9ecd394545055f13469e6adc519ca975ddabbd36171]
08:07:00.850 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
08:07:00.850 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
08:07:00.851 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 98669fc989e662815704f9ecd394545055f13469e6adc519ca975ddabbd36171 finished by subtask 2; deferring removal (restored in pending)
08:07:00.852 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] disconnecting while in state READY
08:07:00.853 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:00.855 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xda3407cd, L:/127.0.0.1:42754 - R:/127.28.220.194:39597] using SASL/PLAIN
08:07:00.878 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159276699648001) for scanner KuduScanner(table=replication_test_table, tablet=f4428ebcade5440ebc2d4803102193ed, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:00.878 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [3c7ad98cc154e87378668fbd1afd60e0a10815138683134cbb9d6cc84489535f]
08:07:00.879 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [3c7ad98cc154e87378668fbd1afd60e0a10815138683134cbb9d6cc84489535f]
08:07:00.879 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
08:07:00.879 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
08:07:00.880 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 3c7ad98cc154e87378668fbd1afd60e0a10815138683134cbb9d6cc84489535f finished by subtask 0; deferring removal (restored in pending)
08:07:00.881 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] disconnecting while in state READY
08:07:00.888 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] handling channelInactive
08:07:00.888 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] cleaning up while in state READY due to: connection closed
08:07:00.889 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:07:00.889 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:00.889 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
08:07:00.916 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
08:07:00.916 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] handling channelInactive
08:07:00.916 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] cleaning up while in state READY due to: connection closed
08:07:00.917 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:07:00.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:00.972 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:00.973 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:00.973 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:00.974 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:00.974 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:00.974 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:00.975 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:00.975 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:00.975 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:00.975 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:00.976 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:00.976 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:00.976 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:01.089 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:01.089 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:01.089 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:01.090 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:01.090 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:01.090 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:01.091 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:01.091 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:01.091 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:01.091 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:01.092 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:01.092 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:01.092 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:01.118 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091621118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:01.131 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job a72e6b48022ef36361b5eef11ee7c683 (2994 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
08:07:01.134 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
08:07:01.134 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 3c7ad98cc154e87378668fbd1afd60e0a10815138683134cbb9d6cc84489535f from pending
08:07:01.134 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 98669fc989e662815704f9ecd394545055f13469e6adc519ca975ddabbd36171 from pending
08:07:01.135 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 79abab4e1fb569ef6ef23fc4e6d5fe1c8e4474e1499d5d36fbc834d013c52179 from pending
08:07:01.135 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 8 complete: removed 3 finished splits from enumerator state
08:07:01.163 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:01.258 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:01.387 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:01.387 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:01.387 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:01.388 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:01.388 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:01.388 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:01.389 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:01.389 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:01.389 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:01.389 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:01.390 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:01.390 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:01.390 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:01.457 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:01.620 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091621619 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:01.632 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
08:07:01.635 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
08:07:01.664 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:01.686 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:01.687 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:01.687 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:01.688 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:01.688 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:01.688 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:01.688 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:01.688 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:01.688 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:01.689 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:01.689 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:01.689 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:01.689 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:01.758 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:01.766 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:01.767 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:01.767 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:01.768 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:01.768 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:01.768 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:01.768 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:01.768 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:01.768 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:01.769 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:01.769 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:01.769 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:01.769 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:01.849 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:01.849 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:01.850 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:01.850 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:01.851 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:01.851 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:01.851 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:01.852 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:01.852 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:01.852 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:01.852 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:01.852 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:01.852 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:01.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:02.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091622118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:02.131 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
08:07:02.133 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
08:07:02.157 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:02.158 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:02.158 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:02.159 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:02.159 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:02.159 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:02.160 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:02.160 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:02.160 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:02.160 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:02.160 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:02.160 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:02.160 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:02.162 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:02.258 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:02.294 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8c252bac8ed749d288b155a27fae1849
08:07:02.300 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:02.300 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:02.300 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:02.301 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:02.301 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:02.301 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:02.302 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:02.302 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:02.302 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:02.303 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:02.303 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:02.303 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:02.303 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:02.305 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 7c05024562a74973892ab2f3098ce916 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
08:07:02.305 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b06031ec130d4dad9efb2794fadd2b04 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
08:07:02.305 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f0136ad45f0f476b999986635f720b8f for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
08:07:02.305 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 1346ae47881b4c43b5c995d59d2a39a2 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
08:07:02.305 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f0135c5dce09400d8d90b12906c890c0 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
08:07:02.305 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f4428ebcade5440ebc2d4803102193ed for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
08:07:02.305 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=7c05024562a74973892ab2f3098ce916@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=b06031ec130d4dad9efb2794fadd2b04@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=f0136ad45f0f476b999986635f720b8f@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=1346ae47881b4c43b5c995d59d2a39a2@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=f0135c5dce09400d8d90b12906c890c0@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711)[L],e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=f4428ebcade5440ebc2d4803102193ed@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
08:07:02.317 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='34c07169650038d11b8fa4a3c3f02bebaf975981ce3c83070add7c3ef905dea8'}]
08:07:02.317 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='9ed645483fe2ec9ddfa3637d2f492783885f256352225b76e2288a5a2d97f301'}]
08:07:02.319 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:02.320 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='83793fa68bac52a14dec58268522e039355e58e06bde1be166580296c1df16ea'}]
08:07:02.322 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='9f4941ad600aee116369c48e203025110309bd4a2a63f856f84396effcc09ad7'}]
08:07:02.323 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:02.323 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
08:07:02.324 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299997, tablet=f0136ad45f0f476b999986635f720b8f@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711)[L],e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}]
08:07:02.323 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
08:07:02.325 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299997, tablet=7c05024562a74973892ab2f3098ce916@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}]
08:07:02.326 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:02.327 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
08:07:02.327 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:02.327 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299997, tablet=b06031ec130d4dad9efb2794fadd2b04@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)[L]]}]
08:07:02.327 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
08:07:02.328 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299990, tablet=1346ae47881b4c43b5c995d59d2a39a2@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)[L]]}]
08:07:02.370 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] connecting to peer
08:07:02.389 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] connecting to peer
08:07:02.398 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] connecting to peer
08:07:02.411 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] connecting to peer
08:07:02.426 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] Successfully connected to peer
08:07:02.426 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] Successfully connected to peer
08:07:02.437 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] Successfully connected to peer
08:07:02.447 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] Successfully connected to peer
08:07:02.457 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:02.467 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.194
08:07:02.472 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.194
08:07:02.474 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.194
08:07:02.486 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:02.486 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:02.487 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:02.487 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:02.487 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:02.487 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:02.488 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:02.488 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:02.488 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:02.488 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:02.488 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:02.488 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:02.489 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:02.521 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:02.523 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.194
08:07:02.530 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:02.530 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:02.536 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xcc36a753, L:/127.0.0.1:42790 - R:/127.28.220.194:39597] using SASL/PLAIN
08:07:02.537 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x253c8844, L:/127.0.0.1:42774 - R:/127.28.220.194:39597] using SASL/PLAIN
08:07:02.538 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x135de097, L:/127.0.0.1:42760 - R:/127.28.220.194:39597] using SASL/PLAIN
08:07:02.571 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:02.579 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159284891648001) for scanner KuduScanner(table=replication_test_table, tablet=b06031ec130d4dad9efb2794fadd2b04, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:02.579 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [83793fa68bac52a14dec58268522e039355e58e06bde1be166580296c1df16ea]
08:07:02.580 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [83793fa68bac52a14dec58268522e039355e58e06bde1be166580296c1df16ea]
08:07:02.580 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
08:07:02.580 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
08:07:02.582 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 83793fa68bac52a14dec58268522e039355e58e06bde1be166580296c1df16ea finished by subtask 1; deferring removal (restored in pending)
08:07:02.582 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] disconnecting while in state READY
08:07:02.583 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='e9cceeba58dd3a25d3828b661899223d069e98999a49b30e6c6d204ebdcae214'}]
08:07:02.583 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:02.586 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:02.586 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
08:07:02.587 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299990, tablet=f0135c5dce09400d8d90b12906c890c0@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}]
08:07:02.587 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc547b579, L:/127.0.0.1:42762 - R:/127.28.220.194:39597] using SASL/PLAIN
08:07:02.619 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159284891648001) for scanner KuduScanner(table=replication_test_table, tablet=7c05024562a74973892ab2f3098ce916, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:02.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091622618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:02.619 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [34c07169650038d11b8fa4a3c3f02bebaf975981ce3c83070add7c3ef905dea8]
08:07:02.619 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [34c07169650038d11b8fa4a3c3f02bebaf975981ce3c83070add7c3ef905dea8]
08:07:02.620 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
08:07:02.620 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
08:07:02.621 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 34c07169650038d11b8fa4a3c3f02bebaf975981ce3c83070add7c3ef905dea8 finished by subtask 3; deferring removal (restored in pending)
08:07:02.622 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] disconnecting while in state READY
08:07:02.624 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159284891648001) for scanner KuduScanner(table=replication_test_table, tablet=1346ae47881b4c43b5c995d59d2a39a2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:02.625 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [9ed645483fe2ec9ddfa3637d2f492783885f256352225b76e2288a5a2d97f301]
08:07:02.625 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [9ed645483fe2ec9ddfa3637d2f492783885f256352225b76e2288a5a2d97f301]
08:07:02.625 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
08:07:02.625 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
08:07:02.626 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] disconnecting while in state READY
08:07:02.626 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='c578c0c5108def176c143c04dcc49bb1e1395fab122d11abf3a0fe6cc2317d6f'}]
08:07:02.626 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:02.627 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 9ed645483fe2ec9ddfa3637d2f492783885f256352225b76e2288a5a2d97f301 finished by subtask 0; deferring removal (restored in pending)
08:07:02.629 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:02.630 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:02.631 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] connecting to peer
08:07:02.655 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159284891648001) for scanner KuduScanner(table=replication_test_table, tablet=f0136ad45f0f476b999986635f720b8f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:02.656 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [9f4941ad600aee116369c48e203025110309bd4a2a63f856f84396effcc09ad7]
08:07:02.656 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [9f4941ad600aee116369c48e203025110309bd4a2a63f856f84396effcc09ad7]
08:07:02.657 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
08:07:02.657 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
08:07:02.658 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 9f4941ad600aee116369c48e203025110309bd4a2a63f856f84396effcc09ad7 finished by subtask 2; deferring removal (restored in pending)
08:07:02.658 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] disconnecting while in state READY
08:07:02.659 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:02.660 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] handling channelInactive
08:07:02.660 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] cleaning up while in state READY due to: connection closed
08:07:02.660 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:07:02.660 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
08:07:02.664 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:02.701 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
08:07:02.703 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job a72e6b48022ef36361b5eef11ee7c683 (5024 bytes, checkpointDuration=84 ms, finalizationTime=1 ms).
08:07:02.709 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
08:07:02.709 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 11 complete: removed split 83793fa68bac52a14dec58268522e039355e58e06bde1be166580296c1df16ea from pending
08:07:02.710 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 11 complete: removed split 34c07169650038d11b8fa4a3c3f02bebaf975981ce3c83070add7c3ef905dea8 from pending
08:07:02.710 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 11 complete: removed split 9ed645483fe2ec9ddfa3637d2f492783885f256352225b76e2288a5a2d97f301 from pending
08:07:02.710 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 11 complete: removed split 9f4941ad600aee116369c48e203025110309bd4a2a63f856f84396effcc09ad7 from pending
08:07:02.710 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 11 complete: removed 4 finished splits from enumerator state
08:07:02.719 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299990, tablet=f4428ebcade5440ebc2d4803102193ed@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711)[L],e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}]
08:07:02.738 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] handling channelInactive
08:07:02.738 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] cleaning up while in state READY due to: connection closed
08:07:02.739 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:07:02.739 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
08:07:02.759 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:02.761 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] handling channelInactive
08:07:02.761 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] cleaning up while in state READY due to: connection closed
08:07:02.761 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
08:07:02.762 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
08:07:02.773 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] handling channelInactive
08:07:02.773 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] cleaning up while in state READY due to: connection closed
08:07:02.774 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:07:02.774 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
08:07:02.780 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] Successfully connected to peer
08:07:02.785 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.194
08:07:02.788 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] connecting to peer
08:07:02.797 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] Successfully connected to peer
08:07:02.801 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.194
08:07:02.820 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:02.827 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:02.837 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x63cd49b1, L:/127.0.0.1:42806 - R:/127.28.220.194:39597] using SASL/PLAIN
08:07:02.854 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159284891648001) for scanner KuduScanner(table=replication_test_table, tablet=f4428ebcade5440ebc2d4803102193ed, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:02.855 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [c578c0c5108def176c143c04dcc49bb1e1395fab122d11abf3a0fe6cc2317d6f]
08:07:02.855 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [c578c0c5108def176c143c04dcc49bb1e1395fab122d11abf3a0fe6cc2317d6f]
08:07:02.856 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
08:07:02.856 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
08:07:02.858 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split c578c0c5108def176c143c04dcc49bb1e1395fab122d11abf3a0fe6cc2317d6f finished by subtask 3; deferring removal (restored in pending)
08:07:02.858 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] disconnecting while in state READY
08:07:02.859 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:02.896 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe49307f3, L:/127.0.0.1:42800 - R:/127.28.220.194:39597] using SASL/PLAIN
08:07:02.945 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] handling channelInactive
08:07:02.945 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] cleaning up while in state READY due to: connection closed
08:07:02.946 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:07:02.946 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
08:07:02.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:02.963 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:02.964 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:02.964 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:02.965 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:02.965 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:02.966 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:02.966 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:02.966 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:02.966 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:02.967 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:02.967 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:02.968 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:02.968 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:02.979 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159284891648001) for scanner KuduScanner(table=replication_test_table, tablet=f0135c5dce09400d8d90b12906c890c0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:02.979 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [e9cceeba58dd3a25d3828b661899223d069e98999a49b30e6c6d204ebdcae214]
08:07:02.979 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [e9cceeba58dd3a25d3828b661899223d069e98999a49b30e6c6d204ebdcae214]
08:07:02.980 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
08:07:02.980 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
08:07:02.980 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] disconnecting while in state READY
08:07:02.981 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:02.981 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split e9cceeba58dd3a25d3828b661899223d069e98999a49b30e6c6d204ebdcae214 finished by subtask 1; deferring removal (restored in pending)
08:07:02.991 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:02.992 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:02.992 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:02.992 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:02.992 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:02.992 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:02.992 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:02.992 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:02.993 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:02.993 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:02.993 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:02.993 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:02.993 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:03.003 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:03.003 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:03.003 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:03.004 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:03.004 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:03.004 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:03.004 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:03.005 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:03.005 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:03.005 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:03.005 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:03.005 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:03.006 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:03.017 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
08:07:03.017 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] handling channelInactive
08:07:03.017 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] cleaning up while in state READY due to: connection closed
08:07:03.018 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:07:03.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091623118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:03.129 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job a72e6b48022ef36361b5eef11ee7c683 (2320 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
08:07:03.132 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
08:07:03.132 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split e9cceeba58dd3a25d3828b661899223d069e98999a49b30e6c6d204ebdcae214 from pending
08:07:03.132 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split c578c0c5108def176c143c04dcc49bb1e1395fab122d11abf3a0fe6cc2317d6f from pending
08:07:03.132 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 12 complete: removed 2 finished splits from enumerator state
08:07:03.163 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:03.257 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:03.406 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:03.407 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:03.407 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:03.407 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:03.408 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:03.408 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:03.408 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:03.408 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:03.408 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:03.409 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:03.409 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:03.409 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:03.409 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:03.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:07:03Z chronyd exiting
08:07:03.514 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:03.596 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:03.596 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:03.596 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:03.597 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:03.597 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:03.597 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:03.597 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:03.598 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:03.598 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:03.598 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:03.597 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:03.598 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:03.598 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:03.621 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091623618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:03.637 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=19 ms, finalizationTime=0 ms).
08:07:03.640 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
08:07:03.662 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:03.845 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:03.845 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:03.846 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:03.846 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:03.847 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:03.847 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:03.847 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:03.849 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:03.849 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:03.849 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:03.849 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:03.849 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:03.849 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:03.850 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:03.956 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:04.056 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:04.057 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:04.057 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:04.058 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:04.058 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:04.058 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:04.058 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:04.058 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:04.058 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:04.059 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:04.059 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:04.059 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:04.059 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:04.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091624118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:04.135 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
08:07:04.137 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
08:07:04.162 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:04.258 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:04.294 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8c252bac8ed749d288b155a27fae1849
08:07:04.303 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 7c05024562a74973892ab2f3098ce916 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
08:07:04.304 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b06031ec130d4dad9efb2794fadd2b04 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
08:07:04.304 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f0136ad45f0f476b999986635f720b8f for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
08:07:04.304 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 1346ae47881b4c43b5c995d59d2a39a2 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
08:07:04.304 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f0135c5dce09400d8d90b12906c890c0 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
08:07:04.304 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f4428ebcade5440ebc2d4803102193ed for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
08:07:04.305 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=7c05024562a74973892ab2f3098ce916@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=b06031ec130d4dad9efb2794fadd2b04@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=f0136ad45f0f476b999986635f720b8f@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299998, tablet=1346ae47881b4c43b5c995d59d2a39a2@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299998, tablet=f0135c5dce09400d8d90b12906c890c0@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711)[L],e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299998, tablet=f4428ebcade5440ebc2d4803102193ed@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299998}]
08:07:04.311 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='26b16f410f59e602fcde95a64268ff43f76c5f48d530431ae5b84f4305cee4c6'}]
08:07:04.314 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='9c688e06373f45b928ae0920295dcb696c7a827949ff053e17a7c24a155d99db'}]
08:07:04.315 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='55dd617b3a94402ce5e384b0a8714e783dca1c7e824b2a0e9fa7bf2cd35552d2'}]
08:07:04.317 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='6312ed52664f7b9a93882808c5e191d871747d8a151521ccb65353bfdca39402'}]
08:07:04.323 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:04.323 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
08:07:04.324 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299996, tablet=7c05024562a74973892ab2f3098ce916@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}]
08:07:04.326 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:04.326 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 5
08:07:04.327 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299996, tablet=1346ae47881b4c43b5c995d59d2a39a2@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)[L]]}]
08:07:04.331 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:04.331 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
08:07:04.332 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:04.332 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299996, tablet=f0136ad45f0f476b999986635f720b8f@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711)[L],e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}]
08:07:04.333 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 5
08:07:04.333 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299996, tablet=b06031ec130d4dad9efb2794fadd2b04@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)[L]]}]
08:07:04.345 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] connecting to peer
08:07:04.346 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] connecting to peer
08:07:04.347 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] connecting to peer
08:07:04.356 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] connecting to peer
08:07:04.389 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] Successfully connected to peer
08:07:04.391 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] Successfully connected to peer
08:07:04.397 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] Successfully connected to peer
08:07:04.403 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.194
08:07:04.408 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] Successfully connected to peer
08:07:04.418 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.194
08:07:04.423 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:04.425 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.194
08:07:04.427 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:04.431 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.194
08:07:04.431 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x3fb9cca0, L:/127.0.0.1:42832 - R:/127.28.220.194:39597] using SASL/PLAIN
08:07:04.440 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:04.441 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x44ef0744, L:/127.0.0.1:42816 - R:/127.28.220.194:39597] using SASL/PLAIN
08:07:04.443 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159293083648001) for scanner KuduScanner(table=replication_test_table, tablet=1346ae47881b4c43b5c995d59d2a39a2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:04.443 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:04.443 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:04.444 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:04.444 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [6312ed52664f7b9a93882808c5e191d871747d8a151521ccb65353bfdca39402]
08:07:04.444 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [6312ed52664f7b9a93882808c5e191d871747d8a151521ccb65353bfdca39402]
08:07:04.444 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:04.445 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:04.445 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:04.445 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 5 because it is idle.
08:07:04.445 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 5
08:07:04.445 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:04.445 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:04.445 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:04.446 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:04.446 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:04.446 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:04.446 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:04.447 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 6312ed52664f7b9a93882808c5e191d871747d8a151521ccb65353bfdca39402 finished by subtask 1; deferring removal (restored in pending)
08:07:04.447 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] disconnecting while in state READY
08:07:04.447 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:04.450 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x3289b18b, L:/127.0.0.1:42838 - R:/127.28.220.194:39597] using SASL/PLAIN
08:07:04.450 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='8b303d1487de0a2bfbca7433de08bad9a982526b9b4c5f2a7d3bf411110939b6'}]
08:07:04.453 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:04.453 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 6
08:07:04.454 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299996, tablet=f0135c5dce09400d8d90b12906c890c0@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)[L],9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711),e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}]
08:07:04.455 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] handling channelInactive
08:07:04.456 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] cleaning up while in state READY due to: connection closed
08:07:04.456 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
08:07:04.456 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 5 exited.
08:07:04.456 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:04.458 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] connecting to peer
08:07:04.462 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] Successfully connected to peer
08:07:04.465 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.194
08:07:04.469 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:04.476 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:04.479 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x9efaaf78, L:/127.0.0.1:42848 - R:/127.28.220.194:39597] using SASL/PLAIN
08:07:04.480 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xafe66064, L:/127.0.0.1:42862 - R:/127.28.220.194:39597] using SASL/PLAIN
08:07:04.496 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159293083648001) for scanner KuduScanner(table=replication_test_table, tablet=b06031ec130d4dad9efb2794fadd2b04, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:04.496 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159293083648001) for scanner KuduScanner(table=replication_test_table, tablet=f0135c5dce09400d8d90b12906c890c0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:04.497 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [8b303d1487de0a2bfbca7433de08bad9a982526b9b4c5f2a7d3bf411110939b6]
08:07:04.497 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [8b303d1487de0a2bfbca7433de08bad9a982526b9b4c5f2a7d3bf411110939b6]
08:07:04.498 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 6 because it is idle.
08:07:04.498 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 6
08:07:04.499 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [9c688e06373f45b928ae0920295dcb696c7a827949ff053e17a7c24a155d99db]
08:07:04.499 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [9c688e06373f45b928ae0920295dcb696c7a827949ff053e17a7c24a155d99db]
08:07:04.499 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 5 because it is idle.
08:07:04.499 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 5
08:07:04.500 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] disconnecting while in state READY
08:07:04.500 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 8b303d1487de0a2bfbca7433de08bad9a982526b9b4c5f2a7d3bf411110939b6 finished by subtask 1; deferring removal (restored in pending)
08:07:04.500 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 9c688e06373f45b928ae0920295dcb696c7a827949ff053e17a7c24a155d99db finished by subtask 2; deferring removal (restored in pending)
08:07:04.500 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] disconnecting while in state READY
08:07:04.501 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='d28a7cf6dead0ab0699d3bde4d540fdf348e5d76381a4163a4e67192f8d1d8f2'}]
08:07:04.502 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:04.502 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:04.503 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:04.503 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 7
08:07:04.504 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299996, tablet=f4428ebcade5440ebc2d4803102193ed@[4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615),9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711)[L],e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)]}]
08:07:04.507 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] connecting to peer
08:07:04.527 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] handling channelInactive
08:07:04.527 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] cleaning up while in state READY due to: connection closed
08:07:04.528 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:07:04.528 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 6 exited.
08:07:04.538 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] Successfully connected to peer
08:07:04.545 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.220.194
08:07:04.550 [ERROR - main] (RetryRule.java:206) org.apache.kudu.replication.TestReplicationTableInitializer.testHashAndRangePartitioning: failed attempt 1
org.apache.kudu.shaded.org.apache.commons.logging.LogConfigurationException: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl (Caused by java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1158)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory$2.run(LogFactory.java:960)
	at java.base/java.security.AccessController.doPrivileged(AccessController.java:318)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.newFactory(LogFactory.java:957)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getFactory(LogFactory.java:624)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getLog(LogFactory.java:655)
	at org.apache.kudu.shaded.org.apache.http.conn.ssl.DefaultHostnameVerifier.<init>(DefaultHostnameVerifier.java:82)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClientBuilder.build(HttpClientBuilder.java:970)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClients.createDefault(HttpClients.java:56)
	at org.apache.kudu.test.junit.ResultReporter.reportResult(ResultReporter.java:207)
	at org.apache.kudu.test.junit.ResultReporter.tryReportResult(ResultReporter.java:244)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.report(RetryRule.java:165)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:191)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
Caused by: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1020)
	... 42 more
08:07:04.565 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] handling channelInactive
08:07:04.565 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] cleaning up while in state READY due to: connection closed
08:07:04.565 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:07:04.565 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 5 exited.
08:07:04.578 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:04.592 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:04.592 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:04.592 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:04.593 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:04.593 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:04.593 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:04.594 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:04.594 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:04.594 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:04.595 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:04.595 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:04.595 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:04.595 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:04.608 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc3acfafb, L:/127.0.0.1:42872 - R:/127.28.220.194:39597] using SASL/PLAIN
08:07:04.616 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159293083648001) for scanner KuduScanner(table=replication_test_table, tablet=7c05024562a74973892ab2f3098ce916, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:04.616 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [26b16f410f59e602fcde95a64268ff43f76c5f48d530431ae5b84f4305cee4c6]
08:07:04.618 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [26b16f410f59e602fcde95a64268ff43f76c5f48d530431ae5b84f4305cee4c6]
08:07:04.618 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
08:07:04.618 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
08:07:04.619 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] disconnecting while in state READY
08:07:04.620 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 26b16f410f59e602fcde95a64268ff43f76c5f48d530431ae5b84f4305cee4c6 finished by subtask 0; deferring removal (restored in pending)
08:07:04.621 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:04.621 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091624618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:04.637 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job a72e6b48022ef36361b5eef11ee7c683 (5024 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
08:07:04.638 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
08:07:04.639 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 15 complete: removed split 6312ed52664f7b9a93882808c5e191d871747d8a151521ccb65353bfdca39402 from pending
08:07:04.639 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 15 complete: removed split 9c688e06373f45b928ae0920295dcb696c7a827949ff053e17a7c24a155d99db from pending
08:07:04.639 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 15 complete: removed split 8b303d1487de0a2bfbca7433de08bad9a982526b9b4c5f2a7d3bf411110939b6 from pending
08:07:04.639 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 15 complete: removed split 26b16f410f59e602fcde95a64268ff43f76c5f48d530431ae5b84f4305cee4c6 from pending
08:07:04.639 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 15 complete: removed 4 finished splits from enumerator state
08:07:04.652 [ERROR - main] (RetryRule.java:253) org.apache.kudu.replication.TestReplicationTableInitializer.testHashAndRangePartitioning: giving up after 1 attempts
08:07:04.652 [DEBUG - main] (Connection.java:575) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] disconnecting while in state READY
08:07:04.652 [DEBUG - main] (Connection.java:575) [peer 9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711)] disconnecting while in state READY
08:07:04.652 [DEBUG - main] (Connection.java:575) [peer master-127.28.220.253:45079(127.28.220.253:45079)] disconnecting while in state READY
08:07:04.652 [DEBUG - main] (Connection.java:575) [peer master-127.28.220.254:37365(127.28.220.254:37365)] disconnecting while in state READY
08:07:04.652 [DEBUG - main] (Connection.java:575) [peer master-127.28.220.252:33543(127.28.220.252:33543)] disconnecting while in state READY
08:07:04.652 [DEBUG - main] (Connection.java:575) [peer 4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)] disconnecting while in state READY
08:07:04.653 [DEBUG - kudu-nio-4] (Connection.java:239) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] handling channelInactive
08:07:04.654 [DEBUG - kudu-nio-4] (Connection.java:709) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] cleaning up while in state READY due to: connection closed
08:07:04.654 [DEBUG - kudu-nio-5] (Connection.java:239) [peer 9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711)] handling channelInactive
08:07:04.654 [DEBUG - kudu-nio-5] (Connection.java:709) [peer 9b230140dcab4f58b02a0b1939e65a5d(127.28.220.193:36711)] cleaning up while in state READY due to: connection closed
08:07:04.655 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.28.220.253:45079(127.28.220.253:45079)] handling channelInactive
08:07:04.655 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state READY due to: connection closed
08:07:04.655 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.28.220.254:37365(127.28.220.254:37365)] handling channelInactive
08:07:04.655 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state READY due to: connection closed
08:07:04.656 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.28.220.252:33543(127.28.220.252:33543)] handling channelInactive
08:07:04.656 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state READY due to: connection closed
08:07:04.656 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:04.662 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:04.663 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159293083648001) for scanner KuduScanner(table=replication_test_table, tablet=f0136ad45f0f476b999986635f720b8f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:04.664 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [55dd617b3a94402ce5e384b0a8714e783dca1c7e824b2a0e9fa7bf2cd35552d2]
08:07:04.664 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [55dd617b3a94402ce5e384b0a8714e783dca1c7e824b2a0e9fa7bf2cd35552d2]
08:07:04.665 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
08:07:04.665 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
08:07:04.666 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 55dd617b3a94402ce5e384b0a8714e783dca1c7e824b2a0e9fa7bf2cd35552d2 finished by subtask 3; deferring removal (restored in pending)
08:07:04.666 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] disconnecting while in state READY
08:07:04.667 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
08:07:04.667 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
08:07:04.668 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-2
08:07:04.668 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-5
08:07:04.668 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-4
08:07:04.669 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:04.675 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] handling channelInactive
08:07:04.675 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] cleaning up while in state READY due to: connection closed
08:07:04.676 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:07:04.676 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
08:07:04.677 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)] handling channelInactive
08:07:04.677 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 4430d593fcee4c1fbd17a7aab7897238(127.28.220.195:37615)] cleaning up while in state READY due to: connection closed
08:07:04.678 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
08:07:04.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:04.679281 29555 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 29857
08:07:04.682 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] handling channelInactive
08:07:04.682 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] cleaning up while in state READY due to: connection closed
08:07:04.682 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
08:07:04.682 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
08:07:04.686 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159293083648001) for scanner KuduScanner(table=replication_test_table, tablet=f4428ebcade5440ebc2d4803102193ed, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:04.687 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [d28a7cf6dead0ab0699d3bde4d540fdf348e5d76381a4163a4e67192f8d1d8f2]
08:07:04.687 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [d28a7cf6dead0ab0699d3bde4d540fdf348e5d76381a4163a4e67192f8d1d8f2]
08:07:04.687 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 7 because it is idle.
08:07:04.687 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 7
08:07:04.688 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split d28a7cf6dead0ab0699d3bde4d540fdf348e5d76381a4163a4e67192f8d1d8f2 finished by subtask 1; deferring removal (restored in pending)
08:07:04.690 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] disconnecting while in state READY
08:07:04.692 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:04.708 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] handling channelInactive
08:07:04.708 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e83b8a545bd54af99acd623fd123912f(127.28.220.194:39597)] cleaning up while in state READY due to: connection closed
08:07:04.708 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:07:04.709 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 7 exited.
08:07:04.758 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:04.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:04.769379 29555 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 30025
08:07:04.776 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:04.777 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:04.777 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:04.777 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:04.777 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:04.778 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:04.778 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:04.778 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:04.778 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:04.778 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:04.778 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:04.779 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:04.779 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:04.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:04.853905 29555 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 30190
08:07:04.891 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:04.892 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:04.892 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:04.892 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:04.892 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:04.892 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:04.892 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:04.892 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:04.892 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:04.892 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:04.892 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:04.893 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:04.893 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:04.894 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27471), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [142ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [144ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [159ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [160ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [253ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [260ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [267ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [267ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [300ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [301ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [302ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [323ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [342ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [343ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [344ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [348ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [348ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [363ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [363ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [364ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [364ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [402ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [403ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [403ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [404ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [442ms] refreshing cache from master, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [443ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [443ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [444ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [444ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [683ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [683ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [684ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [684ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [701ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [702ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [702ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [703ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1682ms] refreshing cache from master, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1684ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1685ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1686ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1686ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3044ms] refreshing cache from master, [3044ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [3045ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [3045ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [3047ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [3048ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [3049ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3049ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [5500ms] refreshing cache from master, [5500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [5501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [5501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [5504ms] too many traces: truncated at 100 traces, deferred=Deferred@1864470077(state=PENDING, result=null, callback=(continuation of Deferred@2090992871 after retry RPC after error@1924427150) -> (continuation of Deferred@589940754 after retry RPC after error@1075509804) -> (continuation of Deferred@754142196 after retry RPC after error@2105183225) -> (continuation of Deferred@276739356 after retry RPC after error@119727781) -> (continuation of Deferred@825799006 after retry RPC after error@414503363) -> (continuation of Deferred@2106016156 after retry RPC after error@1828755271) -> (continuation of Deferred@424049144 after retry RPC after error@658672090) -> (continuation of Deferred@1619961615 after retry RPC after error@165527286) -> (continuation of Deferred@595500940 after retry RPC after error@272752224) -> (continuation of Deferred@98739640 after retry RPC after error@1638699516) -> (continuation of Deferred@913961146 after retry RPC after error@676694731) -> (continuation of Deferred@940188956 after retry RPC after error@1034707088) -> (continuation of Deferred@1143585727 after retry RPC after error@1085170211) -> (continuation of Deferred@694525423 after retry RPC after error@2006175923) -> (continuation of Deferred@2121165245 after retry RPC after error@1298309929) -> (continuation of Deferred@1223546255 after retry RPC after error@554865257) -> (continuation of Deferred@742143095 after retry RPC after error@1956618546) -> (continuation of Deferred@1383617411 after retry RPC after error@1733034623) -> (continuation of Deferred@706612589 after retry RPC after error@595701549) -> (continuation of Deferred@871695509 after retry RPC after error@875411310) -> (continuation of Deferred@1854054883 after retry RPC after error@1079280601) -> (continuation of Deferred@1537140458 after retry RPC after error@38906928), errback=(continuation of Deferred@2090992871 after retry RPC after error@1924427150) -> (continuation of Deferred@589940754 after retry RPC after error@1075509804) -> (continuation of Deferred@754142196 after retry RPC after error@2105183225) -> (continuation of Deferred@276739356 after retry RPC after error@119727781) -> (continuation of Deferred@825799006 after retry RPC after error@414503363) -> (continuation of Deferred@2106016156 after retry RPC after error@1828755271) -> (continuation of Deferred@424049144 after retry RPC after error@658672090) -> (continuation of Deferred@1619961615 after retry RPC after error@165527286) -> (continuation of Deferred@595500940 after retry RPC after error@272752224) -> (continuation of Deferred@98739640 after retry RPC after error@1638699516) -> (continuation of Deferred@913961146 after retry RPC after error@676694731) -> (continuation of Deferred@940188956 after retry RPC after error@1034707088) -> (continuation of Deferred@1143585727 after retry RPC after error@1085170211) -> (continuation of Deferred@694525423 after retry RPC after error@2006175923) -> (continuation of Deferred@2121165245 after retry RPC after error@1298309929) -> (continuation of Deferred@1223546255 after retry RPC after error@554865257) -> (continuation of Deferred@742143095 after retry RPC after error@1956618546) -> (continuation of Deferred@1383617411 after retry RPC after error@1733034623) -> (continuation of Deferred@706612589 after retry RPC after error@595701549) -> (continuation of Deferred@871695509 after retry RPC after error@875411310) -> (continuation of Deferred@1854054883 after retry RPC after error@1079280601) -> (continuation of Deferred@1537140458 after retry RPC after error@38906928)))
08:07:04.896 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
08:07:04.897 [WARN - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27471), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [142ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [144ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [159ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [160ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [253ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [260ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [267ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [267ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [300ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [301ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [302ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [323ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [342ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [343ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [344ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [348ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [348ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [363ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [363ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [364ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [364ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [402ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [403ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [403ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [404ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [442ms] refreshing cache from master, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [443ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [443ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [444ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [444ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [683ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [683ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [684ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [684ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [701ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [702ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [702ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [703ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1682ms] refreshing cache from master, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1684ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1685ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1686ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1686ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3044ms] refreshing cache from master, [3044ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [3045ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [3045ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [3047ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [3048ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [3049ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3049ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [5500ms] refreshing cache from master, [5500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [5501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [5501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [5504ms] too many traces: truncated at 100 traces, deferred=Deferred@1864470077(state=PENDING, result=null, callback=(continuation of Deferred@2090992871 after retry RPC after error@1924427150) -> (continuation of Deferred@589940754 after retry RPC after error@1075509804) -> (continuation of Deferred@754142196 after retry RPC after error@2105183225) -> (continuation of Deferred@276739356 after retry RPC after error@119727781) -> (continuation of Deferred@825799006 after retry RPC after error@414503363) -> (continuation of Deferred@2106016156 after retry RPC after error@1828755271) -> (continuation of Deferred@424049144 after retry RPC after error@658672090) -> (continuation of Deferred@1619961615 after retry RPC after error@165527286) -> (continuation of Deferred@595500940 after retry RPC after error@272752224) -> (continuation of Deferred@98739640 after retry RPC after error@1638699516) -> (continuation of Deferred@913961146 after retry RPC after error@676694731) -> (continuation of Deferred@940188956 after retry RPC after error@1034707088) -> (continuation of Deferred@1143585727 after retry RPC after error@1085170211) -> (continuation of Deferred@694525423 after retry RPC after error@2006175923) -> (continuation of Deferred@2121165245 after retry RPC after error@1298309929) -> (continuation of Deferred@1223546255 after retry RPC after error@554865257) -> (continuation of Deferred@742143095 after retry RPC after error@1956618546) -> (continuation of Deferred@1383617411 after retry RPC after error@1733034623) -> (continuation of Deferred@706612589 after retry RPC after error@595701549) -> (continuation of Deferred@871695509 after retry RPC after error@875411310) -> (continuation of Deferred@1854054883 after retry RPC after error@1079280601) -> (continuation of Deferred@1537140458 after retry RPC after error@38906928), errback=(continuation of Deferred@2090992871 after retry RPC after error@1924427150) -> (continuation of Deferred@589940754 after retry RPC after error@1075509804) -> (continuation of Deferred@754142196 after retry RPC after error@2105183225) -> (continuation of Deferred@276739356 after retry RPC after error@119727781) -> (continuation of Deferred@825799006 after retry RPC after error@414503363) -> (continuation of Deferred@2106016156 after retry RPC after error@1828755271) -> (continuation of Deferred@424049144 after retry RPC after error@658672090) -> (continuation of Deferred@1619961615 after retry RPC after error@165527286) -> (continuation of Deferred@595500940 after retry RPC after error@272752224) -> (continuation of Deferred@98739640 after retry RPC after error@1638699516) -> (continuation of Deferred@913961146 after retry RPC after error@676694731) -> (continuation of Deferred@940188956 after retry RPC after error@1034707088) -> (continuation of Deferred@1143585727 after retry RPC after error@1085170211) -> (continuation of Deferred@694525423 after retry RPC after error@2006175923) -> (continuation of Deferred@2121165245 after retry RPC after error@1298309929) -> (continuation of Deferred@1223546255 after retry RPC after error@554865257) -> (continuation of Deferred@742143095 after retry RPC after error@1956618546) -> (continuation of Deferred@1383617411 after retry RPC after error@1733034623) -> (continuation of Deferred@706612589 after retry RPC after error@595701549) -> (continuation of Deferred@871695509 after retry RPC after error@875411310) -> (continuation of Deferred@1854054883 after retry RPC after error@1079280601) -> (continuation of Deferred@1537140458 after retry RPC after error@38906928)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.200.126:43511
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:07:04.900 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
08:07:04.902 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#1 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
08:07:04.906 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to FAILED on 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27471), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [142ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [144ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [159ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [160ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [253ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [260ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [267ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [267ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [300ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [301ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [302ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [323ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [342ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [343ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [344ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [348ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [348ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [363ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [363ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [364ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [364ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [402ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [403ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [403ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [404ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [442ms] refreshing cache from master, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [443ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [443ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [444ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [444ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [683ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [683ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [684ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [684ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [701ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [702ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [702ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [703ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1682ms] refreshing cache from master, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1684ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1685ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1686ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1686ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3044ms] refreshing cache from master, [3044ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [3045ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [3045ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [3047ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [3048ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [3049ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3049ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [5500ms] refreshing cache from master, [5500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [5501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [5501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [5504ms] too many traces: truncated at 100 traces, deferred=Deferred@1864470077(state=PENDING, result=null, callback=(continuation of Deferred@2090992871 after retry RPC after error@1924427150) -> (continuation of Deferred@589940754 after retry RPC after error@1075509804) -> (continuation of Deferred@754142196 after retry RPC after error@2105183225) -> (continuation of Deferred@276739356 after retry RPC after error@119727781) -> (continuation of Deferred@825799006 after retry RPC after error@414503363) -> (continuation of Deferred@2106016156 after retry RPC after error@1828755271) -> (continuation of Deferred@424049144 after retry RPC after error@658672090) -> (continuation of Deferred@1619961615 after retry RPC after error@165527286) -> (continuation of Deferred@595500940 after retry RPC after error@272752224) -> (continuation of Deferred@98739640 after retry RPC after error@1638699516) -> (continuation of Deferred@913961146 after retry RPC after error@676694731) -> (continuation of Deferred@940188956 after retry RPC after error@1034707088) -> (continuation of Deferred@1143585727 after retry RPC after error@1085170211) -> (continuation of Deferred@694525423 after retry RPC after error@2006175923) -> (continuation of Deferred@2121165245 after retry RPC after error@1298309929) -> (continuation of Deferred@1223546255 after retry RPC after error@554865257) -> (continuation of Deferred@742143095 after retry RPC after error@1956618546) -> (continuation of Deferred@1383617411 after retry RPC after error@1733034623) -> (continuation of Deferred@706612589 after retry RPC after error@595701549) -> (continuation of Deferred@871695509 after retry RPC after error@875411310) -> (continuation of Deferred@1854054883 after retry RPC after error@1079280601) -> (continuation of Deferred@1537140458 after retry RPC after error@38906928), errback=(continuation of Deferred@2090992871 after retry RPC after error@1924427150) -> (continuation of Deferred@589940754 after retry RPC after error@1075509804) -> (continuation of Deferred@754142196 after retry RPC after error@2105183225) -> (continuation of Deferred@276739356 after retry RPC after error@119727781) -> (continuation of Deferred@825799006 after retry RPC after error@414503363) -> (continuation of Deferred@2106016156 after retry RPC after error@1828755271) -> (continuation of Deferred@424049144 after retry RPC after error@658672090) -> (continuation of Deferred@1619961615 after retry RPC after error@165527286) -> (continuation of Deferred@595500940 after retry RPC after error@272752224) -> (continuation of Deferred@98739640 after retry RPC after error@1638699516) -> (continuation of Deferred@913961146 after retry RPC after error@676694731) -> (continuation of Deferred@940188956 after retry RPC after error@1034707088) -> (continuation of Deferred@1143585727 after retry RPC after error@1085170211) -> (continuation of Deferred@694525423 after retry RPC after error@2006175923) -> (continuation of Deferred@2121165245 after retry RPC after error@1298309929) -> (continuation of Deferred@1223546255 after retry RPC after error@554865257) -> (continuation of Deferred@742143095 after retry RPC after error@1956618546) -> (continuation of Deferred@1383617411 after retry RPC after error@1733034623) -> (continuation of Deferred@706612589 after retry RPC after error@595701549) -> (continuation of Deferred@871695509 after retry RPC after error@875411310) -> (continuation of Deferred@1854054883 after retry RPC after error@1079280601) -> (continuation of Deferred@1537140458 after retry RPC after error@38906928)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.200.126:43511
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:07:04.909 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#1) of source Source: KuduSource.
08:07:04.909 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:07:04.909 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
08:07:04.909 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (0d2ddb76420639a9ec06ca05e894cb50) switched from state RUNNING to RESTARTING.
08:07:04.910 [WARN - flink-pekko.actor.default-dispatcher-8] (TaskManagerLocation.java:276) No hostname could be resolved for the IP address 127.0.0.1, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted.
08:07:04.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:04.916169 29555 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 29567
08:07:04.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:04.959 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.28.220.254:37365(127.28.220.254:37365)] handling channelInactive
08:07:04.959 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state READY due to: connection closed
08:07:04.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:04.960811 29555 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 29637
08:07:05.003 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.28.220.253:45079(127.28.220.253:45079)] handling channelInactive
08:07:05.003 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state READY due to: connection closed
08:07:05.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:05.004246 29555 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 29714
08:07:05.047 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.28.220.252:33543(127.28.220.252:33543)] handling channelInactive
08:07:05.047 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:05.047 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state READY due to: connection closed
08:07:05.048 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:05.048 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:05.048 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:05.048 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:05.048 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:05.049 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:05.049 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:05.049 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:05.049 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:05.049 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:05.049 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:05.049 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:05.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091625118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:05.132 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job a72e6b48022ef36361b5eef11ee7c683 (2312 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
08:07:05.133 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
08:07:05.134 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 16 complete: removed split 55dd617b3a94402ce5e384b0a8714e783dca1c7e824b2a0e9fa7bf2cd35552d2 from pending
08:07:05.134 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 16 complete: removed split d28a7cf6dead0ab0699d3bde4d540fdf348e5d76381a4163a4e67192f8d1d8f2 from pending
08:07:05.134 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 16 complete: removed 2 finished splits from enumerator state
08:07:05.163 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:05.438 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:05.438 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:05.439 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:05.439 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.439 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.439 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.439 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.439 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.439 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.439 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.439 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.440 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.440 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:05.457 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:05.457 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:05.458 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:05.458 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:05.458 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:05.458 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:05.458 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:05.458 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:05.459 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:05.459 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:05.459 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:05.459 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:05.459 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:05.459 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:05.477 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:05.478 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:05.478 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:05.478 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.479 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.479 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.479 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.479 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.479 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.479 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.479 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.479 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.479 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:05.538 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:05.538 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:05.538 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:05.538 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.538 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.539 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.539 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.539 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.539 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.539 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.539 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.539 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.539 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:05.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091625618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:05.628 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
08:07:05.629 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
08:07:05.663 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:05.668 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:05.669 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:05.669 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:05.670 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:05.670 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:05.670 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:05.670 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:05.670 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:05.670 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:05.670 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:05.670 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:05.670 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:05.670 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:05.672 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28282), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [51ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [73ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [159ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [159ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [259ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [260ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [269ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [273ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [274ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [274ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [281ms] refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [307ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [308ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [319ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [321ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [321ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [322ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [343ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [343ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [362ms] refreshing cache from master, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [363ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [364ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [364ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [365ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [402ms] refreshing cache from master, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [403ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [403ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [405ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [405ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [406ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [406ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [423ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [423ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [424ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [424ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [463ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [464ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [465ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [465ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [546ms] refreshing cache from master, [546ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [547ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [547ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [548ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [548ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [549ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [549ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [662ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [663ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [664ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [664ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1561ms] refreshing cache from master, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1564ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1565ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1565ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3560ms] refreshing cache from master, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [3562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [3562ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [3563ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [3564ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3564ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [4281ms] refreshing cache from master, [4281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [4282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [4283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [4283ms] too many traces: truncated at 100 traces, deferred=Deferred@1932886479(state=PENDING, result=null, callback=(continuation of Deferred@1790319909 after retry RPC after error@1049682003) -> (continuation of Deferred@865075004 after retry RPC after error@1818962811) -> (continuation of Deferred@913198310 after retry RPC after error@256221184) -> (continuation of Deferred@1140840651 after retry RPC after error@1996100412) -> (continuation of Deferred@850880633 after retry RPC after error@273714063) -> (continuation of Deferred@768876750 after retry RPC after error@185710011) -> (continuation of Deferred@40693760 after retry RPC after error@376704817) -> (continuation of Deferred@438996833 after retry RPC after error@479219186) -> (continuation of Deferred@2031698576 after retry RPC after error@1336071941) -> (continuation of Deferred@20776983 after retry RPC after error@534526495) -> (continuation of Deferred@753067702 after retry RPC after error@1973491408) -> (continuation of Deferred@481674691 after retry RPC after error@1657215112) -> (continuation of Deferred@1504412976 after retry RPC after error@608243523) -> (continuation of Deferred@384327125 after retry RPC after error@1278285016) -> (continuation of Deferred@1236703851 after retry RPC after error@1696710409) -> (continuation of Deferred@838029453 after retry RPC after error@1973425599) -> (continuation of Deferred@137931938 after retry RPC after error@1611236187) -> (continuation of Deferred@1272303855 after retry RPC after error@1043151303) -> (continuation of Deferred@1941819164 after retry RPC after error@1594001771) -> (continuation of Deferred@984967372 after retry RPC after error@1837206876) -> (continuation of Deferred@1893300959 after retry RPC after error@995880062) -> (continuation of Deferred@708378833 after retry RPC after error@1261667239) -> (continuation of Deferred@1887901596 after retry RPC after error@349912558) -> (continuation of Deferred@1980139564 after retry RPC after error@561972208) -> (continuation of Deferred@1762450356 after retry RPC after error@620085046), errback=(continuation of Deferred@1790319909 after retry RPC after error@1049682003) -> (continuation of Deferred@865075004 after retry RPC after error@1818962811) -> (continuation of Deferred@913198310 after retry RPC after error@256221184) -> (continuation of Deferred@1140840651 after retry RPC after error@1996100412) -> (continuation of Deferred@850880633 after retry RPC after error@273714063) -> (continuation of Deferred@768876750 after retry RPC after error@185710011) -> (continuation of Deferred@40693760 after retry RPC after error@376704817) -> (continuation of Deferred@438996833 after retry RPC after error@479219186) -> (continuation of Deferred@2031698576 after retry RPC after error@1336071941) -> (continuation of Deferred@20776983 after retry RPC after error@534526495) -> (continuation of Deferred@753067702 after retry RPC after error@1973491408) -> (continuation of Deferred@481674691 after retry RPC after error@1657215112) -> (continuation of Deferred@1504412976 after retry RPC after error@608243523) -> (continuation of Deferred@384327125 after retry RPC after error@1278285016) -> (continuation of Deferred@1236703851 after retry RPC after error@1696710409) -> (continuation of Deferred@838029453 after retry RPC after error@1973425599) -> (continuation of Deferred@137931938 after retry RPC after error@1611236187) -> (continuation of Deferred@1272303855 after retry RPC after error@1043151303) -> (continuation of Deferred@1941819164 after retry RPC after error@1594001771) -> (continuation of Deferred@984967372 after retry RPC after error@1837206876) -> (continuation of Deferred@1893300959 after retry RPC after error@995880062) -> (continuation of Deferred@708378833 after retry RPC after error@1261667239) -> (continuation of Deferred@1887901596 after retry RPC after error@349912558) -> (continuation of Deferred@1980139564 after retry RPC after error@561972208) -> (continuation of Deferred@1762450356 after retry RPC after error@620085046)))
08:07:05.674 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
08:07:05.675 [WARN - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28282), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [51ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [73ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [159ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [159ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [259ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [260ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [269ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [273ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [274ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [274ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [281ms] refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [307ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [308ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [319ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [321ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [321ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [322ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [343ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [343ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [362ms] refreshing cache from master, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [363ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [364ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [364ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [365ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [402ms] refreshing cache from master, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [403ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [403ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [405ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [405ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [406ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [406ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [423ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [423ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [424ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [424ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [463ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [464ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [465ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [465ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [546ms] refreshing cache from master, [546ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [547ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [547ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [548ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [548ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [549ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [549ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [662ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [663ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [664ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [664ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1561ms] refreshing cache from master, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1564ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1565ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1565ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3560ms] refreshing cache from master, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [3562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [3562ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [3563ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [3564ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3564ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [4281ms] refreshing cache from master, [4281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [4282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [4283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [4283ms] too many traces: truncated at 100 traces, deferred=Deferred@1932886479(state=PENDING, result=null, callback=(continuation of Deferred@1790319909 after retry RPC after error@1049682003) -> (continuation of Deferred@865075004 after retry RPC after error@1818962811) -> (continuation of Deferred@913198310 after retry RPC after error@256221184) -> (continuation of Deferred@1140840651 after retry RPC after error@1996100412) -> (continuation of Deferred@850880633 after retry RPC after error@273714063) -> (continuation of Deferred@768876750 after retry RPC after error@185710011) -> (continuation of Deferred@40693760 after retry RPC after error@376704817) -> (continuation of Deferred@438996833 after retry RPC after error@479219186) -> (continuation of Deferred@2031698576 after retry RPC after error@1336071941) -> (continuation of Deferred@20776983 after retry RPC after error@534526495) -> (continuation of Deferred@753067702 after retry RPC after error@1973491408) -> (continuation of Deferred@481674691 after retry RPC after error@1657215112) -> (continuation of Deferred@1504412976 after retry RPC after error@608243523) -> (continuation of Deferred@384327125 after retry RPC after error@1278285016) -> (continuation of Deferred@1236703851 after retry RPC after error@1696710409) -> (continuation of Deferred@838029453 after retry RPC after error@1973425599) -> (continuation of Deferred@137931938 after retry RPC after error@1611236187) -> (continuation of Deferred@1272303855 after retry RPC after error@1043151303) -> (continuation of Deferred@1941819164 after retry RPC after error@1594001771) -> (continuation of Deferred@984967372 after retry RPC after error@1837206876) -> (continuation of Deferred@1893300959 after retry RPC after error@995880062) -> (continuation of Deferred@708378833 after retry RPC after error@1261667239) -> (continuation of Deferred@1887901596 after retry RPC after error@349912558) -> (continuation of Deferred@1980139564 after retry RPC after error@561972208) -> (continuation of Deferred@1762450356 after retry RPC after error@620085046), errback=(continuation of Deferred@1790319909 after retry RPC after error@1049682003) -> (continuation of Deferred@865075004 after retry RPC after error@1818962811) -> (continuation of Deferred@913198310 after retry RPC after error@256221184) -> (continuation of Deferred@1140840651 after retry RPC after error@1996100412) -> (continuation of Deferred@850880633 after retry RPC after error@273714063) -> (continuation of Deferred@768876750 after retry RPC after error@185710011) -> (continuation of Deferred@40693760 after retry RPC after error@376704817) -> (continuation of Deferred@438996833 after retry RPC after error@479219186) -> (continuation of Deferred@2031698576 after retry RPC after error@1336071941) -> (continuation of Deferred@20776983 after retry RPC after error@534526495) -> (continuation of Deferred@753067702 after retry RPC after error@1973491408) -> (continuation of Deferred@481674691 after retry RPC after error@1657215112) -> (continuation of Deferred@1504412976 after retry RPC after error@608243523) -> (continuation of Deferred@384327125 after retry RPC after error@1278285016) -> (continuation of Deferred@1236703851 after retry RPC after error@1696710409) -> (continuation of Deferred@838029453 after retry RPC after error@1973425599) -> (continuation of Deferred@137931938 after retry RPC after error@1611236187) -> (continuation of Deferred@1272303855 after retry RPC after error@1043151303) -> (continuation of Deferred@1941819164 after retry RPC after error@1594001771) -> (continuation of Deferred@984967372 after retry RPC after error@1837206876) -> (continuation of Deferred@1893300959 after retry RPC after error@995880062) -> (continuation of Deferred@708378833 after retry RPC after error@1261667239) -> (continuation of Deferred@1887901596 after retry RPC after error@349912558) -> (continuation of Deferred@1980139564 after retry RPC after error@561972208) -> (continuation of Deferred@1762450356 after retry RPC after error@620085046)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.200.124:34439
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:07:05.677 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
08:07:05.679 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#1 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
08:07:05.684 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to FAILED on 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28282), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [51ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [73ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [159ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [159ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [259ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [260ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [269ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [273ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [274ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [274ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [281ms] refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [307ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [308ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [319ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [321ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [321ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [322ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [343ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [343ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [362ms] refreshing cache from master, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [363ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [364ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [364ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [365ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [402ms] refreshing cache from master, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [403ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [403ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [405ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [405ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [406ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [406ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [423ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [423ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [424ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [424ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [463ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [464ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [465ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [465ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [546ms] refreshing cache from master, [546ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [547ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [547ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [548ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [548ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [549ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [549ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [662ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [663ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [664ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [664ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1561ms] refreshing cache from master, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1564ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1565ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1565ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3560ms] refreshing cache from master, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [3562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [3562ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [3563ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [3564ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3564ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [4281ms] refreshing cache from master, [4281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [4282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [4283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [4283ms] too many traces: truncated at 100 traces, deferred=Deferred@1932886479(state=PENDING, result=null, callback=(continuation of Deferred@1790319909 after retry RPC after error@1049682003) -> (continuation of Deferred@865075004 after retry RPC after error@1818962811) -> (continuation of Deferred@913198310 after retry RPC after error@256221184) -> (continuation of Deferred@1140840651 after retry RPC after error@1996100412) -> (continuation of Deferred@850880633 after retry RPC after error@273714063) -> (continuation of Deferred@768876750 after retry RPC after error@185710011) -> (continuation of Deferred@40693760 after retry RPC after error@376704817) -> (continuation of Deferred@438996833 after retry RPC after error@479219186) -> (continuation of Deferred@2031698576 after retry RPC after error@1336071941) -> (continuation of Deferred@20776983 after retry RPC after error@534526495) -> (continuation of Deferred@753067702 after retry RPC after error@1973491408) -> (continuation of Deferred@481674691 after retry RPC after error@1657215112) -> (continuation of Deferred@1504412976 after retry RPC after error@608243523) -> (continuation of Deferred@384327125 after retry RPC after error@1278285016) -> (continuation of Deferred@1236703851 after retry RPC after error@1696710409) -> (continuation of Deferred@838029453 after retry RPC after error@1973425599) -> (continuation of Deferred@137931938 after retry RPC after error@1611236187) -> (continuation of Deferred@1272303855 after retry RPC after error@1043151303) -> (continuation of Deferred@1941819164 after retry RPC after error@1594001771) -> (continuation of Deferred@984967372 after retry RPC after error@1837206876) -> (continuation of Deferred@1893300959 after retry RPC after error@995880062) -> (continuation of Deferred@708378833 after retry RPC after error@1261667239) -> (continuation of Deferred@1887901596 after retry RPC after error@349912558) -> (continuation of Deferred@1980139564 after retry RPC after error@561972208) -> (continuation of Deferred@1762450356 after retry RPC after error@620085046), errback=(continuation of Deferred@1790319909 after retry RPC after error@1049682003) -> (continuation of Deferred@865075004 after retry RPC after error@1818962811) -> (continuation of Deferred@913198310 after retry RPC after error@256221184) -> (continuation of Deferred@1140840651 after retry RPC after error@1996100412) -> (continuation of Deferred@850880633 after retry RPC after error@273714063) -> (continuation of Deferred@768876750 after retry RPC after error@185710011) -> (continuation of Deferred@40693760 after retry RPC after error@376704817) -> (continuation of Deferred@438996833 after retry RPC after error@479219186) -> (continuation of Deferred@2031698576 after retry RPC after error@1336071941) -> (continuation of Deferred@20776983 after retry RPC after error@534526495) -> (continuation of Deferred@753067702 after retry RPC after error@1973491408) -> (continuation of Deferred@481674691 after retry RPC after error@1657215112) -> (continuation of Deferred@1504412976 after retry RPC after error@608243523) -> (continuation of Deferred@384327125 after retry RPC after error@1278285016) -> (continuation of Deferred@1236703851 after retry RPC after error@1696710409) -> (continuation of Deferred@838029453 after retry RPC after error@1973425599) -> (continuation of Deferred@137931938 after retry RPC after error@1611236187) -> (continuation of Deferred@1272303855 after retry RPC after error@1043151303) -> (continuation of Deferred@1941819164 after retry RPC after error@1594001771) -> (continuation of Deferred@984967372 after retry RPC after error@1837206876) -> (continuation of Deferred@1893300959 after retry RPC after error@995880062) -> (continuation of Deferred@708378833 after retry RPC after error@1261667239) -> (continuation of Deferred@1887901596 after retry RPC after error@349912558) -> (continuation of Deferred@1980139564 after retry RPC after error@561972208) -> (continuation of Deferred@1762450356 after retry RPC after error@620085046)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.200.124:34439
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:07:05.687 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#1) of source Source: KuduSource.
08:07:05.687 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:07:05.687 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
08:07:05.723 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:05.724 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:05.724 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:05.724 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:05.725 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:05.725 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:05.725 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:05.725 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:05.725 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:05.725 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:05.726 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:05.726 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:05.726 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:05.897 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:05.898 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:05.898 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:05.898 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.899 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.899 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.899 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.899 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.899 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.899 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.899 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.899 [INFO - pool-156-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.899 [WARN - pool-156-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:05.900 [DEBUG - pool-156-thread-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28443), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [30ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [38ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [56ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [56ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [119ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [127ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [136ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [137ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [265ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [273ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [276ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [277ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [277ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [306ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [306ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [307ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [323ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [360ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [361ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [362ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [362ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [362ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [381ms] refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [385ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [423ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [423ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [424ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [424ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [583ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [880ms] refreshing cache from master, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [882ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [883ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [885ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [885ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1681ms] refreshing cache from master, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1683ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1683ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1683ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2081ms] refreshing cache from master, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2083ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2084ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2086ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2086ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2086ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [5421ms] refreshing cache from master, [5421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [5422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [5422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [5424ms] too many traces: truncated at 100 traces, deferred=Deferred@1732409868(state=PENDING, result=null, callback=(continuation of Deferred@600221956 after retry RPC after error@1905031599) -> (continuation of Deferred@655614405 after retry RPC after error@1400204593) -> (continuation of Deferred@1164800210 after retry RPC after error@1463695569) -> (continuation of Deferred@1872487994 after retry RPC after error@402588189) -> (continuation of Deferred@960109520 after retry RPC after error@526664854) -> (continuation of Deferred@805231478 after retry RPC after error@1082055550) -> (continuation of Deferred@703835194 after retry RPC after error@344857958) -> (continuation of Deferred@1299337706 after retry RPC after error@2070005265) -> (continuation of Deferred@1330063163 after retry RPC after error@726038168) -> (continuation of Deferred@1961139995 after retry RPC after error@29400792) -> (continuation of Deferred@2001211172 after retry RPC after error@1864517091) -> (continuation of Deferred@1072563035 after retry RPC after error@979201056) -> (continuation of Deferred@224093536 after retry RPC after error@1890264181) -> (continuation of Deferred@1058014688 after retry RPC after error@1853706830) -> (continuation of Deferred@945506948 after retry RPC after error@301615478) -> (continuation of Deferred@779776428 after retry RPC after error@705800463) -> (continuation of Deferred@1224526243 after retry RPC after error@193894451) -> (continuation of Deferred@1980006399 after retry RPC after error@1375402465) -> (continuation of Deferred@2137359276 after retry RPC after error@5624691) -> (continuation of Deferred@1442561793 after retry RPC after error@1405641134) -> (continuation of Deferred@6545560 after retry RPC after error@780363180) -> (continuation of Deferred@646501578 after retry RPC after error@920454308) -> (continuation of Deferred@698701255 after retry RPC after error@473885530) -> (continuation of Deferred@2087735955 after retry RPC after error@584487325) -> (continuation of Deferred@559866733 after retry RPC after error@1246869543) -> (continuation of Deferred@885759796 after retry RPC after error@579320393), errback=(continuation of Deferred@600221956 after retry RPC after error@1905031599) -> (continuation of Deferred@655614405 after retry RPC after error@1400204593) -> (continuation of Deferred@1164800210 after retry RPC after error@1463695569) -> (continuation of Deferred@1872487994 after retry RPC after error@402588189) -> (continuation of Deferred@960109520 after retry RPC after error@526664854) -> (continuation of Deferred@805231478 after retry RPC after error@1082055550) -> (continuation of Deferred@703835194 after retry RPC after error@344857958) -> (continuation of Deferred@1299337706 after retry RPC after error@2070005265) -> (continuation of Deferred@1330063163 after retry RPC after error@726038168) -> (continuation of Deferred@1961139995 after retry RPC after error@29400792) -> (continuation of Deferred@2001211172 after retry RPC after error@1864517091) -> (continuation of Deferred@1072563035 after retry RPC after error@979201056) -> (continuation of Deferred@224093536 after retry RPC after error@1890264181) -> (continuation of Deferred@1058014688 after retry RPC after error@1853706830) -> (continuation of Deferred@945506948 after retry RPC after error@301615478) -> (continuation of Deferred@779776428 after retry RPC after error@705800463) -> (continuation of Deferred@1224526243 after retry RPC after error@193894451) -> (continuation of Deferred@1980006399 after retry RPC after error@1375402465) -> (continuation of Deferred@2137359276 after retry RPC after error@5624691) -> (continuation of Deferred@1442561793 after retry RPC after error@1405641134) -> (continuation of Deferred@6545560 after retry RPC after error@780363180) -> (continuation of Deferred@646501578 after retry RPC after error@920454308) -> (continuation of Deferred@698701255 after retry RPC after error@473885530) -> (continuation of Deferred@2087735955 after retry RPC after error@584487325) -> (continuation of Deferred@559866733 after retry RPC after error@1246869543) -> (continuation of Deferred@885759796 after retry RPC after error@579320393)))
08:07:05.901 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:05.901 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28443), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [30ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [38ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [56ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [56ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [119ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [127ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [136ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [137ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [265ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [273ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [276ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [277ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [277ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [306ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [306ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [307ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [323ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [360ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [361ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [362ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [362ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [362ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [381ms] refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [385ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [423ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [423ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [424ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [424ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [583ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [880ms] refreshing cache from master, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [882ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [883ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [885ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [885ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1681ms] refreshing cache from master, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1683ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1683ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1683ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2081ms] refreshing cache from master, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2083ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2084ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2086ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2086ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2086ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [5421ms] refreshing cache from master, [5421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [5422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [5422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [5424ms] too many traces: truncated at 100 traces, deferred=Deferred@1732409868(state=PENDING, result=null, callback=(continuation of Deferred@600221956 after retry RPC after error@1905031599) -> (continuation of Deferred@655614405 after retry RPC after error@1400204593) -> (continuation of Deferred@1164800210 after retry RPC after error@1463695569) -> (continuation of Deferred@1872487994 after retry RPC after error@402588189) -> (continuation of Deferred@960109520 after retry RPC after error@526664854) -> (continuation of Deferred@805231478 after retry RPC after error@1082055550) -> (continuation of Deferred@703835194 after retry RPC after error@344857958) -> (continuation of Deferred@1299337706 after retry RPC after error@2070005265) -> (continuation of Deferred@1330063163 after retry RPC after error@726038168) -> (continuation of Deferred@1961139995 after retry RPC after error@29400792) -> (continuation of Deferred@2001211172 after retry RPC after error@1864517091) -> (continuation of Deferred@1072563035 after retry RPC after error@979201056) -> (continuation of Deferred@224093536 after retry RPC after error@1890264181) -> (continuation of Deferred@1058014688 after retry RPC after error@1853706830) -> (continuation of Deferred@945506948 after retry RPC after error@301615478) -> (continuation of Deferred@779776428 after retry RPC after error@705800463) -> (continuation of Deferred@1224526243 after retry RPC after error@193894451) -> (continuation of Deferred@1980006399 after retry RPC after error@1375402465) -> (continuation of Deferred@2137359276 after retry RPC after error@5624691) -> (continuation of Deferred@1442561793 after retry RPC after error@1405641134) -> (continuation of Deferred@6545560 after retry RPC after error@780363180) -> (continuation of Deferred@646501578 after retry RPC after error@920454308) -> (continuation of Deferred@698701255 after retry RPC after error@473885530) -> (continuation of Deferred@2087735955 after retry RPC after error@584487325) -> (continuation of Deferred@559866733 after retry RPC after error@1246869543) -> (continuation of Deferred@885759796 after retry RPC after error@579320393), errback=(continuation of Deferred@600221956 after retry RPC after error@1905031599) -> (continuation of Deferred@655614405 after retry RPC after error@1400204593) -> (continuation of Deferred@1164800210 after retry RPC after error@1463695569) -> (continuation of Deferred@1872487994 after retry RPC after error@402588189) -> (continuation of Deferred@960109520 after retry RPC after error@526664854) -> (continuation of Deferred@805231478 after retry RPC after error@1082055550) -> (continuation of Deferred@703835194 after retry RPC after error@344857958) -> (continuation of Deferred@1299337706 after retry RPC after error@2070005265) -> (continuation of Deferred@1330063163 after retry RPC after error@726038168) -> (continuation of Deferred@1961139995 after retry RPC after error@29400792) -> (continuation of Deferred@2001211172 after retry RPC after error@1864517091) -> (continuation of Deferred@1072563035 after retry RPC after error@979201056) -> (continuation of Deferred@224093536 after retry RPC after error@1890264181) -> (continuation of Deferred@1058014688 after retry RPC after error@1853706830) -> (continuation of Deferred@945506948 after retry RPC after error@301615478) -> (continuation of Deferred@779776428 after retry RPC after error@705800463) -> (continuation of Deferred@1224526243 after retry RPC after error@193894451) -> (continuation of Deferred@1980006399 after retry RPC after error@1375402465) -> (continuation of Deferred@2137359276 after retry RPC after error@5624691) -> (continuation of Deferred@1442561793 after retry RPC after error@1405641134) -> (continuation of Deferred@6545560 after retry RPC after error@780363180) -> (continuation of Deferred@646501578 after retry RPC after error@920454308) -> (continuation of Deferred@698701255 after retry RPC after error@473885530) -> (continuation of Deferred@2087735955 after retry RPC after error@584487325) -> (continuation of Deferred@559866733 after retry RPC after error@1246869543) -> (continuation of Deferred@885759796 after retry RPC after error@579320393)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28443), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [30ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [38ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [56ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [56ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [119ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [127ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [136ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [137ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [265ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [273ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [276ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [277ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [277ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [306ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [306ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [307ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [323ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [360ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [361ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [362ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [362ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [362ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [381ms] refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [385ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [423ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [423ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [424ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [424ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [583ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [880ms] refreshing cache from master, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [882ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [883ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [885ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [885ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1681ms] refreshing cache from master, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1683ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1683ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1683ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2081ms] refreshing cache from master, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2083ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2084ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2086ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2086ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2086ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [5421ms] refreshing cache from master, [5421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [5422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [5422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [5424ms] too many traces: truncated at 100 traces, deferred=Deferred@1732409868(state=PENDING, result=null, callback=(continuation of Deferred@600221956 after retry RPC after error@1905031599) -> (continuation of Deferred@655614405 after retry RPC after error@1400204593) -> (continuation of Deferred@1164800210 after retry RPC after error@1463695569) -> (continuation of Deferred@1872487994 after retry RPC after error@402588189) -> (continuation of Deferred@960109520 after retry RPC after error@526664854) -> (continuation of Deferred@805231478 after retry RPC after error@1082055550) -> (continuation of Deferred@703835194 after retry RPC after error@344857958) -> (continuation of Deferred@1299337706 after retry RPC after error@2070005265) -> (continuation of Deferred@1330063163 after retry RPC after error@726038168) -> (continuation of Deferred@1961139995 after retry RPC after error@29400792) -> (continuation of Deferred@2001211172 after retry RPC after error@1864517091) -> (continuation of Deferred@1072563035 after retry RPC after error@979201056) -> (continuation of Deferred@224093536 after retry RPC after error@1890264181) -> (continuation of Deferred@1058014688 after retry RPC after error@1853706830) -> (continuation of Deferred@945506948 after retry RPC after error@301615478) -> (continuation of Deferred@779776428 after retry RPC after error@705800463) -> (continuation of Deferred@1224526243 after retry RPC after error@193894451) -> (continuation of Deferred@1980006399 after retry RPC after error@1375402465) -> (continuation of Deferred@2137359276 after retry RPC after error@5624691) -> (continuation of Deferred@1442561793 after retry RPC after error@1405641134) -> (continuation of Deferred@6545560 after retry RPC after error@780363180) -> (continuation of Deferred@646501578 after retry RPC after error@920454308) -> (continuation of Deferred@698701255 after retry RPC after error@473885530) -> (continuation of Deferred@2087735955 after retry RPC after error@584487325) -> (continuation of Deferred@559866733 after retry RPC after error@1246869543) -> (continuation of Deferred@885759796 after retry RPC after error@579320393), errback=(continuation of Deferred@600221956 after retry RPC after error@1905031599) -> (continuation of Deferred@655614405 after retry RPC after error@1400204593) -> (continuation of Deferred@1164800210 after retry RPC after error@1463695569) -> (continuation of Deferred@1872487994 after retry RPC after error@402588189) -> (continuation of Deferred@960109520 after retry RPC after error@526664854) -> (continuation of Deferred@805231478 after retry RPC after error@1082055550) -> (continuation of Deferred@703835194 after retry RPC after error@344857958) -> (continuation of Deferred@1299337706 after retry RPC after error@2070005265) -> (continuation of Deferred@1330063163 after retry RPC after error@726038168) -> (continuation of Deferred@1961139995 after retry RPC after error@29400792) -> (continuation of Deferred@2001211172 after retry RPC after error@1864517091) -> (continuation of Deferred@1072563035 after retry RPC after error@979201056) -> (continuation of Deferred@224093536 after retry RPC after error@1890264181) -> (continuation of Deferred@1058014688 after retry RPC after error@1853706830) -> (continuation of Deferred@945506948 after retry RPC after error@301615478) -> (continuation of Deferred@779776428 after retry RPC after error@705800463) -> (continuation of Deferred@1224526243 after retry RPC after error@193894451) -> (continuation of Deferred@1980006399 after retry RPC after error@1375402465) -> (continuation of Deferred@2137359276 after retry RPC after error@5624691) -> (continuation of Deferred@1442561793 after retry RPC after error@1405641134) -> (continuation of Deferred@6545560 after retry RPC after error@780363180) -> (continuation of Deferred@646501578 after retry RPC after error@920454308) -> (continuation of Deferred@698701255 after retry RPC after error@473885530) -> (continuation of Deferred@2087735955 after retry RPC after error@584487325) -> (continuation of Deferred@559866733 after retry RPC after error@1246869543) -> (continuation of Deferred@885759796 after retry RPC after error@579320393)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.addCallbacks(Deferred.java:685)
		at org.apache.kudu.util.AsyncUtil.addCallbacksDeferring(AsyncUtil.java:52)
		at org.apache.kudu.client.AsyncKuduClient.sendRpcToTablet(AsyncKuduClient.java:1465)
		at org.apache.kudu.client.AsyncKuduClient.lambda$delayedSendRpcToTablet$18(AsyncKuduClient.java:2343)
		at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer$HashedWheelTimeout.run(HashedWheelTimer.java:713)
		at org.apache.kudu.shaded.io.netty.util.concurrent.ImmediateExecutor.execute(ImmediateExecutor.java:34)
		at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:701)
		at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:787)
		at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:501)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.addCallbacks(Deferred.java:685)
	at org.apache.kudu.client.ConnectToCluster.connectToMasters(ConnectToCluster.java:205)
	at org.apache.kudu.client.ConnectToCluster.run(ConnectToCluster.java:158)
	at org.apache.kudu.client.AsyncKuduClient.getMasterTableLocationsPB(AsyncKuduClient.java:1953)
	at org.apache.kudu.client.AsyncKuduClient.locateTablet(AsyncKuduClient.java:1923)
	at org.apache.kudu.client.AsyncKuduClient.sendRpcToTablet(AsyncKuduClient.java:1464)
	at org.apache.kudu.client.AsyncKuduClient.lambda$delayedSendRpcToTablet$18(AsyncKuduClient.java:2343)
	at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer$HashedWheelTimeout.run(HashedWheelTimer.java:713)
	at org.apache.kudu.shaded.io.netty.util.concurrent.ImmediateExecutor.execute(ImmediateExecutor.java:34)
	at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:701)
	at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:787)
	at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:501)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:571)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.access$200(DefaultPromise.java:37)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise$1.run(DefaultPromise.java:517)
	at org.apache.kudu.shaded.io.netty.util.concurrent.AbstractEventExecutor.runTask(AbstractEventExecutor.java:173)
	at org.apache.kudu.shaded.io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:166)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:569)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.17.253:37621
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:07:05.902 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:05.902 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.902 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:05.902 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.903 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.903 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.903 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.904 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.904 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.904 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.904 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.904 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:05.908 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28443), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [30ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [38ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [56ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [56ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [119ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [127ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [136ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [137ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [265ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [273ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [276ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [277ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [277ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [306ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [306ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [307ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [323ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [360ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [361ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [362ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [362ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [362ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [381ms] refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [385ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [423ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [423ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [424ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [424ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [583ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [880ms] refreshing cache from master, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [882ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [883ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [885ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [885ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1681ms] refreshing cache from master, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1683ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1683ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1683ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2081ms] refreshing cache from master, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2083ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2084ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2086ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2086ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2086ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [5421ms] refreshing cache from master, [5421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [5422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [5422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [5424ms] too many traces: truncated at 100 traces, deferred=Deferred@1732409868(state=PENDING, result=null, callback=(continuation of Deferred@600221956 after retry RPC after error@1905031599) -> (continuation of Deferred@655614405 after retry RPC after error@1400204593) -> (continuation of Deferred@1164800210 after retry RPC after error@1463695569) -> (continuation of Deferred@1872487994 after retry RPC after error@402588189) -> (continuation of Deferred@960109520 after retry RPC after error@526664854) -> (continuation of Deferred@805231478 after retry RPC after error@1082055550) -> (continuation of Deferred@703835194 after retry RPC after error@344857958) -> (continuation of Deferred@1299337706 after retry RPC after error@2070005265) -> (continuation of Deferred@1330063163 after retry RPC after error@726038168) -> (continuation of Deferred@1961139995 after retry RPC after error@29400792) -> (continuation of Deferred@2001211172 after retry RPC after error@1864517091) -> (continuation of Deferred@1072563035 after retry RPC after error@979201056) -> (continuation of Deferred@224093536 after retry RPC after error@1890264181) -> (continuation of Deferred@1058014688 after retry RPC after error@1853706830) -> (continuation of Deferred@945506948 after retry RPC after error@301615478) -> (continuation of Deferred@779776428 after retry RPC after error@705800463) -> (continuation of Deferred@1224526243 after retry RPC after error@193894451) -> (continuation of Deferred@1980006399 after retry RPC after error@1375402465) -> (continuation of Deferred@2137359276 after retry RPC after error@5624691) -> (continuation of Deferred@1442561793 after retry RPC after error@1405641134) -> (continuation of Deferred@6545560 after retry RPC after error@780363180) -> (continuation of Deferred@646501578 after retry RPC after error@920454308) -> (continuation of Deferred@698701255 after retry RPC after error@473885530) -> (continuation of Deferred@2087735955 after retry RPC after error@584487325) -> (continuation of Deferred@559866733 after retry RPC after error@1246869543) -> (continuation of Deferred@885759796 after retry RPC after error@579320393), errback=(continuation of Deferred@600221956 after retry RPC after error@1905031599) -> (continuation of Deferred@655614405 after retry RPC after error@1400204593) -> (continuation of Deferred@1164800210 after retry RPC after error@1463695569) -> (continuation of Deferred@1872487994 after retry RPC after error@402588189) -> (continuation of Deferred@960109520 after retry RPC after error@526664854) -> (continuation of Deferred@805231478 after retry RPC after error@1082055550) -> (continuation of Deferred@703835194 after retry RPC after error@344857958) -> (continuation of Deferred@1299337706 after retry RPC after error@2070005265) -> (continuation of Deferred@1330063163 after retry RPC after error@726038168) -> (continuation of Deferred@1961139995 after retry RPC after error@29400792) -> (continuation of Deferred@2001211172 after retry RPC after error@1864517091) -> (continuation of Deferred@1072563035 after retry RPC after error@979201056) -> (continuation of Deferred@224093536 after retry RPC after error@1890264181) -> (continuation of Deferred@1058014688 after retry RPC after error@1853706830) -> (continuation of Deferred@945506948 after retry RPC after error@301615478) -> (continuation of Deferred@779776428 after retry RPC after error@705800463) -> (continuation of Deferred@1224526243 after retry RPC after error@193894451) -> (continuation of Deferred@1980006399 after retry RPC after error@1375402465) -> (continuation of Deferred@2137359276 after retry RPC after error@5624691) -> (continuation of Deferred@1442561793 after retry RPC after error@1405641134) -> (continuation of Deferred@6545560 after retry RPC after error@780363180) -> (continuation of Deferred@646501578 after retry RPC after error@920454308) -> (continuation of Deferred@698701255 after retry RPC after error@473885530) -> (continuation of Deferred@2087735955 after retry RPC after error@584487325) -> (continuation of Deferred@559866733 after retry RPC after error@1246869543) -> (continuation of Deferred@885759796 after retry RPC after error@579320393)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28443), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [30ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [38ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [56ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [56ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [119ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [127ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [136ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [137ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [265ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [273ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [276ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [277ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [277ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [306ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [306ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [307ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [323ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [360ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [361ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [362ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [362ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [362ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [381ms] refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [385ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [423ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [423ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [424ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [424ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [583ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [880ms] refreshing cache from master, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [882ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [883ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [885ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [885ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1681ms] refreshing cache from master, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1683ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1683ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1683ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2081ms] refreshing cache from master, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2083ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2084ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2086ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2086ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2086ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [5421ms] refreshing cache from master, [5421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [5422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [5422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [5424ms] too many traces: truncated at 100 traces, deferred=Deferred@1732409868(state=PENDING, result=null, callback=(continuation of Deferred@600221956 after retry RPC after error@1905031599) -> (continuation of Deferred@655614405 after retry RPC after error@1400204593) -> (continuation of Deferred@1164800210 after retry RPC after error@1463695569) -> (continuation of Deferred@1872487994 after retry RPC after error@402588189) -> (continuation of Deferred@960109520 after retry RPC after error@526664854) -> (continuation of Deferred@805231478 after retry RPC after error@1082055550) -> (continuation of Deferred@703835194 after retry RPC after error@344857958) -> (continuation of Deferred@1299337706 after retry RPC after error@2070005265) -> (continuation of Deferred@1330063163 after retry RPC after error@726038168) -> (continuation of Deferred@1961139995 after retry RPC after error@29400792) -> (continuation of Deferred@2001211172 after retry RPC after error@1864517091) -> (continuation of Deferred@1072563035 after retry RPC after error@979201056) -> (continuation of Deferred@224093536 after retry RPC after error@1890264181) -> (continuation of Deferred@1058014688 after retry RPC after error@1853706830) -> (continuation of Deferred@945506948 after retry RPC after error@301615478) -> (continuation of Deferred@779776428 after retry RPC after error@705800463) -> (continuation of Deferred@1224526243 after retry RPC after error@193894451) -> (continuation of Deferred@1980006399 after retry RPC after error@1375402465) -> (continuation of Deferred@2137359276 after retry RPC after error@5624691) -> (continuation of Deferred@1442561793 after retry RPC after error@1405641134) -> (continuation of Deferred@6545560 after retry RPC after error@780363180) -> (continuation of Deferred@646501578 after retry RPC after error@920454308) -> (continuation of Deferred@698701255 after retry RPC after error@473885530) -> (continuation of Deferred@2087735955 after retry RPC after error@584487325) -> (continuation of Deferred@559866733 after retry RPC after error@1246869543) -> (continuation of Deferred@885759796 after retry RPC after error@579320393), errback=(continuation of Deferred@600221956 after retry RPC after error@1905031599) -> (continuation of Deferred@655614405 after retry RPC after error@1400204593) -> (continuation of Deferred@1164800210 after retry RPC after error@1463695569) -> (continuation of Deferred@1872487994 after retry RPC after error@402588189) -> (continuation of Deferred@960109520 after retry RPC after error@526664854) -> (continuation of Deferred@805231478 after retry RPC after error@1082055550) -> (continuation of Deferred@703835194 after retry RPC after error@344857958) -> (continuation of Deferred@1299337706 after retry RPC after error@2070005265) -> (continuation of Deferred@1330063163 after retry RPC after error@726038168) -> (continuation of Deferred@1961139995 after retry RPC after error@29400792) -> (continuation of Deferred@2001211172 after retry RPC after error@1864517091) -> (continuation of Deferred@1072563035 after retry RPC after error@979201056) -> (continuation of Deferred@224093536 after retry RPC after error@1890264181) -> (continuation of Deferred@1058014688 after retry RPC after error@1853706830) -> (continuation of Deferred@945506948 after retry RPC after error@301615478) -> (continuation of Deferred@779776428 after retry RPC after error@705800463) -> (continuation of Deferred@1224526243 after retry RPC after error@193894451) -> (continuation of Deferred@1980006399 after retry RPC after error@1375402465) -> (continuation of Deferred@2137359276 after retry RPC after error@5624691) -> (continuation of Deferred@1442561793 after retry RPC after error@1405641134) -> (continuation of Deferred@6545560 after retry RPC after error@780363180) -> (continuation of Deferred@646501578 after retry RPC after error@920454308) -> (continuation of Deferred@698701255 after retry RPC after error@473885530) -> (continuation of Deferred@2087735955 after retry RPC after error@584487325) -> (continuation of Deferred@559866733 after retry RPC after error@1246869543) -> (continuation of Deferred@885759796 after retry RPC after error@579320393)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.addCallbacks(Deferred.java:685)
		at org.apache.kudu.util.AsyncUtil.addCallbacksDeferring(AsyncUtil.java:52)
		at org.apache.kudu.client.AsyncKuduClient.sendRpcToTablet(AsyncKuduClient.java:1465)
		at org.apache.kudu.client.AsyncKuduClient.lambda$delayedSendRpcToTablet$18(AsyncKuduClient.java:2343)
		at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer$HashedWheelTimeout.run(HashedWheelTimer.java:713)
		at org.apache.kudu.shaded.io.netty.util.concurrent.ImmediateExecutor.execute(ImmediateExecutor.java:34)
		at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:701)
		at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:787)
		at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:501)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.addCallbacks(Deferred.java:685)
	at org.apache.kudu.client.ConnectToCluster.connectToMasters(ConnectToCluster.java:205)
	at org.apache.kudu.client.ConnectToCluster.run(ConnectToCluster.java:158)
	at org.apache.kudu.client.AsyncKuduClient.getMasterTableLocationsPB(AsyncKuduClient.java:1953)
	at org.apache.kudu.client.AsyncKuduClient.locateTablet(AsyncKuduClient.java:1923)
	at org.apache.kudu.client.AsyncKuduClient.sendRpcToTablet(AsyncKuduClient.java:1464)
	at org.apache.kudu.client.AsyncKuduClient.lambda$delayedSendRpcToTablet$18(AsyncKuduClient.java:2343)
	at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer$HashedWheelTimeout.run(HashedWheelTimer.java:713)
	at org.apache.kudu.shaded.io.netty.util.concurrent.ImmediateExecutor.execute(ImmediateExecutor.java:34)
	at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:701)
	at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:787)
	at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:501)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:571)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.access$200(DefaultPromise.java:37)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise$1.run(DefaultPromise.java:517)
	at org.apache.kudu.shaded.io.netty.util.concurrent.AbstractEventExecutor.runTask(AbstractEventExecutor.java:173)
	at org.apache.kudu.shaded.io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:166)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:569)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.17.253:37621
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:07:05.911 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
08:07:05.911 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#1) of source Source: KuduSource.
08:07:05.911 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to CANCELING.
08:07:05.912 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#1) of source Source: KuduSource.
08:07:05.912 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to CANCELING.
08:07:05.912 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
08:07:05.913 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to CANCELING.
08:07:05.913 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
08:07:05.915 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
08:07:05.915 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to CANCELING.
08:07:05.915 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
08:07:05.915 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
08:07:05.916 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
08:07:05.916 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CANCELING to CANCELED.
08:07:05.916 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
08:07:05.916 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CANCELING to CANCELED.
08:07:05.916 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#1 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
08:07:05.916 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#1 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
08:07:05.917 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#1 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
08:07:05.917 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CANCELING to CANCELED.
08:07:05.918 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:05.918 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:07:05.919 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:05.919 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:05.919 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.919 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.919 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.919 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.919 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.919 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.919 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CANCELING to CANCELED.
08:07:05.920 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.920 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.920 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.920 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:05.920 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 0d2ddb76420639a9ec06ca05e894cb50
08:07:05.937 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:05.938 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:05.938 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:05.938 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.938 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.938 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.939 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.939 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.939 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.939 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.939 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.939 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.939 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:05.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:05.961 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:05.961 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:05.962 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:05.962 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.963 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.963 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.963 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.964 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.964 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.964 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.964 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.964 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.964 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:05.977 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:05.978 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:05.978 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.978 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.978 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.979 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.979 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.979 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:05.979 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.979 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.980 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.980 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.980 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:05.997 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:05.998 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:05.998 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:05.998 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.998 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.998 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.998 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.998 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:05.998 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:05.999 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.999 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.999 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:05.999 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:06.058 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:06.058 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:06.058 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.059 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.059 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.059 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:06.059 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.059 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.059 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.059 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.059 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.060 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.060 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:06.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091626118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:06.127 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
08:07:06.128 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
08:07:06.157 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:06.158 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:06.158 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:06.158 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.158 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.158 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.158 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.158 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.158 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.159 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.159 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.159 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.159 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:06.163 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:06.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:07:06Z chronyd exiting
08:07:06.278 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:06.278 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:06.278 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:06.279 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.279 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.279 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.279 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.279 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.279 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.279 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.279 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.279 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.280 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:06.289 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:06.290 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.291 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.291 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.28.220.252:33543(127.28.220.252:33543) for tablet Kudu Master: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.310 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:06.311 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:06.312 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:06.312 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:06.312 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:06.312 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:06.312 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:06.312 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:06.313 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:06.313 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.313 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.313 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.314 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:06.329 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:06.330 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:06.331 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:06.331 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:06.331 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:06.331 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:06.331 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:06.331 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:06.331 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:06.331 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.331 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.331 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.331 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:06.350 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:06.350 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:06.350 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:06.351 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:06.351 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:06.351 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:06.351 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:06.351 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.351 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:06.351 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.351 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.351 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:06.351 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:06.370 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:06.370 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:06.370 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:06.371 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:06.371 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:06.371 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.371 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:06.371 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.371 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:06.371 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.371 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:06.371 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:06.371 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:06.410 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:06.411 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:06.411 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:06.411 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:06.411 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:06.411 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:06.411 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.411 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:06.411 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:06.411 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.411 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.411 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:06.411 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:06.457 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:06.472 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:06.473 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:06.473 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:06.473 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:06.473 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:06.473 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:06.473 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:06.473 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:06.473 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:06.473 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:06.474 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:06.474 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:06.474 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:06.477 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:06.477 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:06.477 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.477 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:06.477 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.478 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.478 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.478 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.478 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.478 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.478 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.478 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.478 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:06.490 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:06.490 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:06.490 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:06.490 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:06.490 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:06.490 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:06.490 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:06.490 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:06.490 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:06.490 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.490 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.491 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.491 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:06.523 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:06.523 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:06.523 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:06.523 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:06.523 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:06.523 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:06.523 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:06.523 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:06.524 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:06.524 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:06.524 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:06.524 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:06.524 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:06.550 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:06.550 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:06.551 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:06.551 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:06.551 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:06.551 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:06.551 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:06.551 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.551 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.551 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:06.551 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:06.551 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.551 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:06.552 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (0d2ddb76420639a9ec06ca05e894cb50) switched from state RESTARTING to RUNNING.
08:07:06.552 [INFO - flink-pekko.actor.default-dispatcher-6] (CheckpointCoordinator.java:1805) Restoring job 0d2ddb76420639a9ec06ca05e894cb50 from Checkpoint 69 @ 1779091595847 for 0d2ddb76420639a9ec06ca05e894cb50 located at file:/tmp/junit4405728108231754423/checkpoints/0d2ddb76420639a9ec06ca05e894cb50/chk-69.
08:07:06.553 [INFO - flink-pekko.actor.default-dispatcher-6] (MasterHooks.java:201) No master state to restore
08:07:06.553 [INFO - flink-pekko.actor.default-dispatcher-6] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
08:07:06.554 [INFO - Thread-33] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
08:07:06.554 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to SCHEDULED.
08:07:06.554 [DEBUG - Thread-33] (Connection.java:575) [peer master-127.27.17.253:37621(127.27.17.253:37621)] disconnecting while in state TERMINATED
08:07:06.554 [DEBUG - Thread-33] (Connection.java:575) [peer master-127.27.17.252:43595(127.27.17.252:43595)] disconnecting while in state TERMINATED
08:07:06.554 [DEBUG - Thread-33] (Connection.java:575) [peer master-127.27.17.254:45447(127.27.17.254:45447)] disconnecting while in state TERMINATED
08:07:06.554 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:06.555 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:07:06.555 [INFO - Thread-33] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
08:07:06.556 [INFO - Thread-33] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
08:07:06.556 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from SCHEDULED to DEPLOYING.
08:07:06.556 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #2) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id 562b84b71b659c92bf587d4c4d45167a
08:07:06.556 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to SCHEDULED.
08:07:06.556 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 562b84b71b659c92bf587d4c4d45167a.
08:07:06.557 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:07:06.557 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from SCHEDULED to DEPLOYING.
08:07:06.557 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #2) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id 23d75c1cae20f6d786d6e473edbc6825
08:07:06.557 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to SCHEDULED.
08:07:06.558 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:07:06.558 [DEBUG - Thread-33] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:06.558 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from SCHEDULED to DEPLOYING.
08:07:06.558 [INFO - Thread-33] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
08:07:06.559 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #2) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id 51ba13794eaa695dfcc17a66fc9521a4
08:07:06.559 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to SCHEDULED.
08:07:06.559 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:07:06.559 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from SCHEDULED to DEPLOYING.
08:07:06.560 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #2) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id e7235da53f93c0af3219c2857bfb1cae
08:07:06.560 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_2), deploy into slot with allocation id 562b84b71b659c92bf587d4c4d45167a.
08:07:06.560 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:07:06.560 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:07:06.560 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:07:06.560 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:07:06.560 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 23d75c1cae20f6d786d6e473edbc6825.
08:07:06.561 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to DEPLOYING.
08:07:06.561 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_2) [DEPLOYING].
08:07:06.562 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@11f7fb44
08:07:06.562 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_2), deploy into slot with allocation id 23d75c1cae20f6d786d6e473edbc6825.
08:07:06.562 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:07:06.562 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:07:06.562 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
08:07:06.562 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
08:07:06.564 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@106362b9
08:07:06.566 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:06.569 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to DEPLOYING.
08:07:06.569 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 51ba13794eaa695dfcc17a66fc9521a4.
08:07:06.569 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_2) [DEPLOYING].
08:07:06.570 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:06.570 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@35b89dda
08:07:06.570 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:07:06.570 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_2), deploy into slot with allocation id 51ba13794eaa695dfcc17a66fc9521a4.
08:07:06.570 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:07:06.571 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
08:07:06.571 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
08:07:06.571 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.571 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:06.571 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot e7235da53f93c0af3219c2857bfb1cae.
08:07:06.571 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.572 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to DEPLOYING.
08:07:06.572 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_2) [DEPLOYING].
08:07:06.572 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_2), deploy into slot with allocation id e7235da53f93c0af3219c2857bfb1cae.
08:07:06.572 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.573 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.573 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.573 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5a674f61
08:07:06.573 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:07:06.573 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.573 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.573 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:07:06.573 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.574 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
08:07:06.574 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:06.574 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
08:07:06.574 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.574 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4bcf525f
08:07:06.574 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.574 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.574 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.574 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.575 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.575 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.575 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.575 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.575 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.575 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:06.576 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:06.576 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@64c19232
08:07:06.578 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.578 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.578 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.578 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.578 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:06.579 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.579 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.580 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to DEPLOYING.
08:07:06.580 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_2) [DEPLOYING].
08:07:06.580 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@431af415
08:07:06.580 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:07:06.581 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:07:06.581 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
08:07:06.581 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
08:07:06.582 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.582 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.582 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.582 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.582 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.583 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.583 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.583 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.583 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4ea348a1
08:07:06.585 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:06.585 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.586 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.586 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.586 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.586 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.586 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.586 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.586 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.587 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.587 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.587 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.587 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.587 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.588 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.588 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.588 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.588 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.588 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.588 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.588 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.588 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.589 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.589 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.589 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.589 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.589 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.590 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.590 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:06.590 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.590 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.590 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:06.590 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.590 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.591 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.591 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:06.591 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.592 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.592 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.592 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.592 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.592 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.592 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.592 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.592 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.592 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.592 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.592 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.592 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:06.593 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.593 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.593 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.593 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.593 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.593 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.593 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.600 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.600 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.600 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.600 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.601 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.601 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.601 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.601 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.601 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.601 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.601 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.601 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.601 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.601 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.601 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.602 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.602 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.602 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.602 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.602 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.602 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.602 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.602 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.602 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.602 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.602 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.607 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.608 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.608 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.608 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.608 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.608 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.609 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.609 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.609 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.609 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.609 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.609 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.609 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.609 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:06.610 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:06.610 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.610 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.610 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:06.610 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.611 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.611 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.611 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.611 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.611 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.611 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.611 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.611 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:06.611 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.612 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.612 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.612 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.612 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.612 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.612 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.612 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.612 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.612 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.612 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.612 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091626618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:06.619 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.620 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.620 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.620 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.621 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.621 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.621 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.621 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.621 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.621 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.622 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.622 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.622 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.623 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.624 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.624 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.624 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.624 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.624 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.624 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.624 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.625 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.625 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.625 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.625 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.625 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.628 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.628 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
08:07:06.628 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.629 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.629 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.629 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.630 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
08:07:06.630 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:06.630 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:06.630 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.631 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:06.631 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.631 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.631 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.631 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.631 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.631 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.631 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.631 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.631 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.631 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:06.632 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.632 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.632 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.632 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.632 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.632 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.632 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.632 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.632 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.632 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.632 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.632 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.632 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.632 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.632 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.632 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.633 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.633 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.633 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.633 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.639 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.640 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.640 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.640 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.640 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.640 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.640 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.640 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.640 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.640 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.640 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.640 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.640 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.640 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.640 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.641 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.641 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.641 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.641 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.640 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.641 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.641 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.641 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.641 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.641 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.641 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.648 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.648 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.648 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.648 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.648 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.648 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.648 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.648 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.648 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.648 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.648 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.649 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.649 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.650 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:06.650 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:06.650 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.650 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:06.650 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.650 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.651 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.651 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.651 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.651 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.651 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.651 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.651 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:06.651 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.651 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.652 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.652 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.652 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.652 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.652 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.652 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.652 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.652 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.652 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.652 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.652 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.659 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.659 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.660 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.660 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.660 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.660 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.660 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.660 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.660 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.660 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.660 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.660 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.660 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.660 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.660 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.660 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.660 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.660 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.660 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.661 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.661 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.661 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.661 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.661 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.661 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.661 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.663 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:06.667 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.667 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.668 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.668 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.668 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.668 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.668 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.668 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.668 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.668 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.668 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.668 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.668 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.670 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:06.670 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:06.670 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:06.670 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.670 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.670 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.670 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.670 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.670 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.670 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.670 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.670 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.670 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:06.679 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.679 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.679 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.680 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.680 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.680 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.680 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.680 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.680 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.680 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.680 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.680 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.680 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.680 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.680 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.680 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.680 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.680 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.681 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.681 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.681 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.681 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.681 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.681 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.681 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.681 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.687 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.687 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.687 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.688 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.688 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.688 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.688 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.688 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.688 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.688 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.688 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.688 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.688 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.691 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.691 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.692 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.692 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.692 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.692 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.692 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.692 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.692 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.692 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.692 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.692 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.692 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.708 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.708 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.708 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.709 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.709 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.709 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.709 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.709 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.709 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.709 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.709 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.709 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.709 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.719 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.719 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.720 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.720 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.720 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.720 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.720 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.720 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.720 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.720 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.720 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.720 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.720 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.720 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.720 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.720 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.720 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.721 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.721 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.721 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.721 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.721 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.721 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.721 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.721 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.721 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.730 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:06.730 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:06.730 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:06.730 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.730 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.730 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.730 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.730 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.730 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.730 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.731 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.731 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.731 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:06.752 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.752 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.752 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.752 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.752 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.752 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.752 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.752 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.753 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.753 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.753 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.753 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.753 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.760 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.760 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.760 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.760 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.760 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.760 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.760 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.760 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.760 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.761 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.761 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.761 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.761 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.792 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.792 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.793 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.793 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.793 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.793 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.793 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.793 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.793 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.793 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.793 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.793 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.793 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.807 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.808 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.808 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.808 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.808 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.808 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.808 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.808 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.808 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.808 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.808 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.808 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.808 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.809 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:06.809 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:06.810 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:06.810 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:06.810 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:06.810 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:06.810 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:06.810 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:06.810 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.810 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:06.810 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.810 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:06.810 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:06.811 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.811 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.811 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.812 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.812 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.812 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.812 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.812 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.812 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.812 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.812 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.812 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.812 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.820 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.820 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.820 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.820 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.820 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.820 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.820 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.820 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.821 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.821 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.821 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.821 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.821 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.827 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.827 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.827 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.828 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.828 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.828 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.828 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.828 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.828 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.828 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.828 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.828 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.828 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.830 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:06.830 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:06.830 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:06.830 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.830 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.830 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.831 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.831 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.831 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.831 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.831 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.831 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.831 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:06.910 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:06.911 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:06.911 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:06.911 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.911 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.911 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.911 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.911 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.911 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.911 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:06.911 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:06.911 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:06.911 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:06.919 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.920 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.920 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.920 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.920 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.920 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.920 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.920 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.920 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.920 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.920 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.921 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.921 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:06.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:06.959 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:06.960 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:06.960 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:06.960 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.960 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.960 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.960 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.960 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.960 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.960 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:06.960 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:06.960 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:06.960 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:07.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:07.017 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:07.018 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:07.018 [DEBUG - pool-159-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:07.018 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.018 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.018 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.018 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.018 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.018 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.019 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.019 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.019 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.019 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:07.019 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29630), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [49ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [103ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [105ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [105ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [157ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [165ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [174ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [174ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [245ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [247ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [259ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [262ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [262ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [281ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [282ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [283ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [283ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [301ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [303ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [323ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [362ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [363ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [364ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [364ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [402ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [403ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [403ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [403ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [443ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [444ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [444ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [444ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [862ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [862ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [863ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [863ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1480ms] refreshing cache from master, [1480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1482ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1482ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1483ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1483ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2741ms] refreshing cache from master, [2741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2743ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2744ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2745ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2746ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2746ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [6420ms] refreshing cache from master, [6420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [6421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [6421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [6422ms] too many traces: truncated at 100 traces, deferred=Deferred@2004579066(state=PENDING, result=null, callback=(continuation of Deferred@30832021 after retry RPC after error@806858654) -> (continuation of Deferred@1733489105 after retry RPC after error@1267905379) -> (continuation of Deferred@2035948889 after retry RPC after error@1958491827) -> (continuation of Deferred@76586380 after retry RPC after error@1514614742) -> (continuation of Deferred@1943945490 after retry RPC after error@1715660916) -> (continuation of Deferred@1715369421 after retry RPC after error@90492739) -> (continuation of Deferred@70506540 after retry RPC after error@1975751062) -> (continuation of Deferred@1615201022 after retry RPC after error@1140578146) -> (continuation of Deferred@1502844297 after retry RPC after error@808837132) -> (continuation of Deferred@1622426886 after retry RPC after error@2104090293) -> (continuation of Deferred@940782412 after retry RPC after error@666468802) -> (continuation of Deferred@1701280838 after retry RPC after error@1455983145) -> (continuation of Deferred@2011187951 after retry RPC after error@473719360) -> (continuation of Deferred@1114089677 after retry RPC after error@1349315434) -> (continuation of Deferred@632186042 after retry RPC after error@1518283821) -> (continuation of Deferred@631363183 after retry RPC after error@312565258) -> (continuation of Deferred@1149002576 after retry RPC after error@1732325814) -> (continuation of Deferred@1282965919 after retry RPC after error@1412552468) -> (continuation of Deferred@1945131041 after retry RPC after error@491916136) -> (continuation of Deferred@363730212 after retry RPC after error@1342040562) -> (continuation of Deferred@1052610940 after retry RPC after error@867812488) -> (continuation of Deferred@1457250542 after retry RPC after error@1984508350), errback=(continuation of Deferred@30832021 after retry RPC after error@806858654) -> (continuation of Deferred@1733489105 after retry RPC after error@1267905379) -> (continuation of Deferred@2035948889 after retry RPC after error@1958491827) -> (continuation of Deferred@76586380 after retry RPC after error@1514614742) -> (continuation of Deferred@1943945490 after retry RPC after error@1715660916) -> (continuation of Deferred@1715369421 after retry RPC after error@90492739) -> (continuation of Deferred@70506540 after retry RPC after error@1975751062) -> (continuation of Deferred@1615201022 after retry RPC after error@1140578146) -> (continuation of Deferred@1502844297 after retry RPC after error@808837132) -> (continuation of Deferred@1622426886 after retry RPC after error@2104090293) -> (continuation of Deferred@940782412 after retry RPC after error@666468802) -> (continuation of Deferred@1701280838 after retry RPC after error@1455983145) -> (continuation of Deferred@2011187951 after retry RPC after error@473719360) -> (continuation of Deferred@1114089677 after retry RPC after error@1349315434) -> (continuation of Deferred@632186042 after retry RPC after error@1518283821) -> (continuation of Deferred@631363183 after retry RPC after error@312565258) -> (continuation of Deferred@1149002576 after retry RPC after error@1732325814) -> (continuation of Deferred@1282965919 after retry RPC after error@1412552468) -> (continuation of Deferred@1945131041 after retry RPC after error@491916136) -> (continuation of Deferred@363730212 after retry RPC after error@1342040562) -> (continuation of Deferred@1052610940 after retry RPC after error@867812488) -> (continuation of Deferred@1457250542 after retry RPC after error@1984508350)))
08:07:07.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091627118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:07.127 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
08:07:07.127 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
08:07:07.155 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:07.156 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:07.156 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:07.156 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:07.157 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:07.157 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:07.157 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:07.157 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:07.157 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:07.157 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:07.157 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:07.157 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:07.157 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:07.162 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:07.170 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:07.170 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:07.170 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:07.170 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:07.170 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:07.171 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:07.171 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:07.171 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:07.171 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:07.171 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:07.171 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:07.171 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:07.171 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:07.179 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:07.180 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:07.180 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:07.180 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.180 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.180 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.180 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.180 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.180 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.180 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.180 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.180 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.180 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:07.231 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:07.232 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:07.232 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:07.232 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.232 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.232 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.232 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.232 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.232 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.232 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.232 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.233 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.233 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:07.267 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:07.268 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:07.268 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:07.268 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.268 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.269 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.269 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.269 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.269 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.269 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.269 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.269 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.269 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:07.321 [ERROR - main] (RetryRule.java:206) org.apache.kudu.replication.TestReplicationTableInitializer.testHashAndRangePartitioning: failed attempt 1
org.apache.kudu.shaded.org.apache.commons.logging.LogConfigurationException: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl (Caused by java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1158)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory$2.run(LogFactory.java:960)
	at java.base/java.security.AccessController.doPrivileged(AccessController.java:318)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.newFactory(LogFactory.java:957)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getFactory(LogFactory.java:624)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getLog(LogFactory.java:655)
	at org.apache.kudu.shaded.org.apache.http.conn.ssl.DefaultHostnameVerifier.<init>(DefaultHostnameVerifier.java:82)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClientBuilder.build(HttpClientBuilder.java:970)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClients.createDefault(HttpClients.java:56)
	at org.apache.kudu.test.junit.ResultReporter.reportResult(ResultReporter.java:207)
	at org.apache.kudu.test.junit.ResultReporter.tryReportResult(ResultReporter.java:244)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.report(RetryRule.java:165)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:216)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
Caused by: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1020)
	... 42 more
08:07:07.331 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:07.331 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:07.331 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:07.331 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:07.331 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:07.331 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:07.332 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:07.332 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:07.332 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:07.332 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:07.332 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:07.332 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:07.332 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:07.361 [ERROR - main] (RetryRule.java:253) org.apache.kudu.replication.TestReplicationTableInitializer.testHashAndRangePartitioning: giving up after 1 attempts
E.08:07:07.362 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779091627361
08:07:07.362 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779091627362
08:07:07.366 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
08:07:07.370 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
08:07:07.371 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
08:07:07.371 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskk4_r_T/test-tmp
08:07:07.372 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
08:07:07.372 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskk4_r_T/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
08:07:07.375 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

08:07:07.406 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:07.407 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:07.407 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:07.407 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.407 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.408 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.408 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.408 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.408 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.408 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.408 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.408 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.408 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:07.409 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29953), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [20ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [25ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [29ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [29ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [179ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [185ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [190ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [190ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [235ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [238ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [246ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [247ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [248ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [248ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [262ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [262ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [262ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [263ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [281ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [281ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [282ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [282ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [303ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [303ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [317ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [343ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [343ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [421ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [422ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [422ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [422ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [660ms] refreshing cache from master, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [662ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [663ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [663ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [663ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [981ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [983ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [983ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [984ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [984ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1680ms] refreshing cache from master, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1683ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1683ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1683ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [3560ms] refreshing cache from master, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [3562ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [3562ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3563ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [3563ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [7260ms] refreshing cache from master, [7260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [7261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [7261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [7262ms] too many traces: truncated at 100 traces, deferred=Deferred@556093058(state=PENDING, result=null, callback=(continuation of Deferred@1579037783 after retry RPC after error@314746815) -> (continuation of Deferred@890013616 after retry RPC after error@1054252749) -> (continuation of Deferred@298166732 after retry RPC after error@373103380) -> (continuation of Deferred@1205682020 after retry RPC after error@1299702180) -> (continuation of Deferred@1900067343 after retry RPC after error@266070664) -> (continuation of Deferred@559141384 after retry RPC after error@1398504775) -> (continuation of Deferred@666842593 after retry RPC after error@2011169844) -> (continuation of Deferred@1209817938 after retry RPC after error@1084597843) -> (continuation of Deferred@518751131 after retry RPC after error@1767761366) -> (continuation of Deferred@1127343460 after retry RPC after error@785077359) -> (continuation of Deferred@1820257654 after retry RPC after error@1787549306) -> (continuation of Deferred@652018826 after retry RPC after error@1380008978) -> (continuation of Deferred@1229919857 after retry RPC after error@2101555492) -> (continuation of Deferred@863273810 after retry RPC after error@1808609530) -> (continuation of Deferred@1518358380 after retry RPC after error@1051631369) -> (continuation of Deferred@693630365 after retry RPC after error@731863725) -> (continuation of Deferred@1933351837 after retry RPC after error@966788132) -> (continuation of Deferred@802022800 after retry RPC after error@2127988982) -> (continuation of Deferred@1763771586 after retry RPC after error@1352252646) -> (continuation of Deferred@280502784 after retry RPC after error@1516472793) -> (continuation of Deferred@998609219 after retry RPC after error@652637273) -> (continuation of Deferred@2006968999 after retry RPC after error@838109388) -> (continuation of Deferred@644614200 after retry RPC after error@868082704) -> (continuation of Deferred@1006631442 after retry RPC after error@785954633) -> (continuation of Deferred@1748195170 after retry RPC after error@879932176), errback=(continuation of Deferred@1579037783 after retry RPC after error@314746815) -> (continuation of Deferred@890013616 after retry RPC after error@1054252749) -> (continuation of Deferred@298166732 after retry RPC after error@373103380) -> (continuation of Deferred@1205682020 after retry RPC after error@1299702180) -> (continuation of Deferred@1900067343 after retry RPC after error@266070664) -> (continuation of Deferred@559141384 after retry RPC after error@1398504775) -> (continuation of Deferred@666842593 after retry RPC after error@2011169844) -> (continuation of Deferred@1209817938 after retry RPC after error@1084597843) -> (continuation of Deferred@518751131 after retry RPC after error@1767761366) -> (continuation of Deferred@1127343460 after retry RPC after error@785077359) -> (continuation of Deferred@1820257654 after retry RPC after error@1787549306) -> (continuation of Deferred@652018826 after retry RPC after error@1380008978) -> (continuation of Deferred@1229919857 after retry RPC after error@2101555492) -> (continuation of Deferred@863273810 after retry RPC after error@1808609530) -> (continuation of Deferred@1518358380 after retry RPC after error@1051631369) -> (continuation of Deferred@693630365 after retry RPC after error@731863725) -> (continuation of Deferred@1933351837 after retry RPC after error@966788132) -> (continuation of Deferred@802022800 after retry RPC after error@2127988982) -> (continuation of Deferred@1763771586 after retry RPC after error@1352252646) -> (continuation of Deferred@280502784 after retry RPC after error@1516472793) -> (continuation of Deferred@998609219 after retry RPC after error@652637273) -> (continuation of Deferred@2006968999 after retry RPC after error@838109388) -> (continuation of Deferred@644614200 after retry RPC after error@868082704) -> (continuation of Deferred@1006631442 after retry RPC after error@785954633) -> (continuation of Deferred@1748195170 after retry RPC after error@879932176)))
08:07:07.456 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:07.460 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:07.460 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:07.460 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:07.461 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.461 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.461 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.461 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.461 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.461 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.461 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.461 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.461 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.461 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:07.480 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:07.480 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:07.480 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:07.481 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.481 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.481 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.481 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.481 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.481 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.481 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.481 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.481 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.481 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:07.510 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:07.511 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:07.511 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:07.511 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:07.511 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:07.511 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:07.511 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:07.511 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:07.512 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:07.512 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:07.512 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:07.512 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:07.512 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:07.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:07.523 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:07.523 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:07.523 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:07.523 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:07.523 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:07.523 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:07.523 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:07.523 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:07.524 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:07.524 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:07.524 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:07.524 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:07.524 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:07.590 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:07.590 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:07.591 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:07.591 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:07.591 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:07.591 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:07.591 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:07.591 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:07.591 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:07.592 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:07.592 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:07.592 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:07.592 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:07.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091627618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:07.630 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:07:07.631 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
08:07:07.662 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:07.716 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:07.716 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:07.717 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:07.717 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:07.717 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:07.717 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:07.717 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:07.717 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:07.717 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:07.717 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:07.717 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:07.717 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:07.717 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:07.720 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:07.720 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:07.720 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:07.721 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.721 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.721 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.721 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.721 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.721 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.721 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.721 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.721 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.721 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:07.788 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:07.789 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:07.789 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:07.789 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.789 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.789 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.789 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.789 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:07.789 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:07.789 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.790 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:07:07.790 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.790 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

08:07:07.790 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:07.790 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:07.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:07.794649 31931 mini_oidc.cc:150] Starting JWKS server
08:07:07.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:07.799242 31931 webserver.cc:533] Webserver started at http://127.0.0.1:34537/ using document root <none> and password file <none>
08:07:07.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:07.799851 31931 mini_oidc.cc:186] Starting OIDC Discovery server
08:07:07.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:07.802194 31931 webserver.cc:533] Webserver started at http://127.0.0.1:32921/ using document root <none> and password file <none>
08:07:07.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:07:07Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
08:07:07.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:07:07Z Disabled control of system clock
08:07:07.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:07.883381 31931 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-0/wal
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-0/data
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-0/logs
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-0/data/info.pb
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.46.254:45015
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.46.254
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.46.212:33327
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:07:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34537/jwks.json with env {}
08:07:07.886 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:07.887 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:07.887 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:07.887 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:07.887 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:07.887 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:07.887 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:07.887 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:07.887 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:07.887 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:07.887 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:07.888 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:07.888 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:07.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:08.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:08.051 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:08.052 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:08.052 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:08.052 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:08.052 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:08.052 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:08.052 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:08.052 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:08.052 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:08.052 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:08.052 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:08.052 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:08.053 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:08.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091628118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:08.128 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
08:07:08.129 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
08:07:08.162 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:08.190 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:08.191 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:08.191 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:08.191 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:08.191 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:08.191 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:08.191 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:08.191 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:08.191 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:08.192 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:08.192 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:08.192 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:08.192 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:08.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:08.253659 31943 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:07:08.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:08.254571 31943 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:07:08.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:08.255223 31943 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:07:08.259 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:08.259 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:08.260 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:08.260 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:08.260 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:08.260 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:08.260 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:08.260 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:08.260 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:08.261 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:08.261 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:08.261 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:08.261 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:08.261 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:08.261 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:08.261 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:08.261 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:08.261 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:08.261 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:08.261 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:08.261 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:08.261 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:08.261 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:08.261 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:08.261 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:08.261 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:08.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:08.295358 31943 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:07:08.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:08.295835 31943 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:07:08.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:08.296216 31943 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:07:08.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:08.296536 31943 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:07:08.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:08.296861 31943 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:07:08.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:08.297122 31943 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34537/jwks.json
08:07:08.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:08.352180 31943 master_runner.cc:387] Master server non-default flags:
08:07:08.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:08.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.46.212:33327
08:07:08.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:08.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:08.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-0/data
08:07:08.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-0/wal
08:07:08.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:07:08.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.46.254:45015
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34537/jwks.json
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-0/data/info.pb
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.46.254
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-0/logs
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:07:08.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:07:08.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:07:08.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:07:08.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:08.354341 31943 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:07:08.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:08.356388 31943 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:07:08.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:08.369267 31950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:08.457 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:08.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:08.540 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:08.541 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:08.541 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:08.542 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:08.542 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:08.542 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:08.543 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:08.543 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:08.543 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:08.543 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:08.543 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:08.544 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:08.544 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:08.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091628618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:08.639 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
08:07:08.642 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
08:07:08.663 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:08.890 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:08.890 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:08.891 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:08.892 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:08.892 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:08.892 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:08.893 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:08.893 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:08.893 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:08.894 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:08.894 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:08.894 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:08.894 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:08.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:09.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:09.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091629118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:09.120 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:09.121 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:09.121 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:09.122 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:09.122 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:09.122 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:09.123 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:09.123 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:09.123 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:09.123 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:09.123 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:09.124 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:09.124 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:09.140 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=21 ms, finalizationTime=1 ms).
08:07:09.143 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
08:07:09.163 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:09.210 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:09.211 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:09.211 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:09.212 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:09.212 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:09.212 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:09.212 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:09.212 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:09.213 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:09.213 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:09.214 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:09.214 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:09.214 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:09.373 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:09.373 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:09.374 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:09.375 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:09.375 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:09.375 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:09.375 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:09.375 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:09.375 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:09.376 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:09.376 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:09.376 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:09.376 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:09.428 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:09.429 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:09.429 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:09.430 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:09.430 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:09.430 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:09.431 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:09.431 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:09.431 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:09.432 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:09.432 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:09.432 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:09.432 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:09.457 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:09.468 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:09.470 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:09.470 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:09.471 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:09.471 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:09.472 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:09.472 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:09.472 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:09.472 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:09.473 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:09.474 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:09.474 [INFO - pool-248-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:09.474 [WARN - pool-248-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:09.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:09.552 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:09.552 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:09.553 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:09.554 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:09.554 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:09.554 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:09.555 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:09.555 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:09.555 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:09.555 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:09.555 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:09.555 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:09.555 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:09.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091629618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:09.636 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=16 ms, finalizationTime=2 ms).
08:07:09.640 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
08:07:09.663 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:09.783 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:09.783 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:09.784 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:09.785 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:09.785 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:09.785 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:09.786 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:09.786 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:09.786 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:09.786 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:09.786 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:09.786 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:09.786 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:09.832 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:09.832 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:09.833 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:09.834 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:09.834 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:09.834 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:09.835 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:09.835 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:09.835 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:09.836 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:09.836 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:09.836 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:09.836 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:09.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:10.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:10.112 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:10.112 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:10.112 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:10.113 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:10.120 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:10.121 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:10.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091630118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:10.118 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:10.121 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:10.122 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:10.114 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:10.122 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:10.122 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:10.122 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:10.194 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:10.199 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=80 ms, finalizationTime=1 ms).
08:07:10.202 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
08:07:10.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:09.776415 31949 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 31943
08:07:10.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:08.371439 31951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:10.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:10.227273 31943 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.855s	user 0.700s	sys 1.149s
08:07:10.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:10.227946 31943 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.857s	user 0.700s	sys 1.149s
08:07:10.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:10.229938 31953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:10.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:10.232826 31952 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1855 milliseconds
08:07:10.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.232910 31943 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:07:10.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.234580 31943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:07:10.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.237923 31943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:07:10.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.239291 31943 hybrid_clock.cc:648] HybridClock initialized: now 1779091630239255 us; error 44 us; skew 500 ppm
08:07:10.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.240279 31943 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:07:10.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.247850 31943 webserver.cc:533] Webserver started at http://127.31.46.254:33565/ using document root <none> and password file <none>
08:07:10.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.248965 31943 fs_manager.cc:362] Metadata directory not provided
08:07:10.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.249238 31943 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:07:10.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.249692 31943 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:07:10.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.254946 31943 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-0/data/instance:
08:07:10.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "505fcead7e1940138e8beb97afc6f217"
08:07:10.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:10 on dist-test-slave-1jss"
08:07:10.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.256246 31943 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-0/wal/instance:
08:07:10.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "505fcead7e1940138e8beb97afc6f217"
08:07:10.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:10 on dist-test-slave-1jss"
08:07:10.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.264847 31943 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.003s
08:07:10.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.271780 31960 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:07:10.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.273052 31943 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
08:07:10.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.273401 31943 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-0/wal
08:07:10.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "505fcead7e1940138e8beb97afc6f217"
08:07:10.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:10 on dist-test-slave-1jss"
08:07:10.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.273739 31943 fs_report.cc:389] FS layout report
08:07:10.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:07:10.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-0/wal
08:07:10.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-0/wal
08:07:10.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-0/data/data
08:07:10.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:07:10.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:07:10.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:07:10.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:07:10.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:07:10.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:07:10.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:07:10.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:07:10.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:07:10.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:07:10.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:07:10.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.348974 31943 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:07:10.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.350927 31943 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:07:10.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.351467 31943 kserver.cc:163] Server-wide thread pool size limit: 3276
08:07:10.407 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:10.407 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:10.408 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:10.408 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:10.408 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:10.408 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:10.408 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:10.409 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:10.409 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:10.409 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:10.409 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:10.410 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:10.410 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:10.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.446317 31943 rpc_server.cc:307] RPC server started. Bound to: 127.31.46.254:45015
08:07:10.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.446413 32011 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.46.254:45015 every 8 connection(s)
08:07:10.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.449927 31943 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-0/data/info.pb
08:07:10.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.451367 31931 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 31943
08:07:10.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.451860 31931 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-0/wal/instance
08:07:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.456979 31931 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:07:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:07:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-1/wal
08:07:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-1/data
08:07:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:07:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:07:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:07:10.457 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-1/logs
08:07:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-1/data/info.pb
08:07:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:07:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:07:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:07:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:07:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:07:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:07:10.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:07:10.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:07:10.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.46.253:46697
08:07:10.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.46.253
08:07:10.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:10.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.46.212:33327
08:07:10.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:10.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:10.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:10.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:07:10.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541
08:07:10.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:07:10.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34537/jwks.json with env {}
08:07:10.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.458825 32012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:10.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.472098 32012 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.46.254" port: 45015 } has no permanent_uuid. Determining permanent_uuid...
08:07:10.475 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:10.476 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:10.476 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:10.476 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:10.477 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:10.477 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:10.477 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:10.477 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:10.477 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:10.478 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:10.478 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:10.478 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:10.478 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:10.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.503861 32012 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } has no permanent_uuid. Determining permanent_uuid...
08:07:10.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:10.506860 31963 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.46.253:46697: connect: Connection refused (error 111)
08:07:10.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:10.512336 32012 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.46.253:46697: Network error: Client connection negotiation failed: client connection to 127.31.46.253:46697: connect: Connection refused (error 111)
08:07:10.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:10.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.562063 32012 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } attempt: 1
08:07:10.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:10.567257 32012 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.46.253:46697: Network error: Client connection negotiation failed: client connection to 127.31.46.253:46697: connect: Connection refused (error 111)
08:07:10.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091630618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:10.628 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
08:07:10.630 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
08:07:10.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.635846 32012 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } attempt: 2
08:07:10.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:10.640555 32012 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.46.253:46697: Network error: Client connection negotiation failed: client connection to 127.31.46.253:46697: connect: Connection refused (error 111)
08:07:10.663 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:10.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.732093 32012 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } attempt: 3
08:07:10.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:10.737057 32012 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.46.253:46697: Network error: Client connection negotiation failed: client connection to 127.31.46.253:46697: connect: Connection refused (error 111)
08:07:10.764 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:10.764 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:10.764 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:10.764 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:10.764 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:10.764 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:10.765 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:10.765 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:10.765 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:10.765 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:10.765 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:10.765 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:10.765 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:10.770 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:10.770 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:10.770 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:10.770 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:10.771 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:10.771 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:10.771 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:10.771 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:10.771 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:10.771 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:10.771 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:10.771 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:10.772 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:10.779 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:10.780 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:10.780 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:10.780 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:10.780 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:10.780 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:10.780 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:10.780 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:10.780 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:10.780 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:10.780 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:10.780 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:10.780 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:10.792 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:10.792 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:10.793 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:10.793 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:10.793 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:10.793 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:10.793 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:10.793 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:10.793 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:10.793 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:10.793 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:10.793 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:10.793 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:10.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:10.844221 32014 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:07:10.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:10.844936 32014 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:07:10.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:10.845556 32014 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:07:10.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.880573 32012 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } attempt: 4
08:07:10.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:10.885058 32014 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:07:10.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:10.885474 32014 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:07:10.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:10.885357 32012 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.46.253:46697: Network error: Client connection negotiation failed: client connection to 127.31.46.253:46697: connect: Connection refused (error 111)
08:07:10.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:10.885854 32014 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:07:10.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:10.886242 32014 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:07:10.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:10.886597 32014 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:07:10.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:10.886857 32014 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34537/jwks.json
08:07:10.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.940873 32014 master_runner.cc:387] Master server non-default flags:
08:07:10.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:10.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.46.212:33327
08:07:10.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:10.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:10.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-1/data
08:07:10.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-1/wal
08:07:10.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:07:10.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541
08:07:10.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:10.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:10.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:07:10.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.46.253:46697
08:07:10.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:07:10.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:07:10.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:07:10.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34537/jwks.json
08:07:10.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:10.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:10.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-1/data/info.pb
08:07:10.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.46.253
08:07:10.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:10.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:07:10.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:10.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:07:10.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:07:10.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:10.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-1/logs
08:07:10.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:10.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:07:10.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:07:10.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:07:10.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:07:10.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:07:10.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:07:10.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:07:10.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:07:10.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:07:10.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.943022 32014 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:07:10.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:10.945080 32014 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:07:10.956 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:10.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:10.959501 32023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:11.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:11.100 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:11.101 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:11.101 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:11.102 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:11.102 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:11.102 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:11.102 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:11.102 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:11.102 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:11.103 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:11.103 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:11.103 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:11.103 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:11.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091631118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:11.131 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
08:07:11.133 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
08:07:11.162 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:11.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:11.184868 32012 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } attempt: 5
08:07:11.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:11.192854 32012 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.46.253:46697: Network error: Client connection negotiation failed: client connection to 127.31.46.253:46697: connect: Connection refused (error 111)
08:07:11.243 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:11.244 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:11.244 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:11.245 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:11.245 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:11.245 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:11.245 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:11.245 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:11.245 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:11.245 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:11.246 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:11.246 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:11.246 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:11.457 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:11.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:11.568 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:11.568 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:11.569 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:11.570 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:11.570 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:11.570 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:11.570 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:11.570 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:11.570 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:11.570 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:11.570 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:11.570 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:11.571 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:11.620 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091631618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:11.632 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=12 ms, finalizationTime=2 ms).
08:07:11.638 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
08:07:11.643 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:11.644 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:11.644 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:11.644 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:11.644 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:11.644 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:11.644 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:11.644 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:11.645 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:11.645 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:11.645 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:11.645 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:11.645 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:11.662 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:11.671 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:11.672 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:11.672 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:11.672 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:11.672 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:11.672 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:11.672 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:11.673 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:11.673 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:11.673 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:11.673 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:11.673 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:11.673 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:11.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:11.740505 32012 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } attempt: 6
08:07:11.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:11.753242 32012 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.46.253:46697: Network error: Client connection negotiation failed: client connection to 127.31.46.253:46697: connect: Connection refused (error 111)
08:07:11.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:12.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:12.047 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:12.048 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:12.048 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:12.048 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:12.048 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:12.048 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:12.049 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:12.049 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:12.049 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:12.049 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:12.049 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:12.049 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:12.049 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:12.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091632118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:12.127 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
08:07:12.129 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
08:07:12.163 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:12.270 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:12.270 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:12.270 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:12.271 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:12.271 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:12.271 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:12.271 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:12.271 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:12.271 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:12.271 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:12.271 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:12.271 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:12.271 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:12.272 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:12.272 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:12.272 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:12.273 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:12.273 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:12.273 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:12.273 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:12.273 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:12.273 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:12.273 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:12.273 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:12.274 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:12.274 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:12.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:10.960711 32024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:12.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:12.280719 32026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:12.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:12.283605 32025 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1316 milliseconds
08:07:12.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.283756 32014 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:07:12.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.285329 32014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:07:12.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.288854 32014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:07:12.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.290252 32014 hybrid_clock.cc:648] HybridClock initialized: now 1779091632290206 us; error 48 us; skew 500 ppm
08:07:12.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.291330 32014 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:07:12.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.298671 32014 webserver.cc:533] Webserver started at http://127.31.46.253:41639/ using document root <none> and password file <none>
08:07:12.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.299953 32014 fs_manager.cc:362] Metadata directory not provided
08:07:12.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.300235 32014 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:07:12.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.300851 32014 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:07:12.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.306403 32014 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-1/data/instance:
08:07:12.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1e0e9e75b93c479c9f616620b4833075"
08:07:12.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:12 on dist-test-slave-1jss"
08:07:12.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.307871 32014 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-1/wal/instance:
08:07:12.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1e0e9e75b93c479c9f616620b4833075"
08:07:12.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:12 on dist-test-slave-1jss"
08:07:12.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.319722 32014 fs_manager.cc:696] Time spent creating directory manager: real 0.011s	user 0.010s	sys 0.001s
08:07:12.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.326529 32035 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:07:12.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.328017 32014 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.002s
08:07:12.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.328369 32014 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-1/wal
08:07:12.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1e0e9e75b93c479c9f616620b4833075"
08:07:12.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:12 on dist-test-slave-1jss"
08:07:12.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.328872 32014 fs_report.cc:389] FS layout report
08:07:12.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:07:12.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-1/wal
08:07:12.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-1/wal
08:07:12.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-1/data/data
08:07:12.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:07:12.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:07:12.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:07:12.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:07:12.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:07:12.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:07:12.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:07:12.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:07:12.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:07:12.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:07:12.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:07:12.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.399987 32014 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:07:12.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.401821 32014 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:07:12.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.402292 32014 kserver.cc:163] Server-wide thread pool size limit: 3276
08:07:12.457 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:12.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.494237 32014 rpc_server.cc:307] RPC server started. Bound to: 127.31.46.253:46697
08:07:12.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.494303 32086 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.46.253:46697 every 8 connection(s)
08:07:12.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.497591 32014 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-1/data/info.pb
08:07:12.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.498313 31931 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 32014
08:07:12.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.498780 31931 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-1/wal/instance
08:07:12.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.502552 31931 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-2/wal
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-2/data
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-2/logs
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-2/data/info.pb
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.46.252:40541
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.46.252
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.46.212:33327
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:07:12.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34537/jwks.json with env {}
08:07:12.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.506913 32087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:12.515 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:12.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.520779 32087 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.46.254" port: 45015 } has no permanent_uuid. Determining permanent_uuid...
08:07:12.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.551257 32087 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } has no permanent_uuid. Determining permanent_uuid...
08:07:12.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.567373 32087 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } has no permanent_uuid. Determining permanent_uuid...
08:07:12.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:12.570067 32038 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.46.252:40541: connect: Connection refused (error 111)
08:07:12.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:12.575058 32087 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.46.252:40541: Network error: Client connection negotiation failed: client connection to 127.31.46.252:40541: connect: Connection refused (error 111)
08:07:12.618 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091632618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:12.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.624660 32087 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } attempt: 1
08:07:12.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:12.639917 32087 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.46.252:40541: Network error: Client connection negotiation failed: client connection to 127.31.46.252:40541: connect: Connection refused (error 111)
08:07:12.644 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=26 ms, finalizationTime=0 ms).
08:07:12.646 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
08:07:12.655 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:12.656 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:12.656 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:12.656 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:12.656 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:12.656 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:12.657 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:12.657 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:12.657 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:12.657 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:12.657 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:12.657 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:12.657 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:12.662 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:12.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.708428 32087 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } attempt: 2
08:07:12.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:12.713582 32087 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.46.252:40541: Network error: Client connection negotiation failed: client connection to 127.31.46.252:40541: connect: Connection refused (error 111)
08:07:12.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.805171 32087 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } attempt: 3
08:07:12.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:12.810297 32087 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.46.252:40541: Network error: Client connection negotiation failed: client connection to 127.31.46.252:40541: connect: Connection refused (error 111)
08:07:12.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.813938 32012 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } attempt: 7
08:07:12.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.827575 32012 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } has no permanent_uuid. Determining permanent_uuid...
08:07:12.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:12.834322 32012 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.46.252:40541: Network error: Client connection negotiation failed: client connection to 127.31.46.252:40541: connect: Connection refused (error 111)
08:07:12.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:12.892076 32089 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:07:12.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:12.892848 32089 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:07:12.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.892881 32012 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } attempt: 1
08:07:12.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:12.893673 32089 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:07:12.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:12.897943 32012 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.46.252:40541: Network error: Client connection negotiation failed: client connection to 127.31.46.252:40541: connect: Connection refused (error 111)
08:07:12.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:12.934103 32089 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:07:12.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:12.934440 32089 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:07:12.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:12.934648 32089 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:07:12.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:12.934856 32089 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:07:12.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:12.935067 32089 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:07:12.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:12.935272 32089 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34537/jwks.json
08:07:12.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.953949 32087 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } attempt: 4
08:07:12.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:12.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:12.958937 32087 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.46.252:40541: Network error: Client connection negotiation failed: client connection to 127.31.46.252:40541: connect: Connection refused (error 111)
08:07:12.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.979416 32012 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } attempt: 2
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.983572 32089 master_runner.cc:387] Master server non-default flags:
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.46.212:33327
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-2/data
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-2/wal
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.46.252:40541
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34537/jwks.json
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-2/data/info.pb
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.46.252
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-2/logs
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:07:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:12.984215 32012 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.46.252:40541: Network error: Client connection negotiation failed: client connection to 127.31.46.252:40541: connect: Connection refused (error 111)
08:07:12.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.985458 32089 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:07:12.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:12.987761 32089 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:07:12.991 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:12.992 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:12.992 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:12.992 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:12.992 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:12.992 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:12.992 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:12.992 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:12.992 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:12.993 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:12.993 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:12.993 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:12.993 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:13.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:13.004335 32101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:13.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:13.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:13.069720 32012 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } attempt: 3
08:07:13.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:13.077981 32012 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.46.252:40541: Network error: Client connection negotiation failed: client connection to 127.31.46.252:40541: connect: Connection refused (error 111)
08:07:13.096 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:13.097 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:13.097 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:13.097 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:13.098 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:13.098 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:13.098 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:13.098 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:13.098 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:13.098 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:13.098 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:13.098 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:13.098 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:13.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091633118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:13.123 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:13.123 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:13.124 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:13.124 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:13.124 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:13.124 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:13.125 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:13.125 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:13.125 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:13.126 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:13.126 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:13.126 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:13.126 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:13.130 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:07:13.133 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
08:07:13.163 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:13.200 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:13.201 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:13.201 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:13.202 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:13.202 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:13.202 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:13.202 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:13.202 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:13.202 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:13.203 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:13.203 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:13.203 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:13.203 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:13.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:13.218653 32012 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } attempt: 4
08:07:13.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:13.223610 32012 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.46.252:40541: Network error: Client connection negotiation failed: client connection to 127.31.46.252:40541: connect: Connection refused (error 111)
08:07:13.255 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:13.256 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:13.256 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:13.257 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:13.257 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:13.257 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:13.258 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:13.258 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:13.258 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:13.258 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:13.258 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:13.258 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:13.258 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:13.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:13.258483 32087 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } attempt: 5
08:07:13.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:13.264971 32087 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.46.252:40541: Network error: Client connection negotiation failed: client connection to 127.31.46.252:40541: connect: Connection refused (error 111)
08:07:13.457 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:13.459 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:13.460 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:13.460 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:13.462 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:13.462 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:13.462 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:13.463 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:13.463 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:13.463 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:13.463 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:13.463 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:13.463 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:13.464 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:13.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:13.507123 32012 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } attempt: 5
08:07:13.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:13.514992 32012 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.46.252:40541: Network error: Client connection negotiation failed: client connection to 127.31.46.252:40541: connect: Connection refused (error 111)
08:07:13.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:13.610 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:13.611 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:13.611 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:13.611 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:13.611 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:13.611 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:13.611 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:13.611 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:13.611 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:13.612 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:13.612 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:13.612 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:13.612 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:13.612 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:13.612 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:13.612 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:13.613 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:13.613 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:13.613 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:13.613 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:13.613 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:13.611 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:13.611 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:13.614 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:13.614 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:13.614 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:13.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091633618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:13.630 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:07:13.631 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
08:07:13.663 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:13.808 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:13.809 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:13.809 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:13.809 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:13.810 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:13.810 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:13.810 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:13.810 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:13.810 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:13.810 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:13.811 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:13.810 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:13.811 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:13.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:13.812518 32087 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } attempt: 6
08:07:13.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:13.823465 32087 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.46.252:40541: Network error: Client connection negotiation failed: client connection to 127.31.46.252:40541: connect: Connection refused (error 111)
08:07:13.951 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:13.951 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:13.952 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:13.952 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:13.953 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:13.953 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:13.953 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:13.953 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:13.953 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:13.954 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:13.954 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:13.954 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:13.954 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:13.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:14.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:14.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.067632 32012 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } attempt: 6
08:07:14.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:14.079905 32012 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.46.252:40541: Network error: Client connection negotiation failed: client connection to 127.31.46.252:40541: connect: Connection refused (error 111)
08:07:14.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091634118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:14.132 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:14.132 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:14.133 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:14.133 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:14.133 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:14.133 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:14.133 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:14.133 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:14.133 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:14.134 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:14.134 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:14.134 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:14.134 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:14.137 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
08:07:14.138 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
08:07:14.163 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:14.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:13.005110 32102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:14.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:14.394527 32104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:14.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:14.398051 32103 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1392 milliseconds
08:07:14.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.398118 32089 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:07:14.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.399737 32089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:07:14.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.402892 32089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:07:14.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.404367 32089 hybrid_clock.cc:648] HybridClock initialized: now 1779091634404326 us; error 41 us; skew 500 ppm
08:07:14.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.405421 32089 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:07:14.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.413094 32089 webserver.cc:533] Webserver started at http://127.31.46.252:34941/ using document root <none> and password file <none>
08:07:14.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.414351 32089 fs_manager.cc:362] Metadata directory not provided
08:07:14.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.414613 32089 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:07:14.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.415210 32089 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:07:14.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.420727 32089 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-2/data/instance:
08:07:14.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b755fd9734604a7f87d143737462e218"
08:07:14.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:14 on dist-test-slave-1jss"
08:07:14.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.422124 32089 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-2/wal/instance:
08:07:14.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b755fd9734604a7f87d143737462e218"
08:07:14.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:14 on dist-test-slave-1jss"
08:07:14.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.431248 32089 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.003s	sys 0.005s
08:07:14.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.438201 32116 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:07:14.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.439523 32089 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.001s
08:07:14.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.439942 32089 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-2/wal
08:07:14.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b755fd9734604a7f87d143737462e218"
08:07:14.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:14 on dist-test-slave-1jss"
08:07:14.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.440384 32089 fs_report.cc:389] FS layout report
08:07:14.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:07:14.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-2/wal
08:07:14.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-2/wal
08:07:14.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-2/data/data
08:07:14.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:07:14.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:07:14.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:07:14.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:07:14.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:07:14.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:07:14.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:07:14.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:07:14.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:07:14.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:07:14.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:07:14.456 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:14.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.507313 32089 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:07:14.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.509156 32089 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:07:14.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.509624 32089 kserver.cc:163] Server-wide thread pool size limit: 3276
08:07:14.515 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:14.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.601269 32089 rpc_server.cc:307] RPC server started. Bound to: 127.31.46.252:40541
08:07:14.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.601336 32167 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.46.252:40541 every 8 connection(s)
08:07:14.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.604455 32089 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-2/data/info.pb
08:07:14.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.610946 31931 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 32089
08:07:14.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.611465 31931 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/master-2/wal/instance
08:07:14.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.611925 32168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:14.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091634618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:14.635 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
08:07:14.636 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
08:07:14.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.629978 32168 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.46.254" port: 45015 } has no permanent_uuid. Determining permanent_uuid...
08:07:14.663 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:14.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.666885 32168 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } has no permanent_uuid. Determining permanent_uuid...
08:07:14.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.678020 32168 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } has no permanent_uuid. Determining permanent_uuid...
08:07:14.680 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:14.680 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:14.680 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:14.680 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:14.680 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:14.681 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:14.681 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:14.681 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:14.681 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:14.681 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:14.681 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:14.681 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:14.681 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:14.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.697227 32168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218: Bootstrap starting.
08:07:14.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.704896 32168 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218: Neither blocks nor log segments found. Creating new log.
08:07:14.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.707279 32168 log.cc:826] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218: Log is configured to *not* fsync() on all Append() calls
08:07:14.712 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:14.712 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:14.712 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:14.713 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:14.713 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:14.713 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:14.713 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:14.713 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:14.713 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:14.713 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:14.713 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:14.713 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:14.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.713383 32168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218: No bootstrap required, opened a new log
08:07:14.713 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:14.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.735188 32168 raft_consensus.cc:359] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505fcead7e1940138e8beb97afc6f217" member_type: VOTER last_known_addr { host: "127.31.46.254" port: 45015 } } peers { permanent_uuid: "1e0e9e75b93c479c9f616620b4833075" member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } } peers { permanent_uuid: "b755fd9734604a7f87d143737462e218" member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } }
08:07:14.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.735893 32168 raft_consensus.cc:385] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:14.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.736107 32168 raft_consensus.cc:740] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b755fd9734604a7f87d143737462e218, State: Initialized, Role: FOLLOWER
08:07:14.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.736899 32168 consensus_queue.cc:260] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505fcead7e1940138e8beb97afc6f217" member_type: VOTER last_known_addr { host: "127.31.46.254" port: 45015 } } peers { permanent_uuid: "1e0e9e75b93c479c9f616620b4833075" member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } } peers { permanent_uuid: "b755fd9734604a7f87d143737462e218" member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } }
08:07:14.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.740650 32177 sys_catalog.cc:455] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505fcead7e1940138e8beb97afc6f217" member_type: VOTER last_known_addr { host: "127.31.46.254" port: 45015 } } peers { permanent_uuid: "1e0e9e75b93c479c9f616620b4833075" member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } } peers { permanent_uuid: "b755fd9734604a7f87d143737462e218" member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } } }
08:07:14.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.741560 32177 sys_catalog.cc:458] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [sys.catalog]: This master's current role is: FOLLOWER
08:07:14.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.742609 32168 sys_catalog.cc:565] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [sys.catalog]: configured and running, proceeding with master startup.
08:07:14.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:14.765888 32122 tablet.cc:2404] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:07:14.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:14.773082 32188 catalog_manager.cc:1593] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:07:14.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:14.773471 32188 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:07:14.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.768685 32089 master_runner.cc:187] Error getting master registration for 127.31.46.254:45015: OK, instance_id { permanent_uuid: "505fcead7e1940138e8beb97afc6f217" instance_seqno: 1779091630420856 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:07:14.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.797523 32089 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:07:14.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.851387 32177 raft_consensus.cc:493] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:07:14.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.851907 32177 raft_consensus.cc:515] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505fcead7e1940138e8beb97afc6f217" member_type: VOTER last_known_addr { host: "127.31.46.254" port: 45015 } } peers { permanent_uuid: "1e0e9e75b93c479c9f616620b4833075" member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } } peers { permanent_uuid: "b755fd9734604a7f87d143737462e218" member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } }
08:07:14.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.854465 32177 leader_election.cc:290] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 505fcead7e1940138e8beb97afc6f217 (127.31.46.254:45015), 1e0e9e75b93c479c9f616620b4833075 (127.31.46.253:46697)
08:07:14.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.884040 32087 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } attempt: 7
08:07:14.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.911885 32087 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e0e9e75b93c479c9f616620b4833075: Bootstrap starting.
08:07:14.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.921413 32087 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e0e9e75b93c479c9f616620b4833075: Neither blocks nor log segments found. Creating new log.
08:07:14.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.924367 32087 log.cc:826] T 00000000000000000000000000000000 P 1e0e9e75b93c479c9f616620b4833075: Log is configured to *not* fsync() on all Append() calls
08:07:14.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.936014 32087 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e0e9e75b93c479c9f616620b4833075: No bootstrap required, opened a new log
08:07:14.956 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:14.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.960561 32087 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1e0e9e75b93c479c9f616620b4833075 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505fcead7e1940138e8beb97afc6f217" member_type: VOTER last_known_addr { host: "127.31.46.254" port: 45015 } } peers { permanent_uuid: "1e0e9e75b93c479c9f616620b4833075" member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } } peers { permanent_uuid: "b755fd9734604a7f87d143737462e218" member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } }
08:07:14.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.961282 32087 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1e0e9e75b93c479c9f616620b4833075 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:14.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.961504 32087 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1e0e9e75b93c479c9f616620b4833075 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e0e9e75b93c479c9f616620b4833075, State: Initialized, Role: FOLLOWER
08:07:14.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.962376 32087 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e0e9e75b93c479c9f616620b4833075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505fcead7e1940138e8beb97afc6f217" member_type: VOTER last_known_addr { host: "127.31.46.254" port: 45015 } } peers { permanent_uuid: "1e0e9e75b93c479c9f616620b4833075" member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } } peers { permanent_uuid: "b755fd9734604a7f87d143737462e218" member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } }
08:07:14.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.967875 32087 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1e0e9e75b93c479c9f616620b4833075 [sys.catalog]: configured and running, proceeding with master startup.
08:07:14.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.965550 32192 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e0e9e75b93c479c9f616620b4833075 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505fcead7e1940138e8beb97afc6f217" member_type: VOTER last_known_addr { host: "127.31.46.254" port: 45015 } } peers { permanent_uuid: "1e0e9e75b93c479c9f616620b4833075" member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } } peers { permanent_uuid: "b755fd9734604a7f87d143737462e218" member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } } }
08:07:14.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.968393 32192 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e0e9e75b93c479c9f616620b4833075 [sys.catalog]: This master's current role is: FOLLOWER
08:07:14.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.971645 32062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b755fd9734604a7f87d143737462e218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e0e9e75b93c479c9f616620b4833075" is_pre_election: true
08:07:14.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.973074 32062 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1e0e9e75b93c479c9f616620b4833075 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b755fd9734604a7f87d143737462e218 in term 0.
08:07:14.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.975353 32119 leader_election.cc:304] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e0e9e75b93c479c9f616620b4833075, b755fd9734604a7f87d143737462e218; no voters: 
08:07:14.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.976833 32177 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:07:14.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.977298 32177 raft_consensus.cc:493] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:07:14.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.977703 32177 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [term 0 FOLLOWER]: Advancing to term 1
08:07:14.983 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:14.984 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:14.984 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:14.984 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:14.984 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:14.984 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:14.986 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:14.986 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:14.986 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:14.987 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:14.987 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:14.987 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:14.987 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:14.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.988029 32177 raft_consensus.cc:515] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505fcead7e1940138e8beb97afc6f217" member_type: VOTER last_known_addr { host: "127.31.46.254" port: 45015 } } peers { permanent_uuid: "1e0e9e75b93c479c9f616620b4833075" member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } } peers { permanent_uuid: "b755fd9734604a7f87d143737462e218" member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } }
08:07:14.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.994763 32062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b755fd9734604a7f87d143737462e218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e0e9e75b93c479c9f616620b4833075"
08:07:14.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.996402 32062 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1e0e9e75b93c479c9f616620b4833075 [term 0 FOLLOWER]: Advancing to term 1
08:07:15.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:14.999812 32177 leader_election.cc:290] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [CANDIDATE]: Term 1 election: Requested vote from peers 505fcead7e1940138e8beb97afc6f217 (127.31.46.254:45015), 1e0e9e75b93c479c9f616620b4833075 (127.31.46.253:46697)
08:07:15.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:15.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.018507 32062 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1e0e9e75b93c479c9f616620b4833075 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b755fd9734604a7f87d143737462e218 in term 1.
08:07:15.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.020591 32119 leader_election.cc:304] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e0e9e75b93c479c9f616620b4833075, b755fd9734604a7f87d143737462e218; no voters: 
08:07:15.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.022112 32177 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [term 1 FOLLOWER]: Leader election won for term 1
08:07:15.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.028724 32177 raft_consensus.cc:697] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [term 1 LEADER]: Becoming Leader. State: Replica: b755fd9734604a7f87d143737462e218, State: Running, Role: LEADER
08:07:15.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.030467 32177 consensus_queue.cc:237] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505fcead7e1940138e8beb97afc6f217" member_type: VOTER last_known_addr { host: "127.31.46.254" port: 45015 } } peers { permanent_uuid: "1e0e9e75b93c479c9f616620b4833075" member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } } peers { permanent_uuid: "b755fd9734604a7f87d143737462e218" member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } }
08:07:15.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.050756 32201 sys_catalog.cc:455] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b755fd9734604a7f87d143737462e218. Latest consensus state: current_term: 1 leader_uuid: "b755fd9734604a7f87d143737462e218" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505fcead7e1940138e8beb97afc6f217" member_type: VOTER last_known_addr { host: "127.31.46.254" port: 45015 } } peers { permanent_uuid: "1e0e9e75b93c479c9f616620b4833075" member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } } peers { permanent_uuid: "b755fd9734604a7f87d143737462e218" member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } } }
08:07:15.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.051725 32201 sys_catalog.cc:458] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [sys.catalog]: This master's current role is: LEADER
08:07:15.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.059262 32206 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
08:07:15.060 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:15.060 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:15.061 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:15.061 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:15.061 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:15.061 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:15.061 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:15.062 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:15.062 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:15.062 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:15.061 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:15.065 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:15.065 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:15.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:15.070490 32205 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 1e0e9e75b93c479c9f616620b4833075: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:07:15.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:15.071115 32205 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:07:15.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.078383 32206 catalog_manager.cc:1519] Initializing Kudu cluster ID...
08:07:15.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.107744 32062 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 1e0e9e75b93c479c9f616620b4833075 [term 1 FOLLOWER]: Refusing update from remote peer b755fd9734604a7f87d143737462e218: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:07:15.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.113094 32177 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e0e9e75b93c479c9f616620b4833075" member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:07:15.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.114826 32012 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } attempt: 7
08:07:15.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091635118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:15.130 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:15.130 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:15.130 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:15.131 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
08:07:15.131 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:15.131 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:15.131 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:15.132 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:15.132 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:15.132 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:15.132 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
08:07:15.132 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:15.132 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:15.133 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:15.133 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:15.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.067304 32014 master_runner.cc:187] Error getting master registration for 127.31.46.254:45015: OK, instance_id { permanent_uuid: "505fcead7e1940138e8beb97afc6f217" instance_seqno: 1779091630420856 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:07:15.136 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:15.136 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:15.136 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:15.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.136384 32014 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:07:15.136 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:15.136 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:15.137 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:15.137 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:15.137 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:15.137 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:15.137 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:15.137 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:15.137 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:15.137 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:15.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:15.166214 32041 tablet.cc:2404] T 00000000000000000000000000000000 P 1e0e9e75b93c479c9f616620b4833075: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:07:15.168 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:15.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.171726 32192 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e0e9e75b93c479c9f616620b4833075 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b755fd9734604a7f87d143737462e218. Latest consensus state: current_term: 1 leader_uuid: "b755fd9734604a7f87d143737462e218" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505fcead7e1940138e8beb97afc6f217" member_type: VOTER last_known_addr { host: "127.31.46.254" port: 45015 } } peers { permanent_uuid: "1e0e9e75b93c479c9f616620b4833075" member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } } peers { permanent_uuid: "b755fd9734604a7f87d143737462e218" member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } } }
08:07:15.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.174719 32192 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e0e9e75b93c479c9f616620b4833075 [sys.catalog]: This master's current role is: FOLLOWER
08:07:15.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.185070 32012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 505fcead7e1940138e8beb97afc6f217: Bootstrap starting.
08:07:15.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.188460 32208 mvcc.cc:204] Tried to move back new op lower bound from 7287159337368449024 to 7287159337100226560. Current Snapshot: MvccSnapshot[applied={T|T < 7287159337368449024}]
08:07:15.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.194679 32210 mvcc.cc:204] Tried to move back new op lower bound from 7287159337368449024 to 7287159337100226560. Current Snapshot: MvccSnapshot[applied={T|T < 7287159337368449024}]
08:07:15.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.198393 32201 sys_catalog.cc:455] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b755fd9734604a7f87d143737462e218" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505fcead7e1940138e8beb97afc6f217" member_type: VOTER last_known_addr { host: "127.31.46.254" port: 45015 } } peers { permanent_uuid: "1e0e9e75b93c479c9f616620b4833075" member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } } peers { permanent_uuid: "b755fd9734604a7f87d143737462e218" member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } } }
08:07:15.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.199368 32201 sys_catalog.cc:458] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [sys.catalog]: This master's current role is: LEADER
08:07:15.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.203999 32206 catalog_manager.cc:1382] Generated new cluster ID: 5e031919c4a04993a0eccfd259f33464
08:07:15.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.204351 32206 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
08:07:15.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.205403 32192 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e0e9e75b93c479c9f616620b4833075 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b755fd9734604a7f87d143737462e218" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505fcead7e1940138e8beb97afc6f217" member_type: VOTER last_known_addr { host: "127.31.46.254" port: 45015 } } peers { permanent_uuid: "1e0e9e75b93c479c9f616620b4833075" member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } } peers { permanent_uuid: "b755fd9734604a7f87d143737462e218" member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } } }
08:07:15.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.206288 32192 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e0e9e75b93c479c9f616620b4833075 [sys.catalog]: This master's current role is: FOLLOWER
08:07:15.226 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:15.226 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:15.227 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:15.227 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:15.228 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:15.229 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:15.229 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:15.229 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:15.229 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:15.230 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:15.230 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:15.230 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:15.230 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:15.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.239455 32012 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 505fcead7e1940138e8beb97afc6f217: Neither blocks nor log segments found. Creating new log.
08:07:15.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.244668 32012 log.cc:826] T 00000000000000000000000000000000 P 505fcead7e1940138e8beb97afc6f217: Log is configured to *not* fsync() on all Append() calls
08:07:15.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.263605 32012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 505fcead7e1940138e8beb97afc6f217: No bootstrap required, opened a new log
08:07:15.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.283334 32206 catalog_manager.cc:1405] Generated new certificate authority record
08:07:15.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.287315 32206 catalog_manager.cc:1539] Loading token signing keys...
08:07:15.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.325703 32206 catalog_manager.cc:6069] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218: Generated new TSK 0
08:07:15.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.327358 32206 catalog_manager.cc:1549] Initializing in-progress tserver states...
08:07:15.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.346107 32012 raft_consensus.cc:359] T 00000000000000000000000000000000 P 505fcead7e1940138e8beb97afc6f217 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505fcead7e1940138e8beb97afc6f217" member_type: VOTER last_known_addr { host: "127.31.46.254" port: 45015 } } peers { permanent_uuid: "1e0e9e75b93c479c9f616620b4833075" member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } } peers { permanent_uuid: "b755fd9734604a7f87d143737462e218" member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } }
08:07:15.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.347221 32012 raft_consensus.cc:385] T 00000000000000000000000000000000 P 505fcead7e1940138e8beb97afc6f217 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:15.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.347553 32012 raft_consensus.cc:740] T 00000000000000000000000000000000 P 505fcead7e1940138e8beb97afc6f217 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 505fcead7e1940138e8beb97afc6f217, State: Initialized, Role: FOLLOWER
08:07:15.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.348661 32012 consensus_queue.cc:260] T 00000000000000000000000000000000 P 505fcead7e1940138e8beb97afc6f217 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505fcead7e1940138e8beb97afc6f217" member_type: VOTER last_known_addr { host: "127.31.46.254" port: 45015 } } peers { permanent_uuid: "1e0e9e75b93c479c9f616620b4833075" member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } } peers { permanent_uuid: "b755fd9734604a7f87d143737462e218" member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } }
08:07:15.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.354022 32012 sys_catalog.cc:565] T 00000000000000000000000000000000 P 505fcead7e1940138e8beb97afc6f217 [sys.catalog]: configured and running, proceeding with master startup.
08:07:15.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.354218 31986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b755fd9734604a7f87d143737462e218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505fcead7e1940138e8beb97afc6f217"
08:07:15.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.355036 31986 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 505fcead7e1940138e8beb97afc6f217 [term 0 FOLLOWER]: Advancing to term 1
08:07:15.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.359220 31987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b755fd9734604a7f87d143737462e218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505fcead7e1940138e8beb97afc6f217" is_pre_election: true
08:07:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:15.364455 31966 tablet.cc:2404] T 00000000000000000000000000000000 P 505fcead7e1940138e8beb97afc6f217: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:07:15.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.384545 31931 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:07:15.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:07:15.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-0/wal
08:07:15.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-0/data
08:07:15.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:07:15.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:07:15.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:07:15.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:15.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:15.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:15.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-0/logs
08:07:15.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-0/data/info.pb
08:07:15.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:15.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:07:15.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:07:15.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:07:15.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:07:15.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:15.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:15.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:15.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:07:15.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:07:15.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.46.193:0
08:07:15.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.46.193
08:07:15.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.46.193
08:07:15.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:15.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541
08:07:15.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.46.212:33327
08:07:15.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:15.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:15.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:07:15.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.353422 32215 sys_catalog.cc:455] T 00000000000000000000000000000000 P 505fcead7e1940138e8beb97afc6f217 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505fcead7e1940138e8beb97afc6f217" member_type: VOTER last_known_addr { host: "127.31.46.254" port: 45015 } } peers { permanent_uuid: "1e0e9e75b93c479c9f616620b4833075" member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } } peers { permanent_uuid: "b755fd9734604a7f87d143737462e218" member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } } }
08:07:15.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.397294 32215 sys_catalog.cc:458] T 00000000000000000000000000000000 P 505fcead7e1940138e8beb97afc6f217 [sys.catalog]: This master's current role is: FOLLOWER
08:07:15.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.397532 31986 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 505fcead7e1940138e8beb97afc6f217 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b755fd9734604a7f87d143737462e218 in term 1.
08:07:15.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.399915 31985 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 505fcead7e1940138e8beb97afc6f217 [term 1 FOLLOWER]: Refusing update from remote peer b755fd9734604a7f87d143737462e218: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:07:15.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.408520 32177 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [LEADER]: Connected to new peer: Peer: permanent_uuid: "505fcead7e1940138e8beb97afc6f217" member_type: VOTER last_known_addr { host: "127.31.46.254" port: 45015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:07:15.457 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:15.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.484655 32215 sys_catalog.cc:455] T 00000000000000000000000000000000 P 505fcead7e1940138e8beb97afc6f217 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b755fd9734604a7f87d143737462e218. Latest consensus state: current_term: 1 leader_uuid: "b755fd9734604a7f87d143737462e218" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505fcead7e1940138e8beb97afc6f217" member_type: VOTER last_known_addr { host: "127.31.46.254" port: 45015 } } peers { permanent_uuid: "1e0e9e75b93c479c9f616620b4833075" member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } } peers { permanent_uuid: "b755fd9734604a7f87d143737462e218" member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } } }
08:07:15.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.485641 32215 sys_catalog.cc:458] T 00000000000000000000000000000000 P 505fcead7e1940138e8beb97afc6f217 [sys.catalog]: This master's current role is: FOLLOWER
08:07:15.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.487361 32221 sys_catalog.cc:455] T 00000000000000000000000000000000 P 505fcead7e1940138e8beb97afc6f217 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b755fd9734604a7f87d143737462e218" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505fcead7e1940138e8beb97afc6f217" member_type: VOTER last_known_addr { host: "127.31.46.254" port: 45015 } } peers { permanent_uuid: "1e0e9e75b93c479c9f616620b4833075" member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } } peers { permanent_uuid: "b755fd9734604a7f87d143737462e218" member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } } }
08:07:15.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.488333 32221 sys_catalog.cc:458] T 00000000000000000000000000000000 P 505fcead7e1940138e8beb97afc6f217 [sys.catalog]: This master's current role is: FOLLOWER
08:07:15.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:15.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.553164 32232 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
08:07:15.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091635618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:15.629 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:07:15.630 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
08:07:15.663 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:15.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:15.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.983672 32233 sys_catalog.cc:455] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b755fd9734604a7f87d143737462e218" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505fcead7e1940138e8beb97afc6f217" member_type: VOTER last_known_addr { host: "127.31.46.254" port: 45015 } } peers { permanent_uuid: "1e0e9e75b93c479c9f616620b4833075" member_type: VOTER last_known_addr { host: "127.31.46.253" port: 46697 } } peers { permanent_uuid: "b755fd9734604a7f87d143737462e218" member_type: VOTER last_known_addr { host: "127.31.46.252" port: 40541 } } }
08:07:15.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:15.984853 32233 sys_catalog.cc:458] T 00000000000000000000000000000000 P b755fd9734604a7f87d143737462e218 [sys.catalog]: This master's current role is: LEADER
08:07:16.021 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:16.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:16.055003 32218 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:07:16.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:16.056094 32218 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:07:16.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:16.056939 32218 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:07:16.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:16.079006 32205 catalog_manager.cc:1294] Loaded cluster ID: 5e031919c4a04993a0eccfd259f33464
08:07:16.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:16.079706 32205 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 1e0e9e75b93c479c9f616620b4833075: loading cluster ID for follower catalog manager: success
08:07:16.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:16.091051 32205 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 1e0e9e75b93c479c9f616620b4833075: acquiring CA information for follower catalog manager: success
08:07:16.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:16.098582 32205 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 1e0e9e75b93c479c9f616620b4833075: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:07:16.118 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091636117 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:16.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:16.123459 32218 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:07:16.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:16.125154 32218 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.46.193
08:07:16.130 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
08:07:16.132 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
08:07:16.162 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:16.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:16.198087 32218 tablet_server_runner.cc:78] Tablet server non-default flags:
08:07:16.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:16.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.46.212:33327
08:07:16.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:16.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:16.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-0/data
08:07:16.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-0/wal
08:07:16.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:16.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:16.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.46.193:0
08:07:16.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:07:16.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:16.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:16.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-0/data/info.pb
08:07:16.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.46.193
08:07:16.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:16.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541
08:07:16.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:07:16.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:16.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:07:16.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:07:16.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:16.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.46.193
08:07:16.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-0/logs
08:07:16.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:16.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:07:16.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:07:16.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:07:16.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:07:16.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:07:16.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:07:16.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:07:16.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:07:16.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:07:16.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:16.200259 32218 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:07:16.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:16.202819 32218 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:07:16.220 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:16.221 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:16.221 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:16.223 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:16.223 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:16.223 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:16.223 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:16.224 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:16.224 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:16.224 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:16.224 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:16.224 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:16.224 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:16.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:16.239481 32242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:16.428 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:16.429 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:16.429 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:16.430 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:16.430 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:16.430 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:16.431 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:16.431 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:16.431 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:16.431 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:16.431 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:16.431 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:16.431 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:16.457 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:16.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:16.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:16.578718 32232 catalog_manager.cc:1294] Loaded cluster ID: 5e031919c4a04993a0eccfd259f33464
08:07:16.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:16.579072 32232 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 505fcead7e1940138e8beb97afc6f217: loading cluster ID for follower catalog manager: success
08:07:16.618 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091636618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:16.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:16.620285 32232 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 505fcead7e1940138e8beb97afc6f217: acquiring CA information for follower catalog manager: success
08:07:16.631 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
08:07:16.632 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
08:07:16.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:16.643113 32232 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 505fcead7e1940138e8beb97afc6f217: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:07:16.662 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:16.776 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:16.776 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:16.777 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:16.778 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:16.778 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:16.778 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:16.778 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:16.778 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:16.778 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:16.779 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:16.779 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:16.779 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:16.779 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:16.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:17.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:17.043 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:17.043 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:17.043 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:17.044 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:17.044 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:17.044 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:17.045 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:17.045 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:17.045 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:17.046 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:17.046 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:17.046 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:17.046 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:17.107 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:17.107 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:17.108 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:17.109 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:17.110 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:17.110 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:17.110 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:17.110 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:17.110 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:17.110 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:17.111 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:17.111 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:17.111 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:17.118 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091637118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:17.132 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
08:07:17.133 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
08:07:17.163 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:17.211 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:17.212 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:17.212 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:17.213 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:17.213 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:17.213 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:17.214 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:17.214 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:17.214 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:17.214 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:17.214 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:17.214 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:17.214 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:17.247 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:17.247 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:17.247 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:17.248 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:17.248 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:17.248 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:17.249 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:17.249 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:17.249 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:17.249 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:17.249 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:17.250 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:17.250 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:17.457 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:17.506 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:17.506 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:17.507 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:17.508 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:17.508 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:17.508 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:17.508 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:17.509 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:17.509 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:17.509 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:17.509 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:17.509 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:17.509 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:17.521 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:17.567 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:17.567 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:17.568 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:17.568 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:17.568 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:17.568 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:17.568 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:17.568 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:17.569 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:17.569 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:17.569 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:17.569 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:17.569 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:17.591 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:17.592 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:17.592 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:17.593 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:17.593 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:17.593 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:17.593 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:17.593 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:17.593 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:17.596 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:17.596 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:17.596 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:17.596 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:17.618 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091637618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:17.633 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
08:07:17.635 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
08:07:17.663 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:17.957 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:18.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:18.106 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:18.107 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:18.107 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:18.108 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:18.108 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:18.108 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:18.108 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:18.108 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:18.109 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:18.109 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:18.109 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:18.109 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:18.109 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:18.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091638118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:18.131 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
08:07:18.132 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
08:07:18.163 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:18.207 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:18.207 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:18.207 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:18.208 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:18.208 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:18.208 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:18.209 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:18.209 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:18.209 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:18.211 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:18.211 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:18.211 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:18.211 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:18.211 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:18.211 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:18.212 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:18.212 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:18.212 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:18.212 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:18.212 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:18.212 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:18.212 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:18.213 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:18.213 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:18.213 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:18.213 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:18.214 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28262), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [19ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [22ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [27ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [36ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [63ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [70ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [77ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [77ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [125ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [152ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [152ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [153ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [161ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [162ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [162ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [162ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [184ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [185ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [185ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [186ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [202ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [202ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [203ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [203ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [243ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [243ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [243ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [302ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [304ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [523ms] refreshing cache from master, [523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [525ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [525ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [526ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [526ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [864ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [865ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [866ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [866ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1000ms] refreshing cache from master, [1000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1007ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1010ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2100ms] refreshing cache from master, [2101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [2102ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [3980ms] refreshing cache from master, [3980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [3983ms] too many traces: truncated at 100 traces, deferred=Deferred@1238409402(state=PENDING, result=null, callback=(continuation of Deferred@1970325915 after retry RPC after error@727910247) -> (continuation of Deferred@1534174856 after retry RPC after error@392697900) -> (continuation of Deferred@1680291659 after retry RPC after error@1473010839) -> (continuation of Deferred@31450368 after retry RPC after error@1445012591) -> (continuation of Deferred@199347343 after retry RPC after error@1048318336) -> (continuation of Deferred@1089799338 after retry RPC after error@522736263) -> (continuation of Deferred@438857817 after retry RPC after error@1141281421) -> (continuation of Deferred@742264563 after retry RPC after error@1902108057) -> (continuation of Deferred@682414419 after retry RPC after error@1489939505) -> (continuation of Deferred@73103437 after retry RPC after error@199741002) -> (continuation of Deferred@1158656044 after retry RPC after error@1754084248) -> (continuation of Deferred@927709140 after retry RPC after error@40614633) -> (continuation of Deferred@987624536 after retry RPC after error@1003290984) -> (continuation of Deferred@1364391122 after retry RPC after error@238133475) -> (continuation of Deferred@1528556105 after retry RPC after error@135161347) -> (continuation of Deferred@1321002932 after retry RPC after error@1292464184) -> (continuation of Deferred@1237619314 after retry RPC after error@838978359) -> (continuation of Deferred@464063364 after retry RPC after error@489107577) -> (continuation of Deferred@1889363629 after retry RPC after error@1291408378) -> (continuation of Deferred@526357706 after retry RPC after error@1004526496) -> (continuation of Deferred@543976056 after retry RPC after error@638360332) -> (continuation of Deferred@1167504067 after retry RPC after error@13726474) -> (continuation of Deferred@1127085762 after retry RPC after error@20697424) -> (continuation of Deferred@1900768030 after retry RPC after error@2047418142) -> (continuation of Deferred@1455324539 after retry RPC after error@156272557) -> (continuation of Deferred@602480130 after retry RPC after error@296354958) -> (continuation of Deferred@886761061 after retry RPC after error@968520380), errback=(continuation of Deferred@1970325915 after retry RPC after error@727910247) -> (continuation of Deferred@1534174856 after retry RPC after error@392697900) -> (continuation of Deferred@1680291659 after retry RPC after error@1473010839) -> (continuation of Deferred@31450368 after retry RPC after error@1445012591) -> (continuation of Deferred@199347343 after retry RPC after error@1048318336) -> (continuation of Deferred@1089799338 after retry RPC after error@522736263) -> (continuation of Deferred@438857817 after retry RPC after error@1141281421) -> (continuation of Deferred@742264563 after retry RPC after error@1902108057) -> (continuation of Deferred@682414419 after retry RPC after error@1489939505) -> (continuation of Deferred@73103437 after retry RPC after error@199741002) -> (continuation of Deferred@1158656044 after retry RPC after error@1754084248) -> (continuation of Deferred@927709140 after retry RPC after error@40614633) -> (continuation of Deferred@987624536 after retry RPC after error@1003290984) -> (continuation of Deferred@1364391122 after retry RPC after error@238133475) -> (continuation of Deferred@1528556105 after retry RPC after error@135161347) -> (continuation of Deferred@1321002932 after retry RPC after error@1292464184) -> (continuation of Deferred@1237619314 after retry RPC after error@838978359) -> (continuation of Deferred@464063364 after retry RPC after error@489107577) -> (continuation of Deferred@1889363629 after retry RPC after error@1291408378) -> (continuation of Deferred@526357706 after retry RPC after error@1004526496) -> (continuation of Deferred@543976056 after retry RPC after error@638360332) -> (continuation of Deferred@1167504067 after retry RPC after error@13726474) -> (continuation of Deferred@1127085762 after retry RPC after error@20697424) -> (continuation of Deferred@1900768030 after retry RPC after error@2047418142) -> (continuation of Deferred@1455324539 after retry RPC after error@156272557) -> (continuation of Deferred@602480130 after retry RPC after error@296354958) -> (continuation of Deferred@886761061 after retry RPC after error@968520380)))
08:07:18.216 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
08:07:18.217 [WARN - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#3 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28262), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [19ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [22ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [27ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [36ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [63ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [70ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [77ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [77ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [125ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [152ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [152ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [153ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [161ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [162ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [162ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [162ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [184ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [185ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [185ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [186ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [202ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [202ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [203ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [203ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [243ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [243ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [243ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [302ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [304ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [523ms] refreshing cache from master, [523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [525ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [525ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [526ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [526ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [864ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [865ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [866ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [866ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1000ms] refreshing cache from master, [1000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1007ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1010ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2100ms] refreshing cache from master, [2101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [2102ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [3980ms] refreshing cache from master, [3980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [3983ms] too many traces: truncated at 100 traces, deferred=Deferred@1238409402(state=PENDING, result=null, callback=(continuation of Deferred@1970325915 after retry RPC after error@727910247) -> (continuation of Deferred@1534174856 after retry RPC after error@392697900) -> (continuation of Deferred@1680291659 after retry RPC after error@1473010839) -> (continuation of Deferred@31450368 after retry RPC after error@1445012591) -> (continuation of Deferred@199347343 after retry RPC after error@1048318336) -> (continuation of Deferred@1089799338 after retry RPC after error@522736263) -> (continuation of Deferred@438857817 after retry RPC after error@1141281421) -> (continuation of Deferred@742264563 after retry RPC after error@1902108057) -> (continuation of Deferred@682414419 after retry RPC after error@1489939505) -> (continuation of Deferred@73103437 after retry RPC after error@199741002) -> (continuation of Deferred@1158656044 after retry RPC after error@1754084248) -> (continuation of Deferred@927709140 after retry RPC after error@40614633) -> (continuation of Deferred@987624536 after retry RPC after error@1003290984) -> (continuation of Deferred@1364391122 after retry RPC after error@238133475) -> (continuation of Deferred@1528556105 after retry RPC after error@135161347) -> (continuation of Deferred@1321002932 after retry RPC after error@1292464184) -> (continuation of Deferred@1237619314 after retry RPC after error@838978359) -> (continuation of Deferred@464063364 after retry RPC after error@489107577) -> (continuation of Deferred@1889363629 after retry RPC after error@1291408378) -> (continuation of Deferred@526357706 after retry RPC after error@1004526496) -> (continuation of Deferred@543976056 after retry RPC after error@638360332) -> (continuation of Deferred@1167504067 after retry RPC after error@13726474) -> (continuation of Deferred@1127085762 after retry RPC after error@20697424) -> (continuation of Deferred@1900768030 after retry RPC after error@2047418142) -> (continuation of Deferred@1455324539 after retry RPC after error@156272557) -> (continuation of Deferred@602480130 after retry RPC after error@296354958) -> (continuation of Deferred@886761061 after retry RPC after error@968520380), errback=(continuation of Deferred@1970325915 after retry RPC after error@727910247) -> (continuation of Deferred@1534174856 after retry RPC after error@392697900) -> (continuation of Deferred@1680291659 after retry RPC after error@1473010839) -> (continuation of Deferred@31450368 after retry RPC after error@1445012591) -> (continuation of Deferred@199347343 after retry RPC after error@1048318336) -> (continuation of Deferred@1089799338 after retry RPC after error@522736263) -> (continuation of Deferred@438857817 after retry RPC after error@1141281421) -> (continuation of Deferred@742264563 after retry RPC after error@1902108057) -> (continuation of Deferred@682414419 after retry RPC after error@1489939505) -> (continuation of Deferred@73103437 after retry RPC after error@199741002) -> (continuation of Deferred@1158656044 after retry RPC after error@1754084248) -> (continuation of Deferred@927709140 after retry RPC after error@40614633) -> (continuation of Deferred@987624536 after retry RPC after error@1003290984) -> (continuation of Deferred@1364391122 after retry RPC after error@238133475) -> (continuation of Deferred@1528556105 after retry RPC after error@135161347) -> (continuation of Deferred@1321002932 after retry RPC after error@1292464184) -> (continuation of Deferred@1237619314 after retry RPC after error@838978359) -> (continuation of Deferred@464063364 after retry RPC after error@489107577) -> (continuation of Deferred@1889363629 after retry RPC after error@1291408378) -> (continuation of Deferred@526357706 after retry RPC after error@1004526496) -> (continuation of Deferred@543976056 after retry RPC after error@638360332) -> (continuation of Deferred@1167504067 after retry RPC after error@13726474) -> (continuation of Deferred@1127085762 after retry RPC after error@20697424) -> (continuation of Deferred@1900768030 after retry RPC after error@2047418142) -> (continuation of Deferred@1455324539 after retry RPC after error@156272557) -> (continuation of Deferred@602480130 after retry RPC after error@296354958) -> (continuation of Deferred@886761061 after retry RPC after error@968520380)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.189:46677
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:07:18.219 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#3 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
08:07:18.226 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#3 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_3.
08:07:18.229 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to FAILED on 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28262), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [19ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [22ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [27ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [36ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [63ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [70ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [77ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [77ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [125ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [152ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [152ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [153ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [161ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [162ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [162ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [162ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [184ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [185ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [185ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [186ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [202ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [202ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [203ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [203ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [243ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [243ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [243ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [302ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [304ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [523ms] refreshing cache from master, [523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [525ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [525ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [526ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [526ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [864ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [865ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [866ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [866ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1000ms] refreshing cache from master, [1000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1007ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1010ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2100ms] refreshing cache from master, [2101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [2102ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [3980ms] refreshing cache from master, [3980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [3983ms] too many traces: truncated at 100 traces, deferred=Deferred@1238409402(state=PENDING, result=null, callback=(continuation of Deferred@1970325915 after retry RPC after error@727910247) -> (continuation of Deferred@1534174856 after retry RPC after error@392697900) -> (continuation of Deferred@1680291659 after retry RPC after error@1473010839) -> (continuation of Deferred@31450368 after retry RPC after error@1445012591) -> (continuation of Deferred@199347343 after retry RPC after error@1048318336) -> (continuation of Deferred@1089799338 after retry RPC after error@522736263) -> (continuation of Deferred@438857817 after retry RPC after error@1141281421) -> (continuation of Deferred@742264563 after retry RPC after error@1902108057) -> (continuation of Deferred@682414419 after retry RPC after error@1489939505) -> (continuation of Deferred@73103437 after retry RPC after error@199741002) -> (continuation of Deferred@1158656044 after retry RPC after error@1754084248) -> (continuation of Deferred@927709140 after retry RPC after error@40614633) -> (continuation of Deferred@987624536 after retry RPC after error@1003290984) -> (continuation of Deferred@1364391122 after retry RPC after error@238133475) -> (continuation of Deferred@1528556105 after retry RPC after error@135161347) -> (continuation of Deferred@1321002932 after retry RPC after error@1292464184) -> (continuation of Deferred@1237619314 after retry RPC after error@838978359) -> (continuation of Deferred@464063364 after retry RPC after error@489107577) -> (continuation of Deferred@1889363629 after retry RPC after error@1291408378) -> (continuation of Deferred@526357706 after retry RPC after error@1004526496) -> (continuation of Deferred@543976056 after retry RPC after error@638360332) -> (continuation of Deferred@1167504067 after retry RPC after error@13726474) -> (continuation of Deferred@1127085762 after retry RPC after error@20697424) -> (continuation of Deferred@1900768030 after retry RPC after error@2047418142) -> (continuation of Deferred@1455324539 after retry RPC after error@156272557) -> (continuation of Deferred@602480130 after retry RPC after error@296354958) -> (continuation of Deferred@886761061 after retry RPC after error@968520380), errback=(continuation of Deferred@1970325915 after retry RPC after error@727910247) -> (continuation of Deferred@1534174856 after retry RPC after error@392697900) -> (continuation of Deferred@1680291659 after retry RPC after error@1473010839) -> (continuation of Deferred@31450368 after retry RPC after error@1445012591) -> (continuation of Deferred@199347343 after retry RPC after error@1048318336) -> (continuation of Deferred@1089799338 after retry RPC after error@522736263) -> (continuation of Deferred@438857817 after retry RPC after error@1141281421) -> (continuation of Deferred@742264563 after retry RPC after error@1902108057) -> (continuation of Deferred@682414419 after retry RPC after error@1489939505) -> (continuation of Deferred@73103437 after retry RPC after error@199741002) -> (continuation of Deferred@1158656044 after retry RPC after error@1754084248) -> (continuation of Deferred@927709140 after retry RPC after error@40614633) -> (continuation of Deferred@987624536 after retry RPC after error@1003290984) -> (continuation of Deferred@1364391122 after retry RPC after error@238133475) -> (continuation of Deferred@1528556105 after retry RPC after error@135161347) -> (continuation of Deferred@1321002932 after retry RPC after error@1292464184) -> (continuation of Deferred@1237619314 after retry RPC after error@838978359) -> (continuation of Deferred@464063364 after retry RPC after error@489107577) -> (continuation of Deferred@1889363629 after retry RPC after error@1291408378) -> (continuation of Deferred@526357706 after retry RPC after error@1004526496) -> (continuation of Deferred@543976056 after retry RPC after error@638360332) -> (continuation of Deferred@1167504067 after retry RPC after error@13726474) -> (continuation of Deferred@1127085762 after retry RPC after error@20697424) -> (continuation of Deferred@1900768030 after retry RPC after error@2047418142) -> (continuation of Deferred@1455324539 after retry RPC after error@156272557) -> (continuation of Deferred@602480130 after retry RPC after error@296354958) -> (continuation of Deferred@886761061 after retry RPC after error@968520380)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.189:46677
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:07:18.240 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:07:18.244 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#3) of source Source: KuduSource.
08:07:18.244 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_3.
08:07:18.245 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (e26b904229418d0e047d5d94c5b9f905) switched from state RUNNING to RESTARTING.
08:07:18.389 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:18.390 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:18.390 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:18.390 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:18.390 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:18.390 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:18.390 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:18.391 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:18.391 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:18.391 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:18.391 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:18.391 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:18.391 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:18.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:17.624810 32241 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 32218
08:07:18.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:18.407685 32241 kernel_stack_watchdog.cc:198] Thread 32218 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 385ms:
08:07:18.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:07:18.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:07:18.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:07:18.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:07:18.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:18.410130 32218 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.173s	user 0.474s	sys 0.632s
08:07:18.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:18.410666 32218 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.174s	user 0.474s	sys 0.632s
08:07:18.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:16.239754 32243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:18.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.430177 32218 server_base.cc:1061] running on GCE node
08:07:18.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:18.432098 32250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:18.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.433764 32218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:07:18.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.464186 32218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:07:18.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.466146 32218 hybrid_clock.cc:648] HybridClock initialized: now 1779091638466102 us; error 64 us; skew 500 ppm
08:07:18.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.467425 32218 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:07:18.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.500520 32218 webserver.cc:533] Webserver started at http://127.31.46.193:40031/ using document root <none> and password file <none>
08:07:18.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.502293 32218 fs_manager.cc:362] Metadata directory not provided
08:07:18.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.502705 32218 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:07:18.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.503402 32218 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:07:18.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.510550 32218 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-0/data/instance:
08:07:18.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7f8fa66c1d0f40fab64f16e98a980e56"
08:07:18.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:18 on dist-test-slave-1jss"
08:07:18.512 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:18.512 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:18.512 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:18.513 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:18.513 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:18.513 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:18.514 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:18.514 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:18.514 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:18.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:18.516 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:18.516 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:18.516 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:18.516 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:18.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.520445 32218 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-0/wal/instance:
08:07:18.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7f8fa66c1d0f40fab64f16e98a980e56"
08:07:18.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:18 on dist-test-slave-1jss"
08:07:18.531 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:18.532 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:18.532 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:18.532 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:18.532 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:18.532 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:18.533 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:18.533 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:18.533 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:18.533 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:18.533 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:18.533 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:18.533 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:18.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.543867 32218 fs_manager.cc:696] Time spent creating directory manager: real 0.022s	user 0.011s	sys 0.003s
08:07:18.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.574908 32255 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:07:18.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.577323 32218 fs_manager.cc:730] Time spent opening block manager: real 0.028s	user 0.017s	sys 0.011s
08:07:18.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.577996 32218 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-0/wal
08:07:18.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7f8fa66c1d0f40fab64f16e98a980e56"
08:07:18.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:18 on dist-test-slave-1jss"
08:07:18.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.578737 32218 fs_report.cc:389] FS layout report
08:07:18.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:07:18.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-0/wal
08:07:18.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-0/wal
08:07:18.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-0/data/data
08:07:18.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:07:18.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:07:18.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:07:18.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:07:18.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:07:18.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:07:18.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:07:18.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:07:18.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:07:18.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:07:18.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:07:18.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091638618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:18.630 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:07:18.631 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
08:07:18.663 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:18.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.694164 32218 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:07:18.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.696434 32218 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:07:18.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.697031 32218 kserver.cc:163] Server-wide thread pool size limit: 3276
08:07:18.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.701105 32218 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:07:18.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.708043 32218 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:07:18.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.708346 32218 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:07:18.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.708669 32218 ts_tablet_manager.cc:616] Registered 0 tablets
08:07:18.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.708886 32218 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:07:18.832 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:18.833 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:18.833 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:18.834 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:18.834 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:18.834 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:18.834 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:18.834 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:18.834 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:18.835 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:18.835 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:18.835 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:18.835 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:18.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.993418 32218 rpc_server.cc:307] RPC server started. Bound to: 127.31.46.193:43719
08:07:18.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.993562 32367 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.46.193:43719 every 8 connection(s)
08:07:18.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:18.996964 32218 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-0/data/info.pb
08:07:19.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:19.004024 31931 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 32218
08:07:19.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:19.004752 31931 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-0/wal/instance
08:07:19.020 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:19.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:19.024009 31931 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:07:19.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:07:19.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-1/wal
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-1/data
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-1/logs
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-1/data/info.pb
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.46.194:0
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.46.194
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.46.194
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.46.212:33327
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:19.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:07:19.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:19.076545 32370 heartbeater.cc:344] Connected to a master server at 127.31.46.254:45015
08:07:19.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:19.076587 32368 heartbeater.cc:344] Connected to a master server at 127.31.46.252:40541
08:07:19.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:19.077303 32370 heartbeater.cc:461] Registering TS with master...
08:07:19.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:19.077477 32368 heartbeater.cc:461] Registering TS with master...
08:07:19.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:19.079077 32370 heartbeater.cc:507] Master 127.31.46.254:45015 requested a full tablet report, sending...
08:07:19.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:19.079582 32368 heartbeater.cc:507] Master 127.31.46.252:40541 requested a full tablet report, sending...
08:07:19.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:19.084084 31977 ts_manager.cc:194] Registered new tserver with Master: 7f8fa66c1d0f40fab64f16e98a980e56 (127.31.46.193:43719)
08:07:19.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:19.084321 32133 ts_manager.cc:194] Registered new tserver with Master: 7f8fa66c1d0f40fab64f16e98a980e56 (127.31.46.193:43719)
08:07:19.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:19.088778 32133 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.46.193:45651
08:07:19.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:19.098366 32369 heartbeater.cc:344] Connected to a master server at 127.31.46.253:46697
08:07:19.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:19.098810 32369 heartbeater.cc:461] Registering TS with master...
08:07:19.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:19.099572 32369 heartbeater.cc:507] Master 127.31.46.253:46697 requested a full tablet report, sending...
08:07:19.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:19.102898 32052 ts_manager.cc:194] Registered new tserver with Master: 7f8fa66c1d0f40fab64f16e98a980e56 (127.31.46.193:43719)
08:07:19.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091639118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:19.129 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:19.130 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:19.130 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:07:19.130 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:19.131 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:19.131 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:19.131 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:19.131 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:19.131 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:19.131 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:19.131 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:19.131 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:19.132 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:19.132 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:19.137 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
08:07:19.163 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:19.413 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:19.413 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:19.414 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:19.414 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:19.414 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:19.414 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:19.414 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:19.414 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:19.414 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:19.415 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:19.415 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:19.415 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:19.415 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:19.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:19.509953 32378 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:07:19.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:19.510659 32378 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:07:19.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:19.511279 32378 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:07:19.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:19.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:19.557431 32378 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:07:19.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:19.558646 32378 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.46.194
08:07:19.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:19.608031 32378 tablet_server_runner.cc:78] Tablet server non-default flags:
08:07:19.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:19.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.46.212:33327
08:07:19.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:19.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:19.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-1/data
08:07:19.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-1/wal
08:07:19.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:19.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:19.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.46.194:0
08:07:19.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:07:19.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:19.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:19.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-1/data/info.pb
08:07:19.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.46.194
08:07:19.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:19.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541
08:07:19.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:07:19.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:19.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:07:19.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:07:19.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:19.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.46.194
08:07:19.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-1/logs
08:07:19.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:19.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:07:19.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:07:19.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:07:19.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:07:19.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:07:19.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:07:19.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:07:19.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:07:19.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:07:19.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:19.610249 32378 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:07:19.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:19.612774 32378 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:07:19.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091639618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:19.620 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:19.620 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:19.621 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:19.622 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:19.622 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:19.622 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:19.622 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:19.622 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:19.622 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:19.623 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:19.623 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:19.623 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:19.623 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:19.635 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
08:07:19.638 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
08:07:19.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:19.656049 32385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:19.663 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:19.863 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:19.864 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:19.864 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:19.865 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:19.865 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:19.865 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:19.865 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:19.865 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:19.865 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:19.865 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:19.866 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:19.866 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:19.866 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:19.867 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=31, TimeoutTracker(timeout=30000, elapsed=29896), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [10ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [16ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [22ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [22ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [65ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [69ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [78ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [78ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [104ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [107ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [109ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [109ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [122ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [123ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [123ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [123ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [141ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [143ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [144ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [145ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [145ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [183ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [183ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [183ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [224ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [224ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [282ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [283ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [283ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [284ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [363ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [363ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [364ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [364ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [663ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [664ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [665ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [665ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1281ms] refreshing cache from master, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1284ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1284ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2001ms] refreshing cache from master, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2003ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2003ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [2004ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2004ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2040ms] refreshing cache from master, [2040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2042ms] too many traces: truncated at 100 traces, deferred=Deferred@1816504912(state=PENDING, result=null, callback=(continuation of Deferred@15925497 after retry RPC after error@543286420) -> (continuation of Deferred@1159948405 after retry RPC after error@74800555) -> (continuation of Deferred@471425300 after retry RPC after error@871592775) -> (continuation of Deferred@1842206092 after retry RPC after error@1140540827) -> (continuation of Deferred@347966769 after retry RPC after error@1014807978) -> (continuation of Deferred@1058958876 after retry RPC after error@651174905) -> (continuation of Deferred@1585247767 after retry RPC after error@120881567) -> (continuation of Deferred@1268150763 after retry RPC after error@1828609163) -> (continuation of Deferred@1435222861 after retry RPC after error@1989183514) -> (continuation of Deferred@242333194 after retry RPC after error@276150603) -> (continuation of Deferred@468685219 after retry RPC after error@1775045276) -> (continuation of Deferred@1779376201 after retry RPC after error@1468887970) -> (continuation of Deferred@805868153 after retry RPC after error@831584014) -> (continuation of Deferred@579765277 after retry RPC after error@513991565) -> (continuation of Deferred@1791832442 after retry RPC after error@1557369770) -> (continuation of Deferred@179001921 after retry RPC after error@60587538) -> (continuation of Deferred@14277114 after retry RPC after error@1079465096) -> (continuation of Deferred@285108113 after retry RPC after error@1886578546) -> (continuation of Deferred@1051387535 after retry RPC after error@1143146182) -> (continuation of Deferred@654451516 after retry RPC after error@1076627929) -> (continuation of Deferred@702222797 after retry RPC after error@1972512518) -> (continuation of Deferred@1128259915 after retry RPC after error@1677543988) -> (continuation of Deferred@316242687 after retry RPC after error@1981273525) -> (continuation of Deferred@1251886981 after retry RPC after error@1127942152) -> (continuation of Deferred@443321362 after retry RPC after error@1386104983) -> (continuation of Deferred@1787072302 after retry RPC after error@1902420286) -> (continuation of Deferred@253148956 after retry RPC after error@795645081) -> (continuation of Deferred@1633649573 after retry RPC after error@895923169) -> (continuation of Deferred@254936078 after retry RPC after error@1144095021) -> (continuation of Deferred@1508794533 after retry RPC after error@1494694338), errback=(continuation of Deferred@15925497 after retry RPC after error@543286420) -> (continuation of Deferred@1159948405 after retry RPC after error@74800555) -> (continuation of Deferred@471425300 after retry RPC after error@871592775) -> (continuation of Deferred@1842206092 after retry RPC after error@1140540827) -> (continuation of Deferred@347966769 after retry RPC after error@1014807978) -> (continuation of Deferred@1058958876 after retry RPC after error@651174905) -> (continuation of Deferred@1585247767 after retry RPC after error@120881567) -> (continuation of Deferred@1268150763 after retry RPC after error@1828609163) -> (continuation of Deferred@1435222861 after retry RPC after error@1989183514) -> (continuation of Deferred@242333194 after retry RPC after error@276150603) -> (continuation of Deferred@468685219 after retry RPC after error@1775045276) -> (continuation of Deferred@1779376201 after retry RPC after error@1468887970) -> (continuation of Deferred@805868153 after retry RPC after error@831584014) -> (continuation of Deferred@579765277 after retry RPC after error@513991565) -> (continuation of Deferred@1791832442 after retry RPC after error@1557369770) -> (continuation of Deferred@179001921 after retry RPC after error@60587538) -> (continuation of Deferred@14277114 after retry RPC after error@1079465096) -> (continuation of Deferred@285108113 after retry RPC after error@1886578546) -> (continuation of Deferred@1051387535 after retry RPC after error@1143146182) -> (continuation of Deferred@654451516 after retry RPC after error@1076627929) -> (continuation of Deferred@702222797 after retry RPC after error@1972512518) -> (continuation of Deferred@1128259915 after retry RPC after error@1677543988) -> (continuation of Deferred@316242687 after retry RPC after error@1981273525) -> (continuation of Deferred@1251886981 after retry RPC after error@1127942152) -> (continuation of Deferred@443321362 after retry RPC after error@1386104983) -> (continuation of Deferred@1787072302 after retry RPC after error@1902420286) -> (continuation of Deferred@253148956 after retry RPC after error@795645081) -> (continuation of Deferred@1633649573 after retry RPC after error@895923169) -> (continuation of Deferred@254936078 after retry RPC after error@1144095021) -> (continuation of Deferred@1508794533 after retry RPC after error@1494694338)))
08:07:19.868 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
08:07:19.869 [WARN - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#3 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=31, TimeoutTracker(timeout=30000, elapsed=29896), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [10ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [16ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [22ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [22ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [65ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [69ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [78ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [78ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [104ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [107ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [109ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [109ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [122ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [123ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [123ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [123ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [141ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [143ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [144ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [145ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [145ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [183ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [183ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [183ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [224ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [224ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [282ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [283ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [283ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [284ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [363ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [363ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [364ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [364ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [663ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [664ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [665ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [665ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1281ms] refreshing cache from master, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1284ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1284ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2001ms] refreshing cache from master, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2003ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2003ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [2004ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2004ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2040ms] refreshing cache from master, [2040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2042ms] too many traces: truncated at 100 traces, deferred=Deferred@1816504912(state=PENDING, result=null, callback=(continuation of Deferred@15925497 after retry RPC after error@543286420) -> (continuation of Deferred@1159948405 after retry RPC after error@74800555) -> (continuation of Deferred@471425300 after retry RPC after error@871592775) -> (continuation of Deferred@1842206092 after retry RPC after error@1140540827) -> (continuation of Deferred@347966769 after retry RPC after error@1014807978) -> (continuation of Deferred@1058958876 after retry RPC after error@651174905) -> (continuation of Deferred@1585247767 after retry RPC after error@120881567) -> (continuation of Deferred@1268150763 after retry RPC after error@1828609163) -> (continuation of Deferred@1435222861 after retry RPC after error@1989183514) -> (continuation of Deferred@242333194 after retry RPC after error@276150603) -> (continuation of Deferred@468685219 after retry RPC after error@1775045276) -> (continuation of Deferred@1779376201 after retry RPC after error@1468887970) -> (continuation of Deferred@805868153 after retry RPC after error@831584014) -> (continuation of Deferred@579765277 after retry RPC after error@513991565) -> (continuation of Deferred@1791832442 after retry RPC after error@1557369770) -> (continuation of Deferred@179001921 after retry RPC after error@60587538) -> (continuation of Deferred@14277114 after retry RPC after error@1079465096) -> (continuation of Deferred@285108113 after retry RPC after error@1886578546) -> (continuation of Deferred@1051387535 after retry RPC after error@1143146182) -> (continuation of Deferred@654451516 after retry RPC after error@1076627929) -> (continuation of Deferred@702222797 after retry RPC after error@1972512518) -> (continuation of Deferred@1128259915 after retry RPC after error@1677543988) -> (continuation of Deferred@316242687 after retry RPC after error@1981273525) -> (continuation of Deferred@1251886981 after retry RPC after error@1127942152) -> (continuation of Deferred@443321362 after retry RPC after error@1386104983) -> (continuation of Deferred@1787072302 after retry RPC after error@1902420286) -> (continuation of Deferred@253148956 after retry RPC after error@795645081) -> (continuation of Deferred@1633649573 after retry RPC after error@895923169) -> (continuation of Deferred@254936078 after retry RPC after error@1144095021) -> (continuation of Deferred@1508794533 after retry RPC after error@1494694338), errback=(continuation of Deferred@15925497 after retry RPC after error@543286420) -> (continuation of Deferred@1159948405 after retry RPC after error@74800555) -> (continuation of Deferred@471425300 after retry RPC after error@871592775) -> (continuation of Deferred@1842206092 after retry RPC after error@1140540827) -> (continuation of Deferred@347966769 after retry RPC after error@1014807978) -> (continuation of Deferred@1058958876 after retry RPC after error@651174905) -> (continuation of Deferred@1585247767 after retry RPC after error@120881567) -> (continuation of Deferred@1268150763 after retry RPC after error@1828609163) -> (continuation of Deferred@1435222861 after retry RPC after error@1989183514) -> (continuation of Deferred@242333194 after retry RPC after error@276150603) -> (continuation of Deferred@468685219 after retry RPC after error@1775045276) -> (continuation of Deferred@1779376201 after retry RPC after error@1468887970) -> (continuation of Deferred@805868153 after retry RPC after error@831584014) -> (continuation of Deferred@579765277 after retry RPC after error@513991565) -> (continuation of Deferred@1791832442 after retry RPC after error@1557369770) -> (continuation of Deferred@179001921 after retry RPC after error@60587538) -> (continuation of Deferred@14277114 after retry RPC after error@1079465096) -> (continuation of Deferred@285108113 after retry RPC after error@1886578546) -> (continuation of Deferred@1051387535 after retry RPC after error@1143146182) -> (continuation of Deferred@654451516 after retry RPC after error@1076627929) -> (continuation of Deferred@702222797 after retry RPC after error@1972512518) -> (continuation of Deferred@1128259915 after retry RPC after error@1677543988) -> (continuation of Deferred@316242687 after retry RPC after error@1981273525) -> (continuation of Deferred@1251886981 after retry RPC after error@1127942152) -> (continuation of Deferred@443321362 after retry RPC after error@1386104983) -> (continuation of Deferred@1787072302 after retry RPC after error@1902420286) -> (continuation of Deferred@253148956 after retry RPC after error@795645081) -> (continuation of Deferred@1633649573 after retry RPC after error@895923169) -> (continuation of Deferred@254936078 after retry RPC after error@1144095021) -> (continuation of Deferred@1508794533 after retry RPC after error@1494694338)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.190:44627
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:07:19.871 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#3 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_3).
08:07:19.873 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#3 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_3.
08:07:19.875 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to FAILED on 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=31, TimeoutTracker(timeout=30000, elapsed=29896), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [10ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [16ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [22ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [22ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [65ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [69ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [78ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [78ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [104ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [107ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [109ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [109ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [122ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [123ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [123ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [123ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [141ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [143ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [144ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [145ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [145ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [183ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [183ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [183ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [224ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [224ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [282ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [283ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [283ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [284ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [363ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [363ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [364ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [364ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [663ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [664ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [665ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [665ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1281ms] refreshing cache from master, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1284ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1284ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2001ms] refreshing cache from master, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2003ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2003ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [2004ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2004ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2040ms] refreshing cache from master, [2040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2042ms] too many traces: truncated at 100 traces, deferred=Deferred@1816504912(state=PENDING, result=null, callback=(continuation of Deferred@15925497 after retry RPC after error@543286420) -> (continuation of Deferred@1159948405 after retry RPC after error@74800555) -> (continuation of Deferred@471425300 after retry RPC after error@871592775) -> (continuation of Deferred@1842206092 after retry RPC after error@1140540827) -> (continuation of Deferred@347966769 after retry RPC after error@1014807978) -> (continuation of Deferred@1058958876 after retry RPC after error@651174905) -> (continuation of Deferred@1585247767 after retry RPC after error@120881567) -> (continuation of Deferred@1268150763 after retry RPC after error@1828609163) -> (continuation of Deferred@1435222861 after retry RPC after error@1989183514) -> (continuation of Deferred@242333194 after retry RPC after error@276150603) -> (continuation of Deferred@468685219 after retry RPC after error@1775045276) -> (continuation of Deferred@1779376201 after retry RPC after error@1468887970) -> (continuation of Deferred@805868153 after retry RPC after error@831584014) -> (continuation of Deferred@579765277 after retry RPC after error@513991565) -> (continuation of Deferred@1791832442 after retry RPC after error@1557369770) -> (continuation of Deferred@179001921 after retry RPC after error@60587538) -> (continuation of Deferred@14277114 after retry RPC after error@1079465096) -> (continuation of Deferred@285108113 after retry RPC after error@1886578546) -> (continuation of Deferred@1051387535 after retry RPC after error@1143146182) -> (continuation of Deferred@654451516 after retry RPC after error@1076627929) -> (continuation of Deferred@702222797 after retry RPC after error@1972512518) -> (continuation of Deferred@1128259915 after retry RPC after error@1677543988) -> (continuation of Deferred@316242687 after retry RPC after error@1981273525) -> (continuation of Deferred@1251886981 after retry RPC after error@1127942152) -> (continuation of Deferred@443321362 after retry RPC after error@1386104983) -> (continuation of Deferred@1787072302 after retry RPC after error@1902420286) -> (continuation of Deferred@253148956 after retry RPC after error@795645081) -> (continuation of Deferred@1633649573 after retry RPC after error@895923169) -> (continuation of Deferred@254936078 after retry RPC after error@1144095021) -> (continuation of Deferred@1508794533 after retry RPC after error@1494694338), errback=(continuation of Deferred@15925497 after retry RPC after error@543286420) -> (continuation of Deferred@1159948405 after retry RPC after error@74800555) -> (continuation of Deferred@471425300 after retry RPC after error@871592775) -> (continuation of Deferred@1842206092 after retry RPC after error@1140540827) -> (continuation of Deferred@347966769 after retry RPC after error@1014807978) -> (continuation of Deferred@1058958876 after retry RPC after error@651174905) -> (continuation of Deferred@1585247767 after retry RPC after error@120881567) -> (continuation of Deferred@1268150763 after retry RPC after error@1828609163) -> (continuation of Deferred@1435222861 after retry RPC after error@1989183514) -> (continuation of Deferred@242333194 after retry RPC after error@276150603) -> (continuation of Deferred@468685219 after retry RPC after error@1775045276) -> (continuation of Deferred@1779376201 after retry RPC after error@1468887970) -> (continuation of Deferred@805868153 after retry RPC after error@831584014) -> (continuation of Deferred@579765277 after retry RPC after error@513991565) -> (continuation of Deferred@1791832442 after retry RPC after error@1557369770) -> (continuation of Deferred@179001921 after retry RPC after error@60587538) -> (continuation of Deferred@14277114 after retry RPC after error@1079465096) -> (continuation of Deferred@285108113 after retry RPC after error@1886578546) -> (continuation of Deferred@1051387535 after retry RPC after error@1143146182) -> (continuation of Deferred@654451516 after retry RPC after error@1076627929) -> (continuation of Deferred@702222797 after retry RPC after error@1972512518) -> (continuation of Deferred@1128259915 after retry RPC after error@1677543988) -> (continuation of Deferred@316242687 after retry RPC after error@1981273525) -> (continuation of Deferred@1251886981 after retry RPC after error@1127942152) -> (continuation of Deferred@443321362 after retry RPC after error@1386104983) -> (continuation of Deferred@1787072302 after retry RPC after error@1902420286) -> (continuation of Deferred@253148956 after retry RPC after error@795645081) -> (continuation of Deferred@1633649573 after retry RPC after error@895923169) -> (continuation of Deferred@254936078 after retry RPC after error@1144095021) -> (continuation of Deferred@1508794533 after retry RPC after error@1494694338)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.190:44627
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:07:19.879 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:07:19.882 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#3) of source Source: KuduSource.
08:07:19.883 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_3.
08:07:20.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:20.019 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:20.020 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:20.020 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:20.021 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:20.021 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:20.021 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:20.021 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:20.021 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:20.021 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:20.021 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:20.021 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:20.021 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:20.021 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:20.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:20.094262 32368 heartbeater.cc:499] Master 127.31.46.252:40541 was elected leader, sending a full tablet report...
08:07:20.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091640118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:20.136 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
08:07:20.138 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
08:07:20.150 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:20.151 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:20.151 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:20.151 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:20.151 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:20.151 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:20.151 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:20.151 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:20.152 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:20.152 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:20.151 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:20.156 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:20.156 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:20.162 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:20.236 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:20.236 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:20.236 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:20.237 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:20.237 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:20.237 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:20.238 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:20.238 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:20.238 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:20.238 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:20.238 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:20.238 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:20.238 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:20.411 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:20.411 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:20.412 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:20.412 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:20.413 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:20.413 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:20.413 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:20.414 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:20.414 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:20.414 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:20.414 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:20.414 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:20.414 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:20.472 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:20.473 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:20.473 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:20.474 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:20.474 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:20.474 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:20.475 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:20.475 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:20.475 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:20.476 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:20.476 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:20.476 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:20.476 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:20.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:20.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091640618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:20.641 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=22 ms, finalizationTime=1 ms).
08:07:20.645 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
08:07:20.662 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:21.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:21.108 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:21.108 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:21.109 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:21.110 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:21.110 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:21.110 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:21.111 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:21.111 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:21.111 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:21.114 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:21.114 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:21.114 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:21.114 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:21.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091641118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:21.131 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
08:07:21.132 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
08:07:21.162 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:21.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:21.047210 32383 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 32378
08:07:21.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:21.304322 32383 kernel_stack_watchdog.cc:198] Thread 32378 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 385ms:
08:07:21.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:07:21.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:07:21.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:07:21.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:07:21.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:19.658367 32384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:21.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:21.306512 32378 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.648s	user 0.000s	sys 0.002s
08:07:21.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:21.306550 32386 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1646 milliseconds
08:07:21.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:21.307111 32378 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.649s	user 0.000s	sys 0.002s
08:07:21.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.309132 32378 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:07:21.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:21.309259 32388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:21.312 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:21.312 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:21.312 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:21.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.312465 32378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:07:21.312 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:21.313 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:21.313 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:21.313 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:21.313 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:21.313 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:21.313 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:21.313 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:21.313 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:21.314 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:21.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.315265 32378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:07:21.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.316663 32378 hybrid_clock.cc:648] HybridClock initialized: now 1779091641316613 us; error 29 us; skew 500 ppm
08:07:21.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.317682 32378 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:07:21.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.325102 32378 webserver.cc:533] Webserver started at http://127.31.46.194:41047/ using document root <none> and password file <none>
08:07:21.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.326364 32378 fs_manager.cc:362] Metadata directory not provided
08:07:21.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.326673 32378 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:07:21.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.327277 32378 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:07:21.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.332679 32378 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-1/data/instance:
08:07:21.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cdab818f784c43329a4a6a164a1cf7c3"
08:07:21.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:21 on dist-test-slave-1jss"
08:07:21.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.334149 32378 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-1/wal/instance:
08:07:21.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cdab818f784c43329a4a6a164a1cf7c3"
08:07:21.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:21 on dist-test-slave-1jss"
08:07:21.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.342823 32378 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.000s
08:07:21.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.350005 32395 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:07:21.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.351487 32378 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.001s
08:07:21.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.351874 32378 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-1/wal
08:07:21.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cdab818f784c43329a4a6a164a1cf7c3"
08:07:21.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:21 on dist-test-slave-1jss"
08:07:21.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.352339 32378 fs_report.cc:389] FS layout report
08:07:21.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:07:21.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-1/wal
08:07:21.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-1/wal
08:07:21.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-1/data/data
08:07:21.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:07:21.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:07:21.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:07:21.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:07:21.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:07:21.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:07:21.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:07:21.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:07:21.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:07:21.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:07:21.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:07:21.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.411798 32378 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:07:21.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.413646 32378 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:07:21.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.414240 32378 kserver.cc:163] Server-wide thread pool size limit: 3276
08:07:21.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.417500 32378 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:07:21.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.422521 32378 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:07:21.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.422760 32378 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:07:21.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.423094 32378 ts_tablet_manager.cc:616] Registered 0 tablets
08:07:21.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.423285 32378 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:07:21.467 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job e26b904229418d0e047d5d94c5b9f905 from Checkpoint 76 @ 1779091546865 for e26b904229418d0e047d5d94c5b9f905 located at file:/tmp/junit16937918701930502306/checkpoints/e26b904229418d0e047d5d94c5b9f905/chk-76.
08:07:21.469 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
08:07:21.469 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to SCHEDULED.
08:07:21.470 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 2 to checkpoint 76 for source Source: KuduSource to checkpoint.
08:07:21.471 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:07:21.471 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from SCHEDULED to DEPLOYING.
08:07:21.471 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #4) with attempt id 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1) with allocation id 0f1066b174fb1f271b9fbb4939140659
08:07:21.472 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (e26b904229418d0e047d5d94c5b9f905) switched from state RESTARTING to RUNNING.
08:07:21.472 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskSlotTableImpl.java:391) Activate slot 0f1066b174fb1f271b9fbb4939140659.
08:07:21.472 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job e26b904229418d0e047d5d94c5b9f905 from Checkpoint 76 @ 1779091546865 for e26b904229418d0e047d5d94c5b9f905 located at file:/tmp/junit16937918701930502306/checkpoints/e26b904229418d0e047d5d94c5b9f905/chk-76.
08:07:21.473 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
08:07:21.473 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 76 for source Source: KuduSource to checkpoint.
08:07:21.473 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to SCHEDULED.
08:07:21.473 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#4 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_4), deploy into slot with allocation id 0f1066b174fb1f271b9fbb4939140659.
08:07:21.474 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:07:21.474 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to DEPLOYING.
08:07:21.474 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#4 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_4) [DEPLOYING].
08:07:21.475 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from SCHEDULED to DEPLOYING.
08:07:21.475 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #4) with attempt id 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1) with allocation id bc35714883422bae5e4de5056d4b8678
08:07:21.475 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot bc35714883422bae5e4de5056d4b8678.
08:07:21.475 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@29b266ed
08:07:21.475 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:07:21.476 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#4 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_4), deploy into slot with allocation id bc35714883422bae5e4de5056d4b8678.
08:07:21.477 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16937918701930502306/checkpoints")
08:07:21.477 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
08:07:21.477 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
08:07:21.480 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3e5fbb58
08:07:21.482 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to DEPLOYING.
08:07:21.482 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#4 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_4) [DEPLOYING].
08:07:21.483 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@9e47fdb
08:07:21.483 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:07:21.483 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16937918701930502306/checkpoints")
08:07:21.483 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
08:07:21.483 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
08:07:21.485 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:21.487 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:21.488 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:21.488 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.488 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.488 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.489 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@307a340a
08:07:21.490 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:21.490 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.491 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.491 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.491 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:21.506 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.506 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.506 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.507 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:21.510 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:21.511 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:21.512 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.512 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.512 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.512 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:21.513 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.513 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.514 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.514 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.514 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.514 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.515 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:21.515 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:21.527 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:21.528 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:21.529 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.529 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.529 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.529 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:21.530 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:21.530 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.530 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.530 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.531 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.531 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.531 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.531 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:21.532 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:21.532 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.532 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.533 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.534 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:21.534 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.534 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.534 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.536 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.536 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.536 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.536 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:21.547 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:21.548 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:21.549 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.549 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.549 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:21.549 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.549 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.549 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.549 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.549 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.549 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.550 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.550 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:21.550 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:21.550 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:21.551 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.551 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:21.551 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.551 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.551 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.551 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.551 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.551 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.551 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.551 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.552 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:21.568 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:21.568 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:21.568 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:21.568 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.569 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.569 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.569 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.569 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.569 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.569 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.569 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.570 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.570 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:21.570 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:21.570 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:21.570 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:21.570 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.571 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.571 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.571 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.571 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.571 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.571 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.571 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.571 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.572 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:21.587 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:21.587 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:21.587 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:21.588 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.588 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.588 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.588 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.588 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.588 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.588 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.589 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.589 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.589 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:21.590 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:21.590 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:21.590 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:21.591 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.591 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.591 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.591 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.591 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.591 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.591 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.591 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.591 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.592 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:21.610 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:21.610 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:21.611 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:21.611 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.611 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.612 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.612 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.612 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.612 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.613 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.613 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.613 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.613 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:21.618 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091641618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:21.627 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:21.627 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:21.628 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:21.629 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.629 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.629 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.630 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.630 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.630 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.632 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:21.632 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:21.632 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.632 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.632 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:21.632 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.633 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.633 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.633 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.634 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.634 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.634 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.634 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:21.634 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.634 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.634 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.634 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:21.637 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=19 ms, finalizationTime=0 ms).
08:07:21.638 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
08:07:21.663 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:21.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.665570 32378 rpc_server.cc:307] RPC server started. Bound to: 127.31.46.194:39687
08:07:21.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.665839 32527 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.46.194:39687 every 8 connection(s)
08:07:21.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.668809 32378 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-1/data/info.pb
08:07:21.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.673949 31931 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 32378
08:07:21.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.674558 31931 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-1/wal/instance
08:07:21.687 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:21.688 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:21.688 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:21.688 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.689 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.689 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.689 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.689 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.689 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.689 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.689 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.689 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.689 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:21.690 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:21.691 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:21.691 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:21.691 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.692 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.692 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.692 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.692 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.692 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.693 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.693 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.693 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.693 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:21.711 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:21.711 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:21.711 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:21.712 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.712 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.712 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.713 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.713 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.713 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.714 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.714 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.714 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.714 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:21.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.717613 31931 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:07:21.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:07:21.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-2/wal
08:07:21.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-2/data
08:07:21.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:07:21.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:07:21.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:07:21.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:21.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:21.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:21.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-2/logs
08:07:21.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-2/data/info.pb
08:07:21.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:21.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:07:21.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:07:21.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:07:21.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:07:21.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:21.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:21.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:21.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:07:21.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:07:21.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.46.195:0
08:07:21.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.46.195
08:07:21.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.46.195
08:07:21.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:21.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541
08:07:21.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.46.212:33327
08:07:21.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:21.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:21.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:07:21.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.740969 32530 heartbeater.cc:344] Connected to a master server at 127.31.46.254:45015
08:07:21.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.741652 32530 heartbeater.cc:461] Registering TS with master...
08:07:21.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.743474 32530 heartbeater.cc:507] Master 127.31.46.254:45015 requested a full tablet report, sending...
08:07:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.747512 31977 ts_manager.cc:194] Registered new tserver with Master: cdab818f784c43329a4a6a164a1cf7c3 (127.31.46.194:39687)
08:07:21.750 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:21.750 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:21.751 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:21.751 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.752 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.752 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.753 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.753 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.753 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.753 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.753 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.754 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.754 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:21.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.753957 32528 heartbeater.cc:344] Connected to a master server at 127.31.46.252:40541
08:07:21.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.754465 32528 heartbeater.cc:461] Registering TS with master...
08:07:21.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.755724 32528 heartbeater.cc:507] Master 127.31.46.252:40541 requested a full tablet report, sending...
08:07:21.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.757965 32529 heartbeater.cc:344] Connected to a master server at 127.31.46.253:46697
08:07:21.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.758338 32529 heartbeater.cc:461] Registering TS with master...
08:07:21.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.758419 32133 ts_manager.cc:194] Registered new tserver with Master: cdab818f784c43329a4a6a164a1cf7c3 (127.31.46.194:39687)
08:07:21.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.759294 32529 heartbeater.cc:507] Master 127.31.46.253:46697 requested a full tablet report, sending...
08:07:21.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.760344 32133 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.46.194:59613
08:07:21.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:21.762311 32052 ts_manager.cc:194] Registered new tserver with Master: cdab818f784c43329a4a6a164a1cf7c3 (127.31.46.194:39687)
08:07:21.787 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:21.788 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:21.788 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:21.788 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.789 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.789 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:21.789 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.789 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.789 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:21.789 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.789 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.789 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:21.789 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:21.954 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:22.015 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:22.047 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:22.048 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:22.048 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:22.048 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:22.048 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:22.048 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:22.048 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:22.048 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:22.048 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:22.048 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:22.049 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:22.049 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:22.049 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:22.095 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:22.096 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:22.096 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:22.096 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:22.096 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:22.097 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:22.097 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:22.097 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:22.097 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:22.097 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:22.097 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:22.097 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:22.097 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:22.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091642118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:22.128 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
08:07:22.129 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
08:07:22.163 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:22.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:22.166513 32538 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:07:22.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:22.167235 32538 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:07:22.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:22.167702 32538 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:07:22.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:22.206828 32538 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:07:22.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:22.207842 32538 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.46.195
08:07:22.227 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:22.228 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:22.228 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:22.228 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:22.228 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:22.228 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:22.228 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:22.228 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:22.228 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:22.228 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:22.228 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:22.228 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:22.229 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:22.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:22.252070 32538 tablet_server_runner.cc:78] Tablet server non-default flags:
08:07:22.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:22.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.46.212:33327
08:07:22.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:22.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:22.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-2/data
08:07:22.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-2/wal
08:07:22.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:22.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:22.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.46.195:0
08:07:22.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:07:22.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:22.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:22.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-2/data/info.pb
08:07:22.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.46.195
08:07:22.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:22.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541
08:07:22.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:07:22.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:22.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:07:22.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:07:22.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:22.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.46.195
08:07:22.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-2/logs
08:07:22.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:22.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:07:22.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:07:22.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:07:22.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:07:22.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:07:22.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:07:22.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:07:22.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:07:22.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:07:22.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:22.254062 32538 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:07:22.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:22.256441 32538 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:07:22.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:22.273906 32544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:22.454 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:22.510 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:22.511 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:22.511 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:22.511 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:22.511 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:22.512 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:22.512 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:22.512 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:22.512 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:22.512 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:22.512 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:22.512 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:22.512 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:22.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:22.580 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:22.581 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:22.581 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:22.581 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:22.581 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:22.582 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:22.582 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:22.583 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:22.583 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:22.583 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:22.583 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:22.583 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:22.584 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:22.612 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:22.613 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:22.613 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:22.614 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:22.614 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:22.614 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:22.615 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:22.615 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:22.615 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:22.617 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:22.617 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:22.617 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:22.617 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:22.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091642618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:22.629 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:07:22.631 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
08:07:22.664 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:22.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:22.765894 32528 heartbeater.cc:499] Master 127.31.46.252:40541 was elected leader, sending a full tablet report...
08:07:22.868 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:22.868 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:22.868 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:22.869 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:22.870 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:22.870 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:22.870 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:22.870 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:22.870 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:22.871 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:22.871 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:22.872 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:22.872 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:22.954 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:23.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:23.120 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091643118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:23.132 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
08:07:23.136 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
08:07:23.163 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:23.454 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:23.515 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:23.570 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:23.571 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:23.571 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:23.571 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:23.571 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:23.571 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:23.571 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:23.571 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:23.571 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:23.572 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:23.572 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:23.572 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:23.572 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:23.620 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091643619 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:23.629 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
08:07:23.631 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
08:07:23.663 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:23.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:22.277832 32545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:23.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:22.278321 32547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:23.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:23.749620 32546 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1470 milliseconds
08:07:23.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:23.749935 32538 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:07:23.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:23.751641 32538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:07:23.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:23.755246 32538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:07:23.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:23.757038 32538 hybrid_clock.cc:648] HybridClock initialized: now 1779091643756732 us; error 333 us; skew 500 ppm
08:07:23.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:23.758350 32538 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:07:23.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:23.766124 32538 webserver.cc:533] Webserver started at http://127.31.46.195:36089/ using document root <none> and password file <none>
08:07:23.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:23.767511 32538 fs_manager.cc:362] Metadata directory not provided
08:07:23.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:23.767808 32538 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:07:23.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:23.768482 32538 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:07:23.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:23.774932 32538 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-2/data/instance:
08:07:23.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4a91936aa3fc4705a7fb8e2e53edf637"
08:07:23.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:23 on dist-test-slave-1jss"
08:07:23.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:23.776527 32538 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-2/wal/instance:
08:07:23.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4a91936aa3fc4705a7fb8e2e53edf637"
08:07:23.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:23 on dist-test-slave-1jss"
08:07:23.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:23.786703 32538 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.007s	sys 0.005s
08:07:23.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:23.793771 32556 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:07:23.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:23.795011 32538 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
08:07:23.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:23.795416 32538 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-2/wal
08:07:23.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4a91936aa3fc4705a7fb8e2e53edf637"
08:07:23.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:23 on dist-test-slave-1jss"
08:07:23.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:23.795809 32538 fs_report.cc:389] FS layout report
08:07:23.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:07:23.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-2/wal
08:07:23.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-2/wal
08:07:23.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-2/data/data
08:07:23.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:07:23.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:07:23.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:07:23.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:07:23.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:07:23.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:07:23.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:07:23.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:07:23.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:07:23.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:07:23.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:07:23.807 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:23.808 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:23.808 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:23.808 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:23.808 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:23.808 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:23.808 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:23.808 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:23.808 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:23.808 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:23.809 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:23.809 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:23.809 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:23.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:23.860138 32538 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:07:23.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:23.862252 32538 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:07:23.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:23.862802 32538 kserver.cc:163] Server-wide thread pool size limit: 3276
08:07:23.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:23.866155 32538 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:07:23.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:23.872100 32538 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:07:23.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:23.872406 32538 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:07:23.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:23.872769 32538 ts_tablet_manager.cc:616] Registered 0 tablets
08:07:23.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:23.872965 32538 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:07:23.953 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:23.970 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:23.971 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:23.971 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:23.972 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:23.972 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:23.972 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:23.972 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:23.972 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:23.972 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:23.972 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:23.972 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:23.972 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:23.972 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:24.000 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:24.000 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:24.000 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:24.001 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:24.001 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:24.001 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:24.001 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:24.002 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:24.002 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:24.001 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:24.002 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:24.002 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:24.002 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:24.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:24.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:24.063540 32538 rpc_server.cc:307] RPC server started. Bound to: 127.31.46.195:38219
08:07:24.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:24.063655 32668 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.46.195:38219 every 8 connection(s)
08:07:24.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:24.066782 32538 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-2/data/info.pb
08:07:24.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:24.067548 31931 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 32538
08:07:24.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:24.068017 31931 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12755385230302992124/ts-2/wal/instance
08:07:24.090 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:24.090 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:24.090 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:24.091 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:24.091 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:24.091 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:24.091 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:24.091 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:24.092 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:24.092 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:24.092 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:24.091 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:24.092 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:24.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091644118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:24.126 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
08:07:24.129 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
08:07:24.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:24.140674 32671 heartbeater.cc:344] Connected to a master server at 127.31.46.254:45015
08:07:24.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:24.141325 32671 heartbeater.cc:461] Registering TS with master...
08:07:24.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:24.142926 32671 heartbeater.cc:507] Master 127.31.46.254:45015 requested a full tablet report, sending...
08:07:24.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:24.145066 32669 heartbeater.cc:344] Connected to a master server at 127.31.46.252:40541
08:07:24.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:24.145445 32669 heartbeater.cc:461] Registering TS with master...
08:07:24.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:24.146526 32669 heartbeater.cc:507] Master 127.31.46.252:40541 requested a full tablet report, sending...
08:07:24.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:24.146625 31976 ts_manager.cc:194] Registered new tserver with Master: 4a91936aa3fc4705a7fb8e2e53edf637 (127.31.46.195:38219)
08:07:24.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:24.149513 32133 ts_manager.cc:194] Registered new tserver with Master: 4a91936aa3fc4705a7fb8e2e53edf637 (127.31.46.195:38219)
08:07:24.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:24.151753 32133 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.46.195:41303
08:07:24.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:24.153988 32670 heartbeater.cc:344] Connected to a master server at 127.31.46.253:46697
08:07:24.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:24.154387 32670 heartbeater.cc:461] Registering TS with master...
08:07:24.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:24.155503 32670 heartbeater.cc:507] Master 127.31.46.253:46697 requested a full tablet report, sending...
08:07:24.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:24.158317 32052 ts_manager.cc:194] Registered new tserver with Master: 4a91936aa3fc4705a7fb8e2e53edf637 (127.31.46.195:38219)
08:07:24.162 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:24.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:24.167766 31931 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
08:07:24.182 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:07:24.182 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

08:07:24.183 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.31.46.254"
      port: 45015
    }
    bound_http_address {
      host: "127.31.46.254"
      port: 33565
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.31.46.253"
      port: 46697
    }
    bound_http_address {
      host: "127.31.46.253"
      port: 41639
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.31.46.252"
      port: 40541
    }
    bound_http_address {
      host: "127.31.46.252"
      port: 34941
    }
  }
}

08:07:24.183 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

08:07:24.184 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.31.46.193"
      port: 43719
    }
    bound_http_address {
      host: "127.31.46.193"
      port: 40031
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.31.46.194"
      port: 39687
    }
    bound_http_address {
      host: "127.31.46.194"
      port: 41047
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.31.46.195"
      port: 38219
    }
    bound_http_address {
      host: "127.31.46.195"
      port: 36089
    }
  }
}

08:07:24.184 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
08:07:24.186 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:24.187 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
08:07:24.187 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskk4_r_T/test-tmp
08:07:24.187 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
08:07:24.188 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskk4_r_T/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
08:07:24.192 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

08:07:24.454 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:24.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:24.572 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:24.572 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:24.573 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:24.573 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:24.573 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:24.573 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:24.573 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:24.573 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:24.573 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:24.573 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:24.573 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:24.573 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:24.573 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:24.603 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:07:24.603 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

08:07:24.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:24.607755 32679 mini_oidc.cc:150] Starting JWKS server
08:07:24.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:24.612180 32679 webserver.cc:533] Webserver started at http://127.0.0.1:38129/ using document root <none> and password file <none>
08:07:24.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:24.612650 32679 mini_oidc.cc:186] Starting OIDC Discovery server
08:07:24.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:24.615391 32679 webserver.cc:533] Webserver started at http://127.0.0.1:44733/ using document root <none> and password file <none>
08:07:24.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091644618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:24.627 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
08:07:24.627 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
08:07:24.663 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:24.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:07:24Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
08:07:24.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:07:24Z Disabled control of system clock
08:07:24.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:24.693326 32679 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:07:24.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:07:24.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-0/wal
08:07:24.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-0/data
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-0/logs
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-0/data/info.pb
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.233.254:35197
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.233.254
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.233.212:42413
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:07:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38129/jwks.json with env {}
08:07:24.707 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:24.708 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:24.708 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:24.708 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:24.708 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:24.708 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:24.708 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:24.709 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:24.709 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:24.709 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:24.709 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:24.709 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:24.709 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:24.954 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:25.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:25.056 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:25.057 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:25.057 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:25.057 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:25.057 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:25.057 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:25.057 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:25.057 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:25.057 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:25.057 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:25.057 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:25.057 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:25.058 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:25.059 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=26978), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [12ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [108ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [125ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [151ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [203ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [218ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [219ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [235ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [238ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [323ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [324ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [347ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [347ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [348ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [348ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [361ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [362ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [362ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [362ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [381ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [381ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [381ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [381ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [421ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [422ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [422ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [423ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [460ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [462ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [463ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [463ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [464ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [581ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [581ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [583ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [583ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [740ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [744ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [745ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [746ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [746ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [820ms] refreshing cache from master, [820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [822ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [822ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [822ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [823ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1740ms] refreshing cache from master, [1740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1743ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1743ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1743ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1744ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1744ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1961ms] refreshing cache from master, [1961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1963ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1964ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1964ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1965ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2341ms] refreshing cache from master, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [2342ms] too many traces: truncated at 100 traces, deferred=Deferred@1343404564(state=PENDING, result=null, callback=(continuation of Deferred@1957844539 after retry RPC after error@595887245) -> (continuation of Deferred@288612811 after retry RPC after error@1421093859) -> (continuation of Deferred@852606144 after retry RPC after error@905373435) -> (continuation of Deferred@1002791991 after retry RPC after error@1314634655) -> (continuation of Deferred@1901279528 after retry RPC after error@1930479815) -> (continuation of Deferred@1675947598 after retry RPC after error@1894790894) -> (continuation of Deferred@411229089 after retry RPC after error@1839296134) -> (continuation of Deferred@703822818 after retry RPC after error@1480949620) -> (continuation of Deferred@1452599310 after retry RPC after error@816277764) -> (continuation of Deferred@37304473 after retry RPC after error@1903450485) -> (continuation of Deferred@5311437 after retry RPC after error@188067210) -> (continuation of Deferred@1073983877 after retry RPC after error@334493441) -> (continuation of Deferred@459839954 after retry RPC after error@1024929480) -> (continuation of Deferred@1623535478 after retry RPC after error@218012560) -> (continuation of Deferred@1401365972 after retry RPC after error@1474437122) -> (continuation of Deferred@513084183 after retry RPC after error@1724850510) -> (continuation of Deferred@202117574 after retry RPC after error@1252577909) -> (continuation of Deferred@2085860740 after retry RPC after error@1661550097) -> (continuation of Deferred@258445719 after retry RPC after error@64012660) -> (continuation of Deferred@1649322783 after retry RPC after error@1218308337) -> (continuation of Deferred@2076517212 after retry RPC after error@2124121649) -> (continuation of Deferred@1771752622 after retry RPC after error@1323793164) -> (continuation of Deferred@485129807 after retry RPC after error@1055054317) -> (continuation of Deferred@27430179 after retry RPC after error@1953016064) -> (continuation of Deferred@994027972 after retry RPC after error@330965759) -> (continuation of Deferred@107249214 after retry RPC after error@938866523), errback=(continuation of Deferred@1957844539 after retry RPC after error@595887245) -> (continuation of Deferred@288612811 after retry RPC after error@1421093859) -> (continuation of Deferred@852606144 after retry RPC after error@905373435) -> (continuation of Deferred@1002791991 after retry RPC after error@1314634655) -> (continuation of Deferred@1901279528 after retry RPC after error@1930479815) -> (continuation of Deferred@1675947598 after retry RPC after error@1894790894) -> (continuation of Deferred@411229089 after retry RPC after error@1839296134) -> (continuation of Deferred@703822818 after retry RPC after error@1480949620) -> (continuation of Deferred@1452599310 after retry RPC after error@816277764) -> (continuation of Deferred@37304473 after retry RPC after error@1903450485) -> (continuation of Deferred@5311437 after retry RPC after error@188067210) -> (continuation of Deferred@1073983877 after retry RPC after error@334493441) -> (continuation of Deferred@459839954 after retry RPC after error@1024929480) -> (continuation of Deferred@1623535478 after retry RPC after error@218012560) -> (continuation of Deferred@1401365972 after retry RPC after error@1474437122) -> (continuation of Deferred@513084183 after retry RPC after error@1724850510) -> (continuation of Deferred@202117574 after retry RPC after error@1252577909) -> (continuation of Deferred@2085860740 after retry RPC after error@1661550097) -> (continuation of Deferred@258445719 after retry RPC after error@64012660) -> (continuation of Deferred@1649322783 after retry RPC after error@1218308337) -> (continuation of Deferred@2076517212 after retry RPC after error@2124121649) -> (continuation of Deferred@1771752622 after retry RPC after error@1323793164) -> (continuation of Deferred@485129807 after retry RPC after error@1055054317) -> (continuation of Deferred@27430179 after retry RPC after error@1953016064) -> (continuation of Deferred@994027972 after retry RPC after error@330965759) -> (continuation of Deferred@107249214 after retry RPC after error@938866523)))
08:07:25.061 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
08:07:25.061 [WARN - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#5 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=26978), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [12ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [108ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [125ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [151ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [203ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [218ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [219ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [235ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [238ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [323ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [324ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [347ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [347ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [348ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [348ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [361ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [362ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [362ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [362ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [381ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [381ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [381ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [381ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [421ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [422ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [422ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [423ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [460ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [462ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [463ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [463ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [464ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [581ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [581ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [583ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [583ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [740ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [744ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [745ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [746ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [746ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [820ms] refreshing cache from master, [820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [822ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [822ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [822ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [823ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1740ms] refreshing cache from master, [1740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1743ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1743ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1743ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1744ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1744ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1961ms] refreshing cache from master, [1961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1963ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1964ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1964ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1965ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2341ms] refreshing cache from master, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [2342ms] too many traces: truncated at 100 traces, deferred=Deferred@1343404564(state=PENDING, result=null, callback=(continuation of Deferred@1957844539 after retry RPC after error@595887245) -> (continuation of Deferred@288612811 after retry RPC after error@1421093859) -> (continuation of Deferred@852606144 after retry RPC after error@905373435) -> (continuation of Deferred@1002791991 after retry RPC after error@1314634655) -> (continuation of Deferred@1901279528 after retry RPC after error@1930479815) -> (continuation of Deferred@1675947598 after retry RPC after error@1894790894) -> (continuation of Deferred@411229089 after retry RPC after error@1839296134) -> (continuation of Deferred@703822818 after retry RPC after error@1480949620) -> (continuation of Deferred@1452599310 after retry RPC after error@816277764) -> (continuation of Deferred@37304473 after retry RPC after error@1903450485) -> (continuation of Deferred@5311437 after retry RPC after error@188067210) -> (continuation of Deferred@1073983877 after retry RPC after error@334493441) -> (continuation of Deferred@459839954 after retry RPC after error@1024929480) -> (continuation of Deferred@1623535478 after retry RPC after error@218012560) -> (continuation of Deferred@1401365972 after retry RPC after error@1474437122) -> (continuation of Deferred@513084183 after retry RPC after error@1724850510) -> (continuation of Deferred@202117574 after retry RPC after error@1252577909) -> (continuation of Deferred@2085860740 after retry RPC after error@1661550097) -> (continuation of Deferred@258445719 after retry RPC after error@64012660) -> (continuation of Deferred@1649322783 after retry RPC after error@1218308337) -> (continuation of Deferred@2076517212 after retry RPC after error@2124121649) -> (continuation of Deferred@1771752622 after retry RPC after error@1323793164) -> (continuation of Deferred@485129807 after retry RPC after error@1055054317) -> (continuation of Deferred@27430179 after retry RPC after error@1953016064) -> (continuation of Deferred@994027972 after retry RPC after error@330965759) -> (continuation of Deferred@107249214 after retry RPC after error@938866523), errback=(continuation of Deferred@1957844539 after retry RPC after error@595887245) -> (continuation of Deferred@288612811 after retry RPC after error@1421093859) -> (continuation of Deferred@852606144 after retry RPC after error@905373435) -> (continuation of Deferred@1002791991 after retry RPC after error@1314634655) -> (continuation of Deferred@1901279528 after retry RPC after error@1930479815) -> (continuation of Deferred@1675947598 after retry RPC after error@1894790894) -> (continuation of Deferred@411229089 after retry RPC after error@1839296134) -> (continuation of Deferred@703822818 after retry RPC after error@1480949620) -> (continuation of Deferred@1452599310 after retry RPC after error@816277764) -> (continuation of Deferred@37304473 after retry RPC after error@1903450485) -> (continuation of Deferred@5311437 after retry RPC after error@188067210) -> (continuation of Deferred@1073983877 after retry RPC after error@334493441) -> (continuation of Deferred@459839954 after retry RPC after error@1024929480) -> (continuation of Deferred@1623535478 after retry RPC after error@218012560) -> (continuation of Deferred@1401365972 after retry RPC after error@1474437122) -> (continuation of Deferred@513084183 after retry RPC after error@1724850510) -> (continuation of Deferred@202117574 after retry RPC after error@1252577909) -> (continuation of Deferred@2085860740 after retry RPC after error@1661550097) -> (continuation of Deferred@258445719 after retry RPC after error@64012660) -> (continuation of Deferred@1649322783 after retry RPC after error@1218308337) -> (continuation of Deferred@2076517212 after retry RPC after error@2124121649) -> (continuation of Deferred@1771752622 after retry RPC after error@1323793164) -> (continuation of Deferred@485129807 after retry RPC after error@1055054317) -> (continuation of Deferred@27430179 after retry RPC after error@1953016064) -> (continuation of Deferred@994027972 after retry RPC after error@330965759) -> (continuation of Deferred@107249214 after retry RPC after error@938866523)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.126:38579
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:07:25.065 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#5 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_5).
08:07:25.067 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#5 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_5.
08:07:25.069 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from INITIALIZING to FAILED on 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=26978), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [12ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [108ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [125ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [151ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [203ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [218ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [219ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [235ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [238ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [323ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [324ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [347ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [347ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [348ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [348ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [361ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [362ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [362ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [362ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [381ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [381ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [381ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [381ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [421ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [422ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [422ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [423ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [460ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [462ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [463ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [463ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [464ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [581ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [581ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [583ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [583ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [740ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [744ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [745ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [746ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [746ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [820ms] refreshing cache from master, [820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [822ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [822ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [822ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [823ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1740ms] refreshing cache from master, [1740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1743ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1743ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1743ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1744ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1744ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1961ms] refreshing cache from master, [1961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1963ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1964ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1964ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1965ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2341ms] refreshing cache from master, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [2342ms] too many traces: truncated at 100 traces, deferred=Deferred@1343404564(state=PENDING, result=null, callback=(continuation of Deferred@1957844539 after retry RPC after error@595887245) -> (continuation of Deferred@288612811 after retry RPC after error@1421093859) -> (continuation of Deferred@852606144 after retry RPC after error@905373435) -> (continuation of Deferred@1002791991 after retry RPC after error@1314634655) -> (continuation of Deferred@1901279528 after retry RPC after error@1930479815) -> (continuation of Deferred@1675947598 after retry RPC after error@1894790894) -> (continuation of Deferred@411229089 after retry RPC after error@1839296134) -> (continuation of Deferred@703822818 after retry RPC after error@1480949620) -> (continuation of Deferred@1452599310 after retry RPC after error@816277764) -> (continuation of Deferred@37304473 after retry RPC after error@1903450485) -> (continuation of Deferred@5311437 after retry RPC after error@188067210) -> (continuation of Deferred@1073983877 after retry RPC after error@334493441) -> (continuation of Deferred@459839954 after retry RPC after error@1024929480) -> (continuation of Deferred@1623535478 after retry RPC after error@218012560) -> (continuation of Deferred@1401365972 after retry RPC after error@1474437122) -> (continuation of Deferred@513084183 after retry RPC after error@1724850510) -> (continuation of Deferred@202117574 after retry RPC after error@1252577909) -> (continuation of Deferred@2085860740 after retry RPC after error@1661550097) -> (continuation of Deferred@258445719 after retry RPC after error@64012660) -> (continuation of Deferred@1649322783 after retry RPC after error@1218308337) -> (continuation of Deferred@2076517212 after retry RPC after error@2124121649) -> (continuation of Deferred@1771752622 after retry RPC after error@1323793164) -> (continuation of Deferred@485129807 after retry RPC after error@1055054317) -> (continuation of Deferred@27430179 after retry RPC after error@1953016064) -> (continuation of Deferred@994027972 after retry RPC after error@330965759) -> (continuation of Deferred@107249214 after retry RPC after error@938866523), errback=(continuation of Deferred@1957844539 after retry RPC after error@595887245) -> (continuation of Deferred@288612811 after retry RPC after error@1421093859) -> (continuation of Deferred@852606144 after retry RPC after error@905373435) -> (continuation of Deferred@1002791991 after retry RPC after error@1314634655) -> (continuation of Deferred@1901279528 after retry RPC after error@1930479815) -> (continuation of Deferred@1675947598 after retry RPC after error@1894790894) -> (continuation of Deferred@411229089 after retry RPC after error@1839296134) -> (continuation of Deferred@703822818 after retry RPC after error@1480949620) -> (continuation of Deferred@1452599310 after retry RPC after error@816277764) -> (continuation of Deferred@37304473 after retry RPC after error@1903450485) -> (continuation of Deferred@5311437 after retry RPC after error@188067210) -> (continuation of Deferred@1073983877 after retry RPC after error@334493441) -> (continuation of Deferred@459839954 after retry RPC after error@1024929480) -> (continuation of Deferred@1623535478 after retry RPC after error@218012560) -> (continuation of Deferred@1401365972 after retry RPC after error@1474437122) -> (continuation of Deferred@513084183 after retry RPC after error@1724850510) -> (continuation of Deferred@202117574 after retry RPC after error@1252577909) -> (continuation of Deferred@2085860740 after retry RPC after error@1661550097) -> (continuation of Deferred@258445719 after retry RPC after error@64012660) -> (continuation of Deferred@1649322783 after retry RPC after error@1218308337) -> (continuation of Deferred@2076517212 after retry RPC after error@2124121649) -> (continuation of Deferred@1771752622 after retry RPC after error@1323793164) -> (continuation of Deferred@485129807 after retry RPC after error@1055054317) -> (continuation of Deferred@27430179 after retry RPC after error@1953016064) -> (continuation of Deferred@994027972 after retry RPC after error@330965759) -> (continuation of Deferred@107249214 after retry RPC after error@938866523)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.126:38579
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:07:25.076 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:07:25.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:25.075999 32691 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:07:25.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:25.077162 32691 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:07:25.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:25.078318 32691 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:07:25.079 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#5) of source Source: KuduSource.
08:07:25.079 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_5.
08:07:25.079 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (b42812d69c586178cf7556c3c92998f3) switched from state RUNNING to RESTARTING.
08:07:25.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091645118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:25.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:25.127723 32691 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:07:25.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:25.128271 32691 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:07:25.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:25.128762 32691 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:07:25.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:25.129001 32691 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:07:25.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:25.129196 32691 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:07:25.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:25.129338 32691 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38129/jwks.json
08:07:25.131 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
08:07:25.131 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
08:07:25.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:25.157153 32669 heartbeater.cc:499] Master 127.31.46.252:40541 was elected leader, sending a full tablet report...
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:25.182711 32691 master_runner.cc:387] Master server non-default flags:
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.233.212:42413
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-0/data
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-0/wal
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.233.254:35197
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38129/jwks.json
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-0/data/info.pb
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.233.254
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-0/logs
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:07:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:07:25.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:07:25.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:07:25.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:07:25.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:07:25.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:07:25.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:07:25.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:07:25.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:25.184780 32691 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:07:25.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:25.186980 32691 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:07:25.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:25.201963 32697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:25.454 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:25.489 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:25.490 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:25.490 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:25.491 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:25.491 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:25.491 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:25.491 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:25.491 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:25.491 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:25.492 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:25.492 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:25.492 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:25.492 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:25.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:25.540 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:25.540 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:25.541 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:25.542 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:25.542 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:25.542 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:25.542 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:25.543 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:25.543 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:25.543 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:25.543 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:25.543 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:25.543 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:25.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091645618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:25.628 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:25.630 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:25.630 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:25.630 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:07:25.630 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:25.630 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:25.631 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:25.631 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:25.631 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:25.631 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:25.631 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
08:07:25.632 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:25.632 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:25.632 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:25.632 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:25.732 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:25.732 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:25.733 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:25.733 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:25.733 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:25.733 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:25.733 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:25.733 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:25.734 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:25.734 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:25.734 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:25.733 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:25.735 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:25.954 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:26.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:26.080 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:26.080 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:26.081 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:26.081 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:26.081 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:26.082 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:26.082 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:26.082 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:26.082 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:26.083 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:26.083 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:26.083 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:26.083 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:26.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091646118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:26.160 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=27 ms, finalizationTime=15 ms).
08:07:26.166 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
08:07:26.450 [DEBUG - pool-178-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30014), Traces: [0ms] sending RPC to server master-127.28.220.252:33543, [26ms] received response from server master-127.28.220.252:33543: OK, deferred=null) with no deferred attached!
08:07:26.455 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:26.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:26.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091646618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:26.627 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
08:07:26.629 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
08:07:26.667 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:26.667 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:26.668 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:26.669 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:26.669 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:26.669 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:26.670 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:26.670 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:26.670 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:26.671 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:26.671 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:26.672 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:26.672 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:26.820 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:26.821 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:26.821 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:26.821 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:26.821 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:26.821 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:26.822 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:26.822 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:26.822 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:26.822 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:26.822 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:26.822 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:26.822 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:26.831 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:26.831 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:26.831 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:26.832 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:26.832 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:26.832 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:26.833 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:26.833 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:26.833 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:26.833 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:26.833 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:26.833 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:26.834 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:26.921 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:26.922 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:26.922 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:26.923 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:26.923 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:26.923 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:26.924 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:26.924 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:26.924 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:26.924 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:26.924 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:26.925 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:26.925 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:26.930 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:26.930 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:26.930 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:26.931 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:26.931 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:26.931 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:26.931 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:26.931 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:26.931 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:26.932 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:26.932 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:26.932 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:26.932 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:26.954 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:26.960 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:26.960 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:26.961 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:26.961 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:26.962 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:26.962 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:26.962 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:26.962 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:26.962 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:26.962 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:26.963 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:26.963 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:26.963 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:27.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:27.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:26.604792 32696 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 32691
08:07:27.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:27.101845 32696 kernel_stack_watchdog.cc:198] Thread 32691 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 398ms:
08:07:27.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:07:27.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:07:27.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:07:27.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:07:27.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:27.102128 32691 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.899s	user 0.680s	sys 1.109s
08:07:27.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:27.102576 32691 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.899s	user 0.680s	sys 1.109s
08:07:27.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:25.205054 32698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:27.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:27.104843 32700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:27.107734 32699 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1904 milliseconds
08:07:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.107788 32691 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:07:27.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.109403 32691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:07:27.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.112425 32691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:07:27.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.113909 32691 hybrid_clock.cc:648] HybridClock initialized: now 1779091647113863 us; error 52 us; skew 500 ppm
08:07:27.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.114750 32691 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:07:27.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091647118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:27.127 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
08:07:27.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.127408 32691 webserver.cc:533] Webserver started at http://127.31.233.254:34959/ using document root <none> and password file <none>
08:07:27.128 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
08:07:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.128841 32691 fs_manager.cc:362] Metadata directory not provided
08:07:27.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.129169 32691 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:07:27.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.129838 32691 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:07:27.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.135700 32691 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-0/data/instance:
08:07:27.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b5764d09f018478db20e7f3ebeaae7fc"
08:07:27.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:27 on dist-test-slave-1jss"
08:07:27.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.136895 32691 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-0/wal/instance:
08:07:27.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b5764d09f018478db20e7f3ebeaae7fc"
08:07:27.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:27 on dist-test-slave-1jss"
08:07:27.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.146451 32691 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.010s	sys 0.002s
08:07:27.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.153755 32708 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:07:27.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.155117 32691 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.000s
08:07:27.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.155444 32691 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-0/wal
08:07:27.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b5764d09f018478db20e7f3ebeaae7fc"
08:07:27.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:27 on dist-test-slave-1jss"
08:07:27.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.155862 32691 fs_report.cc:389] FS layout report
08:07:27.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:07:27.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-0/wal
08:07:27.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-0/wal
08:07:27.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-0/data/data
08:07:27.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:07:27.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:07:27.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:07:27.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:07:27.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:07:27.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:07:27.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:07:27.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:07:27.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:07:27.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:07:27.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:07:27.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.227226 32691 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:07:27.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.229050 32691 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:07:27.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.229542 32691 kserver.cc:163] Server-wide thread pool size limit: 3276
08:07:27.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.323112 32691 rpc_server.cc:307] RPC server started. Bound to: 127.31.233.254:35197
08:07:27.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.323267 32759 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.233.254:35197 every 8 connection(s)
08:07:27.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.326566 32691 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-0/data/info.pb
08:07:27.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.328001 32679 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 32691
08:07:27.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.328727 32679 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-0/wal/instance
08:07:27.334 [DEBUG - pool-184-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30016), Traces: [0ms] sending RPC to server master-127.29.158.188:39061, [14ms] received response from server master-127.29.158.188:39061: OK, deferred=null) with no deferred attached!
08:07:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.335765 32760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.335652 32679 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:07:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:07:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-1/wal
08:07:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-1/data
08:07:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:07:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:07:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:07:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-1/logs
08:07:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-1/data/info.pb
08:07:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:07:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:07:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:07:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:07:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:07:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:07:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:07:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:07:27.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.233.253:33393
08:07:27.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.233.253
08:07:27.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:27.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.233.212:42413
08:07:27.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:27.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:27.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:27.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:07:27.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101
08:07:27.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:07:27.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38129/jwks.json with env {}
08:07:27.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.352252 32760 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.233.254" port: 35197 } has no permanent_uuid. Determining permanent_uuid...
08:07:27.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.385443 32760 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } has no permanent_uuid. Determining permanent_uuid...
08:07:27.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:27.389340 32709 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.233.253:33393: connect: Connection refused (error 111)
08:07:27.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:27.394649 32760 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.233.253:33393: Network error: Client connection negotiation failed: client connection to 127.31.233.253:33393: connect: Connection refused (error 111)
08:07:27.408 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:27.409 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:27.409 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:27.409 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:27.409 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:27.409 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:27.409 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:27.409 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:27.410 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:27.410 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:27.410 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:27.410 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:27.411 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:27.412 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:27.412 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:27.413 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:27.413 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:27.413 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:27.413 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:27.413 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:27.413 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:27.413 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:27.413 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:27.413 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:27.413 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:27.413 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:27.414 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29389), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [93ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [202ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [204ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [205ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [227ms] refreshing cache from master, [227ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [338ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [351ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [352ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [363ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [399ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [400ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [433ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [435ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [474ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [476ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [477ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [481ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [503ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [504ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [504ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [505ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [521ms] refreshing cache from master, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [523ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [524ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [524ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [524ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [563ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [564ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [564ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [565ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [623ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [624ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [624ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [625ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [763ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [763ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [763ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [763ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [825ms] refreshing cache from master, [825ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [826ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [826ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [827ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [828ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [828ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [828ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1121ms] refreshing cache from master, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1124ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1124ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1401ms] refreshing cache from master, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1403ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1404ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1405ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1405ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1405ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2881ms] refreshing cache from master, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [2883ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [2884ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [2885ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2885ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [6500ms] refreshing cache from master, [6501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [6501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [6501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [6502ms] too many traces: truncated at 100 traces, deferred=Deferred@479892842(state=PENDING, result=null, callback=(continuation of Deferred@1486646550 after retry RPC after error@453888008) -> (continuation of Deferred@725621578 after retry RPC after error@1664739981) -> (continuation of Deferred@1484181281 after retry RPC after error@768479663) -> (continuation of Deferred@109036823 after retry RPC after error@717105879) -> (continuation of Deferred@1155528550 after retry RPC after error@432129339) -> (continuation of Deferred@1634663529 after retry RPC after error@987597313) -> (continuation of Deferred@25308923 after retry RPC after error@385735661) -> (continuation of Deferred@6746351 after retry RPC after error@1446899552) -> (continuation of Deferred@1188619946 after retry RPC after error@1048739631) -> (continuation of Deferred@164893080 after retry RPC after error@808167725) -> (continuation of Deferred@826799156 after retry RPC after error@470916660) -> (continuation of Deferred@895485183 after retry RPC after error@1483715007) -> (continuation of Deferred@1443305682 after retry RPC after error@1190644760) -> (continuation of Deferred@1929740229 after retry RPC after error@1447217747) -> (continuation of Deferred@955091393 after retry RPC after error@1082267080) -> (continuation of Deferred@413245770 after retry RPC after error@1492246623) -> (continuation of Deferred@201771265 after retry RPC after error@1559933212) -> (continuation of Deferred@1229254712 after retry RPC after error@509608535) -> (continuation of Deferred@605326939 after retry RPC after error@762292628) -> (continuation of Deferred@1128552753 after retry RPC after error@1562937780) -> (continuation of Deferred@1573823004 after retry RPC after error@230523704) -> (continuation of Deferred@1825693295 after retry RPC after error@1965920104) -> (continuation of Deferred@1574641043 after retry RPC after error@1017049427) -> (continuation of Deferred@1591632393 after retry RPC after error@1200742517), errback=(continuation of Deferred@1486646550 after retry RPC after error@453888008) -> (continuation of Deferred@725621578 after retry RPC after error@1664739981) -> (continuation of Deferred@1484181281 after retry RPC after error@768479663) -> (continuation of Deferred@109036823 after retry RPC after error@717105879) -> (continuation of Deferred@1155528550 after retry RPC after error@432129339) -> (continuation of Deferred@1634663529 after retry RPC after error@987597313) -> (continuation of Deferred@25308923 after retry RPC after error@385735661) -> (continuation of Deferred@6746351 after retry RPC after error@1446899552) -> (continuation of Deferred@1188619946 after retry RPC after error@1048739631) -> (continuation of Deferred@164893080 after retry RPC after error@808167725) -> (continuation of Deferred@826799156 after retry RPC after error@470916660) -> (continuation of Deferred@895485183 after retry RPC after error@1483715007) -> (continuation of Deferred@1443305682 after retry RPC after error@1190644760) -> (continuation of Deferred@1929740229 after retry RPC after error@1447217747) -> (continuation of Deferred@955091393 after retry RPC after error@1082267080) -> (continuation of Deferred@413245770 after retry RPC after error@1492246623) -> (continuation of Deferred@201771265 after retry RPC after error@1559933212) -> (continuation of Deferred@1229254712 after retry RPC after error@509608535) -> (continuation of Deferred@605326939 after retry RPC after error@762292628) -> (continuation of Deferred@1128552753 after retry RPC after error@1562937780) -> (continuation of Deferred@1573823004 after retry RPC after error@230523704) -> (continuation of Deferred@1825693295 after retry RPC after error@1965920104) -> (continuation of Deferred@1574641043 after retry RPC after error@1017049427) -> (continuation of Deferred@1591632393 after retry RPC after error@1200742517)))
08:07:27.416 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
08:07:27.416 [WARN - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#5 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29389), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [93ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [202ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [204ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [205ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [227ms] refreshing cache from master, [227ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [338ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [351ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [352ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [363ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [399ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [400ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [433ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [435ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [474ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [476ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [477ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [481ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [503ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [504ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [504ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [505ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [521ms] refreshing cache from master, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [523ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [524ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [524ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [524ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [563ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [564ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [564ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [565ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [623ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [624ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [624ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [625ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [763ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [763ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [763ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [763ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [825ms] refreshing cache from master, [825ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [826ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [826ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [827ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [828ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [828ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [828ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1121ms] refreshing cache from master, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1124ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1124ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1401ms] refreshing cache from master, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1403ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1404ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1405ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1405ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1405ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2881ms] refreshing cache from master, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [2883ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [2884ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [2885ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2885ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [6500ms] refreshing cache from master, [6501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [6501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [6501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [6502ms] too many traces: truncated at 100 traces, deferred=Deferred@479892842(state=PENDING, result=null, callback=(continuation of Deferred@1486646550 after retry RPC after error@453888008) -> (continuation of Deferred@725621578 after retry RPC after error@1664739981) -> (continuation of Deferred@1484181281 after retry RPC after error@768479663) -> (continuation of Deferred@109036823 after retry RPC after error@717105879) -> (continuation of Deferred@1155528550 after retry RPC after error@432129339) -> (continuation of Deferred@1634663529 after retry RPC after error@987597313) -> (continuation of Deferred@25308923 after retry RPC after error@385735661) -> (continuation of Deferred@6746351 after retry RPC after error@1446899552) -> (continuation of Deferred@1188619946 after retry RPC after error@1048739631) -> (continuation of Deferred@164893080 after retry RPC after error@808167725) -> (continuation of Deferred@826799156 after retry RPC after error@470916660) -> (continuation of Deferred@895485183 after retry RPC after error@1483715007) -> (continuation of Deferred@1443305682 after retry RPC after error@1190644760) -> (continuation of Deferred@1929740229 after retry RPC after error@1447217747) -> (continuation of Deferred@955091393 after retry RPC after error@1082267080) -> (continuation of Deferred@413245770 after retry RPC after error@1492246623) -> (continuation of Deferred@201771265 after retry RPC after error@1559933212) -> (continuation of Deferred@1229254712 after retry RPC after error@509608535) -> (continuation of Deferred@605326939 after retry RPC after error@762292628) -> (continuation of Deferred@1128552753 after retry RPC after error@1562937780) -> (continuation of Deferred@1573823004 after retry RPC after error@230523704) -> (continuation of Deferred@1825693295 after retry RPC after error@1965920104) -> (continuation of Deferred@1574641043 after retry RPC after error@1017049427) -> (continuation of Deferred@1591632393 after retry RPC after error@1200742517), errback=(continuation of Deferred@1486646550 after retry RPC after error@453888008) -> (continuation of Deferred@725621578 after retry RPC after error@1664739981) -> (continuation of Deferred@1484181281 after retry RPC after error@768479663) -> (continuation of Deferred@109036823 after retry RPC after error@717105879) -> (continuation of Deferred@1155528550 after retry RPC after error@432129339) -> (continuation of Deferred@1634663529 after retry RPC after error@987597313) -> (continuation of Deferred@25308923 after retry RPC after error@385735661) -> (continuation of Deferred@6746351 after retry RPC after error@1446899552) -> (continuation of Deferred@1188619946 after retry RPC after error@1048739631) -> (continuation of Deferred@164893080 after retry RPC after error@808167725) -> (continuation of Deferred@826799156 after retry RPC after error@470916660) -> (continuation of Deferred@895485183 after retry RPC after error@1483715007) -> (continuation of Deferred@1443305682 after retry RPC after error@1190644760) -> (continuation of Deferred@1929740229 after retry RPC after error@1447217747) -> (continuation of Deferred@955091393 after retry RPC after error@1082267080) -> (continuation of Deferred@413245770 after retry RPC after error@1492246623) -> (continuation of Deferred@201771265 after retry RPC after error@1559933212) -> (continuation of Deferred@1229254712 after retry RPC after error@509608535) -> (continuation of Deferred@605326939 after retry RPC after error@762292628) -> (continuation of Deferred@1128552753 after retry RPC after error@1562937780) -> (continuation of Deferred@1573823004 after retry RPC after error@230523704) -> (continuation of Deferred@1825693295 after retry RPC after error@1965920104) -> (continuation of Deferred@1574641043 after retry RPC after error@1017049427) -> (continuation of Deferred@1591632393 after retry RPC after error@1200742517)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:07:27.419 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#5 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_5).
08:07:27.421 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#5 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_5.
08:07:27.423 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from INITIALIZING to FAILED on 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29389), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [93ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [202ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [204ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [205ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [227ms] refreshing cache from master, [227ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [338ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [351ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [352ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [363ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [399ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [400ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [433ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [435ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [474ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [476ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [477ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [481ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [503ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [504ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [504ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [505ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [521ms] refreshing cache from master, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [523ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [524ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [524ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [524ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [563ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [564ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [564ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [565ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [623ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [624ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [624ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [625ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [763ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [763ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [763ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [763ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [825ms] refreshing cache from master, [825ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [826ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [826ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [827ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [828ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [828ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [828ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1121ms] refreshing cache from master, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1124ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1124ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1401ms] refreshing cache from master, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1403ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1404ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1405ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1405ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1405ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2881ms] refreshing cache from master, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [2883ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [2884ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [2885ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2885ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [6500ms] refreshing cache from master, [6501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [6501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [6501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [6502ms] too many traces: truncated at 100 traces, deferred=Deferred@479892842(state=PENDING, result=null, callback=(continuation of Deferred@1486646550 after retry RPC after error@453888008) -> (continuation of Deferred@725621578 after retry RPC after error@1664739981) -> (continuation of Deferred@1484181281 after retry RPC after error@768479663) -> (continuation of Deferred@109036823 after retry RPC after error@717105879) -> (continuation of Deferred@1155528550 after retry RPC after error@432129339) -> (continuation of Deferred@1634663529 after retry RPC after error@987597313) -> (continuation of Deferred@25308923 after retry RPC after error@385735661) -> (continuation of Deferred@6746351 after retry RPC after error@1446899552) -> (continuation of Deferred@1188619946 after retry RPC after error@1048739631) -> (continuation of Deferred@164893080 after retry RPC after error@808167725) -> (continuation of Deferred@826799156 after retry RPC after error@470916660) -> (continuation of Deferred@895485183 after retry RPC after error@1483715007) -> (continuation of Deferred@1443305682 after retry RPC after error@1190644760) -> (continuation of Deferred@1929740229 after retry RPC after error@1447217747) -> (continuation of Deferred@955091393 after retry RPC after error@1082267080) -> (continuation of Deferred@413245770 after retry RPC after error@1492246623) -> (continuation of Deferred@201771265 after retry RPC after error@1559933212) -> (continuation of Deferred@1229254712 after retry RPC after error@509608535) -> (continuation of Deferred@605326939 after retry RPC after error@762292628) -> (continuation of Deferred@1128552753 after retry RPC after error@1562937780) -> (continuation of Deferred@1573823004 after retry RPC after error@230523704) -> (continuation of Deferred@1825693295 after retry RPC after error@1965920104) -> (continuation of Deferred@1574641043 after retry RPC after error@1017049427) -> (continuation of Deferred@1591632393 after retry RPC after error@1200742517), errback=(continuation of Deferred@1486646550 after retry RPC after error@453888008) -> (continuation of Deferred@725621578 after retry RPC after error@1664739981) -> (continuation of Deferred@1484181281 after retry RPC after error@768479663) -> (continuation of Deferred@109036823 after retry RPC after error@717105879) -> (continuation of Deferred@1155528550 after retry RPC after error@432129339) -> (continuation of Deferred@1634663529 after retry RPC after error@987597313) -> (continuation of Deferred@25308923 after retry RPC after error@385735661) -> (continuation of Deferred@6746351 after retry RPC after error@1446899552) -> (continuation of Deferred@1188619946 after retry RPC after error@1048739631) -> (continuation of Deferred@164893080 after retry RPC after error@808167725) -> (continuation of Deferred@826799156 after retry RPC after error@470916660) -> (continuation of Deferred@895485183 after retry RPC after error@1483715007) -> (continuation of Deferred@1443305682 after retry RPC after error@1190644760) -> (continuation of Deferred@1929740229 after retry RPC after error@1447217747) -> (continuation of Deferred@955091393 after retry RPC after error@1082267080) -> (continuation of Deferred@413245770 after retry RPC after error@1492246623) -> (continuation of Deferred@201771265 after retry RPC after error@1559933212) -> (continuation of Deferred@1229254712 after retry RPC after error@509608535) -> (continuation of Deferred@605326939 after retry RPC after error@762292628) -> (continuation of Deferred@1128552753 after retry RPC after error@1562937780) -> (continuation of Deferred@1573823004 after retry RPC after error@230523704) -> (continuation of Deferred@1825693295 after retry RPC after error@1965920104) -> (continuation of Deferred@1574641043 after retry RPC after error@1017049427) -> (continuation of Deferred@1591632393 after retry RPC after error@1200742517)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:07:27.427 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:07:27.427 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#5) of source Source: KuduSource.
08:07:27.428 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_5.
08:07:27.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.444267 32760 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } attempt: 1
08:07:27.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:27.450685 32760 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.233.253:33393: Network error: Client connection negotiation failed: client connection to 127.31.233.253:33393: connect: Connection refused (error 111)
08:07:27.454 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:27.459 [DEBUG - pool-186-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30014), Traces: [0ms] sending RPC to server master-127.29.158.188:39061, [22ms] received response from server master-127.29.158.188:39061: OK, deferred=null) with no deferred attached!
08:07:27.480 [DEBUG - pool-186-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30019), Traces: [0ms] sending RPC to server master-127.29.158.188:39061, [35ms] received response from server master-127.29.158.188:39061: OK, deferred=null) with no deferred attached!
08:07:27.480 [DEBUG - pool-186-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30018), Traces: [0ms] sending RPC to server master-127.29.158.188:39061, [18ms] received response from server master-127.29.158.188:39061: OK, deferred=null) with no deferred attached!
08:07:27.480 [DEBUG - pool-186-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30018), Traces: [0ms] sending RPC to server master-127.29.158.188:39061, [34ms] received response from server master-127.29.158.188:39061: OK, deferred=null) with no deferred attached!
08:07:27.480 [DEBUG - pool-186-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30017), Traces: [0ms] sending RPC to server master-127.29.158.188:39061, [19ms] received response from server master-127.29.158.188:39061: OK, deferred=null) with no deferred attached!
08:07:27.480 [DEBUG - pool-186-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30016), Traces: [0ms] sending RPC to server master-127.29.158.188:39061, [39ms] received response from server master-127.29.158.188:39061: OK, deferred=null) with no deferred attached!
08:07:27.480 [DEBUG - pool-186-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30016), Traces: [0ms] sending RPC to server master-127.29.158.188:39061, [36ms] received response from server master-127.29.158.188:39061: OK, deferred=null) with no deferred attached!
08:07:27.480 [DEBUG - pool-186-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30015), Traces: [0ms] sending RPC to server master-127.29.158.188:39061, [51ms] received response from server master-127.29.158.188:39061: OK, deferred=null) with no deferred attached!
08:07:27.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:27.491204 32524 debug-util.cc:398] Leaking SignalData structure 0x7b08000b8e60 after lost signal to thread 32379
08:07:27.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:27.492580 32524 debug-util.cc:398] Leaking SignalData structure 0x7b08000ada40 after lost signal to thread 32527
08:07:27.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:27.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.519418 32760 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } attempt: 2
08:07:27.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:27.528462 32760 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.233.253:33393: Network error: Client connection negotiation failed: client connection to 127.31.233.253:33393: connect: Connection refused (error 111)
08:07:27.618 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091647618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:27.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.619984 32760 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } attempt: 3
08:07:27.631 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
08:07:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:27.631099 32760 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.233.253:33393: Network error: Client connection negotiation failed: client connection to 127.31.233.253:33393: connect: Connection refused (error 111)
08:07:27.632 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
08:07:27.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:27.774601 32760 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } attempt: 4
08:07:27.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:27.785461 32760 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.233.253:33393: Network error: Client connection negotiation failed: client connection to 127.31.233.253:33393: connect: Connection refused (error 111)
08:07:27.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:27.875490 32762 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:07:27.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:27.876432 32762 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:07:27.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:27.877351 32762 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:07:27.950 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:27.950 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:27.951 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:27.951 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:27.951 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:27.951 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:27.951 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:27.952 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:27.952 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:27.953 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:27.954 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:27.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:27.951582 32762 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:07:27.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:27.952082 32762 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:07:27.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:27.952459 32762 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:07:27.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:27.952832 32762 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:07:27.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:27.953202 32762 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:07:27.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:27.953465 32762 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38129/jwks.json
08:07:27.951 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:27.955 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:27.956 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:28.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:28.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:28.037336 32762 master_runner.cc:387] Master server non-default flags:
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.233.212:42413
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-1/data
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-1/wal
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.233.253:33393
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38129/jwks.json
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-1/data/info.pb
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.233.253
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-1/logs
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:07:28.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:07:28.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:28.039583 32762 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:07:28.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:28.042229 32762 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:07:28.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:28.058821   304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:28.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:28.085014 32760 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } attempt: 5
08:07:28.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:28.091926 32760 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.233.253:33393: Network error: Client connection negotiation failed: client connection to 127.31.233.253:33393: connect: Connection refused (error 111)
08:07:28.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091648118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:28.131 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:07:28.132 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
08:07:28.228 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:28.228 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:28.229 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:28.229 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:28.229 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:28.229 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:28.229 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:28.229 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:28.229 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:28.230 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:28.230 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:28.230 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:28.230 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:28.454 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:28.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:28.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091648618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:28.629 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:07:28.634 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
08:07:28.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:28.639356 32760 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } attempt: 6
08:07:28.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:28.671129 32760 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.233.253:33393: Network error: Client connection negotiation failed: client connection to 127.31.233.253:33393: connect: Connection refused (error 111)
08:07:28.948 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:28.949 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:28.949 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:28.950 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:28.950 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:28.950 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:28.950 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:28.950 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:28.951 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:28.951 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:28.951 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:28.951 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:28.951 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:28.953 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:29.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:29.068 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:29.069 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:29.069 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:29.070 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:29.070 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:29.070 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:29.070 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:29.070 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:29.071 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:29.071 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:29.071 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:29.071 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:29.071 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:29.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091649118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:29.129 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
08:07:29.131 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
08:07:29.270 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:29.270 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:29.270 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:29.271 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:29.271 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:29.271 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:29.272 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:29.272 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:29.272 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:29.272 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:29.272 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:29.272 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:29.272 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:29.453 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:29.472 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:29.472 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:29.473 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:29.474 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:29.474 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:29.474 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:29.474 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:29.474 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:29.475 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:29.476 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:29.476 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:29.476 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:29.476 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:29.515 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:29.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091649618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:29.619 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:29.620 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:29.620 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:29.620 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:29.620 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:29.621 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:29.621 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:29.621 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:29.621 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:29.620 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:29.621 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:29.621 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:29.621 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:29.630 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:07:29.631 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
08:07:29.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:29.731652 32760 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } attempt: 7
08:07:29.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:29.743328 32760 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.233.253:33393: Network error: Client connection negotiation failed: client connection to 127.31.233.253:33393: connect: Connection refused (error 111)
08:07:29.750 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:29.751 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:29.751 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:29.752 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:29.752 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:29.752 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:29.752 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:29.752 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:29.752 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:29.753 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:29.753 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:29.753 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:29.753 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:29.794 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:29.794 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:29.795 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:29.795 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:29.795 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:29.795 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:29.795 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:29.795 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:29.796 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:29.798 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:29.798 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:29.798 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:29.799 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:29.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:29.461961   303 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 32762
08:07:29.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:29.853089   303 kernel_stack_watchdog.cc:198] Thread 32762 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 389ms:
08:07:29.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:07:29.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:07:29.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:07:29.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:07:29.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:29.853459   306 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1793 milliseconds
08:07:29.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:28.062271   305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:29.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:29.859989 32762 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.790s	user 0.001s	sys 0.001s
08:07:29.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:29.860327 32762 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.800s	user 0.001s	sys 0.001s
08:07:29.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:29.862449 32762 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:07:29.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:29.862442   308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:29.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:29.864118 32762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:07:29.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:29.867801 32762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:07:29.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:29.869282 32762 hybrid_clock.cc:648] HybridClock initialized: now 1779091649869197 us; error 92 us; skew 500 ppm
08:07:29.870 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:29.870 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:29.870 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:29.870 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:29.870 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:29.871 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:29.871 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:29.871 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:29.871 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:29.871 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:29.871 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:29.871 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:29.871 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:29.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:29.871613 32762 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:07:29.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:29.880741 32762 webserver.cc:533] Webserver started at http://127.31.233.253:33341/ using document root <none> and password file <none>
08:07:29.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:29.882063 32762 fs_manager.cc:362] Metadata directory not provided
08:07:29.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:29.882386 32762 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:07:29.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:29.883018 32762 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:07:29.887 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:29.888 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:29.888 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:29.888 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:29.888 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:29.888 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:29.889 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:29.889 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:29.889 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:29.889 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:29.889 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:29.889 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:29.889 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:29.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:29.889305 32762 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-1/data/instance:
08:07:29.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1616fb6537c34386af1269f34bf5a9c3"
08:07:29.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:29 on dist-test-slave-1jss"
08:07:29.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:29.890923 32762 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-1/wal/instance:
08:07:29.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1616fb6537c34386af1269f34bf5a9c3"
08:07:29.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:29 on dist-test-slave-1jss"
08:07:29.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:29.902918 32762 fs_manager.cc:696] Time spent creating directory manager: real 0.011s	user 0.010s	sys 0.000s
08:07:29.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:29.910375   320 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:07:29.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:29.911863 32762 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.000s
08:07:29.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:29.912393 32762 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-1/wal
08:07:29.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1616fb6537c34386af1269f34bf5a9c3"
08:07:29.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:29 on dist-test-slave-1jss"
08:07:29.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:29.912782 32762 fs_report.cc:389] FS layout report
08:07:29.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:07:29.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-1/wal
08:07:29.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-1/wal
08:07:29.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-1/data/data
08:07:29.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:07:29.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:07:29.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:07:29.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:07:29.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:07:29.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:07:29.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:07:29.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:07:29.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:07:29.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:07:29.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:07:29.940 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:29.940 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:29.940 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:29.941 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:29.941 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:29.941 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:29.941 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:29.942 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:29.942 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:29.942 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:29.942 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:29.942 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:29.942 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:29.953 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:29.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:29.989624 32762 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:07:29.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:29.991907 32762 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:07:29.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:29.992471 32762 kserver.cc:163] Server-wide thread pool size limit: 3276
08:07:30.015 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:30.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 66 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091650118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:30.129 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 66 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:07:30.130 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 66 as completed for source Source: KuduSource.
08:07:30.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:30.136409 32762 rpc_server.cc:307] RPC server started. Bound to: 127.31.233.253:33393
08:07:30.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:30.136644   371 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.233.253:33393 every 8 connection(s)
08:07:30.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:30.139822 32762 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-1/data/info.pb
08:07:30.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:30.146504 32679 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 32762
08:07:30.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:30.147042 32679 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-1/wal/instance
08:07:30.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:30.148679   372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:30.150722 32679 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-2/wal
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-2/data
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-2/logs
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-2/data/info.pb
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.233.252:36101
08:07:30.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.233.252
08:07:30.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:30.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.233.212:42413
08:07:30.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:30.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:30.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:30.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:07:30.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101
08:07:30.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:07:30.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38129/jwks.json with env {}
08:07:30.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:30.162998   372 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.233.254" port: 35197 } has no permanent_uuid. Determining permanent_uuid...
08:07:30.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:30.204058   372 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } has no permanent_uuid. Determining permanent_uuid...
08:07:30.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:30.229698   372 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } has no permanent_uuid. Determining permanent_uuid...
08:07:30.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:30.232827   321 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.233.252:36101: connect: Connection refused (error 111)
08:07:30.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:30.238739   372 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.233.252:36101: Network error: Client connection negotiation failed: client connection to 127.31.233.252:36101: connect: Connection refused (error 111)
08:07:30.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:30.288357   372 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } attempt: 1
08:07:30.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:30.295701   372 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.233.252:36101: Network error: Client connection negotiation failed: client connection to 127.31.233.252:36101: connect: Connection refused (error 111)
08:07:30.310 [DEBUG - pool-178-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30015), Traces: [0ms] sending RPC to server master-127.28.220.252:33543, [8ms] received response from server master-127.28.220.252:33543: OK, deferred=null) with no deferred attached!
08:07:30.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:30.364152   372 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } attempt: 2
08:07:30.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:30.369293   372 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.233.252:36101: Network error: Client connection negotiation failed: client connection to 127.31.233.252:36101: connect: Connection refused (error 111)
08:07:30.450 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:30.450 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:30.450 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:30.451 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:30.451 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:30.451 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:30.451 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:30.451 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:30.451 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:30.451 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:30.451 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:30.451 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:30.451 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:30.453 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:30.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:30.460826   372 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } attempt: 3
08:07:30.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:30.466192   372 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.233.252:36101: Network error: Client connection negotiation failed: client connection to 127.31.233.252:36101: connect: Connection refused (error 111)
08:07:30.510 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:30.510 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:30.511 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:30.511 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:30.511 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:30.512 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:30.512 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:30.512 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:30.512 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:30.512 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:30.513 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:30.513 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:30.513 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:30.515 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:30.560 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:30.560 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:30.560 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:30.561 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:30.561 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:30.561 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:30.561 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:30.561 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:30.561 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:30.561 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:30.561 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:30.561 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:30.561 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:30.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:30.566183   374 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:07:30.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:30.566829   374 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:07:30.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:30.567425   374 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:07:30.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:30.606076   374 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:07:30.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:30.606518   374 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:07:30.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:30.606760   374 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:07:30.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:30.606974   374 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:07:30.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:30.607234   374 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:07:30.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:30.607451   374 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38129/jwks.json
08:07:30.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:30.609709   372 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } attempt: 4
08:07:30.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:30.615130   372 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.233.252:36101: Network error: Client connection negotiation failed: client connection to 127.31.233.252:36101: connect: Connection refused (error 111)
08:07:30.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 67 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091650618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:30.619 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:30.620 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:30.620 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:30.620 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:30.620 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:30.621 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:30.622 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:30.622 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:30.622 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:30.622 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:30.622 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:30.622 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:30.623 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:30.628 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 67 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
08:07:30.629 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 67 as completed for source Source: KuduSource.
08:07:30.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:30.656242   374 master_runner.cc:387] Master server non-default flags:
08:07:30.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:30.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.233.212:42413
08:07:30.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:30.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:30.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-2/data
08:07:30.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-2/wal
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.233.252:36101
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38129/jwks.json
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-2/data/info.pb
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.233.252
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-2/logs
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:07:30.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:07:30.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:30.658264   374 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:07:30.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:30.660611   374 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:07:30.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:30.675928   384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:30.780 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:30.781 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:30.781 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:30.782 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:30.782 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:30.782 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:30.783 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:30.784 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:30.784 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:30.785 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:30.786 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:30.786 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:30.786 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:30.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:30.914921   372 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } attempt: 5
08:07:30.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:30.924062   372 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.233.252:36101: Network error: Client connection negotiation failed: client connection to 127.31.233.252:36101: connect: Connection refused (error 111)
08:07:30.954 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:31.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:31.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 68 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091651118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:31.145 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 68 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=25 ms, finalizationTime=2 ms).
08:07:31.146 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 68 as completed for source Source: KuduSource.
08:07:31.454 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:31.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:31.471678   372 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } attempt: 6
08:07:31.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:31.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:31.540275   372 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.233.252:36101: Network error: Client connection negotiation failed: client connection to 127.31.233.252:36101: connect: Connection refused (error 111)
08:07:31.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 69 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091651618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:31.620 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:31.621 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:31.621 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:31.621 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:31.621 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:31.622 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:31.622 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:31.622 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:31.622 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:31.622 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:31.622 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:31.622 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:31.623 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:31.634 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 69 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
08:07:31.636 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 69 as completed for source Source: KuduSource.
08:07:31.740 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:31.740 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:31.741 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:31.742 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:31.742 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:31.742 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:31.743 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:31.743 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:31.743 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:31.745 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:31.745 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:31.745 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:31.745 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:31.792 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:31.792 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:31.792 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:31.794 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:31.794 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:31.794 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:31.794 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:31.795 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:31.795 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:31.796 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:31.796 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:31.796 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:31.796 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:31.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:31.834096 32760 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } attempt: 8
08:07:31.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:31.885104 32760 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } has no permanent_uuid. Determining permanent_uuid...
08:07:31.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:31.914533 32760 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.233.252:36101: Network error: Client connection negotiation failed: client connection to 127.31.233.252:36101: connect: Connection refused (error 111)
08:07:31.920 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:31.920 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:31.920 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:31.921 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:31.921 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:31.922 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:31.922 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:31.922 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:31.922 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:31.922 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:31.922 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:31.921 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:31.923 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:31.954 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:31.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:31.980443 32760 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } attempt: 1
08:07:31.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:31.992506 32760 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.233.252:36101: Network error: Client connection negotiation failed: client connection to 127.31.233.252:36101: connect: Connection refused (error 111)
08:07:32.020 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:32.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:32.046175 32760 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } attempt: 2
08:07:32.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:32.057639 32760 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.233.252:36101: Network error: Client connection negotiation failed: client connection to 127.31.233.252:36101: connect: Connection refused (error 111)
08:07:32.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 70 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091652118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:32.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:32.135239 32760 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } attempt: 3
08:07:32.152 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 70 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=33 ms, finalizationTime=0 ms).
08:07:32.153 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 70 as completed for source Source: KuduSource.
08:07:32.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:32.159857 32760 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.233.252:36101: Network error: Client connection negotiation failed: client connection to 127.31.233.252:36101: connect: Connection refused (error 111)
08:07:32.168 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:32.168 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:32.168 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:32.169 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:32.169 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:32.169 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:32.169 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:32.169 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:32.169 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:32.170 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:32.170 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:32.170 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:32.170 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:32.323 [DEBUG - pool-178-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30028), Traces: [0ms] sending RPC to server master-127.28.220.252:33543, [9ms] received response from server master-127.28.220.252:33543: OK, deferred=null) with no deferred attached!
08:07:32.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:32.326231 32760 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } attempt: 4
08:07:32.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:32.358183 32760 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.233.252:36101: Network error: Client connection negotiation failed: client connection to 127.31.233.252:36101: connect: Connection refused (error 111)
08:07:32.453 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:32.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:32.591 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:32.591 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:32.592 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:32.593 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:32.594 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:32.595 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:32.596 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:32.596 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:32.596 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:32.597 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:32.598 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:32.598 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:32.598 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:32.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:32.601046   372 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } attempt: 7
08:07:32.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 71 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091652618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:32.642 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 71 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=23 ms, finalizationTime=1 ms).
08:07:32.643 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 71 as completed for source Source: KuduSource.
08:07:32.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:32.654772 32760 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } attempt: 5
08:07:32.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:32.658620 32709 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.233.252:36101: connect: Connection refused (error 111) [suppressed 12 similar messages]
08:07:32.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:32.662593 32760 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.233.252:36101: Network error: Client connection negotiation failed: client connection to 127.31.233.252:36101: connect: Connection refused (error 111)
08:07:32.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:32.673971   372 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.233.252:36101: Network error: Client connection negotiation failed: client connection to 127.31.233.252:36101: connect: Connection refused (error 111)
08:07:32.788 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:32.789 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:32.789 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:32.790 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:32.791 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:32.791 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:32.792 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:32.792 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:32.792 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:32.792 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:32.793 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:32.793 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:32.793 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:32.796 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:32.796 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:32.795 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:32.796 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:32.796 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:32.797 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:32.794 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:32.797 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:32.798 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:32.794 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:32.799 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:32.799 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:32.799 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:32.954 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:33.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:30.676973   385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:33.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:32.079833   383 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 374
08:07:33.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:33.001322   383 kernel_stack_watchdog.cc:198] Thread 374 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 400ms:
08:07:33.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:07:33.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:07:33.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:07:33.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:07:33.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:33.007552   374 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.331s	user 0.000s	sys 0.007s
08:07:33.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:33.007897   374 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.332s	user 0.000s	sys 0.007s
08:07:33.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:33.007956   386 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2324 milliseconds
08:07:33.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:33.009661   387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:33.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.009735   374 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:07:33.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.011554   374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:07:33.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.015244   374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:07:33.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:33.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.016808   374 hybrid_clock.cc:648] HybridClock initialized: now 1779091653016774 us; error 46 us; skew 500 ppm
08:07:33.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.017746   374 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:07:33.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.026263   374 webserver.cc:533] Webserver started at http://127.31.233.252:44863/ using document root <none> and password file <none>
08:07:33.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.027422   374 fs_manager.cc:362] Metadata directory not provided
08:07:33.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.027649   374 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:07:33.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.028117   374 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:07:33.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.033660   374 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-2/data/instance:
08:07:33.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cbc9f25062774200bb25d9f92adb7a11"
08:07:33.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:33 on dist-test-slave-1jss"
08:07:33.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.034924   374 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-2/wal/instance:
08:07:33.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cbc9f25062774200bb25d9f92adb7a11"
08:07:33.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:33 on dist-test-slave-1jss"
08:07:33.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.045336   374 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.005s	sys 0.004s
08:07:33.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.053617   406 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:07:33.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.055110   374 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.007s	sys 0.000s
08:07:33.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.055536   374 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-2/wal
08:07:33.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cbc9f25062774200bb25d9f92adb7a11"
08:07:33.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:33 on dist-test-slave-1jss"
08:07:33.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.056005   374 fs_report.cc:389] FS layout report
08:07:33.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:07:33.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-2/wal
08:07:33.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-2/wal
08:07:33.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-2/data/data
08:07:33.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:07:33.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:07:33.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:07:33.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:07:33.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:07:33.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:07:33.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:07:33.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:07:33.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:07:33.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:07:33.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:07:33.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 72 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091653118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:33.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.123098   374 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:07:33.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.125336   374 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:07:33.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.125960   374 kserver.cc:163] Server-wide thread pool size limit: 3276
08:07:33.128 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 72 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
08:07:33.129 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 72 as completed for source Source: KuduSource.
08:07:33.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.184231 32760 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } attempt: 6
08:07:33.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:33.199169 32760 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.233.252:36101: Network error: Client connection negotiation failed: client connection to 127.31.233.252:36101: connect: Connection refused (error 111)
08:07:33.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.244144   374 rpc_server.cc:307] RPC server started. Bound to: 127.31.233.252:36101
08:07:33.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.244309   459 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.233.252:36101 every 8 connection(s)
08:07:33.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.247980   374 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-2/data/info.pb
08:07:33.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.256387   460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:33.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.257265 32679 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 374
08:07:33.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.257848 32679 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/master-2/wal/instance
08:07:33.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.279407   460 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.233.254" port: 35197 } has no permanent_uuid. Determining permanent_uuid...
08:07:33.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.311424   460 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } has no permanent_uuid. Determining permanent_uuid...
08:07:33.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.323972   460 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } has no permanent_uuid. Determining permanent_uuid...
08:07:33.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.346659   460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11: Bootstrap starting.
08:07:33.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.357134   460 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11: Neither blocks nor log segments found. Creating new log.
08:07:33.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.359440   460 log.cc:826] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11: Log is configured to *not* fsync() on all Append() calls
08:07:33.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.365737   460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11: No bootstrap required, opened a new log
08:07:33.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.389483   460 raft_consensus.cc:359] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5764d09f018478db20e7f3ebeaae7fc" member_type: VOTER last_known_addr { host: "127.31.233.254" port: 35197 } } peers { permanent_uuid: "1616fb6537c34386af1269f34bf5a9c3" member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } } peers { permanent_uuid: "cbc9f25062774200bb25d9f92adb7a11" member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } }
08:07:33.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.390431   460 raft_consensus.cc:385] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:33.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.390787   460 raft_consensus.cc:740] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbc9f25062774200bb25d9f92adb7a11, State: Initialized, Role: FOLLOWER
08:07:33.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.391736   460 consensus_queue.cc:260] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5764d09f018478db20e7f3ebeaae7fc" member_type: VOTER last_known_addr { host: "127.31.233.254" port: 35197 } } peers { permanent_uuid: "1616fb6537c34386af1269f34bf5a9c3" member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } } peers { permanent_uuid: "cbc9f25062774200bb25d9f92adb7a11" member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } }
08:07:33.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.394734   469 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5764d09f018478db20e7f3ebeaae7fc" member_type: VOTER last_known_addr { host: "127.31.233.254" port: 35197 } } peers { permanent_uuid: "1616fb6537c34386af1269f34bf5a9c3" member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } } peers { permanent_uuid: "cbc9f25062774200bb25d9f92adb7a11" member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } } }
08:07:33.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.395494   469 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [sys.catalog]: This master's current role is: FOLLOWER
08:07:33.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.396638   460 sys_catalog.cc:565] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [sys.catalog]: configured and running, proceeding with master startup.
08:07:33.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:33.430570   480 catalog_manager.cc:1593] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:07:33.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:33.430956   480 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:07:33.454 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:33.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.424535   374 master_runner.cc:187] Error getting master registration for 127.31.233.254:35197: OK, instance_id { permanent_uuid: "b5764d09f018478db20e7f3ebeaae7fc" instance_seqno: 1779091647296480 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:07:33.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.456130   374 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:07:33.460 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:33.460 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:33.460 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:33.461 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:33.461 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:33.461 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:33.461 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:33.461 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:33.461 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:33.461 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:33.461 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:33.461 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:33.461 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:33.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.464280   469 raft_consensus.cc:493] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:07:33.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.464906   469 raft_consensus.cc:515] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5764d09f018478db20e7f3ebeaae7fc" member_type: VOTER last_known_addr { host: "127.31.233.254" port: 35197 } } peers { permanent_uuid: "1616fb6537c34386af1269f34bf5a9c3" member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } } peers { permanent_uuid: "cbc9f25062774200bb25d9f92adb7a11" member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } }
08:07:33.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:33.470978   469 leader_election.cc:290] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5764d09f018478db20e7f3ebeaae7fc (127.31.233.254:35197), 1616fb6537c34386af1269f34bf5a9c3 (127.31.233.253:33393)
08:07:33.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:33.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 73 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091653618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:33.632 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 73 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
08:07:33.634 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 73 as completed for source Source: KuduSource.
08:07:33.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:33.633242   412 tablet.cc:2404] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:07:33.750 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:33.750 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:33.750 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:33.750 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:33.751 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:33.751 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:33.751 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:33.751 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:33.751 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:33.751 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:33.751 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:33.751 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:33.751 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:33.870 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:33.870 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:33.871 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:33.871 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:33.871 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:33.871 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:33.871 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:33.872 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:33.872 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:33.872 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:33.872 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:33.872 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:33.872 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:33.873 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27306), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [4ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [6ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [6ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [6ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [22ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [23ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [41ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [42ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [42ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [42ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [62ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [81ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [82ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [101ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [161ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [161ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [162ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [162ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [261ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [262ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [262ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [262ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [342ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [763ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [941ms] refreshing cache from master, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [942ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [942ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [943ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [943ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1621ms] refreshing cache from master, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1623ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1623ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2640ms] refreshing cache from master, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2643ms] too many traces: truncated at 100 traces, deferred=Deferred@1994988148(state=PENDING, result=null, callback=(continuation of Deferred@123103672 after retry RPC after error@81353742) -> (continuation of Deferred@220812794 after retry RPC after error@858637457) -> (continuation of Deferred@125984997 after retry RPC after error@1232434487) -> (continuation of Deferred@238317414 after retry RPC after error@1407200125) -> (continuation of Deferred@1198652588 after retry RPC after error@634385848) -> (continuation of Deferred@137228600 after retry RPC after error@1514440835) -> (continuation of Deferred@311991291 after retry RPC after error@1210113573) -> (continuation of Deferred@803422760 after retry RPC after error@1360910279) -> (continuation of Deferred@118278492 after retry RPC after error@1234435694) -> (continuation of Deferred@2085885814 after retry RPC after error@1137198292) -> (continuation of Deferred@577713112 after retry RPC after error@1952045429) -> (continuation of Deferred@686464815 after retry RPC after error@696619010) -> (continuation of Deferred@1915717401 after retry RPC after error@1208449624) -> (continuation of Deferred@879265680 after retry RPC after error@837289119) -> (continuation of Deferred@1064389364 after retry RPC after error@1289167608) -> (continuation of Deferred@1022589173 after retry RPC after error@1305366280) -> (continuation of Deferred@2019400367 after retry RPC after error@224966590) -> (continuation of Deferred@721109558 after retry RPC after error@368246382) -> (continuation of Deferred@32409245 after retry RPC after error@1240667225) -> (continuation of Deferred@971576739 after retry RPC after error@1005231486) -> (continuation of Deferred@1313156848 after retry RPC after error@524659389) -> (continuation of Deferred@1852891387 after retry RPC after error@18776358) -> (continuation of Deferred@1716198747 after retry RPC after error@1416184685) -> (continuation of Deferred@1039599139 after retry RPC after error@1209382666), errback=(continuation of Deferred@123103672 after retry RPC after error@81353742) -> (continuation of Deferred@220812794 after retry RPC after error@858637457) -> (continuation of Deferred@125984997 after retry RPC after error@1232434487) -> (continuation of Deferred@238317414 after retry RPC after error@1407200125) -> (continuation of Deferred@1198652588 after retry RPC after error@634385848) -> (continuation of Deferred@137228600 after retry RPC after error@1514440835) -> (continuation of Deferred@311991291 after retry RPC after error@1210113573) -> (continuation of Deferred@803422760 after retry RPC after error@1360910279) -> (continuation of Deferred@118278492 after retry RPC after error@1234435694) -> (continuation of Deferred@2085885814 after retry RPC after error@1137198292) -> (continuation of Deferred@577713112 after retry RPC after error@1952045429) -> (continuation of Deferred@686464815 after retry RPC after error@696619010) -> (continuation of Deferred@1915717401 after retry RPC after error@1208449624) -> (continuation of Deferred@879265680 after retry RPC after error@837289119) -> (continuation of Deferred@1064389364 after retry RPC after error@1289167608) -> (continuation of Deferred@1022589173 after retry RPC after error@1305366280) -> (continuation of Deferred@2019400367 after retry RPC after error@224966590) -> (continuation of Deferred@721109558 after retry RPC after error@368246382) -> (continuation of Deferred@32409245 after retry RPC after error@1240667225) -> (continuation of Deferred@971576739 after retry RPC after error@1005231486) -> (continuation of Deferred@1313156848 after retry RPC after error@524659389) -> (continuation of Deferred@1852891387 after retry RPC after error@18776358) -> (continuation of Deferred@1716198747 after retry RPC after error@1416184685) -> (continuation of Deferred@1039599139 after retry RPC after error@1209382666)))
08:07:33.876 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:33.876 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:33.876 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:33.876 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27306), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [4ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [6ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [6ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [6ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [22ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [23ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [41ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [42ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [42ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [42ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [62ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [81ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [82ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [101ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [161ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [161ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [162ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [162ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [261ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [262ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [262ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [262ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [342ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [763ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [941ms] refreshing cache from master, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [942ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [942ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [943ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [943ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1621ms] refreshing cache from master, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1623ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1623ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2640ms] refreshing cache from master, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2643ms] too many traces: truncated at 100 traces, deferred=Deferred@1994988148(state=PENDING, result=null, callback=(continuation of Deferred@123103672 after retry RPC after error@81353742) -> (continuation of Deferred@220812794 after retry RPC after error@858637457) -> (continuation of Deferred@125984997 after retry RPC after error@1232434487) -> (continuation of Deferred@238317414 after retry RPC after error@1407200125) -> (continuation of Deferred@1198652588 after retry RPC after error@634385848) -> (continuation of Deferred@137228600 after retry RPC after error@1514440835) -> (continuation of Deferred@311991291 after retry RPC after error@1210113573) -> (continuation of Deferred@803422760 after retry RPC after error@1360910279) -> (continuation of Deferred@118278492 after retry RPC after error@1234435694) -> (continuation of Deferred@2085885814 after retry RPC after error@1137198292) -> (continuation of Deferred@577713112 after retry RPC after error@1952045429) -> (continuation of Deferred@686464815 after retry RPC after error@696619010) -> (continuation of Deferred@1915717401 after retry RPC after error@1208449624) -> (continuation of Deferred@879265680 after retry RPC after error@837289119) -> (continuation of Deferred@1064389364 after retry RPC after error@1289167608) -> (continuation of Deferred@1022589173 after retry RPC after error@1305366280) -> (continuation of Deferred@2019400367 after retry RPC after error@224966590) -> (continuation of Deferred@721109558 after retry RPC after error@368246382) -> (continuation of Deferred@32409245 after retry RPC after error@1240667225) -> (continuation of Deferred@971576739 after retry RPC after error@1005231486) -> (continuation of Deferred@1313156848 after retry RPC after error@524659389) -> (continuation of Deferred@1852891387 after retry RPC after error@18776358) -> (continuation of Deferred@1716198747 after retry RPC after error@1416184685) -> (continuation of Deferred@1039599139 after retry RPC after error@1209382666), errback=(continuation of Deferred@123103672 after retry RPC after error@81353742) -> (continuation of Deferred@220812794 after retry RPC after error@858637457) -> (continuation of Deferred@125984997 after retry RPC after error@1232434487) -> (continuation of Deferred@238317414 after retry RPC after error@1407200125) -> (continuation of Deferred@1198652588 after retry RPC after error@634385848) -> (continuation of Deferred@137228600 after retry RPC after error@1514440835) -> (continuation of Deferred@311991291 after retry RPC after error@1210113573) -> (continuation of Deferred@803422760 after retry RPC after error@1360910279) -> (continuation of Deferred@118278492 after retry RPC after error@1234435694) -> (continuation of Deferred@2085885814 after retry RPC after error@1137198292) -> (continuation of Deferred@577713112 after retry RPC after error@1952045429) -> (continuation of Deferred@686464815 after retry RPC after error@696619010) -> (continuation of Deferred@1915717401 after retry RPC after error@1208449624) -> (continuation of Deferred@879265680 after retry RPC after error@837289119) -> (continuation of Deferred@1064389364 after retry RPC after error@1289167608) -> (continuation of Deferred@1022589173 after retry RPC after error@1305366280) -> (continuation of Deferred@2019400367 after retry RPC after error@224966590) -> (continuation of Deferred@721109558 after retry RPC after error@368246382) -> (continuation of Deferred@32409245 after retry RPC after error@1240667225) -> (continuation of Deferred@971576739 after retry RPC after error@1005231486) -> (continuation of Deferred@1313156848 after retry RPC after error@524659389) -> (continuation of Deferred@1852891387 after retry RPC after error@18776358) -> (continuation of Deferred@1716198747 after retry RPC after error@1416184685) -> (continuation of Deferred@1039599139 after retry RPC after error@1209382666)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27306), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [4ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [6ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [6ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [6ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [22ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [23ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [41ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [42ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [42ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [42ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [62ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [81ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [82ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [101ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [161ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [161ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [162ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [162ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [261ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [262ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [262ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [262ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [342ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [763ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [941ms] refreshing cache from master, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [942ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [942ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [943ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [943ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1621ms] refreshing cache from master, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1623ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1623ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2640ms] refreshing cache from master, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2643ms] too many traces: truncated at 100 traces, deferred=Deferred@1994988148(state=PENDING, result=null, callback=(continuation of Deferred@123103672 after retry RPC after error@81353742) -> (continuation of Deferred@220812794 after retry RPC after error@858637457) -> (continuation of Deferred@125984997 after retry RPC after error@1232434487) -> (continuation of Deferred@238317414 after retry RPC after error@1407200125) -> (continuation of Deferred@1198652588 after retry RPC after error@634385848) -> (continuation of Deferred@137228600 after retry RPC after error@1514440835) -> (continuation of Deferred@311991291 after retry RPC after error@1210113573) -> (continuation of Deferred@803422760 after retry RPC after error@1360910279) -> (continuation of Deferred@118278492 after retry RPC after error@1234435694) -> (continuation of Deferred@2085885814 after retry RPC after error@1137198292) -> (continuation of Deferred@577713112 after retry RPC after error@1952045429) -> (continuation of Deferred@686464815 after retry RPC after error@696619010) -> (continuation of Deferred@1915717401 after retry RPC after error@1208449624) -> (continuation of Deferred@879265680 after retry RPC after error@837289119) -> (continuation of Deferred@1064389364 after retry RPC after error@1289167608) -> (continuation of Deferred@1022589173 after retry RPC after error@1305366280) -> (continuation of Deferred@2019400367 after retry RPC after error@224966590) -> (continuation of Deferred@721109558 after retry RPC after error@368246382) -> (continuation of Deferred@32409245 after retry RPC after error@1240667225) -> (continuation of Deferred@971576739 after retry RPC after error@1005231486) -> (continuation of Deferred@1313156848 after retry RPC after error@524659389) -> (continuation of Deferred@1852891387 after retry RPC after error@18776358) -> (continuation of Deferred@1716198747 after retry RPC after error@1416184685) -> (continuation of Deferred@1039599139 after retry RPC after error@1209382666), errback=(continuation of Deferred@123103672 after retry RPC after error@81353742) -> (continuation of Deferred@220812794 after retry RPC after error@858637457) -> (continuation of Deferred@125984997 after retry RPC after error@1232434487) -> (continuation of Deferred@238317414 after retry RPC after error@1407200125) -> (continuation of Deferred@1198652588 after retry RPC after error@634385848) -> (continuation of Deferred@137228600 after retry RPC after error@1514440835) -> (continuation of Deferred@311991291 after retry RPC after error@1210113573) -> (continuation of Deferred@803422760 after retry RPC after error@1360910279) -> (continuation of Deferred@118278492 after retry RPC after error@1234435694) -> (continuation of Deferred@2085885814 after retry RPC after error@1137198292) -> (continuation of Deferred@577713112 after retry RPC after error@1952045429) -> (continuation of Deferred@686464815 after retry RPC after error@696619010) -> (continuation of Deferred@1915717401 after retry RPC after error@1208449624) -> (continuation of Deferred@879265680 after retry RPC after error@837289119) -> (continuation of Deferred@1064389364 after retry RPC after error@1289167608) -> (continuation of Deferred@1022589173 after retry RPC after error@1305366280) -> (continuation of Deferred@2019400367 after retry RPC after error@224966590) -> (continuation of Deferred@721109558 after retry RPC after error@368246382) -> (continuation of Deferred@32409245 after retry RPC after error@1240667225) -> (continuation of Deferred@971576739 after retry RPC after error@1005231486) -> (continuation of Deferred@1313156848 after retry RPC after error@524659389) -> (continuation of Deferred@1852891387 after retry RPC after error@18776358) -> (continuation of Deferred@1716198747 after retry RPC after error@1416184685) -> (continuation of Deferred@1039599139 after retry RPC after error@1209382666)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.17.253:37621
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:07:33.877 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:33.877 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:33.877 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:33.878 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:33.878 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:33.878 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:33.878 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:33.879 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:33.879 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:33.879 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:33.890 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:33.891 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:33.891 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:33.891 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:33.891 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:33.891 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:33.891 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:33.891 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:33.892 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:33.892 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:33.892 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:33.891 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:33.892 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:33.894 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27306), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [4ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [6ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [6ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [6ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [22ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [23ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [41ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [42ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [42ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [42ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [62ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [81ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [82ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [101ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [161ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [161ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [162ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [162ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [261ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [262ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [262ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [262ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [342ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [763ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [941ms] refreshing cache from master, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [942ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [942ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [943ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [943ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1621ms] refreshing cache from master, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1623ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1623ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2640ms] refreshing cache from master, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2643ms] too many traces: truncated at 100 traces, deferred=Deferred@1994988148(state=PENDING, result=null, callback=(continuation of Deferred@123103672 after retry RPC after error@81353742) -> (continuation of Deferred@220812794 after retry RPC after error@858637457) -> (continuation of Deferred@125984997 after retry RPC after error@1232434487) -> (continuation of Deferred@238317414 after retry RPC after error@1407200125) -> (continuation of Deferred@1198652588 after retry RPC after error@634385848) -> (continuation of Deferred@137228600 after retry RPC after error@1514440835) -> (continuation of Deferred@311991291 after retry RPC after error@1210113573) -> (continuation of Deferred@803422760 after retry RPC after error@1360910279) -> (continuation of Deferred@118278492 after retry RPC after error@1234435694) -> (continuation of Deferred@2085885814 after retry RPC after error@1137198292) -> (continuation of Deferred@577713112 after retry RPC after error@1952045429) -> (continuation of Deferred@686464815 after retry RPC after error@696619010) -> (continuation of Deferred@1915717401 after retry RPC after error@1208449624) -> (continuation of Deferred@879265680 after retry RPC after error@837289119) -> (continuation of Deferred@1064389364 after retry RPC after error@1289167608) -> (continuation of Deferred@1022589173 after retry RPC after error@1305366280) -> (continuation of Deferred@2019400367 after retry RPC after error@224966590) -> (continuation of Deferred@721109558 after retry RPC after error@368246382) -> (continuation of Deferred@32409245 after retry RPC after error@1240667225) -> (continuation of Deferred@971576739 after retry RPC after error@1005231486) -> (continuation of Deferred@1313156848 after retry RPC after error@524659389) -> (continuation of Deferred@1852891387 after retry RPC after error@18776358) -> (continuation of Deferred@1716198747 after retry RPC after error@1416184685) -> (continuation of Deferred@1039599139 after retry RPC after error@1209382666), errback=(continuation of Deferred@123103672 after retry RPC after error@81353742) -> (continuation of Deferred@220812794 after retry RPC after error@858637457) -> (continuation of Deferred@125984997 after retry RPC after error@1232434487) -> (continuation of Deferred@238317414 after retry RPC after error@1407200125) -> (continuation of Deferred@1198652588 after retry RPC after error@634385848) -> (continuation of Deferred@137228600 after retry RPC after error@1514440835) -> (continuation of Deferred@311991291 after retry RPC after error@1210113573) -> (continuation of Deferred@803422760 after retry RPC after error@1360910279) -> (continuation of Deferred@118278492 after retry RPC after error@1234435694) -> (continuation of Deferred@2085885814 after retry RPC after error@1137198292) -> (continuation of Deferred@577713112 after retry RPC after error@1952045429) -> (continuation of Deferred@686464815 after retry RPC after error@696619010) -> (continuation of Deferred@1915717401 after retry RPC after error@1208449624) -> (continuation of Deferred@879265680 after retry RPC after error@837289119) -> (continuation of Deferred@1064389364 after retry RPC after error@1289167608) -> (continuation of Deferred@1022589173 after retry RPC after error@1305366280) -> (continuation of Deferred@2019400367 after retry RPC after error@224966590) -> (continuation of Deferred@721109558 after retry RPC after error@368246382) -> (continuation of Deferred@32409245 after retry RPC after error@1240667225) -> (continuation of Deferred@971576739 after retry RPC after error@1005231486) -> (continuation of Deferred@1313156848 after retry RPC after error@524659389) -> (continuation of Deferred@1852891387 after retry RPC after error@18776358) -> (continuation of Deferred@1716198747 after retry RPC after error@1416184685) -> (continuation of Deferred@1039599139 after retry RPC after error@1209382666)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27306), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [4ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [6ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [6ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [6ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [22ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [23ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [41ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [42ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [42ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [42ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [62ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [81ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [82ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [101ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [161ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [161ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [162ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [162ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [261ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [262ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [262ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [262ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [342ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [763ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [941ms] refreshing cache from master, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [942ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [942ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [943ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [943ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1621ms] refreshing cache from master, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1623ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1623ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2640ms] refreshing cache from master, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2643ms] too many traces: truncated at 100 traces, deferred=Deferred@1994988148(state=PENDING, result=null, callback=(continuation of Deferred@123103672 after retry RPC after error@81353742) -> (continuation of Deferred@220812794 after retry RPC after error@858637457) -> (continuation of Deferred@125984997 after retry RPC after error@1232434487) -> (continuation of Deferred@238317414 after retry RPC after error@1407200125) -> (continuation of Deferred@1198652588 after retry RPC after error@634385848) -> (continuation of Deferred@137228600 after retry RPC after error@1514440835) -> (continuation of Deferred@311991291 after retry RPC after error@1210113573) -> (continuation of Deferred@803422760 after retry RPC after error@1360910279) -> (continuation of Deferred@118278492 after retry RPC after error@1234435694) -> (continuation of Deferred@2085885814 after retry RPC after error@1137198292) -> (continuation of Deferred@577713112 after retry RPC after error@1952045429) -> (continuation of Deferred@686464815 after retry RPC after error@696619010) -> (continuation of Deferred@1915717401 after retry RPC after error@1208449624) -> (continuation of Deferred@879265680 after retry RPC after error@837289119) -> (continuation of Deferred@1064389364 after retry RPC after error@1289167608) -> (continuation of Deferred@1022589173 after retry RPC after error@1305366280) -> (continuation of Deferred@2019400367 after retry RPC after error@224966590) -> (continuation of Deferred@721109558 after retry RPC after error@368246382) -> (continuation of Deferred@32409245 after retry RPC after error@1240667225) -> (continuation of Deferred@971576739 after retry RPC after error@1005231486) -> (continuation of Deferred@1313156848 after retry RPC after error@524659389) -> (continuation of Deferred@1852891387 after retry RPC after error@18776358) -> (continuation of Deferred@1716198747 after retry RPC after error@1416184685) -> (continuation of Deferred@1039599139 after retry RPC after error@1209382666), errback=(continuation of Deferred@123103672 after retry RPC after error@81353742) -> (continuation of Deferred@220812794 after retry RPC after error@858637457) -> (continuation of Deferred@125984997 after retry RPC after error@1232434487) -> (continuation of Deferred@238317414 after retry RPC after error@1407200125) -> (continuation of Deferred@1198652588 after retry RPC after error@634385848) -> (continuation of Deferred@137228600 after retry RPC after error@1514440835) -> (continuation of Deferred@311991291 after retry RPC after error@1210113573) -> (continuation of Deferred@803422760 after retry RPC after error@1360910279) -> (continuation of Deferred@118278492 after retry RPC after error@1234435694) -> (continuation of Deferred@2085885814 after retry RPC after error@1137198292) -> (continuation of Deferred@577713112 after retry RPC after error@1952045429) -> (continuation of Deferred@686464815 after retry RPC after error@696619010) -> (continuation of Deferred@1915717401 after retry RPC after error@1208449624) -> (continuation of Deferred@879265680 after retry RPC after error@837289119) -> (continuation of Deferred@1064389364 after retry RPC after error@1289167608) -> (continuation of Deferred@1022589173 after retry RPC after error@1305366280) -> (continuation of Deferred@2019400367 after retry RPC after error@224966590) -> (continuation of Deferred@721109558 after retry RPC after error@368246382) -> (continuation of Deferred@32409245 after retry RPC after error@1240667225) -> (continuation of Deferred@971576739 after retry RPC after error@1005231486) -> (continuation of Deferred@1313156848 after retry RPC after error@524659389) -> (continuation of Deferred@1852891387 after retry RPC after error@18776358) -> (continuation of Deferred@1716198747 after retry RPC after error@1416184685) -> (continuation of Deferred@1039599139 after retry RPC after error@1209382666)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.17.253:37621
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:07:33.905 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
08:07:33.905 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (0d2ddb76420639a9ec06ca05e894cb50) switched from state RUNNING to RESTARTING.
08:07:33.906 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#2) of source Source: KuduSource.
08:07:33.906 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to CANCELING.
08:07:33.907 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#2) of source Source: KuduSource.
08:07:33.907 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to CANCELING.
08:07:33.907 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
08:07:33.907 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to CANCELING.
08:07:33.907 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#2) of source Source: KuduSource.
08:07:33.907 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
08:07:33.907 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to CANCELING.
08:07:33.907 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#2) of source Source: KuduSource.
08:07:33.907 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to CANCELING.
08:07:33.911 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:33.912 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:33.912 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:33.912 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:33.912 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:33.912 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:33.912 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:33.912 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:33.912 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:33.913 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:33.913 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:33.913 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:33.913 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:33.915 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
08:07:33.915 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CANCELING to CANCELED.
08:07:33.915 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
08:07:33.922 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
08:07:33.922 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to CANCELING.
08:07:33.922 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
08:07:33.925 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
08:07:33.925 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CANCELING to CANCELED.
08:07:33.925 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
08:07:33.930 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:33.931 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:33.931 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:33.931 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:33.931 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:33.932 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:33.932 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:33.931 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:33.933 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:33.934 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:33.934 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:33.934 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:33.934 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:33.941 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
08:07:33.941 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to CANCELING.
08:07:33.941 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
08:07:33.944 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
08:07:33.944 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CANCELING to CANCELED.
08:07:33.944 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
08:07:33.946 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
08:07:33.946 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to CANCELING.
08:07:33.947 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
08:07:33.948 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
08:07:33.948 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CANCELING to CANCELED.
08:07:33.948 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#2 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
08:07:33.948 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#2 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_2.
08:07:33.950 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#2 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_2.
08:07:33.950 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#2 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
08:07:33.950 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#2 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_2.
08:07:33.950 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:33.951 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:33.951 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CANCELING to CANCELED.
08:07:33.952 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:33.952 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:33.952 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CANCELING to CANCELED.
08:07:33.952 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:33.952 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:33.952 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:33.952 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:33.953 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CANCELING to CANCELED.
08:07:33.953 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:07:33.953 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CANCELING to CANCELED.
08:07:33.953 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:33.953 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:07:33.955 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:07:33.956 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 0d2ddb76420639a9ec06ca05e894cb50
08:07:33.951 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:33.957 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:33.958 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:33.958 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:33.958 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:33.991 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:33.991 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:33.991 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:33.992 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:33.992 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:33.992 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:33.992 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:33.992 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:33.992 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:33.992 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:33.992 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:33.993 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:33.993 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:34.030 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:34.031 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:34.031 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:34.032 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:34.032 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:34.032 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:34.033 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:34.033 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:34.033 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:34.033 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:34.033 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:34.033 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:34.033 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:34.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 74 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091654118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:34.130 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 74 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:07:34.131 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 74 as completed for source Source: KuduSource.
08:07:34.151 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:34.151 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:34.151 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:34.151 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:34.152 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:34.152 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:34.152 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:34.153 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:34.153 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:34.153 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:34.153 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:34.153 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:34.153 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:34.172 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:34.172 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:34.172 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:34.173 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:34.173 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:34.173 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:34.173 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:34.173 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:34.173 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:34.173 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:34.173 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:34.173 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:34.173 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:34.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.237000 32760 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } attempt: 7
08:07:34.310 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:34.311 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:34.311 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:34.311 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:34.311 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:34.311 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:34.312 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:34.312 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:34.312 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:34.312 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:34.312 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:34.313 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:34.313 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:34.315 [DEBUG - pool-178-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30020), Traces: [0ms] sending RPC to server master-127.28.220.252:33543, [9ms] received response from server master-127.28.220.252:33543: OK, deferred=null) with no deferred attached!
08:07:34.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.317045 32760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5764d09f018478db20e7f3ebeaae7fc: Bootstrap starting.
08:07:34.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.334319 32760 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5764d09f018478db20e7f3ebeaae7fc: Neither blocks nor log segments found. Creating new log.
08:07:34.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.351400 32760 log.cc:826] T 00000000000000000000000000000000 P b5764d09f018478db20e7f3ebeaae7fc: Log is configured to *not* fsync() on all Append() calls
08:07:34.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.374065 32760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5764d09f018478db20e7f3ebeaae7fc: No bootstrap required, opened a new log
08:07:34.380 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:34.380 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:34.380 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:34.381 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:34.381 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:34.381 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:34.382 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:34.382 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:34.382 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:34.382 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:34.382 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:34.382 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:34.382 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:34.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.425972 32760 raft_consensus.cc:359] T 00000000000000000000000000000000 P b5764d09f018478db20e7f3ebeaae7fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5764d09f018478db20e7f3ebeaae7fc" member_type: VOTER last_known_addr { host: "127.31.233.254" port: 35197 } } peers { permanent_uuid: "1616fb6537c34386af1269f34bf5a9c3" member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } } peers { permanent_uuid: "cbc9f25062774200bb25d9f92adb7a11" member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } }
08:07:34.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.427024 32760 raft_consensus.cc:385] T 00000000000000000000000000000000 P b5764d09f018478db20e7f3ebeaae7fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:34.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.427428 32760 raft_consensus.cc:740] T 00000000000000000000000000000000 P b5764d09f018478db20e7f3ebeaae7fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5764d09f018478db20e7f3ebeaae7fc, State: Initialized, Role: FOLLOWER
08:07:34.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.428475 32760 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5764d09f018478db20e7f3ebeaae7fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5764d09f018478db20e7f3ebeaae7fc" member_type: VOTER last_known_addr { host: "127.31.233.254" port: 35197 } } peers { permanent_uuid: "1616fb6537c34386af1269f34bf5a9c3" member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } } peers { permanent_uuid: "cbc9f25062774200bb25d9f92adb7a11" member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } }
08:07:34.430 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:34.431 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:34.431 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:34.431 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:34.431 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:34.432 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:34.432 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:34.432 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:34.432 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:34.437 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:34.437 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:34.437 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:34.437 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:34.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:34.436128   480 catalog_manager.cc:1593] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:07:34.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:34.436502   480 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:07:34.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.444471   497 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5764d09f018478db20e7f3ebeaae7fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5764d09f018478db20e7f3ebeaae7fc" member_type: VOTER last_known_addr { host: "127.31.233.254" port: 35197 } } peers { permanent_uuid: "1616fb6537c34386af1269f34bf5a9c3" member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } } peers { permanent_uuid: "cbc9f25062774200bb25d9f92adb7a11" member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } } }
08:07:34.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.445318   497 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5764d09f018478db20e7f3ebeaae7fc [sys.catalog]: This master's current role is: FOLLOWER
08:07:34.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.449214 32760 sys_catalog.cc:565] T 00000000000000000000000000000000 P b5764d09f018478db20e7f3ebeaae7fc [sys.catalog]: configured and running, proceeding with master startup.
08:07:34.454 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:34.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.457763 32735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cbc9f25062774200bb25d9f92adb7a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5764d09f018478db20e7f3ebeaae7fc" is_pre_election: true
08:07:34.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.459280 32735 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b5764d09f018478db20e7f3ebeaae7fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc9f25062774200bb25d9f92adb7a11 in term 0.
08:07:34.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.462371   409 leader_election.cc:304] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5764d09f018478db20e7f3ebeaae7fc, cbc9f25062774200bb25d9f92adb7a11; no voters: 
08:07:34.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.470356   499 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:07:34.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.471035   499 raft_consensus.cc:493] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:07:34.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.471536   499 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [term 0 FOLLOWER]: Advancing to term 1
08:07:34.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.490525   499 raft_consensus.cc:515] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5764d09f018478db20e7f3ebeaae7fc" member_type: VOTER last_known_addr { host: "127.31.233.254" port: 35197 } } peers { permanent_uuid: "1616fb6537c34386af1269f34bf5a9c3" member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } } peers { permanent_uuid: "cbc9f25062774200bb25d9f92adb7a11" member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } }
08:07:34.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:34.503741 32714 tablet.cc:2404] T 00000000000000000000000000000000 P b5764d09f018478db20e7f3ebeaae7fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:07:34.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.520354 32735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cbc9f25062774200bb25d9f92adb7a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5764d09f018478db20e7f3ebeaae7fc"
08:07:34.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.521025 32735 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b5764d09f018478db20e7f3ebeaae7fc [term 0 FOLLOWER]: Advancing to term 1
08:07:34.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.519832   499 leader_election.cc:290] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [CANDIDATE]: Term 1 election: Requested vote from peers b5764d09f018478db20e7f3ebeaae7fc (127.31.233.254:35197), 1616fb6537c34386af1269f34bf5a9c3 (127.31.233.253:33393)
08:07:34.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.536386 32735 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b5764d09f018478db20e7f3ebeaae7fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc9f25062774200bb25d9f92adb7a11 in term 1.
08:07:34.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.540210   409 leader_election.cc:304] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5764d09f018478db20e7f3ebeaae7fc, cbc9f25062774200bb25d9f92adb7a11; no voters: 
08:07:34.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.541682   499 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [term 1 FOLLOWER]: Leader election won for term 1
08:07:34.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.556747   499 raft_consensus.cc:697] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [term 1 LEADER]: Becoming Leader. State: Replica: cbc9f25062774200bb25d9f92adb7a11, State: Running, Role: LEADER
08:07:34.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.558323   499 consensus_queue.cc:237] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5764d09f018478db20e7f3ebeaae7fc" member_type: VOTER last_known_addr { host: "127.31.233.254" port: 35197 } } peers { permanent_uuid: "1616fb6537c34386af1269f34bf5a9c3" member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } } peers { permanent_uuid: "cbc9f25062774200bb25d9f92adb7a11" member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } }
08:07:34.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.577440   503 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cbc9f25062774200bb25d9f92adb7a11. Latest consensus state: current_term: 1 leader_uuid: "cbc9f25062774200bb25d9f92adb7a11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5764d09f018478db20e7f3ebeaae7fc" member_type: VOTER last_known_addr { host: "127.31.233.254" port: 35197 } } peers { permanent_uuid: "1616fb6537c34386af1269f34bf5a9c3" member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } } peers { permanent_uuid: "cbc9f25062774200bb25d9f92adb7a11" member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } } }
08:07:34.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.580180   503 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [sys.catalog]: This master's current role is: LEADER
08:07:34.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.596921   507 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
08:07:34.610 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:34.610 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:34.610 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:34.612 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:34.612 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:34.612 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:34.613 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:34.613 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:34.613 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:34.613 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:34.613 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:34.613 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:34.614 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:34.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.614280   507 catalog_manager.cc:1519] Initializing Kudu cluster ID...
08:07:34.618 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 75 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091654618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:34.629 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 75 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
08:07:34.631 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 75 as completed for source Source: KuduSource.
08:07:34.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.653825 32735 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b5764d09f018478db20e7f3ebeaae7fc [term 1 FOLLOWER]: Refusing update from remote peer cbc9f25062774200bb25d9f92adb7a11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:07:34.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.657055   503 consensus_queue.cc:1048] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5764d09f018478db20e7f3ebeaae7fc" member_type: VOTER last_known_addr { host: "127.31.233.254" port: 35197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:07:34.680 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:34.680 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:34.681 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:34.681 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:34.681 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:34.681 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:34.682 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:34.682 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:34.682 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:34.682 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:34.682 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:34.682 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:34.683 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:34.683 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28106), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [7ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [8ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [9ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [9ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [22ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [23ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [42ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [42ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [45ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [45ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [62ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [81ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [82ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [102ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [102ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [102ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [141ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [142ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [142ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [142ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [181ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [181ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [182ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [182ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [341ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [341ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [342ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [601ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [601ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [601ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [601ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [880ms] refreshing cache from master, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [882ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [882ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [882ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [882ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1680ms] refreshing cache from master, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1682ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1961ms] refreshing cache from master, [1961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1963ms] too many traces: truncated at 100 traces, deferred=Deferred@2042538219(state=PENDING, result=null, callback=(continuation of Deferred@982769238 after retry RPC after error@798536180) -> (continuation of Deferred@1826331766 after retry RPC after error@1622055158) -> (continuation of Deferred@1156287451 after retry RPC after error@781620643) -> (continuation of Deferred@505320491 after retry RPC after error@182703670) -> (continuation of Deferred@315498978 after retry RPC after error@149919125) -> (continuation of Deferred@1656416111 after retry RPC after error@1987891048) -> (continuation of Deferred@366883188 after retry RPC after error@1642679655) -> (continuation of Deferred@1415405482 after retry RPC after error@1154145734) -> (continuation of Deferred@544932282 after retry RPC after error@198374055) -> (continuation of Deferred@902585464 after retry RPC after error@662340586) -> (continuation of Deferred@1609834606 after retry RPC after error@1127200509) -> (continuation of Deferred@349638012 after retry RPC after error@1732356575) -> (continuation of Deferred@432538121 after retry RPC after error@661571475) -> (continuation of Deferred@201233135 after retry RPC after error@1637600542) -> (continuation of Deferred@941249390 after retry RPC after error@1763269025) -> (continuation of Deferred@378525575 after retry RPC after error@700648309) -> (continuation of Deferred@1135127552 after retry RPC after error@1625239941) -> (continuation of Deferred@134537718 after retry RPC after error@967691040) -> (continuation of Deferred@1071888569 after retry RPC after error@640284121) -> (continuation of Deferred@160283579 after retry RPC after error@1588495713) -> (continuation of Deferred@2091567229 after retry RPC after error@365194508) -> (continuation of Deferred@1911577708 after retry RPC after error@1541364414) -> (continuation of Deferred@1906083992 after retry RPC after error@1191585706) -> (continuation of Deferred@887488538 after retry RPC after error@365803154) -> (continuation of Deferred@8402171 after retry RPC after error@1993177142), errback=(continuation of Deferred@982769238 after retry RPC after error@798536180) -> (continuation of Deferred@1826331766 after retry RPC after error@1622055158) -> (continuation of Deferred@1156287451 after retry RPC after error@781620643) -> (continuation of Deferred@505320491 after retry RPC after error@182703670) -> (continuation of Deferred@315498978 after retry RPC after error@149919125) -> (continuation of Deferred@1656416111 after retry RPC after error@1987891048) -> (continuation of Deferred@366883188 after retry RPC after error@1642679655) -> (continuation of Deferred@1415405482 after retry RPC after error@1154145734) -> (continuation of Deferred@544932282 after retry RPC after error@198374055) -> (continuation of Deferred@902585464 after retry RPC after error@662340586) -> (continuation of Deferred@1609834606 after retry RPC after error@1127200509) -> (continuation of Deferred@349638012 after retry RPC after error@1732356575) -> (continuation of Deferred@432538121 after retry RPC after error@661571475) -> (continuation of Deferred@201233135 after retry RPC after error@1637600542) -> (continuation of Deferred@941249390 after retry RPC after error@1763269025) -> (continuation of Deferred@378525575 after retry RPC after error@700648309) -> (continuation of Deferred@1135127552 after retry RPC after error@1625239941) -> (continuation of Deferred@134537718 after retry RPC after error@967691040) -> (continuation of Deferred@1071888569 after retry RPC after error@640284121) -> (continuation of Deferred@160283579 after retry RPC after error@1588495713) -> (continuation of Deferred@2091567229 after retry RPC after error@365194508) -> (continuation of Deferred@1911577708 after retry RPC after error@1541364414) -> (continuation of Deferred@1906083992 after retry RPC after error@1191585706) -> (continuation of Deferred@887488538 after retry RPC after error@365803154) -> (continuation of Deferred@8402171 after retry RPC after error@1993177142)))
08:07:34.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.688148   514 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
08:07:34.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.715428   497 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5764d09f018478db20e7f3ebeaae7fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader cbc9f25062774200bb25d9f92adb7a11. Latest consensus state: current_term: 1 leader_uuid: "cbc9f25062774200bb25d9f92adb7a11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5764d09f018478db20e7f3ebeaae7fc" member_type: VOTER last_known_addr { host: "127.31.233.254" port: 35197 } } peers { permanent_uuid: "1616fb6537c34386af1269f34bf5a9c3" member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } } peers { permanent_uuid: "cbc9f25062774200bb25d9f92adb7a11" member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } } }
08:07:34.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.716276   497 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5764d09f018478db20e7f3ebeaae7fc [sys.catalog]: This master's current role is: FOLLOWER
08:07:34.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.723089   513 mvcc.cc:204] Tried to move back new op lower bound from 7287159417421103104 to 7287159417089630208. Current Snapshot: MvccSnapshot[applied={T|T < 7287159417421103104}]
08:07:34.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.738569   499 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cbc9f25062774200bb25d9f92adb7a11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5764d09f018478db20e7f3ebeaae7fc" member_type: VOTER last_known_addr { host: "127.31.233.254" port: 35197 } } peers { permanent_uuid: "1616fb6537c34386af1269f34bf5a9c3" member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } } peers { permanent_uuid: "cbc9f25062774200bb25d9f92adb7a11" member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } } }
08:07:34.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.739409   499 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [sys.catalog]: This master's current role is: LEADER
08:07:34.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.741202   497 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5764d09f018478db20e7f3ebeaae7fc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cbc9f25062774200bb25d9f92adb7a11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5764d09f018478db20e7f3ebeaae7fc" member_type: VOTER last_known_addr { host: "127.31.233.254" port: 35197 } } peers { permanent_uuid: "1616fb6537c34386af1269f34bf5a9c3" member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } } peers { permanent_uuid: "cbc9f25062774200bb25d9f92adb7a11" member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } } }
08:07:34.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.745888   497 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5764d09f018478db20e7f3ebeaae7fc [sys.catalog]: This master's current role is: FOLLOWER
08:07:34.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.755357   507 catalog_manager.cc:1382] Generated new cluster ID: d6e87c249307483da66b5cbeb5b5b077
08:07:34.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.755731   507 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
08:07:34.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.764441   372 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } attempt: 8
08:07:34.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.804703   507 catalog_manager.cc:1405] Generated new certificate authority record
08:07:34.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.718207 32691 master_runner.cc:187] Error getting master registration for 127.31.233.253:33393: OK, instance_id { permanent_uuid: "1616fb6537c34386af1269f34bf5a9c3" instance_seqno: 1779091650099755 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:07:34.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.807746 32691 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:07:34.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.807904   507 catalog_manager.cc:1539] Loading token signing keys...
08:07:34.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.815189   372 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1616fb6537c34386af1269f34bf5a9c3: Bootstrap starting.
08:07:34.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.834903   372 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1616fb6537c34386af1269f34bf5a9c3: Neither blocks nor log segments found. Creating new log.
08:07:34.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.837713   372 log.cc:826] T 00000000000000000000000000000000 P 1616fb6537c34386af1269f34bf5a9c3: Log is configured to *not* fsync() on all Append() calls
08:07:34.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.844134   372 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1616fb6537c34386af1269f34bf5a9c3: No bootstrap required, opened a new log
08:07:34.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.860550   507 catalog_manager.cc:6069] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11: Generated new TSK 0
08:07:34.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.862102   507 catalog_manager.cc:1549] Initializing in-progress tserver states...
08:07:34.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.878516   372 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1616fb6537c34386af1269f34bf5a9c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5764d09f018478db20e7f3ebeaae7fc" member_type: VOTER last_known_addr { host: "127.31.233.254" port: 35197 } } peers { permanent_uuid: "1616fb6537c34386af1269f34bf5a9c3" member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } } peers { permanent_uuid: "cbc9f25062774200bb25d9f92adb7a11" member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } }
08:07:34.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.879473   372 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1616fb6537c34386af1269f34bf5a9c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:34.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.879812   372 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1616fb6537c34386af1269f34bf5a9c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1616fb6537c34386af1269f34bf5a9c3, State: Initialized, Role: FOLLOWER
08:07:34.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.880905   372 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1616fb6537c34386af1269f34bf5a9c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5764d09f018478db20e7f3ebeaae7fc" member_type: VOTER last_known_addr { host: "127.31.233.254" port: 35197 } } peers { permanent_uuid: "1616fb6537c34386af1269f34bf5a9c3" member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } } peers { permanent_uuid: "cbc9f25062774200bb25d9f92adb7a11" member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } }
08:07:34.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.885421   521 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1616fb6537c34386af1269f34bf5a9c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5764d09f018478db20e7f3ebeaae7fc" member_type: VOTER last_known_addr { host: "127.31.233.254" port: 35197 } } peers { permanent_uuid: "1616fb6537c34386af1269f34bf5a9c3" member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } } peers { permanent_uuid: "cbc9f25062774200bb25d9f92adb7a11" member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } } }
08:07:34.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.886438   521 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1616fb6537c34386af1269f34bf5a9c3 [sys.catalog]: This master's current role is: FOLLOWER
08:07:34.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.887315   372 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1616fb6537c34386af1269f34bf5a9c3 [sys.catalog]: configured and running, proceeding with master startup.
08:07:34.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.889297   346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cbc9f25062774200bb25d9f92adb7a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1616fb6537c34386af1269f34bf5a9c3"
08:07:34.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.888491   347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cbc9f25062774200bb25d9f92adb7a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1616fb6537c34386af1269f34bf5a9c3" is_pre_election: true
08:07:34.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.889971   345 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1616fb6537c34386af1269f34bf5a9c3 [term 0 FOLLOWER]: Advancing to term 1
08:07:34.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:34.891458   347 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47308 (request call id 1) took 1421 ms (client timeout 1587 ms). Trace:
08:07:34.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:34.894383   347 rpcz_store.cc:269] 0518 08:07:33.470117 (+     0us) service_pool.cc:167] Inserting onto call queue
08:07:34.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 08:07:33.470281 (+   164us) service_pool.cc:224] Handling call
08:07:34.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 08:07:34.891368 (+1421087us) inbound_call.cc:177] Queueing success response
08:07:34.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
08:07:34.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.902135   345 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 1616fb6537c34386af1269f34bf5a9c3 [term 1 FOLLOWER]: Refusing update from remote peer cbc9f25062774200bb25d9f92adb7a11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:07:34.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.904484   499 consensus_queue.cc:1048] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1616fb6537c34386af1269f34bf5a9c3" member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:07:34.907 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:34.907 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:34.908 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:34.908 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:34.908 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:34.909 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:34.909 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:34.909 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:34.909 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:34.909 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:34.910 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:34.910 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:34.910 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:34.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.921454 32679 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:07:34.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:07:34.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-0/wal
08:07:34.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-0/data
08:07:34.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:07:34.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:07:34.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:07:34.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:34.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:34.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:34.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-0/logs
08:07:34.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-0/data/info.pb
08:07:34.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:34.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:07:34.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:07:34.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:07:34.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:07:34.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:34.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:34.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:34.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:07:34.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:07:34.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.233.193:0
08:07:34.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.233.193
08:07:34.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.233.193
08:07:34.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:34.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101
08:07:34.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.233.212:42413
08:07:34.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:34.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:34.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:07:34.948 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:34.948 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:34.949 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:34.949 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:34.949 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:34.949 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:34.949 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:34.950 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:34.950 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:34.950 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:34.950 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:34.950 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:34.950 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:34.951 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28365), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [3ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [21ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [22ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [22ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [22ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [42ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [45ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [45ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [45ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [61ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [61ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [62ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [81ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [81ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [81ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [81ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [101ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [122ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [122ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [122ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [122ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [221ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [221ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [221ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [221ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [241ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [241ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [241ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [241ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [681ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [682ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [682ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [682ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1201ms] refreshing cache from master, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1203ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1203ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2841ms] refreshing cache from master, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2843ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2844ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2845ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2845ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2881ms] refreshing cache from master, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2883ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2884ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2885ms] too many traces: truncated at 100 traces, deferred=Deferred@692444559(state=PENDING, result=null, callback=(continuation of Deferred@272251222 after retry RPC after error@967556460) -> (continuation of Deferred@541935248 after retry RPC after error@669212339) -> (continuation of Deferred@1725051792 after retry RPC after error@41329403) -> (continuation of Deferred@1220873699 after retry RPC after error@1970197646) -> (continuation of Deferred@47658752 after retry RPC after error@897658075) -> (continuation of Deferred@1431016861 after retry RPC after error@1443033374) -> (continuation of Deferred@1842787305 after retry RPC after error@1359850876) -> (continuation of Deferred@1491287485 after retry RPC after error@430489022) -> (continuation of Deferred@1094261913 after retry RPC after error@2103656335) -> (continuation of Deferred@1009576779 after retry RPC after error@1622533181) -> (continuation of Deferred@1776415078 after retry RPC after error@219817106) -> (continuation of Deferred@1446502601 after retry RPC after error@434926142) -> (continuation of Deferred@2145442468 after retry RPC after error@587358078) -> (continuation of Deferred@1255854719 after retry RPC after error@819799192) -> (continuation of Deferred@1234300381 after retry RPC after error@2027532862) -> (continuation of Deferred@1678560880 after retry RPC after error@1026350989) -> (continuation of Deferred@2064986864 after retry RPC after error@1315452910) -> (continuation of Deferred@1276448541 after retry RPC after error@387867045) -> (continuation of Deferred@1162756868 after retry RPC after error@1251400452) -> (continuation of Deferred@773806252 after retry RPC after error@1248335747) -> (continuation of Deferred@2097757097 after retry RPC after error@29069815) -> (continuation of Deferred@1429566292 after retry RPC after error@1600889470) -> (continuation of Deferred@1795890761 after retry RPC after error@920784630) -> (continuation of Deferred@1219716269 after retry RPC after error@1246316439), errback=(continuation of Deferred@272251222 after retry RPC after error@967556460) -> (continuation of Deferred@541935248 after retry RPC after error@669212339) -> (continuation of Deferred@1725051792 after retry RPC after error@41329403) -> (continuation of Deferred@1220873699 after retry RPC after error@1970197646) -> (continuation of Deferred@47658752 after retry RPC after error@897658075) -> (continuation of Deferred@1431016861 after retry RPC after error@1443033374) -> (continuation of Deferred@1842787305 after retry RPC after error@1359850876) -> (continuation of Deferred@1491287485 after retry RPC after error@430489022) -> (continuation of Deferred@1094261913 after retry RPC after error@2103656335) -> (continuation of Deferred@1009576779 after retry RPC after error@1622533181) -> (continuation of Deferred@1776415078 after retry RPC after error@219817106) -> (continuation of Deferred@1446502601 after retry RPC after error@434926142) -> (continuation of Deferred@2145442468 after retry RPC after error@587358078) -> (continuation of Deferred@1255854719 after retry RPC after error@819799192) -> (continuation of Deferred@1234300381 after retry RPC after error@2027532862) -> (continuation of Deferred@1678560880 after retry RPC after error@1026350989) -> (continuation of Deferred@2064986864 after retry RPC after error@1315452910) -> (continuation of Deferred@1276448541 after retry RPC after error@387867045) -> (continuation of Deferred@1162756868 after retry RPC after error@1251400452) -> (continuation of Deferred@773806252 after retry RPC after error@1248335747) -> (continuation of Deferred@2097757097 after retry RPC after error@29069815) -> (continuation of Deferred@1429566292 after retry RPC after error@1600889470) -> (continuation of Deferred@1795890761 after retry RPC after error@920784630) -> (continuation of Deferred@1219716269 after retry RPC after error@1246316439)))
08:07:34.954 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:34.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.977417   521 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1616fb6537c34386af1269f34bf5a9c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cbc9f25062774200bb25d9f92adb7a11. Latest consensus state: current_term: 1 leader_uuid: "cbc9f25062774200bb25d9f92adb7a11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5764d09f018478db20e7f3ebeaae7fc" member_type: VOTER last_known_addr { host: "127.31.233.254" port: 35197 } } peers { permanent_uuid: "1616fb6537c34386af1269f34bf5a9c3" member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } } peers { permanent_uuid: "cbc9f25062774200bb25d9f92adb7a11" member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } } }
08:07:34.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.978291   521 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1616fb6537c34386af1269f34bf5a9c3 [sys.catalog]: This master's current role is: FOLLOWER
08:07:34.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.979929   535 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1616fb6537c34386af1269f34bf5a9c3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cbc9f25062774200bb25d9f92adb7a11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5764d09f018478db20e7f3ebeaae7fc" member_type: VOTER last_known_addr { host: "127.31.233.254" port: 35197 } } peers { permanent_uuid: "1616fb6537c34386af1269f34bf5a9c3" member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } } peers { permanent_uuid: "cbc9f25062774200bb25d9f92adb7a11" member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } } }
08:07:34.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:34.980896   535 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1616fb6537c34386af1269f34bf5a9c3 [sys.catalog]: This master's current role is: FOLLOWER
08:07:35.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:35.006938   538 catalog_manager.cc:1294] Loaded cluster ID: d6e87c249307483da66b5cbeb5b5b077
08:07:35.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:35.007416   538 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 1616fb6537c34386af1269f34bf5a9c3: loading cluster ID for follower catalog manager: success
08:07:35.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:35.018769   538 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 1616fb6537c34386af1269f34bf5a9c3: acquiring CA information for follower catalog manager: success
08:07:35.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:35.026048   538 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 1616fb6537c34386af1269f34bf5a9c3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:07:35.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:35.098829 32364 debug-util.cc:398] Leaking SignalData structure 0x7b08000b5360 after lost signal to thread 32235
08:07:35.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:35.100387 32364 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad7c0 after lost signal to thread 32367
08:07:35.102 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:35.102 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:35.102 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:35.103 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:35.103 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:35.103 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:35.103 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:35.104 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:35.104 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:35.104 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:35.104 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:35.104 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:35.104 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:35.105 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=28525), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [3ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [4ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [7ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [7ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [22ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [22ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [23ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [43ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [46ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [46ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [46ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [61ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [61ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [62ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [81ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [81ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [82ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [102ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [102ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [141ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [141ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [142ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [142ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [241ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [241ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [242ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [242ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [381ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [381ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [381ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [382ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [902ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [902ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [902ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [902ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1141ms] refreshing cache from master, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1142ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1680ms] refreshing cache from master, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1681ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1682ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2541ms] refreshing cache from master, [2541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2543ms] too many traces: truncated at 100 traces, deferred=Deferred@1842898475(state=PENDING, result=null, callback=(continuation of Deferred@300273788 after retry RPC after error@1674381597) -> (continuation of Deferred@1669791457 after retry RPC after error@1304507780) -> (continuation of Deferred@1914202736 after retry RPC after error@2039877839) -> (continuation of Deferred@758352106 after retry RPC after error@1763374557) -> (continuation of Deferred@1482709348 after retry RPC after error@288959183) -> (continuation of Deferred@553419994 after retry RPC after error@519452933) -> (continuation of Deferred@1141369030 after retry RPC after error@481353179) -> (continuation of Deferred@1479426243 after retry RPC after error@2009035986) -> (continuation of Deferred@210101051 after retry RPC after error@381794677) -> (continuation of Deferred@1011075894 after retry RPC after error@819339656) -> (continuation of Deferred@325681298 after retry RPC after error@142121371) -> (continuation of Deferred@717289945 after retry RPC after error@731600744) -> (continuation of Deferred@1957244825 after retry RPC after error@953275606) -> (continuation of Deferred@359857188 after retry RPC after error@1688455669) -> (continuation of Deferred@1498146591 after retry RPC after error@1862987652) -> (continuation of Deferred@1830534557 after retry RPC after error@386743722) -> (continuation of Deferred@301482827 after retry RPC after error@691468351) -> (continuation of Deferred@426856401 after retry RPC after error@1735377208) -> (continuation of Deferred@878584965 after retry RPC after error@716690737) -> (continuation of Deferred@959125617 after retry RPC after error@550791277) -> (continuation of Deferred@1701518078 after retry RPC after error@1910588735) -> (continuation of Deferred@283653090 after retry RPC after error@335328914) -> (continuation of Deferred@788390649 after retry RPC after error@1431208612) -> (continuation of Deferred@82365644 after retry RPC after error@1918280421) -> (continuation of Deferred@872250492 after retry RPC after error@302486277) -> (continuation of Deferred@1355526949 after retry RPC after error@399340115) -> (continuation of Deferred@1334571594 after retry RPC after error@1631248133) -> (continuation of Deferred@1818565276 after retry RPC after error@273064617), errback=(continuation of Deferred@300273788 after retry RPC after error@1674381597) -> (continuation of Deferred@1669791457 after retry RPC after error@1304507780) -> (continuation of Deferred@1914202736 after retry RPC after error@2039877839) -> (continuation of Deferred@758352106 after retry RPC after error@1763374557) -> (continuation of Deferred@1482709348 after retry RPC after error@288959183) -> (continuation of Deferred@553419994 after retry RPC after error@519452933) -> (continuation of Deferred@1141369030 after retry RPC after error@481353179) -> (continuation of Deferred@1479426243 after retry RPC after error@2009035986) -> (continuation of Deferred@210101051 after retry RPC after error@381794677) -> (continuation of Deferred@1011075894 after retry RPC after error@819339656) -> (continuation of Deferred@325681298 after retry RPC after error@142121371) -> (continuation of Deferred@717289945 after retry RPC after error@731600744) -> (continuation of Deferred@1957244825 after retry RPC after error@953275606) -> (continuation of Deferred@359857188 after retry RPC after error@1688455669) -> (continuation of Deferred@1498146591 after retry RPC after error@1862987652) -> (continuation of Deferred@1830534557 after retry RPC after error@386743722) -> (continuation of Deferred@301482827 after retry RPC after error@691468351) -> (continuation of Deferred@426856401 after retry RPC after error@1735377208) -> (continuation of Deferred@878584965 after retry RPC after error@716690737) -> (continuation of Deferred@959125617 after retry RPC after error@550791277) -> (continuation of Deferred@1701518078 after retry RPC after error@1910588735) -> (continuation of Deferred@283653090 after retry RPC after error@335328914) -> (continuation of Deferred@788390649 after retry RPC after error@1431208612) -> (continuation of Deferred@82365644 after retry RPC after error@1918280421) -> (continuation of Deferred@872250492 after retry RPC after error@302486277) -> (continuation of Deferred@1355526949 after retry RPC after error@399340115) -> (continuation of Deferred@1334571594 after retry RPC after error@1631248133) -> (continuation of Deferred@1818565276 after retry RPC after error@273064617)))
08:07:35.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 76 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091655118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:35.129 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 76 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:07:35.131 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 76 as completed for source Source: KuduSource.
08:07:35.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:35.422349   499 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cbc9f25062774200bb25d9f92adb7a11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5764d09f018478db20e7f3ebeaae7fc" member_type: VOTER last_known_addr { host: "127.31.233.254" port: 35197 } } peers { permanent_uuid: "1616fb6537c34386af1269f34bf5a9c3" member_type: VOTER last_known_addr { host: "127.31.233.253" port: 33393 } } peers { permanent_uuid: "cbc9f25062774200bb25d9f92adb7a11" member_type: VOTER last_known_addr { host: "127.31.233.252" port: 36101 } } }
08:07:35.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:35.423172   499 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11 [sys.catalog]: This master's current role is: LEADER
08:07:35.454 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:35.550 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:35.551 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:35.551 [DEBUG - pool-240-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:35.551 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:35.551 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:35.551 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:35.551 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:35.551 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:35.551 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:35.552 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:35.552 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:35.551 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:35.552 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:35.619 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 77 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091655618 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:35.629 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 77 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:07:35.631 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 77 as completed for source Source: KuduSource.
08:07:35.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:35.635812   534 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:07:35.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:35.636610   534 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:07:35.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:35.637427   534 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:07:35.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:35.707340   514 catalog_manager.cc:1294] Loaded cluster ID: d6e87c249307483da66b5cbeb5b5b077
08:07:35.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:35.707782   514 catalog_manager.cc:1587] T 00000000000000000000000000000000 P b5764d09f018478db20e7f3ebeaae7fc: loading cluster ID for follower catalog manager: success
08:07:35.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:35.719332   534 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:07:35.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:35.720858   534 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.233.193
08:07:35.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:35.729024   514 catalog_manager.cc:1609] T 00000000000000000000000000000000 P b5764d09f018478db20e7f3ebeaae7fc: acquiring CA information for follower catalog manager: success
08:07:35.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:35.739693   514 catalog_manager.cc:1637] T 00000000000000000000000000000000 P b5764d09f018478db20e7f3ebeaae7fc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:07:35.851 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:35.852 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:35.852 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:35.853 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:35.853 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:35.853 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:35.853 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:35.853 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:35.853 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:35.853 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:35.853 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:35.854 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:35.854 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:35.854 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29287), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [3ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [7ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [7ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [21ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [22ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [22ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [22ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [41ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [41ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [41ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [41ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [61ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [61ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [62ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [81ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [81ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [81ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [81ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [121ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [121ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [121ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [121ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [180ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [181ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [181ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [182ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [182ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [222ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [222ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [222ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [223ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [241ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [241ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [241ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [241ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [660ms] refreshing cache from master, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [661ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [661ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [662ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [662ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1480ms] refreshing cache from master, [1480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1481ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1481ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1481ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1482ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2980ms] refreshing cache from master, [2980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2983ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2984ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2984ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2984ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [3260ms] refreshing cache from master, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [3263ms] too many traces: truncated at 100 traces, deferred=Deferred@890830970(state=PENDING, result=null, callback=(continuation of Deferred@70347134 after retry RPC after error@304693980) -> (continuation of Deferred@193465236 after retry RPC after error@1987035215) -> (continuation of Deferred@2040151397 after retry RPC after error@570273576) -> (continuation of Deferred@1784861736 after retry RPC after error@1653017747) -> (continuation of Deferred@1247704243 after retry RPC after error@102110783) -> (continuation of Deferred@2057916737 after retry RPC after error@546322707) -> (continuation of Deferred@433203806 after retry RPC after error@792948917) -> (continuation of Deferred@533733189 after retry RPC after error@1042933005) -> (continuation of Deferred@916564044 after retry RPC after error@47423733) -> (continuation of Deferred@493272541 after retry RPC after error@1821778673) -> (continuation of Deferred@1473119463 after retry RPC after error@1216725731) -> (continuation of Deferred@1621431931 after retry RPC after error@1039737140) -> (continuation of Deferred@448262992 after retry RPC after error@2084808767) -> (continuation of Deferred@882732802 after retry RPC after error@1083775012) -> (continuation of Deferred@1704025620 after retry RPC after error@74584265) -> (continuation of Deferred@1531480634 after retry RPC after error@1394143567) -> (continuation of Deferred@1008104646 after retry RPC after error@678875093) -> (continuation of Deferred@938510779 after retry RPC after error@594969731) -> (continuation of Deferred@751395951 after retry RPC after error@845094468) -> (continuation of Deferred@30536933 after retry RPC after error@378813120) -> (continuation of Deferred@1905905249 after retry RPC after error@1006519080) -> (continuation of Deferred@889646702 after retry RPC after error@49512500) -> (continuation of Deferred@1025944781 after retry RPC after error@1946701634) -> (continuation of Deferred@1996470835 after retry RPC after error@1754490616) -> (continuation of Deferred@1625030627 after retry RPC after error@1444925157), errback=(continuation of Deferred@70347134 after retry RPC after error@304693980) -> (continuation of Deferred@193465236 after retry RPC after error@1987035215) -> (continuation of Deferred@2040151397 after retry RPC after error@570273576) -> (continuation of Deferred@1784861736 after retry RPC after error@1653017747) -> (continuation of Deferred@1247704243 after retry RPC after error@102110783) -> (continuation of Deferred@2057916737 after retry RPC after error@546322707) -> (continuation of Deferred@433203806 after retry RPC after error@792948917) -> (continuation of Deferred@533733189 after retry RPC after error@1042933005) -> (continuation of Deferred@916564044 after retry RPC after error@47423733) -> (continuation of Deferred@493272541 after retry RPC after error@1821778673) -> (continuation of Deferred@1473119463 after retry RPC after error@1216725731) -> (continuation of Deferred@1621431931 after retry RPC after error@1039737140) -> (continuation of Deferred@448262992 after retry RPC after error@2084808767) -> (continuation of Deferred@882732802 after retry RPC after error@1083775012) -> (continuation of Deferred@1704025620 after retry RPC after error@74584265) -> (continuation of Deferred@1531480634 after retry RPC after error@1394143567) -> (continuation of Deferred@1008104646 after retry RPC after error@678875093) -> (continuation of Deferred@938510779 after retry RPC after error@594969731) -> (continuation of Deferred@751395951 after retry RPC after error@845094468) -> (continuation of Deferred@30536933 after retry RPC after error@378813120) -> (continuation of Deferred@1905905249 after retry RPC after error@1006519080) -> (continuation of Deferred@889646702 after retry RPC after error@49512500) -> (continuation of Deferred@1025944781 after retry RPC after error@1946701634) -> (continuation of Deferred@1996470835 after retry RPC after error@1754490616) -> (continuation of Deferred@1625030627 after retry RPC after error@1444925157)))
08:07:35.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:35.882217   534 tablet_server_runner.cc:78] Tablet server non-default flags:
08:07:35.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:35.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.233.212:42413
08:07:35.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-0/data
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-0/wal
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.233.193:0
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-0/data/info.pb
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.233.193
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.233.193
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-0/logs
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:07:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:07:35.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:35.906687   534 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:07:35.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:35.914925   534 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:07:35.947 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:35.947 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:35.948 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:35.948 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:35.948 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:35.949 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:35.949 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:35.949 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:35.949 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:35.949 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:35.950 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:35.950 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:35.950 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:35.954 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:35.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:35.969363   549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:36.109 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (0d2ddb76420639a9ec06ca05e894cb50) switched from state RESTARTING to RUNNING.
08:07:36.110 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job 0d2ddb76420639a9ec06ca05e894cb50 from Checkpoint 69 @ 1779091595847 for 0d2ddb76420639a9ec06ca05e894cb50 located at file:/tmp/junit4405728108231754423/checkpoints/0d2ddb76420639a9ec06ca05e894cb50/chk-69.
08:07:36.111 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
08:07:36.111 [INFO - flink-pekko.actor.default-dispatcher-8] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
08:07:36.119 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 78 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091656118 for job a72e6b48022ef36361b5eef11ee7c683.
08:07:36.129 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job b42812d69c586178cf7556c3c92998f3 from Checkpoint 65 @ 1779091487380 for b42812d69c586178cf7556c3c92998f3 located at file:/tmp/junit1738461414297871817/checkpoints/b42812d69c586178cf7556c3c92998f3/chk-65.
08:07:36.129 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 78 for job a72e6b48022ef36361b5eef11ee7c683 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:07:36.129 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
08:07:36.130 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from CREATED to SCHEDULED.
08:07:36.130 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 78 as completed for source Source: KuduSource.
08:07:36.131 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from SCHEDULED to DEPLOYING.
08:07:36.131 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #6) with attempt id 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1) with allocation id 2f9a5ebd231a465571d2109e36591407
08:07:36.132 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 0 to checkpoint 65 for source Source: KuduSource to checkpoint.
08:07:36.132 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:07:36.133 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 2f9a5ebd231a465571d2109e36591407.
08:07:36.135 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#6 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_6), deploy into slot with allocation id 2f9a5ebd231a465571d2109e36591407.
08:07:36.135 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (b42812d69c586178cf7556c3c92998f3) switched from state RESTARTING to RUNNING.
08:07:36.136 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job b42812d69c586178cf7556c3c92998f3 from Checkpoint 65 @ 1779091487380 for b42812d69c586178cf7556c3c92998f3 located at file:/tmp/junit1738461414297871817/checkpoints/b42812d69c586178cf7556c3c92998f3/chk-65.
08:07:36.137 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
08:07:36.137 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 3 to checkpoint 65 for source Source: KuduSource to checkpoint.
08:07:36.137 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from CREATED to SCHEDULED.
08:07:36.138 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:07:36.140 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from SCHEDULED to DEPLOYING.
08:07:36.140 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #6) with attempt id 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1) with allocation id 4c78869737ef27e21dadfe7d1a23010d
08:07:36.145 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to SCHEDULED.
08:07:36.146 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:07:36.146 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from SCHEDULED to DEPLOYING.
08:07:36.146 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #3) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id 23d75c1cae20f6d786d6e473edbc6825
08:07:36.147 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to SCHEDULED.
08:07:36.147 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:07:36.147 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from SCHEDULED to DEPLOYING.
08:07:36.147 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #3) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id 562b84b71b659c92bf587d4c4d45167a
08:07:36.147 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to SCHEDULED.
08:07:36.148 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:07:36.148 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from SCHEDULED to DEPLOYING.
08:07:36.148 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #3) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id 51ba13794eaa695dfcc17a66fc9521a4
08:07:36.148 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to SCHEDULED.
08:07:36.148 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:07:36.149 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from SCHEDULED to DEPLOYING.
08:07:36.149 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #3) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id e7235da53f93c0af3219c2857bfb1cae
08:07:36.149 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 23d75c1cae20f6d786d6e473edbc6825.
08:07:36.150 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:36.151 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_3), deploy into slot with allocation id 23d75c1cae20f6d786d6e473edbc6825.
08:07:36.154 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 4c78869737ef27e21dadfe7d1a23010d.
08:07:36.155 [INFO - Thread-36] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
08:07:36.156 [DEBUG - Thread-36] (Connection.java:575) [peer master-127.27.17.253:37621(127.27.17.253:37621)] disconnecting while in state TERMINATED
08:07:36.157 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#6 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_6), deploy into slot with allocation id 4c78869737ef27e21dadfe7d1a23010d.
08:07:36.157 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#6 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from CREATED to DEPLOYING.
08:07:36.157 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#6 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_6) [DEPLOYING].
08:07:36.158 [DEBUG - Thread-36] (Connection.java:575) [peer master-127.27.17.252:43595(127.27.17.252:43595)] disconnecting while in state TERMINATED
08:07:36.158 [DEBUG - Thread-36] (Connection.java:575) [peer master-127.27.17.254:45447(127.27.17.254:45447)] disconnecting while in state TERMINATED
08:07:36.158 [DEBUG - Thread-36] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:36.160 [INFO - Thread-36] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
08:07:36.160 [INFO - Thread-36] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
08:07:36.162 [DEBUG - Thread-36] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:36.162 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@77a0ef6
08:07:36.162 [INFO - Thread-36] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
08:07:36.163 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:07:36.164 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit1738461414297871817/checkpoints")
08:07:36.164 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#6 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from DEPLOYING to INITIALIZING.
08:07:36.164 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from DEPLOYING to INITIALIZING.
08:07:36.172 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 562b84b71b659c92bf587d4c4d45167a.
08:07:36.175 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_3), deploy into slot with allocation id 562b84b71b659c92bf587d4c4d45167a.
08:07:36.175 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to DEPLOYING.
08:07:36.175 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_3) [DEPLOYING].
08:07:36.178 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3e940e84
08:07:36.178 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:07:36.178 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:07:36.179 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
08:07:36.179 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
08:07:36.184 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#6 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from CREATED to DEPLOYING.
08:07:36.185 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#6 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_6) [DEPLOYING].
08:07:36.186 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7c97157b
08:07:36.186 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:07:36.187 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit1738461414297871817/checkpoints")
08:07:36.187 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#6 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from DEPLOYING to INITIALIZING.
08:07:36.187 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from DEPLOYING to INITIALIZING.
08:07:36.189 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@24241e97
08:07:36.190 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@54eecce0
08:07:36.202 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 51ba13794eaa695dfcc17a66fc9521a4.
08:07:36.203 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_3), deploy into slot with allocation id 51ba13794eaa695dfcc17a66fc9521a4.
08:07:36.204 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to DEPLOYING.
08:07:36.204 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_3) [DEPLOYING].
08:07:36.205 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4a096751
08:07:36.205 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:07:36.205 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:07:36.206 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
08:07:36.206 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
08:07:36.210 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3c21fb77
08:07:36.212 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:36.216 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:36.251 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@198c8ffb
08:07:36.252 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot e7235da53f93c0af3219c2857bfb1cae.
08:07:36.254 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_3), deploy into slot with allocation id e7235da53f93c0af3219c2857bfb1cae.
08:07:36.255 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to DEPLOYING.
08:07:36.256 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:36.256 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_3) [DEPLOYING].
08:07:36.256 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:36.258 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@29a38120
08:07:36.258 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:07:36.258 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:07:36.258 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
08:07:36.258 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
08:07:36.263 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:07:36.263 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:07:36.263 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:07:36.264 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:07:36.273 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:36.274 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:36.274 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:36.274 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@18f26495
08:07:36.275 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.275 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.275 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.275 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.275 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.275 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.276 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.276 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.276 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.276 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:36.277 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=29987), Traces: [0ms] sending RPC to server master-127.28.220.252:33543, [3ms] received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [21ms] refreshing cache from master, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [24ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [25ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [25ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [26ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [43ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [61ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [64ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [83ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [123ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [203ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [203ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [261ms] refreshing cache from master, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [263ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [522ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [882ms] refreshing cache from master, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [883ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1302ms] refreshing cache from master, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [1303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1304ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2601ms] refreshing cache from master, [2602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2603ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [2604ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [2605ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [2606ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2606ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [5981ms] refreshing cache from master, [5981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [5982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [5982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [5983ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [5983ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [5983ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [5983ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [7322ms] refreshing cache from master, [7322ms] too many traces: truncated at 100 traces, deferred=Deferred@234243225(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$232/0x00007f7544330000@3ea31a7c -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2040148685 after retry RPC after error@1211556147) -> (continuation of Deferred@2010887712 after retry RPC after error@1359819357) -> (continuation of Deferred@2041151211 after retry RPC after error@107558804) -> (continuation of Deferred@749337551 after retry RPC after error@344898525) -> (continuation of Deferred@652398977 after retry RPC after error@1777895262) -> (continuation of Deferred@183270957 after retry RPC after error@1801288958) -> (continuation of Deferred@1535366861 after retry RPC after error@1995204756) -> (continuation of Deferred@530087282 after retry RPC after error@522344691) -> (continuation of Deferred@1515372644 after retry RPC after error@1332722546) -> (continuation of Deferred@322972672 after retry RPC after error@505940827) -> (continuation of Deferred@1379248410 after retry RPC after error@1622354949) -> (continuation of Deferred@1921072191 after retry RPC after error@741180391) -> (continuation of Deferred@1395622401 after retry RPC after error@713383781) -> (continuation of Deferred@1360985806 after retry RPC after error@292318641) -> (continuation of Deferred@1048365591 after retry RPC after error@1040372938) -> (continuation of Deferred@416064842 after retry RPC after error@1782534663) -> (continuation of Deferred@843776293 after retry RPC after error@440870690) -> (continuation of Deferred@1734092757 after retry RPC after error@2003037779) -> (continuation of Deferred@491494323 after retry RPC after error@1050067215) -> (continuation of Deferred@947006343 after retry RPC after error@1351310252) -> (continuation of Deferred@299680781 after retry RPC after error@432730496) -> (continuation of Deferred@818794285 after retry RPC after error@982623395), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2040148685 after retry RPC after error@1211556147) -> (continuation of Deferred@2010887712 after retry RPC after error@1359819357) -> (continuation of Deferred@2041151211 after retry RPC after error@107558804) -> (continuation of Deferred@749337551 after retry RPC after error@344898525) -> (continuation of Deferred@652398977 after retry RPC after error@1777895262) -> (continuation of Deferred@183270957 after retry RPC after error@1801288958) -> (continuation of Deferred@1535366861 after retry RPC after error@1995204756) -> (continuation of Deferred@530087282 after retry RPC after error@522344691) -> (continuation of Deferred@1515372644 after retry RPC after error@1332722546) -> (continuation of Deferred@322972672 after retry RPC after error@505940827) -> (continuation of Deferred@1379248410 after retry RPC after error@1622354949) -> (continuation of Deferred@1921072191 after retry RPC after error@741180391) -> (continuation of Deferred@1395622401 after retry RPC after error@713383781) -> (continuation of Deferred@1360985806 after retry RPC after error@292318641) -> (continuation of Deferred@1048365591 after retry RPC after error@1040372938) -> (continuation of Deferred@416064842 after retry RPC after error@1782534663) -> (continuation of Deferred@843776293 after retry RPC after error@440870690) -> (continuation of Deferred@1734092757 after retry RPC after error@2003037779) -> (continuation of Deferred@491494323 after retry RPC after error@1050067215) -> (continuation of Deferred@947006343 after retry RPC after error@1351310252) -> (continuation of Deferred@299680781 after retry RPC after error@432730496) -> (continuation of Deferred@818794285 after retry RPC after error@982623395)))
08:07:36.278 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:36.285 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:36.285 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:36.285 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=29987), Traces: [0ms] sending RPC to server master-127.28.220.252:33543, [3ms] received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [21ms] refreshing cache from master, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [24ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [25ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [25ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [26ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [43ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [61ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [64ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [83ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [123ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [203ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [203ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [261ms] refreshing cache from master, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [263ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [522ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [882ms] refreshing cache from master, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [883ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1302ms] refreshing cache from master, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [1303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1304ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2601ms] refreshing cache from master, [2602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2603ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [2604ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [2605ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [2606ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2606ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [5981ms] refreshing cache from master, [5981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [5982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [5982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [5983ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [5983ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [5983ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [5983ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [7322ms] refreshing cache from master, [7322ms] too many traces: truncated at 100 traces, deferred=Deferred@234243225(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$232/0x00007f7544330000@3ea31a7c -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2040148685 after retry RPC after error@1211556147) -> (continuation of Deferred@2010887712 after retry RPC after error@1359819357) -> (continuation of Deferred@2041151211 after retry RPC after error@107558804) -> (continuation of Deferred@749337551 after retry RPC after error@344898525) -> (continuation of Deferred@652398977 after retry RPC after error@1777895262) -> (continuation of Deferred@183270957 after retry RPC after error@1801288958) -> (continuation of Deferred@1535366861 after retry RPC after error@1995204756) -> (continuation of Deferred@530087282 after retry RPC after error@522344691) -> (continuation of Deferred@1515372644 after retry RPC after error@1332722546) -> (continuation of Deferred@322972672 after retry RPC after error@505940827) -> (continuation of Deferred@1379248410 after retry RPC after error@1622354949) -> (continuation of Deferred@1921072191 after retry RPC after error@741180391) -> (continuation of Deferred@1395622401 after retry RPC after error@713383781) -> (continuation of Deferred@1360985806 after retry RPC after error@292318641) -> (continuation of Deferred@1048365591 after retry RPC after error@1040372938) -> (continuation of Deferred@416064842 after retry RPC after error@1782534663) -> (continuation of Deferred@843776293 after retry RPC after error@440870690) -> (continuation of Deferred@1734092757 after retry RPC after error@2003037779) -> (continuation of Deferred@491494323 after retry RPC after error@1050067215) -> (continuation of Deferred@947006343 after retry RPC after error@1351310252) -> (continuation of Deferred@299680781 after retry RPC after error@432730496) -> (continuation of Deferred@818794285 after retry RPC after error@982623395), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2040148685 after retry RPC after error@1211556147) -> (continuation of Deferred@2010887712 after retry RPC after error@1359819357) -> (continuation of Deferred@2041151211 after retry RPC after error@107558804) -> (continuation of Deferred@749337551 after retry RPC after error@344898525) -> (continuation of Deferred@652398977 after retry RPC after error@1777895262) -> (continuation of Deferred@183270957 after retry RPC after error@1801288958) -> (continuation of Deferred@1535366861 after retry RPC after error@1995204756) -> (continuation of Deferred@530087282 after retry RPC after error@522344691) -> (continuation of Deferred@1515372644 after retry RPC after error@1332722546) -> (continuation of Deferred@322972672 after retry RPC after error@505940827) -> (continuation of Deferred@1379248410 after retry RPC after error@1622354949) -> (continuation of Deferred@1921072191 after retry RPC after error@741180391) -> (continuation of Deferred@1395622401 after retry RPC after error@713383781) -> (continuation of Deferred@1360985806 after retry RPC after error@292318641) -> (continuation of Deferred@1048365591 after retry RPC after error@1040372938) -> (continuation of Deferred@416064842 after retry RPC after error@1782534663) -> (continuation of Deferred@843776293 after retry RPC after error@440870690) -> (continuation of Deferred@1734092757 after retry RPC after error@2003037779) -> (continuation of Deferred@491494323 after retry RPC after error@1050067215) -> (continuation of Deferred@947006343 after retry RPC after error@1351310252) -> (continuation of Deferred@299680781 after retry RPC after error@432730496) -> (continuation of Deferred@818794285 after retry RPC after error@982623395)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=29987), Traces: [0ms] sending RPC to server master-127.28.220.252:33543, [3ms] received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [21ms] refreshing cache from master, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [24ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [25ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [25ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [26ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [43ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [61ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [64ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [83ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [123ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [203ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [203ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [261ms] refreshing cache from master, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [263ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [522ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [882ms] refreshing cache from master, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [883ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1302ms] refreshing cache from master, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [1303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1304ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2601ms] refreshing cache from master, [2602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2603ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [2604ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [2605ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [2606ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2606ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [5981ms] refreshing cache from master, [5981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [5982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [5982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [5983ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [5983ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [5983ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [5983ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [7322ms] refreshing cache from master, [7322ms] too many traces: truncated at 100 traces, deferred=Deferred@234243225(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$232/0x00007f7544330000@3ea31a7c -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2040148685 after retry RPC after error@1211556147) -> (continuation of Deferred@2010887712 after retry RPC after error@1359819357) -> (continuation of Deferred@2041151211 after retry RPC after error@107558804) -> (continuation of Deferred@749337551 after retry RPC after error@344898525) -> (continuation of Deferred@652398977 after retry RPC after error@1777895262) -> (continuation of Deferred@183270957 after retry RPC after error@1801288958) -> (continuation of Deferred@1535366861 after retry RPC after error@1995204756) -> (continuation of Deferred@530087282 after retry RPC after error@522344691) -> (continuation of Deferred@1515372644 after retry RPC after error@1332722546) -> (continuation of Deferred@322972672 after retry RPC after error@505940827) -> (continuation of Deferred@1379248410 after retry RPC after error@1622354949) -> (continuation of Deferred@1921072191 after retry RPC after error@741180391) -> (continuation of Deferred@1395622401 after retry RPC after error@713383781) -> (continuation of Deferred@1360985806 after retry RPC after error@292318641) -> (continuation of Deferred@1048365591 after retry RPC after error@1040372938) -> (continuation of Deferred@416064842 after retry RPC after error@1782534663) -> (continuation of Deferred@843776293 after retry RPC after error@440870690) -> (continuation of Deferred@1734092757 after retry RPC after error@2003037779) -> (continuation of Deferred@491494323 after retry RPC after error@1050067215) -> (continuation of Deferred@947006343 after retry RPC after error@1351310252) -> (continuation of Deferred@299680781 after retry RPC after error@432730496) -> (continuation of Deferred@818794285 after retry RPC after error@982623395), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2040148685 after retry RPC after error@1211556147) -> (continuation of Deferred@2010887712 after retry RPC after error@1359819357) -> (continuation of Deferred@2041151211 after retry RPC after error@107558804) -> (continuation of Deferred@749337551 after retry RPC after error@344898525) -> (continuation of Deferred@652398977 after retry RPC after error@1777895262) -> (continuation of Deferred@183270957 after retry RPC after error@1801288958) -> (continuation of Deferred@1535366861 after retry RPC after error@1995204756) -> (continuation of Deferred@530087282 after retry RPC after error@522344691) -> (continuation of Deferred@1515372644 after retry RPC after error@1332722546) -> (continuation of Deferred@322972672 after retry RPC after error@505940827) -> (continuation of Deferred@1379248410 after retry RPC after error@1622354949) -> (continuation of Deferred@1921072191 after retry RPC after error@741180391) -> (continuation of Deferred@1395622401 after retry RPC after error@713383781) -> (continuation of Deferred@1360985806 after retry RPC after error@292318641) -> (continuation of Deferred@1048365591 after retry RPC after error@1040372938) -> (continuation of Deferred@416064842 after retry RPC after error@1782534663) -> (continuation of Deferred@843776293 after retry RPC after error@440870690) -> (continuation of Deferred@1734092757 after retry RPC after error@2003037779) -> (continuation of Deferred@491494323 after retry RPC after error@1050067215) -> (continuation of Deferred@947006343 after retry RPC after error@1351310252) -> (continuation of Deferred@299680781 after retry RPC after error@432730496) -> (continuation of Deferred@818794285 after retry RPC after error@982623395)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.220.252:33543
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:07:36.289 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.291 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:36.292 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.293 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.293 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.294 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.294 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.294 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.296 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.296 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.296 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:36.302 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=29987), Traces: [0ms] sending RPC to server master-127.28.220.252:33543, [3ms] received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [21ms] refreshing cache from master, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [24ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [25ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [25ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [26ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [43ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [61ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [64ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [83ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [123ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [203ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [203ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [261ms] refreshing cache from master, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [263ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [522ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [882ms] refreshing cache from master, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [883ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1302ms] refreshing cache from master, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [1303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1304ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2601ms] refreshing cache from master, [2602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2603ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [2604ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [2605ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [2606ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2606ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [5981ms] refreshing cache from master, [5981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [5982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [5982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [5983ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [5983ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [5983ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [5983ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [7322ms] refreshing cache from master, [7322ms] too many traces: truncated at 100 traces, deferred=Deferred@234243225(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$232/0x00007f7544330000@3ea31a7c -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2040148685 after retry RPC after error@1211556147) -> (continuation of Deferred@2010887712 after retry RPC after error@1359819357) -> (continuation of Deferred@2041151211 after retry RPC after error@107558804) -> (continuation of Deferred@749337551 after retry RPC after error@344898525) -> (continuation of Deferred@652398977 after retry RPC after error@1777895262) -> (continuation of Deferred@183270957 after retry RPC after error@1801288958) -> (continuation of Deferred@1535366861 after retry RPC after error@1995204756) -> (continuation of Deferred@530087282 after retry RPC after error@522344691) -> (continuation of Deferred@1515372644 after retry RPC after error@1332722546) -> (continuation of Deferred@322972672 after retry RPC after error@505940827) -> (continuation of Deferred@1379248410 after retry RPC after error@1622354949) -> (continuation of Deferred@1921072191 after retry RPC after error@741180391) -> (continuation of Deferred@1395622401 after retry RPC after error@713383781) -> (continuation of Deferred@1360985806 after retry RPC after error@292318641) -> (continuation of Deferred@1048365591 after retry RPC after error@1040372938) -> (continuation of Deferred@416064842 after retry RPC after error@1782534663) -> (continuation of Deferred@843776293 after retry RPC after error@440870690) -> (continuation of Deferred@1734092757 after retry RPC after error@2003037779) -> (continuation of Deferred@491494323 after retry RPC after error@1050067215) -> (continuation of Deferred@947006343 after retry RPC after error@1351310252) -> (continuation of Deferred@299680781 after retry RPC after error@432730496) -> (continuation of Deferred@818794285 after retry RPC after error@982623395), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2040148685 after retry RPC after error@1211556147) -> (continuation of Deferred@2010887712 after retry RPC after error@1359819357) -> (continuation of Deferred@2041151211 after retry RPC after error@107558804) -> (continuation of Deferred@749337551 after retry RPC after error@344898525) -> (continuation of Deferred@652398977 after retry RPC after error@1777895262) -> (continuation of Deferred@183270957 after retry RPC after error@1801288958) -> (continuation of Deferred@1535366861 after retry RPC after error@1995204756) -> (continuation of Deferred@530087282 after retry RPC after error@522344691) -> (continuation of Deferred@1515372644 after retry RPC after error@1332722546) -> (continuation of Deferred@322972672 after retry RPC after error@505940827) -> (continuation of Deferred@1379248410 after retry RPC after error@1622354949) -> (continuation of Deferred@1921072191 after retry RPC after error@741180391) -> (continuation of Deferred@1395622401 after retry RPC after error@713383781) -> (continuation of Deferred@1360985806 after retry RPC after error@292318641) -> (continuation of Deferred@1048365591 after retry RPC after error@1040372938) -> (continuation of Deferred@416064842 after retry RPC after error@1782534663) -> (continuation of Deferred@843776293 after retry RPC after error@440870690) -> (continuation of Deferred@1734092757 after retry RPC after error@2003037779) -> (continuation of Deferred@491494323 after retry RPC after error@1050067215) -> (continuation of Deferred@947006343 after retry RPC after error@1351310252) -> (continuation of Deferred@299680781 after retry RPC after error@432730496) -> (continuation of Deferred@818794285 after retry RPC after error@982623395)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=29987), Traces: [0ms] sending RPC to server master-127.28.220.252:33543, [3ms] received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [21ms] refreshing cache from master, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [24ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [25ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [25ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [26ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [43ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [61ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [64ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [83ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [123ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [203ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [203ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [261ms] refreshing cache from master, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [263ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [522ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [882ms] refreshing cache from master, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [883ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1302ms] refreshing cache from master, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [1303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1304ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2601ms] refreshing cache from master, [2602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2603ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [2604ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [2605ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [2606ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2606ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [5981ms] refreshing cache from master, [5981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [5982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [5982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [5983ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [5983ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [5983ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [5983ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [7322ms] refreshing cache from master, [7322ms] too many traces: truncated at 100 traces, deferred=Deferred@234243225(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$232/0x00007f7544330000@3ea31a7c -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2040148685 after retry RPC after error@1211556147) -> (continuation of Deferred@2010887712 after retry RPC after error@1359819357) -> (continuation of Deferred@2041151211 after retry RPC after error@107558804) -> (continuation of Deferred@749337551 after retry RPC after error@344898525) -> (continuation of Deferred@652398977 after retry RPC after error@1777895262) -> (continuation of Deferred@183270957 after retry RPC after error@1801288958) -> (continuation of Deferred@1535366861 after retry RPC after error@1995204756) -> (continuation of Deferred@530087282 after retry RPC after error@522344691) -> (continuation of Deferred@1515372644 after retry RPC after error@1332722546) -> (continuation of Deferred@322972672 after retry RPC after error@505940827) -> (continuation of Deferred@1379248410 after retry RPC after error@1622354949) -> (continuation of Deferred@1921072191 after retry RPC after error@741180391) -> (continuation of Deferred@1395622401 after retry RPC after error@713383781) -> (continuation of Deferred@1360985806 after retry RPC after error@292318641) -> (continuation of Deferred@1048365591 after retry RPC after error@1040372938) -> (continuation of Deferred@416064842 after retry RPC after error@1782534663) -> (continuation of Deferred@843776293 after retry RPC after error@440870690) -> (continuation of Deferred@1734092757 after retry RPC after error@2003037779) -> (continuation of Deferred@491494323 after retry RPC after error@1050067215) -> (continuation of Deferred@947006343 after retry RPC after error@1351310252) -> (continuation of Deferred@299680781 after retry RPC after error@432730496) -> (continuation of Deferred@818794285 after retry RPC after error@982623395), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2040148685 after retry RPC after error@1211556147) -> (continuation of Deferred@2010887712 after retry RPC after error@1359819357) -> (continuation of Deferred@2041151211 after retry RPC after error@107558804) -> (continuation of Deferred@749337551 after retry RPC after error@344898525) -> (continuation of Deferred@652398977 after retry RPC after error@1777895262) -> (continuation of Deferred@183270957 after retry RPC after error@1801288958) -> (continuation of Deferred@1535366861 after retry RPC after error@1995204756) -> (continuation of Deferred@530087282 after retry RPC after error@522344691) -> (continuation of Deferred@1515372644 after retry RPC after error@1332722546) -> (continuation of Deferred@322972672 after retry RPC after error@505940827) -> (continuation of Deferred@1379248410 after retry RPC after error@1622354949) -> (continuation of Deferred@1921072191 after retry RPC after error@741180391) -> (continuation of Deferred@1395622401 after retry RPC after error@713383781) -> (continuation of Deferred@1360985806 after retry RPC after error@292318641) -> (continuation of Deferred@1048365591 after retry RPC after error@1040372938) -> (continuation of Deferred@416064842 after retry RPC after error@1782534663) -> (continuation of Deferred@843776293 after retry RPC after error@440870690) -> (continuation of Deferred@1734092757 after retry RPC after error@2003037779) -> (continuation of Deferred@491494323 after retry RPC after error@1050067215) -> (continuation of Deferred@947006343 after retry RPC after error@1351310252) -> (continuation of Deferred@299680781 after retry RPC after error@432730496) -> (continuation of Deferred@818794285 after retry RPC after error@982623395)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.220.252:33543
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:07:36.319 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:36.325 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:36.325 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:36.326 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.326 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.326 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.326 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.327 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.327 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.327 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.327 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.328 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.328 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:36.330 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:36.333 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:36.333 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:36.334 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.334 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.334 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.334 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.334 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.334 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.335 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.335 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.335 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.335 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:36.339 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
08:07:36.339 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (a72e6b48022ef36361b5eef11ee7c683) switched from state RUNNING to RESTARTING.
08:07:36.340 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#0) of source Source: KuduSource.
08:07:36.340 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:36.341 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
08:07:36.343 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
08:07:36.343 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
08:07:36.343 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
08:07:36.346 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#0) of source Source: KuduSource.
08:07:36.346 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
08:07:36.347 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
08:07:36.347 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
08:07:36.348 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
08:07:36.348 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
08:07:36.350 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:36.350 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:36.350 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:36.351 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.351 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.351 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.351 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.351 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.351 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.352 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.352 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.352 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.352 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:36.353 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:36.365 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to DEPLOYING.
08:07:36.365 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_3) [DEPLOYING].
08:07:36.367 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4746eee5
08:07:36.367 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:07:36.370 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:36.370 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:36.370 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:36.371 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.371 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.371 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.372 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.372 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.372 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.372 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:07:36.372 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
08:07:36.373 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
08:07:36.373 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.373 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.373 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.374 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:36.382 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:36.390 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:36.390 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@33c9b458
08:07:36.390 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:36.390 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:36.391 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.391 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.391 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.392 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.392 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.392 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.392 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.392 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.392 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.392 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:36.394 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:36.397 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:36.411 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:36.416 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
08:07:36.416 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
08:07:36.416 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
08:07:36.417 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer d6acb62062c54919acc5ee398d03f785(127.29.158.129:45149)] disconnecting while in state TERMINATED
08:07:36.417 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.29.158.189:41727(127.29.158.189:41727)] disconnecting while in state TERMINATED
08:07:36.418 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.29.158.190:38071(127.29.158.190:38071)] disconnecting while in state TERMINATED
08:07:36.418 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.29.158.188:39061(127.29.158.188:39061)] disconnecting while in state TERMINATED
08:07:36.418 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:36.419 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:07:36.419 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-1
08:07:36.419 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-3
08:07:36.421 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.29.158.189:41727(127.29.158.189:41727)] disconnecting while in state TERMINATED
08:07:36.421 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 3fd6ff86a84648679872c7b9c828d708(127.29.158.130:33769)] disconnecting while in state TERMINATED
08:07:36.421 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.29.158.190:38071(127.29.158.190:38071)] disconnecting while in state TERMINATED
08:07:36.421 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.29.158.188:39061(127.29.158.188:39061)] disconnecting while in state TERMINATED
08:07:36.421 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:36.422 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:07:36.422 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-1
08:07:36.422 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-3
08:07:36.430 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:36.430 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:36.430 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:36.431 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:36.431 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.431 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.431 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.432 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.432 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.432 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.432 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.432 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.433 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.433 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.433 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.433 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.433 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:36.443 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:36.453 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:36.454 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:36.465 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:36.468 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.469 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.469 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.474 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:36.477 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.479 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.479 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.482 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:36.486 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.486 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.486 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.494 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.494 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.495 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.495 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:36.504 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:36.505 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.506 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:36.506 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.507 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.511 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:36.515 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:36.522 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.522 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.523 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.526 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.527 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.527 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.527 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:36.530 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-2
08:07:36.531 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
08:07:36.532 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
08:07:36.532 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
08:07:36.534 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
08:07:36.534 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-2
08:07:36.534 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
08:07:36.534 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
08:07:36.539 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:36.542 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:36.543 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.543 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.543 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.547 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.548 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.549 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:36.550 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:36.550 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:36.550 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.551 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.551 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.551 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.551 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.551 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.551 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.552 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.552 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.552 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:36.553 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.553 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:36.558 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:36.560 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:36.560 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:36.561 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:36.568 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:36.571 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:36.571 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:36.573 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:36.575 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:36.579 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:36.579 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:36.579 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:36.579 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:36.594 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
08:07:36.594 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
08:07:36.594 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
08:07:36.594 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:36.595 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.29.158.189:41727(127.29.158.189:41727)] disconnecting while in state TERMINATED
08:07:36.596 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.29.158.190:38071(127.29.158.190:38071)] disconnecting while in state TERMINATED
08:07:36.596 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.29.158.188:39061(127.29.158.188:39061)] disconnecting while in state TERMINATED
08:07:36.596 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:36.596 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:07:36.597 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
08:07:36.610 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
08:07:36.610 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
08:07:36.610 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
08:07:36.613 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:36.614 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.614 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.614 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.626 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:36.631 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.631 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.632 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.637 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:36.640 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.640 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.640 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.650 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:36.651 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:36.652 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.652 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.652 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.657 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:36.658 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.658 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.658 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.670 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:36.672 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.673 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.673 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.675 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:36.682 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:36.682 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:36.682 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:36.683 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:36.684 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:36.685 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:36.685 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:36.690 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:36.690 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:36.690 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:36.690 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:36.694 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:36.694 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:36.696 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.29.158.189:41727(127.29.158.189:41727)] disconnecting while in state TERMINATED
08:07:36.696 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.29.158.190:38071(127.29.158.190:38071)] disconnecting while in state TERMINATED
08:07:36.696 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.29.158.188:39061(127.29.158.188:39061)] disconnecting while in state TERMINATED
08:07:36.697 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:36.698 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
08:07:36.699 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-2
08:07:36.702 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#0 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
08:07:36.703 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#0 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_0.
08:07:36.704 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
08:07:36.705 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
08:07:36.705 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:07:36.706 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:07:36.712 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.713 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.713 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.714 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:36.723 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:36.723 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:36.724 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.725 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.725 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.725 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:36.726 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.727 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.727 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.733 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.733 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.733 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.735 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:36.752 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:36.754 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:36.754 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:36.754 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:36.754 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:36.754 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:36.755 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:36.755 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:36.755 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:36.756 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:36.756 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:36.756 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:36.756 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:36.767 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:36.772 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.772 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.772 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.774 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:36.774 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:36.774 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:36.775 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:36.775 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:36.775 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:36.775 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:36.775 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:36.775 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:36.776 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:36.776 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:36.776 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:36.776 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:36.776 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:36.777 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.777 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.777 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.780 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.780 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.780 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.780 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:36.781 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:36.782 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:36.783 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.783 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.783 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.783 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.783 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.784 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.790 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
08:07:36.790 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-2
08:07:36.790 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
08:07:36.790 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
08:07:36.790 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:36.791 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:36.791 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:36.791 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
08:07:36.791 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.791 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.791 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:36.792 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.792 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
08:07:36.792 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.792 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:36.792 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.792 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.792 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:36.792 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:36.793 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:07:36.794 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:36.794 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:36.794 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:36.795 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:36.795 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:36.795 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:36.795 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:36.795 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:36.795 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:36.796 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:36.796 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:36.797 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:36.797 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:36.800 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:36.810 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:36.812 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.812 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.812 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.812 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:36.813 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.813 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.813 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.814 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.814 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.814 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.814 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:36.827 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
08:07:36.827 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:07:36.827 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
08:07:36.828 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
08:07:36.829 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
08:07:36.830 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
08:07:36.831 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:318) Clearing resource requirements of job a72e6b48022ef36361b5eef11ee7c683
08:07:36.834 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:36.834 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:36.834 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:36.835 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:36.836 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:36.836 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:36.836 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:36.837 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:36.837 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:36.837 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:36.837 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:36.837 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:36.837 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:36.837 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:36.848 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.849 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.849 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.851 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:36.855 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:36.860 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.860 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.860 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.868 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:36.871 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.871 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:36.872 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.872 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.875 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.875 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.875 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.875 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:36.881 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:36.882 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:36.883 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.883 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.883 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.889 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:36.889 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.890 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.890 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.891 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.891 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.891 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.891 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:36.894 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:36.895 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:36.895 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:36.896 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:36.896 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:36.896 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:36.896 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:36.896 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:36.896 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:36.897 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:36.897 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:36.897 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:36.897 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:36.903 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:36.904 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:36.904 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:36.904 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.904 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.905 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.905 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.905 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.905 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.905 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.906 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.906 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.906 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:36.912 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:36.914 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.914 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.914 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.922 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:36.923 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:36.923 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:36.923 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.924 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.924 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.924 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.924 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.924 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.924 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.925 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.925 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.925 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:36.925 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.925 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.925 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.925 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:36.933 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:36.935 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.935 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.935 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.942 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:36.942 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:36.943 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:36.943 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:36.943 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.943 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.943 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.944 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.944 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.944 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.944 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:36.944 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.944 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.944 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.945 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.945 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.945 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.945 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:36.951 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:36.951 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.951 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.951 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.952 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.952 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.952 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.953 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:36.954 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:36.961 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:36.961 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:36.962 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:36.962 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.962 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.962 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.962 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.962 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.962 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.962 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:36.962 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.962 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.962 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.962 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:36.963 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.964 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.964 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.966 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:36.967 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.967 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.967 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.968 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.968 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.968 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.968 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:36.973 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:36.974 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:36.974 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:36.974 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.974 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.974 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.974 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.974 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.974 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.974 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.974 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.974 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.975 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:36.981 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:36.981 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:36.982 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.982 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:36.982 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.982 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.982 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.982 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:36.982 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:36.982 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.982 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.982 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:36.982 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:36.983 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:36.983 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.983 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.983 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.983 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:36.984 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.984 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.985 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.985 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:36.985 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.985 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.985 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.990 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:36.991 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:36.991 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:36.992 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:36.992 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.992 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.992 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.992 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.993 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.993 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.993 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.993 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.993 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.993 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.993 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:36.996 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.996 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.994 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:36.996 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:36.996 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:36.996 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.996 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.996 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:36.996 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.996 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.997 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.997 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:36.997 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.997 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:36.997 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.001 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:37.001 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:37.002 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:37.002 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.003 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:37.003 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.003 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.003 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.003 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.004 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.004 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.004 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.004 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.004 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.004 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.004 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.004 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.004 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:37.005 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:37.005 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:37.005 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.006 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.006 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.006 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.006 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.006 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.007 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.007 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.007 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.007 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:37.007 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:37.010 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.010 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.010 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.010 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.011 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.011 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.012 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.012 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.012 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.012 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.012 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.012 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.013 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.012 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.013 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.013 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.013 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.013 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.014 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.014 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.014 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.014 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.014 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.014 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.014 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.014 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:37.014 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.014 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.014 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:37.014 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.014 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.014 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.014 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:37.015 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.015 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.015 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:37.015 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.015 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:37.015 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.015 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:37.015 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:37.015 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:37.015 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:37.016 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:37.016 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:37.016 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:37.016 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:37.020 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:37.021 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:37.021 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:37.021 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.021 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.022 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.022 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.022 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.022 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.023 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.023 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.023 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.023 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:37.024 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.034 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.034 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.035 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.035 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.035 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.035 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.035 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.035 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.035 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.036 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.036 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.036 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.036 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.037 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.038 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.038 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.038 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.046 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.047 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.047 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.047 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.048 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.049 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.049 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.049 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.051 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.051 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.052 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.052 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.052 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.053 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.054 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.054 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.054 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.054 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.054 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.055 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.055 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.055 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.055 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.055 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.055 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.055 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.055 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.055 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.054 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.056 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.056 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.055 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.056 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.056 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.057 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.057 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.057 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.057 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.057 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.057 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.057 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.057 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.057 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.057 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.054 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.058 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.058 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.064 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.064 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.064 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.064 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.064 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.065 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.065 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.065 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.065 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.065 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.065 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.066 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.066 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.081 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:37.082 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:37.082 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:37.083 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.083 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.083 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.083 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.083 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.084 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.084 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.084 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.084 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.084 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.084 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.084 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.084 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:37.084 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.084 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.084 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.085 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.085 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.085 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.085 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.085 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.085 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.085 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.095 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.095 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.096 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.096 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.096 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.096 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.097 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.097 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.097 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.098 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.098 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.098 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.098 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.123 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:37.123 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:37.123 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.123 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:37.124 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.124 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.124 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.124 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.124 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.124 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.124 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.124 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.124 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.124 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.124 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.124 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.124 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.125 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.125 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.125 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.125 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.124 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.124 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.125 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.125 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.125 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:37.131 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.132 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.132 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.133 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.133 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.133 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.133 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.133 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.133 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.134 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.134 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.134 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.134 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.134 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.134 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.134 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.134 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.135 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.135 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.135 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.135 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.135 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.135 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.135 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.135 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.135 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.143 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:37.143 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:37.143 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:37.143 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.144 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.144 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.144 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.144 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.144 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.144 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.144 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.144 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.144 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:37.144 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.145 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.145 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.145 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.145 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.145 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.145 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.145 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.145 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.145 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.145 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.146 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.146 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.150 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:37.155 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.155 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.156 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.156 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.156 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.156 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.157 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.157 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.157 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.157 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.157 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.157 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.158 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.172 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.172 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.172 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.173 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.173 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.173 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.174 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.174 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.174 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.175 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.175 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.175 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.175 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.189 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:37.190 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:37.190 [DEBUG - pool-178-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:37.190 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:37.190 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:37.190 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:37.191 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:37.191 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:37.191 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:37.191 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:37.191 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:37.191 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:37.192 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:37.214 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:37.214 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.215 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:37.215 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.215 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:37.215 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.216 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:37.216 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.216 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.216 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:37.216 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:37.216 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.216 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:37.216 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.216 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:37.216 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:37.216 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.216 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.217 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.217 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.216 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.217 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.216 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:37.217 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:37.217 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:37.218 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:37.223 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.224 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.224 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.224 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.224 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.224 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.224 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.224 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.224 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.225 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.225 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.225 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.225 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.244 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.244 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.244 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.245 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.245 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.245 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.245 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.245 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.245 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.246 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.246 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.246 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.246 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.321 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:37.321 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:37.321 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:37.322 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.322 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.322 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.323 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.323 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.323 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.323 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.324 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.324 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.324 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:37.330 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:37.330 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:37.331 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:37.331 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:37.331 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:37.331 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:37.331 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:37.331 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:37.331 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:37.332 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:37.332 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:37.332 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:37.332 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:37.374 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.375 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.376 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.377 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.377 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.377 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.378 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.378 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.378 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.378 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.379 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.379 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.379 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.406 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (a72e6b48022ef36361b5eef11ee7c683) switched from state RESTARTING to RUNNING.
08:07:37.407 [INFO - flink-pekko.actor.default-dispatcher-6] (CheckpointCoordinator.java:1805) Restoring job a72e6b48022ef36361b5eef11ee7c683 from Checkpoint 78 @ 1779091656118 for a72e6b48022ef36361b5eef11ee7c683 located at file:/tmp/junit13140095929423248446/checkpoints/a72e6b48022ef36361b5eef11ee7c683/chk-78.
08:07:37.408 [INFO - flink-pekko.actor.default-dispatcher-6] (MasterHooks.java:201) No master state to restore
08:07:37.408 [INFO - flink-pekko.actor.default-dispatcher-6] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
08:07:37.412 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.412 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.412 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.413 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.413 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.413 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.413 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.413 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.414 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.414 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.414 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.414 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.414 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.418 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to SCHEDULED.
08:07:37.419 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING.
08:07:37.419 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #1) with attempt id 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1) with allocation id 68aed56532af9c33564af146c662175d
08:07:37.420 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
08:07:37.420 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:07:37.421 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 68aed56532af9c33564af146c662175d.
08:07:37.422 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id 68aed56532af9c33564af146c662175d.
08:07:37.423 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:37.423 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:07:37.423 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:37.424 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:37.425 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.425 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.425 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.425 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
08:07:37.425 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1) with allocation id 99f4948912648970d945ee4b7d180287
08:07:37.426 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to SCHEDULED.
08:07:37.426 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.426 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.427 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:07:37.427 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.427 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.427 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.427 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.427 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:37.427 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from SCHEDULED to DEPLOYING.
08:07:37.427 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #1) with attempt id 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1) with allocation id 4d91c4a4289e885e1ccd40283ee9eec0
08:07:37.427 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to SCHEDULED.
08:07:37.429 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:07:37.430 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from SCHEDULED to DEPLOYING.
08:07:37.430 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #1) with attempt id 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1) with allocation id 0a17552dd40f187ff1067ce2b4829466
08:07:37.431 [INFO - Thread-37] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
08:07:37.432 [DEBUG - Thread-37] (Connection.java:575) [peer master-127.28.220.253:45079(127.28.220.253:45079)] disconnecting while in state TERMINATED
08:07:37.432 [DEBUG - Thread-37] (Connection.java:575) [peer master-127.28.220.254:37365(127.28.220.254:37365)] disconnecting while in state TERMINATED
08:07:37.432 [DEBUG - Thread-37] (Connection.java:575) [peer master-127.28.220.252:33543(127.28.220.252:33543)] disconnecting while in state TERMINATED
08:07:37.434 [DEBUG - Thread-37] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:37.434 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:07:37.435 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-1
08:07:37.436 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-2
08:07:37.438 [INFO - Thread-37] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
08:07:37.438 [INFO - Thread-37] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
08:07:37.443 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 99f4948912648970d945ee4b7d180287.
08:07:37.444 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id 99f4948912648970d945ee4b7d180287.
08:07:37.445 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
08:07:37.445 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
08:07:37.447 [DEBUG - Thread-37] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:37.447 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@64ba4f97
08:07:37.447 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:07:37.447 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13140095929423248446/checkpoints")
08:07:37.448 [INFO - Thread-37] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
08:07:37.450 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
08:07:37.451 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.451 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 4d91c4a4289e885e1ccd40283ee9eec0.
08:07:37.452 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
08:07:37.453 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:37.455 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_1), deploy into slot with allocation id 4d91c4a4289e885e1ccd40283ee9eec0.
08:07:37.456 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.456 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.456 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.456 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.456 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.457 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.457 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.457 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.458 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.458 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.458 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.458 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.459 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
08:07:37.460 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
08:07:37.462 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6536dedf
08:07:37.462 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:07:37.463 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13140095929423248446/checkpoints")
08:07:37.463 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
08:07:37.463 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
08:07:37.475 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.475 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.475 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.476 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:07:37.476 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:07:37.476 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:07:37.476 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:07:37.476 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.476 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.477 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.477 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.477 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.478 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.478 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 0a17552dd40f187ff1067ce2b4829466.
08:07:37.478 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to DEPLOYING.
08:07:37.478 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_1) [DEPLOYING].
08:07:37.479 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.479 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.479 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.479 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.479 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@603f3b2b
08:07:37.482 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:37.483 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:37.483 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:37.483 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.483 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.483 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.483 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.483 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.483 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.484 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.484 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.484 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.484 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:37.485 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:07:37.485 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13140095929423248446/checkpoints")
08:07:37.486 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
08:07:37.486 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
08:07:37.486 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_1), deploy into slot with allocation id 0a17552dd40f187ff1067ce2b4829466.
08:07:37.488 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5604ec34
08:07:37.496 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@32eba7fc
08:07:37.502 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:37.502 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:37.506 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:37.510 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@13891f5f
08:07:37.515 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:37.516 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to DEPLOYING.
08:07:37.516 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_1) [DEPLOYING].
08:07:37.517 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@35018d9e
08:07:37.517 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:07:37.522 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13140095929423248446/checkpoints")
08:07:37.525 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
08:07:37.525 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
08:07:37.527 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:37.538 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:37.544 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.550 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.555 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.556 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5a91f28e
08:07:37.562 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:37.564 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:37.564 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:37.564 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:37.564 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:37.567 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:37.568 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:37.568 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:37.569 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:37.581 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.581 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:37.582 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:37.582 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:37.582 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:37.583 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.583 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.583 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.588 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:37.590 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.591 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.592 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.592 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.597 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.603 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.605 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.605 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.605 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.608 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.610 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.610 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.610 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.614 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.615 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.615 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.617 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.631 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.632 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.632 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.632 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.632 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.636 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.636 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.638 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.638 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.638 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.641 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:37.641 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:37.642 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:37.642 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.642 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.642 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.642 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.643 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.643 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.643 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.643 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.643 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.643 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.643 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.644 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:37.644 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.644 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.646 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.646 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.646 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.647 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.650 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:37.652 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.655 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.657 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.662 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.665 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.666 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.667 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.667 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.667 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.668 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.668 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.668 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.671 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.682 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.682 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.682 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.682 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.682 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.683 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.683 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.686 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.687 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.687 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.687 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.687 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.687 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.688 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.688 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.688 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.694 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.694 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:37.694 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:37.695 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:37.695 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:37.695 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:37.695 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:37.695 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.696 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:37.696 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:37.696 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.696 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:37.696 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.696 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:37.696 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:37.697 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:37.697 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:37.702 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.702 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.702 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.702 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.702 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.702 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.703 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.703 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.705 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.710 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.710 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.710 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.711 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.711 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.711 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.711 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.711 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.711 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.711 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.711 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.711 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.712 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.713 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:37.714 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:37.714 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:37.714 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:37.722 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:37.723 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:37.723 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:37.723 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:37.723 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.724 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.724 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.724 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.725 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.725 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.725 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.725 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.726 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.726 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.726 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.726 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.726 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.733 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.734 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.734 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.734 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.734 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.734 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.734 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.734 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.734 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.735 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.735 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.735 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.735 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.771 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.771 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.771 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.773 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.773 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.773 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.775 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.775 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.775 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.777 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.777 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.777 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.777 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.813 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.815 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.815 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.815 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.817 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.819 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.819 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.819 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.829 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.830 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.830 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.830 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.835 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.835 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.836 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.836 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.836 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.836 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.837 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.837 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.837 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.837 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.837 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.837 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.837 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.842 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:37.842 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:37.842 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:37.842 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:37.843 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.843 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.843 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.843 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.845 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.847 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:37.852 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.852 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.852 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.852 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.854 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.855 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.855 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.855 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.855 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.855 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.855 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.856 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.856 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.856 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.856 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.856 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.857 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.857 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.857 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.858 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.858 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.859 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.859 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.863 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:37.863 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:37.863 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:37.864 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.864 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.864 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.864 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.864 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.864 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.865 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.865 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.865 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.865 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:37.866 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.868 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.869 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.872 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.876 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.876 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.876 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.876 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.884 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.884 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.885 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.885 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.885 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.885 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.885 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.885 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.885 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.885 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.886 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.886 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.886 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.886 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.887 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.887 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.887 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.898 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.899 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.899 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.899 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.899 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.899 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.899 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.900 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.904 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.905 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.905 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.905 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.905 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.905 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.905 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.905 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.906 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.906 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.906 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.906 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.906 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.910 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.910 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.911 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.911 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.911 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.911 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.911 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.912 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.912 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.912 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.911 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.912 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.912 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.916 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.917 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.917 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.917 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.917 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.917 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.917 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.917 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.917 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.918 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.918 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.918 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.918 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.918 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.919 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.919 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:37.920 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:37.920 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:37.920 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:37.920 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:37.921 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:37.921 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:37.921 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:37.921 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:37.921 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:37.921 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:37.921 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:37.922 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.922 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.922 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.922 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.922 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.922 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.923 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.923 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.923 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.923 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.927 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:37.927 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:37.927 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:37.927 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:37.927 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:37.927 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:37.928 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:37.927 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:37.928 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:37.928 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:37.929 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:37.929 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:37.929 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:37.936 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.936 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.937 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.937 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.937 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.937 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.937 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.937 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.937 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.937 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.937 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.937 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.937 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.937 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.938 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.939 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.939 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.939 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.940 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.940 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.940 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.940 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.940 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.940 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.940 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.940 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.944 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.944 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.945 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.945 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.945 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.945 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.946 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.946 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.946 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.947 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.947 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.947 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.947 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.947 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:37.948 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:37.948 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:37.948 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:37.948 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:37.948 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:37.948 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:37.948 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:37.948 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:37.949 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:37.949 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:37.949 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:37.949 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:37.954 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:37.957 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.957 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.958 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.958 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.958 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.958 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.958 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.958 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.958 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.958 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.958 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.959 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.959 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.967 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:37.967 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:37.968 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:37.968 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:37.968 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:37.968 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:37.969 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:37.969 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:37.969 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:37.969 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:37.969 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:37.969 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:37.970 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:37.976 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.976 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.977 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.977 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.977 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.977 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.978 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.978 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.978 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.978 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.978 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.978 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.978 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.978 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.978 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.978 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.979 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.979 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.979 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.979 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.979 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.979 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.979 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.979 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.979 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.979 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.981 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:37.981 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:37.981 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:37.982 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.982 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.982 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:37.982 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.983 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.983 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:37.983 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.983 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.983 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:37.983 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:37.984 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.984 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.984 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.985 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.985 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.985 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.986 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.986 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.986 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.987 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.987 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.987 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.987 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:37.994 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:37.994 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:37.995 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:37.995 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.995 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.995 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:37.996 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.996 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.996 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:37.996 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.997 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.997 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:37.997 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:37.998 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:37.998 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:37.998 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:37.998 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.998 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.998 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:37.998 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.998 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.999 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:37.998 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.999 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.999 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:37.999 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:38.006 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:38.027 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:38.028 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:38.028 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:38.028 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:38.029 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:38.029 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:38.029 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:38.029 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:38.029 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:38.029 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:38.029 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:38.029 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:38.029 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:38.037 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:38.038 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:38.038 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:38.038 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:38.038 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.038 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.038 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.039 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.039 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.039 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.039 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.039 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.039 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.039 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:38.057 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:38.057 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:38.057 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:38.058 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.058 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.058 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.059 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.059 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.059 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.060 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.060 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.060 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.060 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:38.134 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:38.134 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:38.134 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:38.135 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.135 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.135 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.138 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.138 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.138 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.138 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.138 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.138 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.139 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:38.147 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:38.147 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:38.147 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:38.148 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:38.148 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:38.148 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:38.149 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:38.149 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:38.149 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:38.149 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:38.149 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:38.149 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:38.149 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:38.151 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:38.151 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:38.152 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:38.152 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:38.152 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.152 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.153 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.154 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.154 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.154 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.154 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.155 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.155 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.155 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:38.156 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:38.157 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:38.157 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:38.157 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:38.157 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.157 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.157 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.157 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:38.157 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:38.158 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.158 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.158 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.158 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.158 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.158 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.158 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.158 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.158 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.158 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.158 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.158 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.158 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:38.158 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.158 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.158 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.158 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:38.207 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:38.208 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:38.208 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:38.209 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:38.209 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:38.209 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:38.209 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:38.210 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:38.210 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:38.210 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:38.210 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:38.210 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:38.210 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:38.210 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:38.211 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:38.211 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:38.211 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.211 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.211 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.212 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.212 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.212 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.212 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.212 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.212 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.212 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:38.224 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:38.225 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:38.225 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:38.225 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.226 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.226 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.226 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.226 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.226 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.226 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.226 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.226 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.226 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:38.268 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:38.268 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:38.268 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:38.269 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:38.269 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:38.269 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:38.269 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:38.269 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:38.269 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:38.270 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:38.270 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:38.270 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:38.270 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:38.318 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:38.318 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:38.318 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:38.319 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.319 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.319 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.320 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.320 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.320 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.320 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.320 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.320 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.320 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:38.334 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:38.335 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:38.335 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:38.335 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:38.335 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:38.336 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:38.336 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:38.336 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:38.336 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:38.337 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:38.337 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:38.337 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:38.337 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:38.337 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:38.337 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:38.337 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:38.338 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.338 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.338 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.338 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.338 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.338 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.339 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.339 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.339 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.339 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:38.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:38.358706 32119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.46.253:46697, user_credentials={real_user=slave}} blocked reactor thread for 52900.9us
08:07:38.435 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:38.435 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:38.435 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:38.436 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:38.436 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:38.437 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:38.437 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:38.437 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:38.437 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:38.437 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:38.438 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:38.438 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:38.438 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:38.462 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:38.485 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:38.485 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:38.485 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:38.486 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.487 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.487 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.487 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.487 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.487 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.488 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.488 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.488 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.488 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:38.491 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:38.492 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:38.492 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:38.492 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:38.492 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:38.492 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:38.493 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:38.493 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:38.493 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:38.494 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:38.494 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:38.494 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:38.494 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:38.506 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:38.516 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:38.516 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:38.516 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:38.517 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.517 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.517 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.518 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.518 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.518 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.518 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.518 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.518 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.518 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:38.538 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:38.578 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:38.578 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:38.578 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:38.579 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.579 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.579 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.580 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.580 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.580 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.580 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.580 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.580 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.580 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:38.625 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:38.625 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:38.626 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:38.626 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.626 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.626 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:38.626 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.627 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.627 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:38.627 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.627 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.627 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:38.627 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:38.651 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:38.664 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:38.664 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:38.664 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:38.665 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:38.666 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:38.667 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:38.666 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:38.667 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:38.667 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:38.666 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:38.667 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:38.667 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:38.667 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:38.694 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:38.694 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:38.695 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:38.695 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:38.695 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:38.695 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:38.696 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:38.696 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:38.696 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:38.696 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:38.696 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:38.696 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:38.696 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:38.765 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:38.766 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:38.766 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:38.767 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:38.767 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:38.768 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:38.769 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:38.769 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:38.769 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:38.769 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:38.769 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:38.769 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:38.770 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:38.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:38.841305 32665 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad3e0 after lost signal to thread 32539
08:07:38.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:38.843148 32665 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad8a0 after lost signal to thread 32668
08:07:38.894 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:38.895 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:38.895 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:38.896 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:38.896 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:38.896 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:38.896 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:38.897 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:38.897 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:38.897 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:38.897 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:38.897 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:38.897 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:38.954 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:39.005 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:39.038 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:39.131 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:39.131 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:39.131 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:39.131 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:39.132 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:39.132 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:39.132 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:39.132 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:39.132 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:39.132 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:39.132 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:39.132 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:39.132 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:39.133 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:39.133 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:39.133 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:39.134 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:39.134 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:39.134 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:39.134 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:39.134 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:39.134 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:39.134 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:39.134 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:39.134 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:39.135 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:39.151 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:39.234 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:39.235 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:39.235 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:39.236 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:39.236 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:39.236 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:39.236 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:39.236 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:39.236 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:39.237 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:39.237 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:39.237 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:39.237 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:39.287 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:39.288 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:39.288 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:39.288 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:39.288 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:39.289 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:39.289 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:39.289 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:39.289 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:39.289 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:39.290 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:39.290 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:39.290 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:39.321 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:39.322 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:39.322 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:39.323 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:39.323 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:39.323 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:39.323 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:39.324 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:39.324 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:39.324 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:39.324 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:39.324 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:39.324 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:39.434 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:39.435 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:39.435 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:39.435 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:39.435 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:39.435 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:39.435 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:39.435 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:39.435 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:39.436 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:39.436 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:39.436 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:39.436 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:39.438 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:39.438 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:39.438 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:39.438 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:39.438 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:39.439 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:39.439 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:39.439 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:39.439 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:39.439 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:39.439 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:39.440 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:39.440 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:39.454 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:39.476 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:39.476 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:39.476 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:39.477 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:39.477 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:39.477 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:39.478 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:39.478 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:39.478 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:39.478 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:39.478 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:39.478 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:39.478 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:39.505 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:39.538 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:39.604 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:39.604 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:39.605 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:39.606 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:39.606 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:39.606 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:39.606 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:39.606 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:39.606 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:39.607 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:39.607 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:39.607 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:39.607 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:39.651 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:39.671 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:39.671 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:39.671 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:39.672 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:39.672 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:39.672 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:39.672 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:39.673 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:39.673 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:39.673 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:39.674 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:39.674 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:39.674 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:39.724 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:39.725 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:39.725 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:39.726 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:39.726 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:39.726 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:39.726 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:39.726 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:39.726 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:39.726 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:39.726 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:39.726 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:39.726 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:39.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:37.359122   548 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 534
08:07:39.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:39.754639   548 kernel_stack_watchdog.cc:198] Thread 534 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 381ms:
08:07:39.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:07:39.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:07:39.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:07:39.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:07:39.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:35.978353   550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:39.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:39.760564   534 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 3.785s	user 0.574s	sys 0.798s
08:07:39.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:39.760951   534 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 3.786s	user 0.574s	sys 0.798s
08:07:39.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:39.775105   534 server_base.cc:1061] running on GCE node
08:07:39.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:39.777448   707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:39.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:39.779270   534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:07:39.787 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:39.787 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:39.788 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:39.788 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:39.788 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:39.788 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:39.789 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:39.789 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:39.789 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:39.789 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:39.790 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:39.790 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:39.790 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:39.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:39.791234   534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:07:39.796 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:39.796 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:39.796 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:39.797 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:39.797 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:39.797 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:39.797 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:39.797 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:39.797 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:39.798 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:39.798 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:39.798 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:39.798 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:39.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:39.799185   534 hybrid_clock.cc:648] HybridClock initialized: now 1779091659799067 us; error 102 us; skew 500 ppm
08:07:39.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:39.801488   534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:07:39.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:39.830742   534 webserver.cc:533] Webserver started at http://127.31.233.193:39087/ using document root <none> and password file <none>
08:07:39.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:39.832811   534 fs_manager.cc:362] Metadata directory not provided
08:07:39.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:39.833352   534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:07:39.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:39.834298   534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:07:39.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:39.858125   534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-0/data/instance:
08:07:39.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0f355e70bcf64068abe0047310247ddf"
08:07:39.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:39 on dist-test-slave-1jss"
08:07:39.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:39.863181   534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-0/wal/instance:
08:07:39.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0f355e70bcf64068abe0047310247ddf"
08:07:39.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:39 on dist-test-slave-1jss"
08:07:39.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:39.900142   534 fs_manager.cc:696] Time spent creating directory manager: real 0.036s	user 0.008s	sys 0.004s
08:07:39.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:39.922799   712 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:07:39.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:39.929113   534 fs_manager.cc:730] Time spent opening block manager: real 0.020s	user 0.004s	sys 0.001s
08:07:39.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:39.929611   534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-0/wal
08:07:39.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0f355e70bcf64068abe0047310247ddf"
08:07:39.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:39 on dist-test-slave-1jss"
08:07:39.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:39.930563   534 fs_report.cc:389] FS layout report
08:07:39.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:07:39.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-0/wal
08:07:39.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-0/wal
08:07:39.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-0/data/data
08:07:39.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:07:39.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:07:39.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:07:39.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:07:39.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:07:39.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:07:39.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:07:39.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:07:39.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:07:39.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:07:39.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:07:39.954 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:40.006 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:40.011 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:40.012 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:40.012 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:40.013 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:40.013 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:40.013 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:40.013 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:40.014 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:40.014 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:40.014 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:40.014 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:40.014 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:40.014 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:40.037 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:40.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:40.113847   534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:07:40.117 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:40.118 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:40.118 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:40.119 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:40.119 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:40.119 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:40.119 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:40.119 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:40.119 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:40.120 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:40.120 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:40.120 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:40.120 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:40.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:40.123685   534 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:07:40.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:40.127274   534 kserver.cc:163] Server-wide thread pool size limit: 3276
08:07:40.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:40.145639   534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:07:40.151 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:40.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:40.170096   534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:07:40.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:40.171106   534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.001s	sys 0.000s
08:07:40.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:40.171711   534 ts_tablet_manager.cc:616] Registered 0 tablets
08:07:40.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:40.172087   534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:07:40.174 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:40.174 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:40.174 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:40.175 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:40.175 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:40.175 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:40.175 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:40.175 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:40.176 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:40.176 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:40.176 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:40.176 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:40.176 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:40.454 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:40.506 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:40.537 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:40.638 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:40.638 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:40.638 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:40.639 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:40.639 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:40.639 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:40.639 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:40.640 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:40.640 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:40.640 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:40.640 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:40.640 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:40.640 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:40.650 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:40.662 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:40.663 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:40.663 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:40.664 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:40.664 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:40.664 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:40.664 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:40.665 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:40.665 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:40.665 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:40.665 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:40.665 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:40.665 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:40.851 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:40.851 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:40.852 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:40.852 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:40.853 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:40.853 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:40.853 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:40.853 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:40.854 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:40.854 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:40.854 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:40.854 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:40.854 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:40.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:40.871982   534 rpc_server.cc:307] RPC server started. Bound to: 127.31.233.193:44827
08:07:40.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:40.872258   827 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.233.193:44827 every 8 connection(s)
08:07:40.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:40.875694   534 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-0/data/info.pb
08:07:40.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:40.879213 32679 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 534
08:07:40.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:40.879812 32679 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-0/wal/instance
08:07:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:40.918146 32679 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:07:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:07:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-1/wal
08:07:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-1/data
08:07:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:07:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:07:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:07:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:40.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:40.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:40.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-1/logs
08:07:40.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-1/data/info.pb
08:07:40.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:40.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:07:40.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:07:40.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:07:40.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:07:40.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:40.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:40.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:40.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:07:40.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:07:40.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.233.194:0
08:07:40.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.233.194
08:07:40.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.233.194
08:07:40.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:40.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101
08:07:40.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.233.212:42413
08:07:40.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:40.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:40.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:07:40.954 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:41.006 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:41.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:41.018639   830 heartbeater.cc:344] Connected to a master server at 127.31.233.254:35197
08:07:41.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:41.019284   830 heartbeater.cc:461] Registering TS with master...
08:07:41.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:41.020998   830 heartbeater.cc:507] Master 127.31.233.254:35197 requested a full tablet report, sending...
08:07:41.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:41.029758 32725 ts_manager.cc:194] Registered new tserver with Master: 0f355e70bcf64068abe0047310247ddf (127.31.233.193:44827)
08:07:41.038 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:41.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:41.040109   828 heartbeater.cc:344] Connected to a master server at 127.31.233.252:36101
08:07:41.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:41.040518   828 heartbeater.cc:461] Registering TS with master...
08:07:41.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:41.041548   828 heartbeater.cc:507] Master 127.31.233.252:36101 requested a full tablet report, sending...
08:07:41.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:41.046852   423 ts_manager.cc:194] Registered new tserver with Master: 0f355e70bcf64068abe0047310247ddf (127.31.233.193:44827)
08:07:41.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:41.050647   423 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.233.193:41385
08:07:41.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:41.057960   829 heartbeater.cc:344] Connected to a master server at 127.31.233.253:33393
08:07:41.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:41.058362   829 heartbeater.cc:461] Registering TS with master...
08:07:41.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:41.059226   829 heartbeater.cc:507] Master 127.31.233.253:33393 requested a full tablet report, sending...
08:07:41.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:41.063745   337 ts_manager.cc:194] Registered new tserver with Master: 0f355e70bcf64068abe0047310247ddf (127.31.233.193:44827)
08:07:41.150 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:41.157 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:41.158 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:41.158 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:41.158 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:41.158 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:41.159 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:41.159 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:41.159 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:41.159 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:41.159 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:41.159 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:41.159 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:41.160 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:41.167 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:41.168 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:41.168 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:41.169 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:41.169 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:41.170 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:41.170 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:41.170 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:41.170 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:41.170 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:41.171 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:41.171 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:41.171 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:41.172 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:41.172 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:41.172 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:41.172 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:41.172 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:41.173 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:41.173 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:41.173 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:41.173 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:41.174 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:41.174 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:41.174 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:41.174 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:41.312 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:41.312 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:41.312 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:41.313 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:41.313 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:41.313 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:41.314 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:41.314 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:41.314 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:41.315 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:41.315 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:41.315 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:41.315 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:41.454 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:41.506 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:41.538 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:41.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:41.571935   837 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:07:41.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:41.572672   837 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:07:41.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:41.573462   837 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:07:41.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:41.642915   837 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:07:41.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:41.644357   837 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.233.194
08:07:41.650 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:41.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:41.700307   837 tablet_server_runner.cc:78] Tablet server non-default flags:
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.233.212:42413
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-1/data
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-1/wal
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.233.194:0
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-1/data/info.pb
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.233.194
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.233.194
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-1/logs
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:07:41.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:07:41.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:07:41.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:07:41.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:07:41.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:07:41.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:41.703014   837 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:07:41.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:41.705257   837 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:07:41.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:41.727151   845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:41.734 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:41.735 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:41.735 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:41.736 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:41.736 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:41.736 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:41.737 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:41.737 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:41.737 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:41.738 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:41.738 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:41.738 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:41.738 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:41.953 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:42.011 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:42.040 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:42.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:42.056205   828 heartbeater.cc:499] Master 127.31.233.252:36101 was elected leader, sending a full tablet report...
08:07:42.114 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:42.115 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:42.115 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:42.116 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:42.116 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:42.116 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:42.116 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:42.116 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:42.116 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:42.117 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:42.117 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:42.117 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:42.117 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:42.142 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:42.143 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:42.143 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:42.143 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:42.144 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:42.144 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:42.144 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:42.144 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:42.144 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:42.145 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:42.145 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:42.145 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:42.145 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:42.151 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:42.171 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:42.171 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:42.172 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:42.172 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:42.172 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:42.173 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:42.174 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:42.174 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:42.175 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:42.175 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:42.175 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:42.175 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:42.175 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:42.291 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:42.291 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:42.292 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:42.292 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:42.292 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:42.292 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:42.298 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:42.298 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:42.298 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:42.298 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:42.298 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:42.298 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:42.298 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:42.407 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:42.408 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:42.408 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:42.409 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:42.409 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:42.409 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:42.410 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:42.410 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:42.410 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:42.410 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:42.410 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:42.410 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:42.410 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:42.431 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:42.431 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:42.431 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:42.432 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:42.432 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:42.432 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:42.433 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:42.433 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:42.433 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:42.433 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:42.434 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:42.434 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:42.434 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:42.455 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:42.505 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:42.539 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:42.651 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:42.705 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:42.705 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:42.705 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:42.706 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:42.706 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:42.706 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:42.706 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:42.706 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:42.706 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:42.706 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:42.706 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:42.707 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:42.707 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:42.837 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:42.837 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:42.837 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:42.838 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:42.838 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:42.838 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:42.838 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:42.838 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:42.838 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:42.838 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:42.838 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:42.838 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:42.839 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:42.924 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:42.925 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:42.926 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:42.926 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:42.926 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:42.926 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:42.926 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:42.927 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:42.927 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:42.927 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:42.926 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:42.927 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:42.927 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:42.954 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:43.006 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:43.038 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:43.151 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:43.201 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:43.202 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:43.202 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:43.202 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:43.202 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:43.202 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:43.203 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:43.203 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:43.203 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:43.203 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:43.203 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:43.203 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:43.203 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:43.243 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:43.244 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:43.244 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:43.244 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:43.244 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:43.244 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:43.244 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:43.245 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:43.246 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:43.246 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:43.246 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:43.246 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:43.247 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:43.391 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:43.391 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:43.391 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:43.392 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:43.392 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:43.392 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:43.392 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:43.392 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:43.393 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:43.393 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:43.393 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:43.392 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:43.394 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:43.394 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:43.395 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:43.395 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:43.395 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:43.395 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:43.395 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:43.396 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:43.396 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:43.396 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:43.396 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:43.395 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:43.400 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:43.400 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:43.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:43.129029   844 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 837
08:07:43.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:41.737193   846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:43.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:43.421669   837 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.687s	user 0.496s	sys 1.082s
08:07:43.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:43.422160   837 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.688s	user 0.497s	sys 1.082s
08:07:43.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.431275   837 server_base.cc:1061] running on GCE node
08:07:43.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:43.431726   851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:43.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.433130   837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:07:43.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.435701   837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:07:43.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.437110   837 hybrid_clock.cc:648] HybridClock initialized: now 1779091663437067 us; error 68 us; skew 500 ppm
08:07:43.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.438261   837 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:07:43.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.446053   837 webserver.cc:533] Webserver started at http://127.31.233.194:40445/ using document root <none> and password file <none>
08:07:43.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.447438   837 fs_manager.cc:362] Metadata directory not provided
08:07:43.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.447700   837 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:07:43.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.448339   837 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:07:43.454 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:43.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.454514   837 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-1/data/instance:
08:07:43.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "253085249e36466eb1c769512f22e6cd"
08:07:43.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:43 on dist-test-slave-1jss"
08:07:43.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.456144   837 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-1/wal/instance:
08:07:43.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "253085249e36466eb1c769512f22e6cd"
08:07:43.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:43 on dist-test-slave-1jss"
08:07:43.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.465580   837 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.005s	sys 0.005s
08:07:43.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.473081   857 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:07:43.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.475263   837 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.003s	sys 0.004s
08:07:43.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.475741   837 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-1/wal
08:07:43.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "253085249e36466eb1c769512f22e6cd"
08:07:43.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:43 on dist-test-slave-1jss"
08:07:43.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.476222   837 fs_report.cc:389] FS layout report
08:07:43.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:07:43.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-1/wal
08:07:43.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-1/wal
08:07:43.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-1/data/data
08:07:43.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:07:43.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:07:43.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:07:43.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:07:43.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:07:43.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:07:43.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:07:43.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:07:43.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:07:43.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:07:43.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:07:43.506 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:43.538 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:43.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.552399   837 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:07:43.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.554557   837 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:07:43.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.555004   837 kserver.cc:163] Server-wide thread pool size limit: 3276
08:07:43.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.558457   837 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:07:43.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.563187   837 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:07:43.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.563391   837 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:07:43.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.563594   837 ts_tablet_manager.cc:616] Registered 0 tablets
08:07:43.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.563736   837 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:07:43.651 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:43.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.766116   837 rpc_server.cc:307] RPC server started. Bound to: 127.31.233.194:37469
08:07:43.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.766284   969 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.233.194:37469 every 8 connection(s)
08:07:43.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.770025   837 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-1/data/info.pb
08:07:43.775 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:43.775 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:43.775 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:43.776 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:43.776 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:43.776 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:43.777 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:43.777 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:43.778 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:43.778 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:43.778 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:43.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.778658 32679 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 837
08:07:43.779 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:43.779 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:43.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.779332 32679 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-1/wal/instance
08:07:43.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.805526 32679 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:07:43.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:07:43.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-2/wal
08:07:43.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-2/data
08:07:43.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:07:43.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:07:43.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:07:43.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:43.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:43.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:43.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-2/logs
08:07:43.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-2/data/info.pb
08:07:43.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:43.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:07:43.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:07:43.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:07:43.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:07:43.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:43.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:43.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:43.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:07:43.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:07:43.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.233.195:0
08:07:43.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.233.195
08:07:43.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.233.195
08:07:43.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:43.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101
08:07:43.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.233.212:42413
08:07:43.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:43.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:43.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:07:43.810 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:43.811 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:43.811 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:43.811 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:43.811 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:43.812 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:43.812 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:43.812 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:43.812 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:43.813 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:43.813 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:43.813 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:43.813 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:43.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.845242   971 heartbeater.cc:344] Connected to a master server at 127.31.233.253:33393
08:07:43.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.845785   971 heartbeater.cc:461] Registering TS with master...
08:07:43.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.847349   971 heartbeater.cc:507] Master 127.31.233.253:33393 requested a full tablet report, sending...
08:07:43.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.849476   972 heartbeater.cc:344] Connected to a master server at 127.31.233.254:35197
08:07:43.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.850188   972 heartbeater.cc:461] Registering TS with master...
08:07:43.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.851301   972 heartbeater.cc:507] Master 127.31.233.254:35197 requested a full tablet report, sending...
08:07:43.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.851682   970 heartbeater.cc:344] Connected to a master server at 127.31.233.252:36101
08:07:43.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.852103   970 heartbeater.cc:461] Registering TS with master...
08:07:43.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.853132   970 heartbeater.cc:507] Master 127.31.233.252:36101 requested a full tablet report, sending...
08:07:43.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.854403   337 ts_manager.cc:194] Registered new tserver with Master: 253085249e36466eb1c769512f22e6cd (127.31.233.194:37469)
08:07:43.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.855227 32725 ts_manager.cc:194] Registered new tserver with Master: 253085249e36466eb1c769512f22e6cd (127.31.233.194:37469)
08:07:43.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.855530   423 ts_manager.cc:194] Registered new tserver with Master: 253085249e36466eb1c769512f22e6cd (127.31.233.194:37469)
08:07:43.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:43.857378   423 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.233.194:53655
08:07:43.954 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:44.006 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:44.038 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:44.150 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:44.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:44.250168   980 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:07:44.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:44.251216   980 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:07:44.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:44.252068   980 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:07:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:44.311069   980 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:07:44.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:44.312391   980 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.233.195
08:07:44.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:44.377900   980 tablet_server_runner.cc:78] Tablet server non-default flags:
08:07:44.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:44.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.233.212:42413
08:07:44.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:44.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:44.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-2/data
08:07:44.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-2/wal
08:07:44.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:44.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:44.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.233.195:0
08:07:44.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:07:44.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:44.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:44.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-2/data/info.pb
08:07:44.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.233.195
08:07:44.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:44.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101
08:07:44.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:07:44.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:44.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:07:44.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:07:44.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:44.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.233.195
08:07:44.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-2/logs
08:07:44.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:44.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:07:44.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:07:44.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:07:44.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:07:44.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:07:44.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:07:44.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:07:44.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:07:44.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:07:44.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:44.379531   980 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:07:44.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:44.381604   980 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:07:44.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:44.398170   986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:44.411 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:44.412 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:44.412 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:44.412 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:44.412 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:44.412 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:44.413 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:44.413 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:44.413 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:44.413 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:44.413 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:44.413 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:44.413 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:44.432 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:44.432 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:44.433 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:44.433 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:44.433 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:44.433 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:44.433 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:44.433 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:44.434 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:44.434 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:44.434 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:44.433 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:44.435 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:44.453 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:44.506 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:44.538 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:44.631 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:44.632 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:44.632 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:44.632 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:44.632 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:44.632 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:44.632 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:44.632 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:44.632 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:44.633 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:44.633 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:44.633 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:44.633 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:44.651 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:44.818 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:44.819 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:44.819 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:44.819 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:44.819 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:44.819 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:44.820 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:44.820 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:44.820 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:44.820 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:44.820 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:44.820 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:44.820 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:44.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:44.861343   970 heartbeater.cc:499] Master 127.31.233.252:36101 was elected leader, sending a full tablet report...
08:07:44.953 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:44.964 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:44.965 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:44.965 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:44.966 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:44.966 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:44.966 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:44.967 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:44.966 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:44.966 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:44.967 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:44.967 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:44.967 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:44.967 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:45.006 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:45.038 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:45.151 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:45.227 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:45.228 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:45.228 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:45.228 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:45.228 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:45.229 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:45.229 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:45.229 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:45.229 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:45.229 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:45.229 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:45.229 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:45.229 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:45.236 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:45.236 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:45.236 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:45.236 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:45.236 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:45.236 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:45.237 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:45.237 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:45.237 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:45.237 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:45.237 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:45.237 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:45.238 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:45.454 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:45.506 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:45.537 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:45.651 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:45.904 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:45.904 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:45.905 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:45.905 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:45.906 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:45.906 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:45.906 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:45.906 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:45.906 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:45.909 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:45.909 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:45.910 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:45.910 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:45.934 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:45.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:44.400004   987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:45.935 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:45.935 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:45.935 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:45.936 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:45.936 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:45.937 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:45.937 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:45.937 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:45.937 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:45.937 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:45.938 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:45.938 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:45.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:45.937901   989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:45.942974   988 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1544 milliseconds
08:07:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:45.943130   980 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:07:45.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:45.944679   980 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:07:45.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:45.947530   980 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:07:45.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:45.948974   980 hybrid_clock.cc:648] HybridClock initialized: now 1779091665948945 us; error 51 us; skew 500 ppm
08:07:45.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:45.950027   980 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:07:45.954 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:45.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:45.960237   980 webserver.cc:533] Webserver started at http://127.31.233.195:37099/ using document root <none> and password file <none>
08:07:45.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:45.961398   980 fs_manager.cc:362] Metadata directory not provided
08:07:45.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:45.961678   980 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:07:45.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:45.962267   980 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:07:45.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:45.967933   980 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-2/data/instance:
08:07:45.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ff0efe9052574a8fb425700eee4efb00"
08:07:45.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:45 on dist-test-slave-1jss"
08:07:45.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:45.969514   980 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-2/wal/instance:
08:07:45.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ff0efe9052574a8fb425700eee4efb00"
08:07:45.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:45 on dist-test-slave-1jss"
08:07:45.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:45.978989   980 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.001s
08:07:45.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:45.986258  1000 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:07:45.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:45.987805   980 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.001s	sys 0.003s
08:07:45.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:45.988183   980 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-2/wal
08:07:45.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ff0efe9052574a8fb425700eee4efb00"
08:07:45.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:07:45 on dist-test-slave-1jss"
08:07:45.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:45.988585   980 fs_report.cc:389] FS layout report
08:07:45.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:07:45.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-2/wal
08:07:45.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-2/wal
08:07:45.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-2/data/data
08:07:45.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:07:45.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:07:45.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:07:45.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:07:45.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:07:45.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:07:45.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:07:45.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:07:45.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:07:45.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:07:45.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:07:46.005 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:46.038 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:46.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.057514   980 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:07:46.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.060343   980 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:07:46.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.061048   980 kserver.cc:163] Server-wide thread pool size limit: 3276
08:07:46.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.065372   980 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:07:46.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.071444   980 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:07:46.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.071683   980 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:07:46.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.071955   980 ts_tablet_manager.cc:616] Registered 0 tablets
08:07:46.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.072165   980 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:07:46.101 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:46.102 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:46.102 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:46.102 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:46.103 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:46.103 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:46.103 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:46.103 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:46.103 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:46.103 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:46.103 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:46.103 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:46.103 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:46.108 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:46.108 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:46.108 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:46.108 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:46.109 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:46.109 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:46.109 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:46.109 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:46.109 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:46.109 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:46.109 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:46.109 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:46.109 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:46.130 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:46.131 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:46.131 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:46.131 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:46.131 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:46.131 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:46.131 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:46.131 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:46.132 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:46.132 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:46.132 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:46.132 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:46.132 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:46.151 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:46.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.287556   980 rpc_server.cc:307] RPC server started. Bound to: 127.31.233.195:40161
08:07:46.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.287663  1113 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.233.195:40161 every 8 connection(s)
08:07:46.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.290876   980 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-2/data/info.pb
08:07:46.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.302888 32679 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 980
08:07:46.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.303593 32679 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster17135914740172987633/ts-2/wal/instance
08:07:46.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.397243  1114 heartbeater.cc:344] Connected to a master server at 127.31.233.252:36101
08:07:46.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.397758  1114 heartbeater.cc:461] Registering TS with master...
08:07:46.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.399410  1114 heartbeater.cc:507] Master 127.31.233.252:36101 requested a full tablet report, sending...
08:07:46.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.405769   422 ts_manager.cc:194] Registered new tserver with Master: ff0efe9052574a8fb425700eee4efb00 (127.31.233.195:40161)
08:07:46.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.410226   422 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.233.195:35899
08:07:46.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.410403  1118 heartbeater.cc:344] Connected to a master server at 127.31.233.254:35197
08:07:46.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.410784  1118 heartbeater.cc:461] Registering TS with master...
08:07:46.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.411895  1118 heartbeater.cc:507] Master 127.31.233.254:35197 requested a full tablet report, sending...
08:07:46.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.415652  1115 heartbeater.cc:344] Connected to a master server at 127.31.233.253:33393
08:07:46.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.415777 32725 ts_manager.cc:194] Registered new tserver with Master: ff0efe9052574a8fb425700eee4efb00 (127.31.233.195:40161)
08:07:46.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.416044  1115 heartbeater.cc:461] Registering TS with master...
08:07:46.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.416806  1115 heartbeater.cc:507] Master 127.31.233.253:33393 requested a full tablet report, sending...
08:07:46.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.419178   337 ts_manager.cc:194] Registered new tserver with Master: ff0efe9052574a8fb425700eee4efb00 (127.31.233.195:40161)
08:07:46.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.439507 32679 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
08:07:46.454 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:46.457 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:07:46.457 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

08:07:46.459 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.31.233.254"
      port: 35197
    }
    bound_http_address {
      host: "127.31.233.254"
      port: 34959
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.31.233.253"
      port: 33393
    }
    bound_http_address {
      host: "127.31.233.253"
      port: 33341
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.31.233.252"
      port: 36101
    }
    bound_http_address {
      host: "127.31.233.252"
      port: 44863
    }
  }
}

08:07:46.460 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

08:07:46.461 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.31.233.193"
      port: 44827
    }
    bound_http_address {
      host: "127.31.233.193"
      port: 39087
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.31.233.194"
      port: 37469
    }
    bound_http_address {
      host: "127.31.233.194"
      port: 40445
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.31.233.195"
      port: 40161
    }
    bound_http_address {
      host: "127.31.233.195"
      port: 37099
    }
  }
}

08:07:46.461 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
08:07:46.463 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:46.465 [DEBUG - main] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:07:46.466 [DEBUG - main] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:07:46.467 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.31.46.254:45015(127.31.46.254:45015)] Successfully connected to peer
08:07:46.472 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.46.254
08:07:46.474 [DEBUG - main] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:07:46.477 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.31.46.253:46697(127.31.46.253:46697)] Successfully connected to peer
08:07:46.481 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.46.253
08:07:46.486 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.31.46.252:40541(127.31.46.252:40541)] Successfully connected to peer
08:07:46.486 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:46.492 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x866544bf, L:/127.0.0.1:36754 - R:/127.31.46.254:45015] using SASL/PLAIN
08:07:46.505 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:46.508 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.46.252
08:07:46.508 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:46.515 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x46dd8bf6, L:/127.0.0.1:34842 - R:/127.31.46.253:46697] using SASL/PLAIN
08:07:46.524 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:46.529 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x7466d46a, L:/127.0.0.1:55100 - R:/127.31.46.252:40541] using SASL/PLAIN
08:07:46.534 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:07:46.534 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=70), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [31ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: OK, [54ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: OK, [68ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: OK, deferred=null) after lookup
08:07:46.537 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:46.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.536842 32132 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55100:
08:07:46.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
08:07:46.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
08:07:46.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:07:46.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
08:07:46.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:07:46.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:07:46.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:07:46.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:07:46.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:07:46.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:07:46.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:07:46.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:07:46.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
08:07:46.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:07:46.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:07:46.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:07:46.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:07:46.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:07:46.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:07:46.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:07:46.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:07:46.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\004\001d\000\000\000\004\001\310\000\000\000"
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:07:46.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:07:46.542 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:46.543 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:46.543 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:46.543 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:46.543 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:46.543 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:46.543 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:46.543 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:46.543 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:46.544 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:46.544 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:46.545 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:46.545 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:46.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:46.546146 32132 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
08:07:46.622 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 75171ad0cb2448e380e6b1e23553a1df
08:07:46.634 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:46.635 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:46.635 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:46.635 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:46.635 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:46.636 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:46.636 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:46.636 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:46.636 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:46.636 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:46.636 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:46.637 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:46.637 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:46.651 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:46.716 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:46.716 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:46.717 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:46.718 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:46.718 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:46.718 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:46.718 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:46.718 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:46.718 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:46.719 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:46.719 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:46.719 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:46.719 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:46.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.727897 32303 tablet_service.cc:1511] Processing CreateTablet for tablet 98ec5300665e4981b383fed816312f05 (DEFAULT_TABLE table=replication_test_table [id=75171ad0cb2448e380e6b1e23553a1df]), partition=RANGE (key1) PARTITION VALUES < 100
08:07:46.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.735044 32302 tablet_service.cc:1511] Processing CreateTablet for tablet 2647411043ab45458706fde51f0f7d18 (DEFAULT_TABLE table=replication_test_table [id=75171ad0cb2448e380e6b1e23553a1df]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
08:07:46.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.735932 32603 tablet_service.cc:1511] Processing CreateTablet for tablet 2647411043ab45458706fde51f0f7d18 (DEFAULT_TABLE table=replication_test_table [id=75171ad0cb2448e380e6b1e23553a1df]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
08:07:46.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.739784 32301 tablet_service.cc:1511] Processing CreateTablet for tablet 19dc48939efd43049bf739035d3707d5 (DEFAULT_TABLE table=replication_test_table [id=75171ad0cb2448e380e6b1e23553a1df]), partition=RANGE (key1) PARTITION 200 <= VALUES
08:07:46.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.740929 32602 tablet_service.cc:1511] Processing CreateTablet for tablet 19dc48939efd43049bf739035d3707d5 (DEFAULT_TABLE table=replication_test_table [id=75171ad0cb2448e380e6b1e23553a1df]), partition=RANGE (key1) PARTITION 200 <= VALUES
08:07:46.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.742911 32602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19dc48939efd43049bf739035d3707d5. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:46.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.747404 32603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2647411043ab45458706fde51f0f7d18. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:46.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.744226 32303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ec5300665e4981b383fed816312f05. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:46.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.745452 32604 tablet_service.cc:1511] Processing CreateTablet for tablet 98ec5300665e4981b383fed816312f05 (DEFAULT_TABLE table=replication_test_table [id=75171ad0cb2448e380e6b1e23553a1df]), partition=RANGE (key1) PARTITION VALUES < 100
08:07:46.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.755442 32604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ec5300665e4981b383fed816312f05. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:46.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.755766 32302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2647411043ab45458706fde51f0f7d18. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:46.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.756883 32301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19dc48939efd43049bf739035d3707d5. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:46.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.778645 32458 tablet_service.cc:1511] Processing CreateTablet for tablet 19dc48939efd43049bf739035d3707d5 (DEFAULT_TABLE table=replication_test_table [id=75171ad0cb2448e380e6b1e23553a1df]), partition=RANGE (key1) PARTITION 200 <= VALUES
08:07:46.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.777680 32462 tablet_service.cc:1511] Processing CreateTablet for tablet 2647411043ab45458706fde51f0f7d18 (DEFAULT_TABLE table=replication_test_table [id=75171ad0cb2448e380e6b1e23553a1df]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
08:07:46.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.786298 32458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19dc48939efd43049bf739035d3707d5. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:46.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.786051 32463 tablet_service.cc:1511] Processing CreateTablet for tablet 98ec5300665e4981b383fed816312f05 (DEFAULT_TABLE table=replication_test_table [id=75171ad0cb2448e380e6b1e23553a1df]), partition=RANGE (key1) PARTITION VALUES < 100
08:07:46.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.791638 32462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2647411043ab45458706fde51f0f7d18. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:46.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.794261 32463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ec5300665e4981b383fed816312f05. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:46.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.848453  1149 tablet_bootstrap.cc:492] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56: Bootstrap starting.
08:07:46.854 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:46.854 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:46.854 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:46.854 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:46.855 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:46.855 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:46.855 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:46.855 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:46.855 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:46.855 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:46.855 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:46.856 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:46.856 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:46.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.857426  1150 tablet_bootstrap.cc:492] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637: Bootstrap starting.
08:07:46.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.862149  1149 tablet_bootstrap.cc:654] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56: Neither blocks nor log segments found. Creating new log.
08:07:46.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.865109  1149 log.cc:826] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56: Log is configured to *not* fsync() on all Append() calls
08:07:46.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.867106  1150 tablet_bootstrap.cc:654] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637: Neither blocks nor log segments found. Creating new log.
08:07:46.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.870088  1150 log.cc:826] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637: Log is configured to *not* fsync() on all Append() calls
08:07:46.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.891855  1153 tablet_bootstrap.cc:492] T 98ec5300665e4981b383fed816312f05 P cdab818f784c43329a4a6a164a1cf7c3: Bootstrap starting.
08:07:46.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.900601  1149 tablet_bootstrap.cc:492] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56: No bootstrap required, opened a new log
08:07:46.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.901396  1149 ts_tablet_manager.cc:1403] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56: Time spent bootstrapping tablet: real 0.054s	user 0.023s	sys 0.020s
08:07:46.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.903168  1150 tablet_bootstrap.cc:492] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637: No bootstrap required, opened a new log
08:07:46.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.903867  1150 ts_tablet_manager.cc:1403] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637: Time spent bootstrapping tablet: real 0.047s	user 0.021s	sys 0.017s
08:07:46.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.906033  1153 tablet_bootstrap.cc:654] T 98ec5300665e4981b383fed816312f05 P cdab818f784c43329a4a6a164a1cf7c3: Neither blocks nor log segments found. Creating new log.
08:07:46.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.913094  1153 log.cc:826] T 98ec5300665e4981b383fed816312f05 P cdab818f784c43329a4a6a164a1cf7c3: Log is configured to *not* fsync() on all Append() calls
08:07:46.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.931665  1153 tablet_bootstrap.cc:492] T 98ec5300665e4981b383fed816312f05 P cdab818f784c43329a4a6a164a1cf7c3: No bootstrap required, opened a new log
08:07:46.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.932374  1153 ts_tablet_manager.cc:1403] T 98ec5300665e4981b383fed816312f05 P cdab818f784c43329a4a6a164a1cf7c3: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.019s
08:07:46.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.939195  1150 raft_consensus.cc:359] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:46.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.940508  1150 raft_consensus.cc:385] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:46.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.940199  1149 raft_consensus.cc:359] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:46.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.940892  1150 raft_consensus.cc:740] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a91936aa3fc4705a7fb8e2e53edf637, State: Initialized, Role: FOLLOWER
08:07:46.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.941272  1149 raft_consensus.cc:385] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:46.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.941612  1149 raft_consensus.cc:740] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f8fa66c1d0f40fab64f16e98a980e56, State: Initialized, Role: FOLLOWER
08:07:46.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.942507  1150 consensus_queue.cc:260] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:46.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.942620  1149 consensus_queue.cc:260] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:46.953 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:46.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.958072  1150 ts_tablet_manager.cc:1434] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637: Time spent starting tablet: real 0.054s	user 0.030s	sys 0.015s
08:07:46.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.959436  1150 tablet_bootstrap.cc:492] T 19dc48939efd43049bf739035d3707d5 P 4a91936aa3fc4705a7fb8e2e53edf637: Bootstrap starting.
08:07:46.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.966861  1150 tablet_bootstrap.cc:654] T 19dc48939efd43049bf739035d3707d5 P 4a91936aa3fc4705a7fb8e2e53edf637: Neither blocks nor log segments found. Creating new log.
08:07:46.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.980392  1150 tablet_bootstrap.cc:492] T 19dc48939efd43049bf739035d3707d5 P 4a91936aa3fc4705a7fb8e2e53edf637: No bootstrap required, opened a new log
08:07:46.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.981094  1150 ts_tablet_manager.cc:1403] T 19dc48939efd43049bf739035d3707d5 P 4a91936aa3fc4705a7fb8e2e53edf637: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.008s
08:07:46.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.984411  1150 raft_consensus.cc:359] T 19dc48939efd43049bf739035d3707d5 P 4a91936aa3fc4705a7fb8e2e53edf637 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:46.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.985740  1150 raft_consensus.cc:385] T 19dc48939efd43049bf739035d3707d5 P 4a91936aa3fc4705a7fb8e2e53edf637 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:46.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.986231  1150 raft_consensus.cc:740] T 19dc48939efd43049bf739035d3707d5 P 4a91936aa3fc4705a7fb8e2e53edf637 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a91936aa3fc4705a7fb8e2e53edf637, State: Initialized, Role: FOLLOWER
08:07:46.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.987131  1150 consensus_queue.cc:260] T 19dc48939efd43049bf739035d3707d5 P 4a91936aa3fc4705a7fb8e2e53edf637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:46.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.989687  1150 ts_tablet_manager.cc:1434] T 19dc48939efd43049bf739035d3707d5 P 4a91936aa3fc4705a7fb8e2e53edf637: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
08:07:46.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.990793  1150 tablet_bootstrap.cc:492] T 2647411043ab45458706fde51f0f7d18 P 4a91936aa3fc4705a7fb8e2e53edf637: Bootstrap starting.
08:07:47.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:46.989735  1149 ts_tablet_manager.cc:1434] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56: Time spent starting tablet: real 0.088s	user 0.040s	sys 0.027s
08:07:47.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.002594  1150 tablet_bootstrap.cc:654] T 2647411043ab45458706fde51f0f7d18 P 4a91936aa3fc4705a7fb8e2e53edf637: Neither blocks nor log segments found. Creating new log.
08:07:47.006 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:47.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.011282  1149 tablet_bootstrap.cc:492] T 98ec5300665e4981b383fed816312f05 P 7f8fa66c1d0f40fab64f16e98a980e56: Bootstrap starting.
08:07:47.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.026602  1149 tablet_bootstrap.cc:654] T 98ec5300665e4981b383fed816312f05 P 7f8fa66c1d0f40fab64f16e98a980e56: Neither blocks nor log segments found. Creating new log.
08:07:47.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.032037  1153 raft_consensus.cc:359] T 98ec5300665e4981b383fed816312f05 P cdab818f784c43329a4a6a164a1cf7c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:47.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.036362  1153 raft_consensus.cc:385] T 98ec5300665e4981b383fed816312f05 P cdab818f784c43329a4a6a164a1cf7c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:47.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.036868  1153 raft_consensus.cc:740] T 98ec5300665e4981b383fed816312f05 P cdab818f784c43329a4a6a164a1cf7c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdab818f784c43329a4a6a164a1cf7c3, State: Initialized, Role: FOLLOWER
08:07:47.038 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:47.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.038710  1150 tablet_bootstrap.cc:492] T 2647411043ab45458706fde51f0f7d18 P 4a91936aa3fc4705a7fb8e2e53edf637: No bootstrap required, opened a new log
08:07:47.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.039351  1150 ts_tablet_manager.cc:1403] T 2647411043ab45458706fde51f0f7d18 P 4a91936aa3fc4705a7fb8e2e53edf637: Time spent bootstrapping tablet: real 0.049s	user 0.023s	sys 0.000s
08:07:47.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.040375  1153 consensus_queue.cc:260] T 98ec5300665e4981b383fed816312f05 P cdab818f784c43329a4a6a164a1cf7c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:47.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.042729  1150 raft_consensus.cc:359] T 2647411043ab45458706fde51f0f7d18 P 4a91936aa3fc4705a7fb8e2e53edf637 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:47.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.043540  1150 raft_consensus.cc:385] T 2647411043ab45458706fde51f0f7d18 P 4a91936aa3fc4705a7fb8e2e53edf637 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:47.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.044319  1150 raft_consensus.cc:740] T 2647411043ab45458706fde51f0f7d18 P 4a91936aa3fc4705a7fb8e2e53edf637 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a91936aa3fc4705a7fb8e2e53edf637, State: Initialized, Role: FOLLOWER
08:07:47.047 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:47.047 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:47.047 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:47.048 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:47.048 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:47.048 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:47.048 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:47.048 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:47.048 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:47.049 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:47.049 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:47.049 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:47.049 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:47.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.048640  1149 tablet_bootstrap.cc:492] T 98ec5300665e4981b383fed816312f05 P 7f8fa66c1d0f40fab64f16e98a980e56: No bootstrap required, opened a new log
08:07:47.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.049264  1149 ts_tablet_manager.cc:1403] T 98ec5300665e4981b383fed816312f05 P 7f8fa66c1d0f40fab64f16e98a980e56: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.004s
08:07:47.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.045701  1150 consensus_queue.cc:260] T 2647411043ab45458706fde51f0f7d18 P 4a91936aa3fc4705a7fb8e2e53edf637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:47.054 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:47.054 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:47.055 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:47.055 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:47.055 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:47.055 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:47.056 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:47.056 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:47.056 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:47.056 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:47.056 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:47.056 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:47.056 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:47.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.057861  1150 ts_tablet_manager.cc:1434] T 2647411043ab45458706fde51f0f7d18 P 4a91936aa3fc4705a7fb8e2e53edf637: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
08:07:47.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.058538  1149 raft_consensus.cc:359] T 98ec5300665e4981b383fed816312f05 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:47.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.059391  1149 raft_consensus.cc:385] T 98ec5300665e4981b383fed816312f05 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:47.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.060674  1149 raft_consensus.cc:740] T 98ec5300665e4981b383fed816312f05 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f8fa66c1d0f40fab64f16e98a980e56, State: Initialized, Role: FOLLOWER
08:07:47.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.061484  1149 consensus_queue.cc:260] T 98ec5300665e4981b383fed816312f05 P 7f8fa66c1d0f40fab64f16e98a980e56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:47.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.070631  1149 ts_tablet_manager.cc:1434] T 98ec5300665e4981b383fed816312f05 P 7f8fa66c1d0f40fab64f16e98a980e56: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.003s
08:07:47.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.071743  1149 tablet_bootstrap.cc:492] T 2647411043ab45458706fde51f0f7d18 P 7f8fa66c1d0f40fab64f16e98a980e56: Bootstrap starting.
08:07:47.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.077920  1153 ts_tablet_manager.cc:1434] T 98ec5300665e4981b383fed816312f05 P cdab818f784c43329a4a6a164a1cf7c3: Time spent starting tablet: real 0.145s	user 0.038s	sys 0.012s
08:07:47.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.079336  1153 tablet_bootstrap.cc:492] T 19dc48939efd43049bf739035d3707d5 P cdab818f784c43329a4a6a164a1cf7c3: Bootstrap starting.
08:07:47.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.083273  1149 tablet_bootstrap.cc:654] T 2647411043ab45458706fde51f0f7d18 P 7f8fa66c1d0f40fab64f16e98a980e56: Neither blocks nor log segments found. Creating new log.
08:07:47.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.085711  1156 raft_consensus.cc:493] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:07:47.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.086396  1156 raft_consensus.cc:515] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:47.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.087064  1153 tablet_bootstrap.cc:654] T 19dc48939efd43049bf739035d3707d5 P cdab818f784c43329a4a6a164a1cf7c3: Neither blocks nor log segments found. Creating new log.
08:07:47.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:47.093509 32373 tablet.cc:2404] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:07:47.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.104775  1156 leader_election.cc:290] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdab818f784c43329a4a6a164a1cf7c3 (127.31.46.194:39687), 4a91936aa3fc4705a7fb8e2e53edf637 (127.31.46.195:38219)
08:07:47.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.142704  1155 raft_consensus.cc:493] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:07:47.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.143100  1149 tablet_bootstrap.cc:492] T 2647411043ab45458706fde51f0f7d18 P 7f8fa66c1d0f40fab64f16e98a980e56: No bootstrap required, opened a new log
08:07:47.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.143606  1149 ts_tablet_manager.cc:1403] T 2647411043ab45458706fde51f0f7d18 P 7f8fa66c1d0f40fab64f16e98a980e56: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.007s
08:07:47.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.143507  1155 raft_consensus.cc:515] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.147153  1149 raft_consensus.cc:359] T 2647411043ab45458706fde51f0f7d18 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:47.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.147915  1149 raft_consensus.cc:385] T 2647411043ab45458706fde51f0f7d18 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:47.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:47.148641 32674 tablet.cc:2404] T 19dc48939efd43049bf739035d3707d5 P 4a91936aa3fc4705a7fb8e2e53edf637: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:07:47.151 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:47.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.151659  1149 raft_consensus.cc:740] T 2647411043ab45458706fde51f0f7d18 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f8fa66c1d0f40fab64f16e98a980e56, State: Initialized, Role: FOLLOWER
08:07:47.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.152695  1155 leader_election.cc:290] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdab818f784c43329a4a6a164a1cf7c3 (127.31.46.194:39687), 7f8fa66c1d0f40fab64f16e98a980e56 (127.31.46.193:43719)
08:07:47.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.165560  1153 tablet_bootstrap.cc:492] T 19dc48939efd43049bf739035d3707d5 P cdab818f784c43329a4a6a164a1cf7c3: No bootstrap required, opened a new log
08:07:47.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.166440  1153 ts_tablet_manager.cc:1403] T 19dc48939efd43049bf739035d3707d5 P cdab818f784c43329a4a6a164a1cf7c3: Time spent bootstrapping tablet: real 0.087s	user 0.037s	sys 0.008s
08:07:47.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.170202  1153 raft_consensus.cc:359] T 19dc48939efd43049bf739035d3707d5 P cdab818f784c43329a4a6a164a1cf7c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:47.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.171072  1153 raft_consensus.cc:385] T 19dc48939efd43049bf739035d3707d5 P cdab818f784c43329a4a6a164a1cf7c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:47.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.171464  1153 raft_consensus.cc:740] T 19dc48939efd43049bf739035d3707d5 P cdab818f784c43329a4a6a164a1cf7c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdab818f784c43329a4a6a164a1cf7c3, State: Initialized, Role: FOLLOWER
08:07:47.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.172534  1153 consensus_queue.cc:260] T 19dc48939efd43049bf739035d3707d5 P cdab818f784c43329a4a6a164a1cf7c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:47.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.175103  1153 ts_tablet_manager.cc:1434] T 19dc48939efd43049bf739035d3707d5 P cdab818f784c43329a4a6a164a1cf7c3: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
08:07:47.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.176199  1153 tablet_bootstrap.cc:492] T 2647411043ab45458706fde51f0f7d18 P cdab818f784c43329a4a6a164a1cf7c3: Bootstrap starting.
08:07:47.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.179833  1149 consensus_queue.cc:260] T 2647411043ab45458706fde51f0f7d18 P 7f8fa66c1d0f40fab64f16e98a980e56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:47.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.190752  1149 ts_tablet_manager.cc:1434] T 2647411043ab45458706fde51f0f7d18 P 7f8fa66c1d0f40fab64f16e98a980e56: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.005s
08:07:47.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.204739  1153 tablet_bootstrap.cc:654] T 2647411043ab45458706fde51f0f7d18 P cdab818f784c43329a4a6a164a1cf7c3: Neither blocks nor log segments found. Creating new log.
08:07:47.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.209578  1160 raft_consensus.cc:493] T 19dc48939efd43049bf739035d3707d5 P cdab818f784c43329a4a6a164a1cf7c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:07:47.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.210325  1160 raft_consensus.cc:515] T 19dc48939efd43049bf739035d3707d5 P cdab818f784c43329a4a6a164a1cf7c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:47.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.214566  1160 leader_election.cc:290] T 19dc48939efd43049bf739035d3707d5 P cdab818f784c43329a4a6a164a1cf7c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f8fa66c1d0f40fab64f16e98a980e56 (127.31.46.193:43719), 4a91936aa3fc4705a7fb8e2e53edf637 (127.31.46.195:38219)
08:07:47.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.217926 32624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19dc48939efd43049bf739035d3707d5" candidate_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" is_pre_election: true
08:07:47.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.218784 32624 raft_consensus.cc:2468] T 19dc48939efd43049bf739035d3707d5 P 4a91936aa3fc4705a7fb8e2e53edf637 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f8fa66c1d0f40fab64f16e98a980e56 in term 0.
08:07:47.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.223042 32259 leader_election.cc:304] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a91936aa3fc4705a7fb8e2e53edf637, 7f8fa66c1d0f40fab64f16e98a980e56; no voters: 
08:07:47.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.223978  1156 raft_consensus.cc:2804] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:07:47.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.224398  1156 raft_consensus.cc:493] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:07:47.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.224733  1156 raft_consensus.cc:3060] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 0 FOLLOWER]: Advancing to term 1
08:07:47.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.241055 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19dc48939efd43049bf739035d3707d5" candidate_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdab818f784c43329a4a6a164a1cf7c3" is_pre_election: true
08:07:47.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.242107 32483 raft_consensus.cc:2468] T 19dc48939efd43049bf739035d3707d5 P cdab818f784c43329a4a6a164a1cf7c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f8fa66c1d0f40fab64f16e98a980e56 in term 0.
08:07:47.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.245867 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ec5300665e4981b383fed816312f05" candidate_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdab818f784c43329a4a6a164a1cf7c3" is_pre_election: true
08:07:47.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.246588 32483 raft_consensus.cc:2468] T 98ec5300665e4981b383fed816312f05 P cdab818f784c43329a4a6a164a1cf7c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a91936aa3fc4705a7fb8e2e53edf637 in term 0.
08:07:47.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:47.248208 32535 tablet.cc:2404] T 19dc48939efd43049bf739035d3707d5 P cdab818f784c43329a4a6a164a1cf7c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:07:47.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.249076 32558 leader_election.cc:304] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a91936aa3fc4705a7fb8e2e53edf637, cdab818f784c43329a4a6a164a1cf7c3; no voters: 
08:07:47.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.250108  1155 raft_consensus.cc:2804] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:07:47.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.250550  1155 raft_consensus.cc:493] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:07:47.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.250912  1155 raft_consensus.cc:3060] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637 [term 0 FOLLOWER]: Advancing to term 1
08:07:47.254 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:47.254 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:47.254 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:47.255 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:47.255 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:47.255 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:47.255 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:47.255 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:47.255 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:47.255 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:47.255 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:47.255 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:47.255 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:47.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.244925  1156 raft_consensus.cc:515] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:47.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.257449  1153 tablet_bootstrap.cc:492] T 2647411043ab45458706fde51f0f7d18 P cdab818f784c43329a4a6a164a1cf7c3: No bootstrap required, opened a new log
08:07:47.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.258034  1153 ts_tablet_manager.cc:1403] T 2647411043ab45458706fde51f0f7d18 P cdab818f784c43329a4a6a164a1cf7c3: Time spent bootstrapping tablet: real 0.082s	user 0.005s	sys 0.010s
08:07:47.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.262071  1156 leader_election.cc:290] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56 [CANDIDATE]: Term 1 election: Requested vote from peers cdab818f784c43329a4a6a164a1cf7c3 (127.31.46.194:39687), 4a91936aa3fc4705a7fb8e2e53edf637 (127.31.46.195:38219)
08:07:47.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.263376 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19dc48939efd43049bf739035d3707d5" candidate_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdab818f784c43329a4a6a164a1cf7c3"
08:07:47.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.264086 32483 raft_consensus.cc:3060] T 19dc48939efd43049bf739035d3707d5 P cdab818f784c43329a4a6a164a1cf7c3 [term 0 FOLLOWER]: Advancing to term 1
08:07:47.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.265087 32624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19dc48939efd43049bf739035d3707d5" candidate_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a91936aa3fc4705a7fb8e2e53edf637"
08:07:47.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.265691 32624 raft_consensus.cc:3060] T 19dc48939efd43049bf739035d3707d5 P 4a91936aa3fc4705a7fb8e2e53edf637 [term 0 FOLLOWER]: Advancing to term 1
08:07:47.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.272848  1153 raft_consensus.cc:359] T 2647411043ab45458706fde51f0f7d18 P cdab818f784c43329a4a6a164a1cf7c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:47.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.273710  1153 raft_consensus.cc:385] T 2647411043ab45458706fde51f0f7d18 P cdab818f784c43329a4a6a164a1cf7c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:47.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.273940 32624 raft_consensus.cc:2468] T 19dc48939efd43049bf739035d3707d5 P 4a91936aa3fc4705a7fb8e2e53edf637 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f8fa66c1d0f40fab64f16e98a980e56 in term 1.
08:07:47.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.274081  1153 raft_consensus.cc:740] T 2647411043ab45458706fde51f0f7d18 P cdab818f784c43329a4a6a164a1cf7c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdab818f784c43329a4a6a164a1cf7c3, State: Initialized, Role: FOLLOWER
08:07:47.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.275009  1153 consensus_queue.cc:260] T 2647411043ab45458706fde51f0f7d18 P cdab818f784c43329a4a6a164a1cf7c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:47.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.275277  1155 raft_consensus.cc:515] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:47.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.275300 32259 leader_election.cc:304] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a91936aa3fc4705a7fb8e2e53edf637, 7f8fa66c1d0f40fab64f16e98a980e56; no voters: 
08:07:47.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.278218  1153 ts_tablet_manager.cc:1434] T 2647411043ab45458706fde51f0f7d18 P cdab818f784c43329a4a6a164a1cf7c3: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
08:07:47.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.283869  1155 leader_election.cc:290] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637 [CANDIDATE]: Term 1 election: Requested vote from peers cdab818f784c43329a4a6a164a1cf7c3 (127.31.46.194:39687), 7f8fa66c1d0f40fab64f16e98a980e56 (127.31.46.193:43719)
08:07:47.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.293068  1172 raft_consensus.cc:493] T 98ec5300665e4981b383fed816312f05 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:07:47.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.296828  1156 raft_consensus.cc:2804] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 1 FOLLOWER]: Leader election won for term 1
08:07:47.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.298241 32323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ec5300665e4981b383fed816312f05" candidate_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" is_pre_election: true
08:07:47.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.298532 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ec5300665e4981b383fed816312f05" candidate_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdab818f784c43329a4a6a164a1cf7c3"
08:07:47.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.299336 32482 raft_consensus.cc:3060] T 98ec5300665e4981b383fed816312f05 P cdab818f784c43329a4a6a164a1cf7c3 [term 0 FOLLOWER]: Advancing to term 1
08:07:47.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.294711  1172 raft_consensus.cc:515] T 98ec5300665e4981b383fed816312f05 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:47.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.300863 32323 raft_consensus.cc:2468] T 98ec5300665e4981b383fed816312f05 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a91936aa3fc4705a7fb8e2e53edf637 in term 0.
08:07:47.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.302071 32322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ec5300665e4981b383fed816312f05" candidate_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f8fa66c1d0f40fab64f16e98a980e56"
08:07:47.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.315047 32482 raft_consensus.cc:2468] T 98ec5300665e4981b383fed816312f05 P cdab818f784c43329a4a6a164a1cf7c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a91936aa3fc4705a7fb8e2e53edf637 in term 1.
08:07:47.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.313951  1172 leader_election.cc:290] T 98ec5300665e4981b383fed816312f05 P 7f8fa66c1d0f40fab64f16e98a980e56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdab818f784c43329a4a6a164a1cf7c3 (127.31.46.194:39687), 4a91936aa3fc4705a7fb8e2e53edf637 (127.31.46.195:38219)
08:07:47.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.316095 32481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ec5300665e4981b383fed816312f05" candidate_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdab818f784c43329a4a6a164a1cf7c3" is_pre_election: true
08:07:47.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.317131 32481 raft_consensus.cc:2393] T 98ec5300665e4981b383fed816312f05 P cdab818f784c43329a4a6a164a1cf7c3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7f8fa66c1d0f40fab64f16e98a980e56 in current term 1: Already voted for candidate 4a91936aa3fc4705a7fb8e2e53edf637 in this term.
08:07:47.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.318447 32558 leader_election.cc:304] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a91936aa3fc4705a7fb8e2e53edf637, cdab818f784c43329a4a6a164a1cf7c3; no voters: 7f8fa66c1d0f40fab64f16e98a980e56
08:07:47.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.319432  1155 raft_consensus.cc:2804] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637 [term 1 FOLLOWER]: Leader election won for term 1
08:07:47.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.327402  1156 raft_consensus.cc:697] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 1 LEADER]: Becoming Leader. State: Replica: 7f8fa66c1d0f40fab64f16e98a980e56, State: Running, Role: LEADER
08:07:47.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.328749  1156 consensus_queue.cc:237] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:47.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.330915 32323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19dc48939efd43049bf739035d3707d5" candidate_uuid: "cdab818f784c43329a4a6a164a1cf7c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" is_pre_election: true
08:07:47.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.335620  1155 raft_consensus.cc:697] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637 [term 1 LEADER]: Becoming Leader. State: Replica: 4a91936aa3fc4705a7fb8e2e53edf637, State: Running, Role: LEADER
08:07:47.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.337278  1155 consensus_queue.cc:237] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:47.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:47.340240 32259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.31.46.195:38219, user_credentials={real_user=slave}} blocked reactor thread for 65022.1us
08:07:47.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.337664 32483 raft_consensus.cc:2468] T 19dc48939efd43049bf739035d3707d5 P cdab818f784c43329a4a6a164a1cf7c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f8fa66c1d0f40fab64f16e98a980e56 in term 1.
08:07:47.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.342545 32624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ec5300665e4981b383fed816312f05" candidate_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" is_pre_election: true
08:07:47.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.344879 32259 leader_election.cc:304] T 98ec5300665e4981b383fed816312f05 P 7f8fa66c1d0f40fab64f16e98a980e56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f8fa66c1d0f40fab64f16e98a980e56; no voters: 4a91936aa3fc4705a7fb8e2e53edf637, cdab818f784c43329a4a6a164a1cf7c3
08:07:47.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.347030  1173 raft_consensus.cc:3060] T 98ec5300665e4981b383fed816312f05 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 0 FOLLOWER]: Advancing to term 1
08:07:47.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.356448  1173 raft_consensus.cc:2749] T 98ec5300665e4981b383fed816312f05 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
08:07:47.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.367148 32624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19dc48939efd43049bf739035d3707d5" candidate_uuid: "cdab818f784c43329a4a6a164a1cf7c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" is_pre_election: true
08:07:47.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.367988 32624 raft_consensus.cc:2393] T 19dc48939efd43049bf739035d3707d5 P 4a91936aa3fc4705a7fb8e2e53edf637 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cdab818f784c43329a4a6a164a1cf7c3 in current term 1: Already voted for candidate 7f8fa66c1d0f40fab64f16e98a980e56 in this term.
08:07:47.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.376607 32131 catalog_manager.cc:5696] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a91936aa3fc4705a7fb8e2e53edf637 (127.31.46.195). New cstate: current_term: 1 leader_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } health_report { overall_health: HEALTHY } } }
08:07:47.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.381771 32399 leader_election.cc:304] T 19dc48939efd43049bf739035d3707d5 P cdab818f784c43329a4a6a164a1cf7c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cdab818f784c43329a4a6a164a1cf7c3; no voters: 4a91936aa3fc4705a7fb8e2e53edf637, 7f8fa66c1d0f40fab64f16e98a980e56
08:07:47.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.383006  1160 raft_consensus.cc:2749] T 19dc48939efd43049bf739035d3707d5 P cdab818f784c43329a4a6a164a1cf7c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
08:07:47.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.404413  1173 raft_consensus.cc:493] T 2647411043ab45458706fde51f0f7d18 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:07:47.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.404901  1173 raft_consensus.cc:515] T 2647411043ab45458706fde51f0f7d18 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:47.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.407083  1173 leader_election.cc:290] T 2647411043ab45458706fde51f0f7d18 P 7f8fa66c1d0f40fab64f16e98a980e56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdab818f784c43329a4a6a164a1cf7c3 (127.31.46.194:39687), 4a91936aa3fc4705a7fb8e2e53edf637 (127.31.46.195:38219)
08:07:47.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.410307 32624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647411043ab45458706fde51f0f7d18" candidate_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" is_pre_election: true
08:07:47.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.411170 32624 raft_consensus.cc:2468] T 2647411043ab45458706fde51f0f7d18 P 4a91936aa3fc4705a7fb8e2e53edf637 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f8fa66c1d0f40fab64f16e98a980e56 in term 0.
08:07:47.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.412696 32259 leader_election.cc:304] T 2647411043ab45458706fde51f0f7d18 P 7f8fa66c1d0f40fab64f16e98a980e56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a91936aa3fc4705a7fb8e2e53edf637, 7f8fa66c1d0f40fab64f16e98a980e56; no voters: 
08:07:47.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.414754 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647411043ab45458706fde51f0f7d18" candidate_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdab818f784c43329a4a6a164a1cf7c3" is_pre_election: true
08:07:47.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.415515  1173 raft_consensus.cc:2804] T 2647411043ab45458706fde51f0f7d18 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:07:47.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.415768  1114 heartbeater.cc:499] Master 127.31.233.252:36101 was elected leader, sending a full tablet report...
08:07:47.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.416308 32483 raft_consensus.cc:2468] T 2647411043ab45458706fde51f0f7d18 P cdab818f784c43329a4a6a164a1cf7c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f8fa66c1d0f40fab64f16e98a980e56 in term 0.
08:07:47.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.415854  1173 raft_consensus.cc:493] T 2647411043ab45458706fde51f0f7d18 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:07:47.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.417364  1173 raft_consensus.cc:3060] T 2647411043ab45458706fde51f0f7d18 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 0 FOLLOWER]: Advancing to term 1
08:07:47.454 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:47.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.454459  1173 raft_consensus.cc:515] T 2647411043ab45458706fde51f0f7d18 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:47.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.456336 32131 catalog_manager.cc:5696] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f8fa66c1d0f40fab64f16e98a980e56 (127.31.46.193). New cstate: current_term: 1 leader_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } health_report { overall_health: UNKNOWN } } }
08:07:47.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.459949 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647411043ab45458706fde51f0f7d18" candidate_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdab818f784c43329a4a6a164a1cf7c3"
08:07:47.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.460572 32483 raft_consensus.cc:3060] T 2647411043ab45458706fde51f0f7d18 P cdab818f784c43329a4a6a164a1cf7c3 [term 0 FOLLOWER]: Advancing to term 1
08:07:47.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.470158 32483 raft_consensus.cc:2468] T 2647411043ab45458706fde51f0f7d18 P cdab818f784c43329a4a6a164a1cf7c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f8fa66c1d0f40fab64f16e98a980e56 in term 1.
08:07:47.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.472788 32257 leader_election.cc:304] T 2647411043ab45458706fde51f0f7d18 P 7f8fa66c1d0f40fab64f16e98a980e56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f8fa66c1d0f40fab64f16e98a980e56, cdab818f784c43329a4a6a164a1cf7c3; no voters: 
08:07:47.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.473685  1156 raft_consensus.cc:2804] T 2647411043ab45458706fde51f0f7d18 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 1 FOLLOWER]: Leader election won for term 1
08:07:47.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.474201  1156 raft_consensus.cc:697] T 2647411043ab45458706fde51f0f7d18 P 7f8fa66c1d0f40fab64f16e98a980e56 [term 1 LEADER]: Becoming Leader. State: Replica: 7f8fa66c1d0f40fab64f16e98a980e56, State: Running, Role: LEADER
08:07:47.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.475034  1156 consensus_queue.cc:237] T 2647411043ab45458706fde51f0f7d18 P 7f8fa66c1d0f40fab64f16e98a980e56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } } peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } }
08:07:47.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.476773 32624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2647411043ab45458706fde51f0f7d18" candidate_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a91936aa3fc4705a7fb8e2e53edf637"
08:07:47.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.477392 32624 raft_consensus.cc:3060] T 2647411043ab45458706fde51f0f7d18 P 4a91936aa3fc4705a7fb8e2e53edf637 [term 0 FOLLOWER]: Advancing to term 1
08:07:47.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.492596  1173 leader_election.cc:290] T 2647411043ab45458706fde51f0f7d18 P 7f8fa66c1d0f40fab64f16e98a980e56 [CANDIDATE]: Term 1 election: Requested vote from peers cdab818f784c43329a4a6a164a1cf7c3 (127.31.46.194:39687), 4a91936aa3fc4705a7fb8e2e53edf637 (127.31.46.195:38219)
08:07:47.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.492050 32624 raft_consensus.cc:2468] T 2647411043ab45458706fde51f0f7d18 P 4a91936aa3fc4705a7fb8e2e53edf637 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f8fa66c1d0f40fab64f16e98a980e56 in term 1.
08:07:47.505 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:47.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.515296 32131 catalog_manager.cc:5696] T 2647411043ab45458706fde51f0f7d18 P 7f8fa66c1d0f40fab64f16e98a980e56 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f8fa66c1d0f40fab64f16e98a980e56 (127.31.46.193). New cstate: current_term: 1 leader_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 } health_report { overall_health: UNKNOWN } } }
08:07:47.538 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:47.651 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:47.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.756085  1155 consensus_queue.cc:1048] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:07:47.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.783190  1155 consensus_queue.cc:1048] T 98ec5300665e4981b383fed816312f05 P 4a91936aa3fc4705a7fb8e2e53edf637 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f8fa66c1d0f40fab64f16e98a980e56" member_type: VOTER last_known_addr { host: "127.31.46.193" port: 43719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:07:47.807 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:47.808 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:47.808 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:47.808 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:47.809 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:47.809 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:47.809 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:47.809 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:47.809 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:47.810 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:47.811 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:47.811 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:47.811 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:47.874 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:47.874 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:47.875 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:47.875 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:47.875 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:47.875 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:47.875 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:47.875 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:47.875 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:47.876 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:47.876 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:47.876 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:47.876 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:47.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.876694  1156 consensus_queue.cc:1048] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:07:47.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:47.895818  1172 consensus_queue.cc:1048] T 19dc48939efd43049bf739035d3707d5 P 7f8fa66c1d0f40fab64f16e98a980e56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:07:47.935 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:47.935 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:47.935 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:47.936 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:47.936 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:47.936 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:47.936 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:47.936 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:47.936 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:47.936 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:47.936 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:47.937 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:47.937 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:47.953 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:48.006 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:48.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.037415  1172 consensus_queue.cc:1048] T 2647411043ab45458706fde51f0f7d18 P 7f8fa66c1d0f40fab64f16e98a980e56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdab818f784c43329a4a6a164a1cf7c3" member_type: VOTER last_known_addr { host: "127.31.46.194" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:07:48.039 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:48.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.054435  1172 consensus_queue.cc:1048] T 2647411043ab45458706fde51f0f7d18 P 7f8fa66c1d0f40fab64f16e98a980e56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a91936aa3fc4705a7fb8e2e53edf637" member_type: VOTER last_known_addr { host: "127.31.46.195" port: 38219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:07:48.075 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:48.075 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:48.075 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:48.076 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:48.076 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:48.076 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:48.076 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:48.076 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:48.077 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:48.077 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:48.077 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:48.077 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:48.077 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:48.132 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:48.132 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 75171ad0cb2448e380e6b1e23553a1df
08:07:48.132 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:48.132 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:48.132 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:48.132 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:48.132 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:48.133 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:48.133 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:48.133 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:48.133 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:48.133 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:48.133 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:48.133 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:48.136 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 98ec5300665e4981b383fed816312f05 for table 'replication_test_table' with partition [<start>, 0x80000064)
08:07:48.136 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2647411043ab45458706fde51f0f7d18 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
08:07:48.137 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 19dc48939efd43049bf739035d3707d5 for table 'replication_test_table' with partition [0x800000C8, <end>)
08:07:48.137 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=98ec5300665e4981b383fed816312f05@[4a91936aa3fc4705a7fb8e2e53edf637(127.31.46.195:38219)[L],7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719),cdab818f784c43329a4a6a164a1cf7c3(127.31.46.194:39687)]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=2647411043ab45458706fde51f0f7d18@[4a91936aa3fc4705a7fb8e2e53edf637(127.31.46.195:38219),7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)[L],cdab818f784c43329a4a6a164a1cf7c3(127.31.46.194:39687)]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=19dc48939efd43049bf739035d3707d5@[4a91936aa3fc4705a7fb8e2e53edf637(127.31.46.195:38219),7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)[L],cdab818f784c43329a4a6a164a1cf7c3(127.31.46.194:39687)]}]
08:07:48.137 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.46.252:40541, [4ms] Sub RPC GetTableLocations: received response from server master-127.31.46.252:40541: OK, deferred=null) after lookup
08:07:48.138 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 4a91936aa3fc4705a7fb8e2e53edf637(127.31.46.195:38219)] connecting to peer
08:07:48.139 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 4a91936aa3fc4705a7fb8e2e53edf637(127.31.46.195:38219)] Successfully connected to peer
08:07:48.151 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:48.153 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:48.165 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x65fb2eab, L:/127.0.0.1:58832 - R:/127.31.46.195:38219] using TOKEN/null
08:07:48.186 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:48.186 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:48.186 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:48.187 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:48.187 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:48.187 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:48.187 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:48.187 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:48.187 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:48.187 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:48.187 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:48.187 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:48.187 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:48.198 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:48.198 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:48.198 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:48.199 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:48.199 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:48.199 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:48.199 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:48.199 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:48.199 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:48.199 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:48.199 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:48.199 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:48.199 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:48.301 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:48.302 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:48.302 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:48.304 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:48.304 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:48.304 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:48.305 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:48.305 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:48.305 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:48.306 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:48.306 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:48.306 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:48.306 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:48.363 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:48.363 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:48.364 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:48.364 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:48.364 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:48.364 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:48.366 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:48.366 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:48.366 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:48.366 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:48.366 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:48.366 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:48.366 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:48.454 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:48.475 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:48.475 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:48.475 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:48.476 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:48.476 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:48.476 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:48.477 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:48.477 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:48.477 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:48.477 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:48.477 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:48.478 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:48.478 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:48.508 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:48.527 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:48.528 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:48.528 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:48.529 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:48.529 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:48.529 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:48.529 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:48.529 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:48.530 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:48.531 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:48.531 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:48.531 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:48.531 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:48.539 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:48.585 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:48.586 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:48.586 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:48.587 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:48.587 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:48.587 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:48.587 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:48.587 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:48.587 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:48.587 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:48.587 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:48.587 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:48.587 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:48.588 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:48.588 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:48.588 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:48.588 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:48.588 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:48.588 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:48.588 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:48.588 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:48.588 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:48.590 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:48.590 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:48.590 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:48.590 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:48.602 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:48.604 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:48.607 [DEBUG - main] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:07:48.610 [DEBUG - main] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:07:48.611 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.31.233.254:35197(127.31.233.254:35197)] Successfully connected to peer
08:07:48.617 [DEBUG - main] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:07:48.618 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.31.233.253:33393(127.31.233.253:33393)] Successfully connected to peer
08:07:48.632 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.233.254
08:07:48.634 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.233.253
08:07:48.634 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.31.233.252:36101(127.31.233.252:36101)] Successfully connected to peer
08:07:48.645 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:48.647 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:48.650 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xfb9452ff, L:/127.0.0.1:49556 - R:/127.31.233.254:35197] using SASL/PLAIN
08:07:48.651 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:48.658 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xea37eef7, L:/127.0.0.1:41706 - R:/127.31.233.253:33393] using SASL/PLAIN
08:07:48.658 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.233.252
08:07:48.678 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:48.681 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x543b2183, L:/127.0.0.1:58306 - R:/127.31.233.252:36101] using SASL/PLAIN
08:07:48.686 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:07:48.686 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=81), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [50ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: OK, [56ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: OK, [79ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: OK, deferred=null) after lookup
08:07:48.698 [DEBUG - main] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:07:48.710 [DEBUG - main] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:07:48.710 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.31.46.254:45015(127.31.46.254:45015)] Successfully connected to peer
08:07:48.711 [DEBUG - main] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:07:48.723 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.31.46.253:46697(127.31.46.253:46697)] Successfully connected to peer
08:07:48.724 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.31.46.252:40541(127.31.46.252:40541)] Successfully connected to peer
08:07:48.732 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.46.254
08:07:48.736 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.46.252
08:07:48.737 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.46.253
08:07:48.743 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:48.747 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc36b4b4a, L:/127.0.0.1:55126 - R:/127.31.46.254:45015] using SASL/PLAIN
08:07:48.748 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:48.750 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:48.753 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xabf04ba6, L:/127.0.0.1:45410 - R:/127.31.46.253:46697] using SASL/PLAIN
08:07:48.754 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x06d7c82f, L:/127.0.0.1:38832 - R:/127.31.46.252:40541] using SASL/PLAIN
08:07:48.758 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:07:48.758 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=69), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [53ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: OK, [60ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: OK, [61ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: OK, deferred=null) after lookup
08:07:48.761 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 75171ad0cb2448e380e6b1e23553a1df
08:07:48.766 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 98ec5300665e4981b383fed816312f05 for table 'replication_test_table' with partition [<start>, 0x80000064)
08:07:48.766 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2647411043ab45458706fde51f0f7d18 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
08:07:48.766 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 19dc48939efd43049bf739035d3707d5 for table 'replication_test_table' with partition [0x800000C8, <end>)
08:07:48.766 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=98ec5300665e4981b383fed816312f05@[4a91936aa3fc4705a7fb8e2e53edf637(127.31.46.195:38219)[L],7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719),cdab818f784c43329a4a6a164a1cf7c3(127.31.46.194:39687)]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=2647411043ab45458706fde51f0f7d18@[4a91936aa3fc4705a7fb8e2e53edf637(127.31.46.195:38219),7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)[L],cdab818f784c43329a4a6a164a1cf7c3(127.31.46.194:39687)]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=19dc48939efd43049bf739035d3707d5@[4a91936aa3fc4705a7fb8e2e53edf637(127.31.46.195:38219),7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)[L],cdab818f784c43329a4a6a164a1cf7c3(127.31.46.194:39687)]}]
08:07:48.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.769170   422 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58306:
08:07:48.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
08:07:48.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
08:07:48.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:07:48.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
08:07:48.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:07:48.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:07:48.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:07:48.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:07:48.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:07:48.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:07:48.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:07:48.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:07:48.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:07:48.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:07:48.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
08:07:48.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:07:48.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:07:48.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:07:48.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:07:48.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\000\007\001d\000\000\000"
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:07:48.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
08:07:48.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:48.773994   422 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
08:07:48.820 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8b349d67027848718b0fda44e6180d3c
08:07:48.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.858829   763 tablet_service.cc:1511] Processing CreateTablet for tablet 9b2648a42d214c22b00f99eb0cf6a10d (DEFAULT_TABLE table=replication_test_table [id=8b349d67027848718b0fda44e6180d3c]), partition=RANGE (key1) PARTITION VALUES < 100
08:07:48.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.861621   763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b2648a42d214c22b00f99eb0cf6a10d. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:48.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.897955  1048 tablet_service.cc:1511] Processing CreateTablet for tablet 9b2648a42d214c22b00f99eb0cf6a10d (DEFAULT_TABLE table=replication_test_table [id=8b349d67027848718b0fda44e6180d3c]), partition=RANGE (key1) PARTITION VALUES < 100
08:07:48.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.900681  1048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b2648a42d214c22b00f99eb0cf6a10d. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:48.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.918955   905 tablet_service.cc:1511] Processing CreateTablet for tablet 9b2648a42d214c22b00f99eb0cf6a10d (DEFAULT_TABLE table=replication_test_table [id=8b349d67027848718b0fda44e6180d3c]), partition=RANGE (key1) PARTITION VALUES < 100
08:07:48.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.921787   905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b2648a42d214c22b00f99eb0cf6a10d. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:48.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.929275  1236 tablet_bootstrap.cc:492] T 9b2648a42d214c22b00f99eb0cf6a10d P 0f355e70bcf64068abe0047310247ddf: Bootstrap starting.
08:07:48.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.937148  1237 tablet_bootstrap.cc:492] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00: Bootstrap starting.
08:07:48.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.937780  1236 tablet_bootstrap.cc:654] T 9b2648a42d214c22b00f99eb0cf6a10d P 0f355e70bcf64068abe0047310247ddf: Neither blocks nor log segments found. Creating new log.
08:07:48.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.940781  1236 log.cc:826] T 9b2648a42d214c22b00f99eb0cf6a10d P 0f355e70bcf64068abe0047310247ddf: Log is configured to *not* fsync() on all Append() calls
08:07:48.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.945500  1237 tablet_bootstrap.cc:654] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00: Neither blocks nor log segments found. Creating new log.
08:07:48.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.947301  1236 tablet_bootstrap.cc:492] T 9b2648a42d214c22b00f99eb0cf6a10d P 0f355e70bcf64068abe0047310247ddf: No bootstrap required, opened a new log
08:07:48.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.947939  1236 ts_tablet_manager.cc:1403] T 9b2648a42d214c22b00f99eb0cf6a10d P 0f355e70bcf64068abe0047310247ddf: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
08:07:48.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.948141  1237 log.cc:826] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00: Log is configured to *not* fsync() on all Append() calls
08:07:48.953 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:48.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.955590  1237 tablet_bootstrap.cc:492] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00: No bootstrap required, opened a new log
08:07:48.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.957191  1237 ts_tablet_manager.cc:1403] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
08:07:48.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.967813  1240 tablet_bootstrap.cc:492] T 9b2648a42d214c22b00f99eb0cf6a10d P 253085249e36466eb1c769512f22e6cd: Bootstrap starting.
08:07:48.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.975884  1236 raft_consensus.cc:359] T 9b2648a42d214c22b00f99eb0cf6a10d P 0f355e70bcf64068abe0047310247ddf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } }
08:07:48.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.976915  1236 raft_consensus.cc:385] T 9b2648a42d214c22b00f99eb0cf6a10d P 0f355e70bcf64068abe0047310247ddf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:48.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.977087  1240 tablet_bootstrap.cc:654] T 9b2648a42d214c22b00f99eb0cf6a10d P 253085249e36466eb1c769512f22e6cd: Neither blocks nor log segments found. Creating new log.
08:07:48.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.977228  1236 raft_consensus.cc:740] T 9b2648a42d214c22b00f99eb0cf6a10d P 0f355e70bcf64068abe0047310247ddf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f355e70bcf64068abe0047310247ddf, State: Initialized, Role: FOLLOWER
08:07:48.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.978240  1236 consensus_queue.cc:260] T 9b2648a42d214c22b00f99eb0cf6a10d P 0f355e70bcf64068abe0047310247ddf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } }
08:07:48.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.979743  1240 log.cc:826] T 9b2648a42d214c22b00f99eb0cf6a10d P 253085249e36466eb1c769512f22e6cd: Log is configured to *not* fsync() on all Append() calls
08:07:48.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:48.984606  1236 ts_tablet_manager.cc:1434] T 9b2648a42d214c22b00f99eb0cf6a10d P 0f355e70bcf64068abe0047310247ddf: Time spent starting tablet: real 0.036s	user 0.022s	sys 0.012s
08:07:49.006 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:49.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.005048  1237 raft_consensus.cc:359] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } }
08:07:49.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.007622  1237 raft_consensus.cc:385] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:49.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.008104  1237 raft_consensus.cc:740] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff0efe9052574a8fb425700eee4efb00, State: Initialized, Role: FOLLOWER
08:07:49.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.010102  1237 consensus_queue.cc:260] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } }
08:07:49.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.024931  1237 ts_tablet_manager.cc:1434] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00: Time spent starting tablet: real 0.067s	user 0.044s	sys 0.011s
08:07:49.039 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:49.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.039537  1243 raft_consensus.cc:493] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:07:49.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.040231  1243 raft_consensus.cc:515] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } }
08:07:49.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.047611  1243 leader_election.cc:290] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f355e70bcf64068abe0047310247ddf (127.31.233.193:44827), 253085249e36466eb1c769512f22e6cd (127.31.233.194:37469)
08:07:49.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.072012   783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2648a42d214c22b00f99eb0cf6a10d" candidate_uuid: "ff0efe9052574a8fb425700eee4efb00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f355e70bcf64068abe0047310247ddf" is_pre_election: true
08:07:49.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.073239   783 raft_consensus.cc:2468] T 9b2648a42d214c22b00f99eb0cf6a10d P 0f355e70bcf64068abe0047310247ddf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff0efe9052574a8fb425700eee4efb00 in term 0.
08:07:49.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.077348  1004 leader_election.cc:304] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f355e70bcf64068abe0047310247ddf, ff0efe9052574a8fb425700eee4efb00; no voters: 
08:07:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.079674  1243 raft_consensus.cc:2804] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:07:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.080137  1243 raft_consensus.cc:493] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:07:49.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.080520  1243 raft_consensus.cc:3060] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00 [term 0 FOLLOWER]: Advancing to term 1
08:07:49.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.099472  1241 raft_consensus.cc:493] T 9b2648a42d214c22b00f99eb0cf6a10d P 0f355e70bcf64068abe0047310247ddf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:07:49.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.100270  1241 raft_consensus.cc:515] T 9b2648a42d214c22b00f99eb0cf6a10d P 0f355e70bcf64068abe0047310247ddf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } }
08:07:49.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.106004  1243 raft_consensus.cc:515] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } }
08:07:49.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.114838  1241 leader_election.cc:290] T 9b2648a42d214c22b00f99eb0cf6a10d P 0f355e70bcf64068abe0047310247ddf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff0efe9052574a8fb425700eee4efb00 (127.31.233.195:40161), 253085249e36466eb1c769512f22e6cd (127.31.233.194:37469)
08:07:49.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.121891   783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2648a42d214c22b00f99eb0cf6a10d" candidate_uuid: "ff0efe9052574a8fb425700eee4efb00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f355e70bcf64068abe0047310247ddf"
08:07:49.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.122771   783 raft_consensus.cc:3060] T 9b2648a42d214c22b00f99eb0cf6a10d P 0f355e70bcf64068abe0047310247ddf [term 0 FOLLOWER]: Advancing to term 1
08:07:49.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.126946  1243 leader_election.cc:290] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00 [CANDIDATE]: Term 1 election: Requested vote from peers 0f355e70bcf64068abe0047310247ddf (127.31.233.193:44827), 253085249e36466eb1c769512f22e6cd (127.31.233.194:37469)
08:07:49.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.132400   783 raft_consensus.cc:2468] T 9b2648a42d214c22b00f99eb0cf6a10d P 0f355e70bcf64068abe0047310247ddf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0efe9052574a8fb425700eee4efb00 in term 1.
08:07:49.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.133853  1004 leader_election.cc:304] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f355e70bcf64068abe0047310247ddf, ff0efe9052574a8fb425700eee4efb00; no voters: 
08:07:49.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.134734  1243 raft_consensus.cc:2804] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00 [term 1 FOLLOWER]: Leader election won for term 1
08:07:49.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:49.138965  1123 tablet.cc:2404] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:07:49.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.127328   924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2648a42d214c22b00f99eb0cf6a10d" candidate_uuid: "ff0efe9052574a8fb425700eee4efb00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "253085249e36466eb1c769512f22e6cd"
08:07:49.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.140645  1243 raft_consensus.cc:697] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00 [term 1 LEADER]: Becoming Leader. State: Replica: ff0efe9052574a8fb425700eee4efb00, State: Running, Role: LEADER
08:07:49.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.142028  1243 consensus_queue.cc:237] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } }
08:07:49.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.126034   925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2648a42d214c22b00f99eb0cf6a10d" candidate_uuid: "ff0efe9052574a8fb425700eee4efb00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "253085249e36466eb1c769512f22e6cd" is_pre_election: true
08:07:49.144 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:49.144 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:49.145 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:49.145 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:49.145 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:49.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:49.142643  1002 leader_election.cc:343] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 253085249e36466eb1c769512f22e6cd (127.31.233.194:37469): Illegal state: must be running to vote when last-logged opid is not known
08:07:49.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.144356  1240 tablet_bootstrap.cc:492] T 9b2648a42d214c22b00f99eb0cf6a10d P 253085249e36466eb1c769512f22e6cd: No bootstrap required, opened a new log
08:07:49.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:49.144855  1002 leader_election.cc:343] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 253085249e36466eb1c769512f22e6cd (127.31.233.194:37469): Illegal state: must be running to vote when last-logged opid is not known
08:07:49.145 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:49.145 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:49.145 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:49.145 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:49.146 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:49.146 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:49.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.145866  1240 ts_tablet_manager.cc:1403] T 9b2648a42d214c22b00f99eb0cf6a10d P 253085249e36466eb1c769512f22e6cd: Time spent bootstrapping tablet: real 0.179s	user 0.056s	sys 0.073s
08:07:49.146 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:49.146 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:49.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.150099   925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2648a42d214c22b00f99eb0cf6a10d" candidate_uuid: "0f355e70bcf64068abe0047310247ddf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "253085249e36466eb1c769512f22e6cd" is_pre_election: true
08:07:49.152 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:49.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.152916  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2648a42d214c22b00f99eb0cf6a10d" candidate_uuid: "0f355e70bcf64068abe0047310247ddf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0efe9052574a8fb425700eee4efb00" is_pre_election: true
08:07:49.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:49.156680   714 leader_election.cc:343] T 9b2648a42d214c22b00f99eb0cf6a10d P 0f355e70bcf64068abe0047310247ddf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 253085249e36466eb1c769512f22e6cd (127.31.233.194:37469): Illegal state: must be running to vote when last-logged opid is not known
08:07:49.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.159490   713 leader_election.cc:304] T 9b2648a42d214c22b00f99eb0cf6a10d P 0f355e70bcf64068abe0047310247ddf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f355e70bcf64068abe0047310247ddf; no voters: 253085249e36466eb1c769512f22e6cd, ff0efe9052574a8fb425700eee4efb00
08:07:49.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.160429  1241 raft_consensus.cc:2749] T 9b2648a42d214c22b00f99eb0cf6a10d P 0f355e70bcf64068abe0047310247ddf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
08:07:49.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.169242  1240 raft_consensus.cc:359] T 9b2648a42d214c22b00f99eb0cf6a10d P 253085249e36466eb1c769512f22e6cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } }
08:07:49.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.170205  1240 raft_consensus.cc:385] T 9b2648a42d214c22b00f99eb0cf6a10d P 253085249e36466eb1c769512f22e6cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:49.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.170524  1240 raft_consensus.cc:740] T 9b2648a42d214c22b00f99eb0cf6a10d P 253085249e36466eb1c769512f22e6cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 253085249e36466eb1c769512f22e6cd, State: Initialized, Role: FOLLOWER
08:07:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.170524   423 catalog_manager.cc:5696] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff0efe9052574a8fb425700eee4efb00 (127.31.233.195). New cstate: current_term: 1 leader_uuid: "ff0efe9052574a8fb425700eee4efb00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } health_report { overall_health: UNKNOWN } } }
08:07:49.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.171651  1240 consensus_queue.cc:260] T 9b2648a42d214c22b00f99eb0cf6a10d P 253085249e36466eb1c769512f22e6cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } }
08:07:49.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.176226  1240 ts_tablet_manager.cc:1434] T 9b2648a42d214c22b00f99eb0cf6a10d P 253085249e36466eb1c769512f22e6cd: Time spent starting tablet: real 0.030s	user 0.019s	sys 0.006s
08:07:49.210 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:49.211 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:49.211 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:49.211 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:49.211 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:49.211 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:49.211 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:49.211 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:49.212 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:49.212 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:49.212 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:49.212 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:49.212 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:49.213 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27720), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [3ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [4ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [5ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [6ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [24ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [25ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [27ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [27ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [42ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [42ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [42ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [43ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [62ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [62ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [62ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [63ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [82ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [82ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [82ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [83ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [103ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [104ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [104ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [123ms] refreshing cache from master, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [123ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [124ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [125ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [125ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [183ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [183ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [184ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [185ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [203ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [204ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [205ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [205ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [243ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [244ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [245ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [245ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1004ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2461ms] refreshing cache from master, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2463ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [2463ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2463ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2464ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [6441ms] refreshing cache from master, [6441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [6441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [6442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [6442ms] too many traces: truncated at 100 traces, deferred=Deferred@418226328(state=PENDING, result=null, callback=(continuation of Deferred@1494763891 after retry RPC after error@849827140) -> (continuation of Deferred@2000207079 after retry RPC after error@35924984) -> (continuation of Deferred@426551582 after retry RPC after error@292147714) -> (continuation of Deferred@595888972 after retry RPC after error@14425903) -> (continuation of Deferred@2089050739 after retry RPC after error@589452835) -> (continuation of Deferred@620455904 after retry RPC after error@1144922423) -> (continuation of Deferred@469128249 after retry RPC after error@710187562) -> (continuation of Deferred@1433349351 after retry RPC after error@1617791204) -> (continuation of Deferred@1226002252 after retry RPC after error@1201146254) -> (continuation of Deferred@1807490446 after retry RPC after error@1738183349) -> (continuation of Deferred@874567717 after retry RPC after error@863200086) -> (continuation of Deferred@950556891 after retry RPC after error@185891393) -> (continuation of Deferred@960981750 after retry RPC after error@294045531) -> (continuation of Deferred@1796352816 after retry RPC after error@1132233313) -> (continuation of Deferred@1106133026 after retry RPC after error@1719008091) -> (continuation of Deferred@474220302 after retry RPC after error@999092589) -> (continuation of Deferred@147868014 after retry RPC after error@1094112268) -> (continuation of Deferred@2113324883 after retry RPC after error@565007897) -> (continuation of Deferred@725414011 after retry RPC after error@1558042532) -> (continuation of Deferred@400183091 after retry RPC after error@1552735823) -> (continuation of Deferred@285168269 after retry RPC after error@573425601) -> (continuation of Deferred@1741399904 after retry RPC after error@1561289584), errback=(continuation of Deferred@1494763891 after retry RPC after error@849827140) -> (continuation of Deferred@2000207079 after retry RPC after error@35924984) -> (continuation of Deferred@426551582 after retry RPC after error@292147714) -> (continuation of Deferred@595888972 after retry RPC after error@14425903) -> (continuation of Deferred@2089050739 after retry RPC after error@589452835) -> (continuation of Deferred@620455904 after retry RPC after error@1144922423) -> (continuation of Deferred@469128249 after retry RPC after error@710187562) -> (continuation of Deferred@1433349351 after retry RPC after error@1617791204) -> (continuation of Deferred@1226002252 after retry RPC after error@1201146254) -> (continuation of Deferred@1807490446 after retry RPC after error@1738183349) -> (continuation of Deferred@874567717 after retry RPC after error@863200086) -> (continuation of Deferred@950556891 after retry RPC after error@185891393) -> (continuation of Deferred@960981750 after retry RPC after error@294045531) -> (continuation of Deferred@1796352816 after retry RPC after error@1132233313) -> (continuation of Deferred@1106133026 after retry RPC after error@1719008091) -> (continuation of Deferred@474220302 after retry RPC after error@999092589) -> (continuation of Deferred@147868014 after retry RPC after error@1094112268) -> (continuation of Deferred@2113324883 after retry RPC after error@565007897) -> (continuation of Deferred@725414011 after retry RPC after error@1558042532) -> (continuation of Deferred@400183091 after retry RPC after error@1552735823) -> (continuation of Deferred@285168269 after retry RPC after error@573425601) -> (continuation of Deferred@1741399904 after retry RPC after error@1561289584)))
08:07:49.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:49.214382   835 tablet.cc:2404] T 9b2648a42d214c22b00f99eb0cf6a10d P 0f355e70bcf64068abe0047310247ddf: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:07:49.215 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
08:07:49.216 [WARN - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#4 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27720), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [3ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [4ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [5ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [6ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [24ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [25ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [27ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [27ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [42ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [42ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [42ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [43ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [62ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [62ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [62ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [63ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [82ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [82ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [82ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [83ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [103ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [104ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [104ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [123ms] refreshing cache from master, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [123ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [124ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [125ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [125ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [183ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [183ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [184ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [185ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [203ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [204ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [205ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [205ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [243ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [244ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [245ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [245ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1004ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2461ms] refreshing cache from master, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2463ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [2463ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2463ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2464ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [6441ms] refreshing cache from master, [6441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [6441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [6442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [6442ms] too many traces: truncated at 100 traces, deferred=Deferred@418226328(state=PENDING, result=null, callback=(continuation of Deferred@1494763891 after retry RPC after error@849827140) -> (continuation of Deferred@2000207079 after retry RPC after error@35924984) -> (continuation of Deferred@426551582 after retry RPC after error@292147714) -> (continuation of Deferred@595888972 after retry RPC after error@14425903) -> (continuation of Deferred@2089050739 after retry RPC after error@589452835) -> (continuation of Deferred@620455904 after retry RPC after error@1144922423) -> (continuation of Deferred@469128249 after retry RPC after error@710187562) -> (continuation of Deferred@1433349351 after retry RPC after error@1617791204) -> (continuation of Deferred@1226002252 after retry RPC after error@1201146254) -> (continuation of Deferred@1807490446 after retry RPC after error@1738183349) -> (continuation of Deferred@874567717 after retry RPC after error@863200086) -> (continuation of Deferred@950556891 after retry RPC after error@185891393) -> (continuation of Deferred@960981750 after retry RPC after error@294045531) -> (continuation of Deferred@1796352816 after retry RPC after error@1132233313) -> (continuation of Deferred@1106133026 after retry RPC after error@1719008091) -> (continuation of Deferred@474220302 after retry RPC after error@999092589) -> (continuation of Deferred@147868014 after retry RPC after error@1094112268) -> (continuation of Deferred@2113324883 after retry RPC after error@565007897) -> (continuation of Deferred@725414011 after retry RPC after error@1558042532) -> (continuation of Deferred@400183091 after retry RPC after error@1552735823) -> (continuation of Deferred@285168269 after retry RPC after error@573425601) -> (continuation of Deferred@1741399904 after retry RPC after error@1561289584), errback=(continuation of Deferred@1494763891 after retry RPC after error@849827140) -> (continuation of Deferred@2000207079 after retry RPC after error@35924984) -> (continuation of Deferred@426551582 after retry RPC after error@292147714) -> (continuation of Deferred@595888972 after retry RPC after error@14425903) -> (continuation of Deferred@2089050739 after retry RPC after error@589452835) -> (continuation of Deferred@620455904 after retry RPC after error@1144922423) -> (continuation of Deferred@469128249 after retry RPC after error@710187562) -> (continuation of Deferred@1433349351 after retry RPC after error@1617791204) -> (continuation of Deferred@1226002252 after retry RPC after error@1201146254) -> (continuation of Deferred@1807490446 after retry RPC after error@1738183349) -> (continuation of Deferred@874567717 after retry RPC after error@863200086) -> (continuation of Deferred@950556891 after retry RPC after error@185891393) -> (continuation of Deferred@960981750 after retry RPC after error@294045531) -> (continuation of Deferred@1796352816 after retry RPC after error@1132233313) -> (continuation of Deferred@1106133026 after retry RPC after error@1719008091) -> (continuation of Deferred@474220302 after retry RPC after error@999092589) -> (continuation of Deferred@147868014 after retry RPC after error@1094112268) -> (continuation of Deferred@2113324883 after retry RPC after error@565007897) -> (continuation of Deferred@725414011 after retry RPC after error@1558042532) -> (continuation of Deferred@400183091 after retry RPC after error@1552735823) -> (continuation of Deferred@285168269 after retry RPC after error@573425601) -> (continuation of Deferred@1741399904 after retry RPC after error@1561289584)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.189:46677
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:07:49.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.217600  1253 raft_consensus.cc:493] T 9b2648a42d214c22b00f99eb0cf6a10d P 253085249e36466eb1c769512f22e6cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:07:49.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.218420  1253 raft_consensus.cc:515] T 9b2648a42d214c22b00f99eb0cf6a10d P 253085249e36466eb1c769512f22e6cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } }
08:07:49.222 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#4 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_4).
08:07:49.224 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#4 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_4.
08:07:49.227 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to FAILED on 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27720), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [3ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [4ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [5ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [6ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [24ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [25ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [27ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [27ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [42ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [42ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [42ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [43ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [62ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [62ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [62ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [63ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [82ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [82ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [82ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [83ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [103ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [104ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [104ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [123ms] refreshing cache from master, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [123ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [124ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [125ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [125ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [183ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [183ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [184ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [185ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [203ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [204ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [205ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [205ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [243ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [244ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [245ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [245ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1004ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2461ms] refreshing cache from master, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2463ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [2463ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2463ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2464ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [6441ms] refreshing cache from master, [6441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [6441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [6442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [6442ms] too many traces: truncated at 100 traces, deferred=Deferred@418226328(state=PENDING, result=null, callback=(continuation of Deferred@1494763891 after retry RPC after error@849827140) -> (continuation of Deferred@2000207079 after retry RPC after error@35924984) -> (continuation of Deferred@426551582 after retry RPC after error@292147714) -> (continuation of Deferred@595888972 after retry RPC after error@14425903) -> (continuation of Deferred@2089050739 after retry RPC after error@589452835) -> (continuation of Deferred@620455904 after retry RPC after error@1144922423) -> (continuation of Deferred@469128249 after retry RPC after error@710187562) -> (continuation of Deferred@1433349351 after retry RPC after error@1617791204) -> (continuation of Deferred@1226002252 after retry RPC after error@1201146254) -> (continuation of Deferred@1807490446 after retry RPC after error@1738183349) -> (continuation of Deferred@874567717 after retry RPC after error@863200086) -> (continuation of Deferred@950556891 after retry RPC after error@185891393) -> (continuation of Deferred@960981750 after retry RPC after error@294045531) -> (continuation of Deferred@1796352816 after retry RPC after error@1132233313) -> (continuation of Deferred@1106133026 after retry RPC after error@1719008091) -> (continuation of Deferred@474220302 after retry RPC after error@999092589) -> (continuation of Deferred@147868014 after retry RPC after error@1094112268) -> (continuation of Deferred@2113324883 after retry RPC after error@565007897) -> (continuation of Deferred@725414011 after retry RPC after error@1558042532) -> (continuation of Deferred@400183091 after retry RPC after error@1552735823) -> (continuation of Deferred@285168269 after retry RPC after error@573425601) -> (continuation of Deferred@1741399904 after retry RPC after error@1561289584), errback=(continuation of Deferred@1494763891 after retry RPC after error@849827140) -> (continuation of Deferred@2000207079 after retry RPC after error@35924984) -> (continuation of Deferred@426551582 after retry RPC after error@292147714) -> (continuation of Deferred@595888972 after retry RPC after error@14425903) -> (continuation of Deferred@2089050739 after retry RPC after error@589452835) -> (continuation of Deferred@620455904 after retry RPC after error@1144922423) -> (continuation of Deferred@469128249 after retry RPC after error@710187562) -> (continuation of Deferred@1433349351 after retry RPC after error@1617791204) -> (continuation of Deferred@1226002252 after retry RPC after error@1201146254) -> (continuation of Deferred@1807490446 after retry RPC after error@1738183349) -> (continuation of Deferred@874567717 after retry RPC after error@863200086) -> (continuation of Deferred@950556891 after retry RPC after error@185891393) -> (continuation of Deferred@960981750 after retry RPC after error@294045531) -> (continuation of Deferred@1796352816 after retry RPC after error@1132233313) -> (continuation of Deferred@1106133026 after retry RPC after error@1719008091) -> (continuation of Deferred@474220302 after retry RPC after error@999092589) -> (continuation of Deferred@147868014 after retry RPC after error@1094112268) -> (continuation of Deferred@2113324883 after retry RPC after error@565007897) -> (continuation of Deferred@725414011 after retry RPC after error@1558042532) -> (continuation of Deferred@400183091 after retry RPC after error@1552735823) -> (continuation of Deferred@285168269 after retry RPC after error@573425601) -> (continuation of Deferred@1741399904 after retry RPC after error@1561289584)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.189:46677
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:07:49.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.231390  1253 leader_election.cc:290] T 9b2648a42d214c22b00f99eb0cf6a10d P 253085249e36466eb1c769512f22e6cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f355e70bcf64068abe0047310247ddf (127.31.233.193:44827), ff0efe9052574a8fb425700eee4efb00 (127.31.233.195:40161)
08:07:49.238 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:07:49.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.239370   422 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58306:
08:07:49.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "replication_test_table" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\001d\000\000\000\007\001\310\000\000\000" } } } schema { columns { name: "key1" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key2" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key3" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "data" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } }
08:07:49.240 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#4) of source Source: KuduSource.
08:07:49.241 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_4.
08:07:49.241 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (e26b904229418d0e047d5d94c5b9f905) switched from state RUNNING to RESTARTING.
08:07:49.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.251187   783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2648a42d214c22b00f99eb0cf6a10d" candidate_uuid: "253085249e36466eb1c769512f22e6cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f355e70bcf64068abe0047310247ddf" is_pre_election: true
08:07:49.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.252242   783 raft_consensus.cc:2393] T 9b2648a42d214c22b00f99eb0cf6a10d P 0f355e70bcf64068abe0047310247ddf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 253085249e36466eb1c769512f22e6cd in current term 1: Already voted for candidate ff0efe9052574a8fb425700eee4efb00 in this term.
08:07:49.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.264420  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2648a42d214c22b00f99eb0cf6a10d" candidate_uuid: "253085249e36466eb1c769512f22e6cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0efe9052574a8fb425700eee4efb00" is_pre_election: true
08:07:49.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.266471   858 leader_election.cc:304] T 9b2648a42d214c22b00f99eb0cf6a10d P 253085249e36466eb1c769512f22e6cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 253085249e36466eb1c769512f22e6cd; no voters: 0f355e70bcf64068abe0047310247ddf, ff0efe9052574a8fb425700eee4efb00
08:07:49.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.267822  1253 raft_consensus.cc:3060] T 9b2648a42d214c22b00f99eb0cf6a10d P 253085249e36466eb1c769512f22e6cd [term 0 FOLLOWER]: Advancing to term 1
08:07:49.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.275492  1253 raft_consensus.cc:2749] T 9b2648a42d214c22b00f99eb0cf6a10d P 253085249e36466eb1c769512f22e6cd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
08:07:49.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:49.287809   422 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3977edf91b3a4033a50087f2384482d2 has no consensus state
08:07:49.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:49.319566   408 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 3977edf91b3a4033a50087f2384482d2 (table replication_test_table [id=8b349d67027848718b0fda44e6180d3c], current schema version=0) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3977edf91b3a4033a50087f2384482d2 has no consensus state
08:07:49.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.327407   763 tablet_service.cc:1511] Processing CreateTablet for tablet 3977edf91b3a4033a50087f2384482d2 (DEFAULT_TABLE table=replication_test_table [id=8b349d67027848718b0fda44e6180d3c]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
08:07:49.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.328732   763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3977edf91b3a4033a50087f2384482d2. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:49.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:49.335935   975 tablet.cc:2404] T 9b2648a42d214c22b00f99eb0cf6a10d P 253085249e36466eb1c769512f22e6cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:07:49.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.336838   905 tablet_service.cc:1511] Processing CreateTablet for tablet 3977edf91b3a4033a50087f2384482d2 (DEFAULT_TABLE table=replication_test_table [id=8b349d67027848718b0fda44e6180d3c]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
08:07:49.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.338191   905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3977edf91b3a4033a50087f2384482d2. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:49.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.338785  1048 tablet_service.cc:1511] Processing CreateTablet for tablet 3977edf91b3a4033a50087f2384482d2 (DEFAULT_TABLE table=replication_test_table [id=8b349d67027848718b0fda44e6180d3c]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
08:07:49.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.340030  1048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3977edf91b3a4033a50087f2384482d2. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:49.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.358120  1236 tablet_bootstrap.cc:492] T 3977edf91b3a4033a50087f2384482d2 P 0f355e70bcf64068abe0047310247ddf: Bootstrap starting.
08:07:49.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.358325  1237 tablet_bootstrap.cc:492] T 3977edf91b3a4033a50087f2384482d2 P ff0efe9052574a8fb425700eee4efb00: Bootstrap starting.
08:07:49.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.364480  1236 tablet_bootstrap.cc:654] T 3977edf91b3a4033a50087f2384482d2 P 0f355e70bcf64068abe0047310247ddf: Neither blocks nor log segments found. Creating new log.
08:07:49.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.366232  1237 tablet_bootstrap.cc:654] T 3977edf91b3a4033a50087f2384482d2 P ff0efe9052574a8fb425700eee4efb00: Neither blocks nor log segments found. Creating new log.
08:07:49.367 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:49.368 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:49.368 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:49.369 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:49.369 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:49.369 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:49.369 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:49.369 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:49.369 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:49.369 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:49.369 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:49.369 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:49.369 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:49.370 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27883), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [5ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [20ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [21ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [43ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [44ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [45ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [45ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [63ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [63ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [63ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [64ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [83ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [83ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [83ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [84ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [103ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [103ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [143ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [144ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [148ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [148ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [203ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [203ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [203ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [203ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [304ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [562ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [562ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [563ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [563ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [742ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [742ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [742ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [743ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1381ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1384ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1384ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1386ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1386ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2321ms] refreshing cache from master, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2322ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2322ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [2323ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2323ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [5180ms] refreshing cache from master, [5181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [5181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [5182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [5183ms] too many traces: truncated at 100 traces, deferred=Deferred@1253908015(state=PENDING, result=null, callback=(continuation of Deferred@1158455177 after retry RPC after error@1129056086) -> (continuation of Deferred@214969480 after retry RPC after error@784209755) -> (continuation of Deferred@267331026 after retry RPC after error@750446030) -> (continuation of Deferred@553859261 after retry RPC after error@2136602377) -> (continuation of Deferred@166628485 after retry RPC after error@1921092835) -> (continuation of Deferred@1249871070 after retry RPC after error@2049884967) -> (continuation of Deferred@131719747 after retry RPC after error@2042728655) -> (continuation of Deferred@1336844893 after retry RPC after error@1133868916) -> (continuation of Deferred@194404031 after retry RPC after error@2116350186) -> (continuation of Deferred@1143085369 after retry RPC after error@744810526) -> (continuation of Deferred@364783755 after retry RPC after error@1287928182) -> (continuation of Deferred@410716678 after retry RPC after error@324285711) -> (continuation of Deferred@2009775518 after retry RPC after error@447231384) -> (continuation of Deferred@1514350577 after retry RPC after error@1745718779) -> (continuation of Deferred@1242164009 after retry RPC after error@290853637) -> (continuation of Deferred@1391051377 after retry RPC after error@1452273538) -> (continuation of Deferred@1406797529 after retry RPC after error@1924524444) -> (continuation of Deferred@1859344369 after retry RPC after error@1200178774) -> (continuation of Deferred@1147563184 after retry RPC after error@423793833) -> (continuation of Deferred@1834628271 after retry RPC after error@1626104996) -> (continuation of Deferred@395876325 after retry RPC after error@452116067) -> (continuation of Deferred@640749278 after retry RPC after error@628852728) -> (continuation of Deferred@1980697357 after retry RPC after error@2038542857), errback=(continuation of Deferred@1158455177 after retry RPC after error@1129056086) -> (continuation of Deferred@214969480 after retry RPC after error@784209755) -> (continuation of Deferred@267331026 after retry RPC after error@750446030) -> (continuation of Deferred@553859261 after retry RPC after error@2136602377) -> (continuation of Deferred@166628485 after retry RPC after error@1921092835) -> (continuation of Deferred@1249871070 after retry RPC after error@2049884967) -> (continuation of Deferred@131719747 after retry RPC after error@2042728655) -> (continuation of Deferred@1336844893 after retry RPC after error@1133868916) -> (continuation of Deferred@194404031 after retry RPC after error@2116350186) -> (continuation of Deferred@1143085369 after retry RPC after error@744810526) -> (continuation of Deferred@364783755 after retry RPC after error@1287928182) -> (continuation of Deferred@410716678 after retry RPC after error@324285711) -> (continuation of Deferred@2009775518 after retry RPC after error@447231384) -> (continuation of Deferred@1514350577 after retry RPC after error@1745718779) -> (continuation of Deferred@1242164009 after retry RPC after error@290853637) -> (continuation of Deferred@1391051377 after retry RPC after error@1452273538) -> (continuation of Deferred@1406797529 after retry RPC after error@1924524444) -> (continuation of Deferred@1859344369 after retry RPC after error@1200178774) -> (continuation of Deferred@1147563184 after retry RPC after error@423793833) -> (continuation of Deferred@1834628271 after retry RPC after error@1626104996) -> (continuation of Deferred@395876325 after retry RPC after error@452116067) -> (continuation of Deferred@640749278 after retry RPC after error@628852728) -> (continuation of Deferred@1980697357 after retry RPC after error@2038542857)))
08:07:49.372 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
08:07:49.372 [WARN - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#4 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27883), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [5ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [20ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [21ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [43ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [44ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [45ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [45ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [63ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [63ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [63ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [64ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [83ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [83ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [83ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [84ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [103ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [103ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [143ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [144ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [148ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [148ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [203ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [203ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [203ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [203ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [304ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [562ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [562ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [563ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [563ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [742ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [742ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [742ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [743ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1381ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1384ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1384ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1386ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1386ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2321ms] refreshing cache from master, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2322ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2322ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [2323ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2323ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [5180ms] refreshing cache from master, [5181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [5181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [5182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [5183ms] too many traces: truncated at 100 traces, deferred=Deferred@1253908015(state=PENDING, result=null, callback=(continuation of Deferred@1158455177 after retry RPC after error@1129056086) -> (continuation of Deferred@214969480 after retry RPC after error@784209755) -> (continuation of Deferred@267331026 after retry RPC after error@750446030) -> (continuation of Deferred@553859261 after retry RPC after error@2136602377) -> (continuation of Deferred@166628485 after retry RPC after error@1921092835) -> (continuation of Deferred@1249871070 after retry RPC after error@2049884967) -> (continuation of Deferred@131719747 after retry RPC after error@2042728655) -> (continuation of Deferred@1336844893 after retry RPC after error@1133868916) -> (continuation of Deferred@194404031 after retry RPC after error@2116350186) -> (continuation of Deferred@1143085369 after retry RPC after error@744810526) -> (continuation of Deferred@364783755 after retry RPC after error@1287928182) -> (continuation of Deferred@410716678 after retry RPC after error@324285711) -> (continuation of Deferred@2009775518 after retry RPC after error@447231384) -> (continuation of Deferred@1514350577 after retry RPC after error@1745718779) -> (continuation of Deferred@1242164009 after retry RPC after error@290853637) -> (continuation of Deferred@1391051377 after retry RPC after error@1452273538) -> (continuation of Deferred@1406797529 after retry RPC after error@1924524444) -> (continuation of Deferred@1859344369 after retry RPC after error@1200178774) -> (continuation of Deferred@1147563184 after retry RPC after error@423793833) -> (continuation of Deferred@1834628271 after retry RPC after error@1626104996) -> (continuation of Deferred@395876325 after retry RPC after error@452116067) -> (continuation of Deferred@640749278 after retry RPC after error@628852728) -> (continuation of Deferred@1980697357 after retry RPC after error@2038542857), errback=(continuation of Deferred@1158455177 after retry RPC after error@1129056086) -> (continuation of Deferred@214969480 after retry RPC after error@784209755) -> (continuation of Deferred@267331026 after retry RPC after error@750446030) -> (continuation of Deferred@553859261 after retry RPC after error@2136602377) -> (continuation of Deferred@166628485 after retry RPC after error@1921092835) -> (continuation of Deferred@1249871070 after retry RPC after error@2049884967) -> (continuation of Deferred@131719747 after retry RPC after error@2042728655) -> (continuation of Deferred@1336844893 after retry RPC after error@1133868916) -> (continuation of Deferred@194404031 after retry RPC after error@2116350186) -> (continuation of Deferred@1143085369 after retry RPC after error@744810526) -> (continuation of Deferred@364783755 after retry RPC after error@1287928182) -> (continuation of Deferred@410716678 after retry RPC after error@324285711) -> (continuation of Deferred@2009775518 after retry RPC after error@447231384) -> (continuation of Deferred@1514350577 after retry RPC after error@1745718779) -> (continuation of Deferred@1242164009 after retry RPC after error@290853637) -> (continuation of Deferred@1391051377 after retry RPC after error@1452273538) -> (continuation of Deferred@1406797529 after retry RPC after error@1924524444) -> (continuation of Deferred@1859344369 after retry RPC after error@1200178774) -> (continuation of Deferred@1147563184 after retry RPC after error@423793833) -> (continuation of Deferred@1834628271 after retry RPC after error@1626104996) -> (continuation of Deferred@395876325 after retry RPC after error@452116067) -> (continuation of Deferred@640749278 after retry RPC after error@628852728) -> (continuation of Deferred@1980697357 after retry RPC after error@2038542857)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.188:41049
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:07:49.376 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#4 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_4).
08:07:49.377 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#4 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_4.
08:07:49.380 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to FAILED on 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27883), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [5ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [20ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [21ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [43ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [44ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [45ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [45ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [63ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [63ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [63ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [64ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [83ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [83ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [83ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [84ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [103ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [103ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [143ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [144ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [148ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [148ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [203ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [203ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [203ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [203ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [304ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [562ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [562ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [563ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [563ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [742ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [742ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [742ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [743ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1381ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1384ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1384ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1386ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1386ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2321ms] refreshing cache from master, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2322ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2322ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [2323ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2323ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [5180ms] refreshing cache from master, [5181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [5181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [5182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [5183ms] too many traces: truncated at 100 traces, deferred=Deferred@1253908015(state=PENDING, result=null, callback=(continuation of Deferred@1158455177 after retry RPC after error@1129056086) -> (continuation of Deferred@214969480 after retry RPC after error@784209755) -> (continuation of Deferred@267331026 after retry RPC after error@750446030) -> (continuation of Deferred@553859261 after retry RPC after error@2136602377) -> (continuation of Deferred@166628485 after retry RPC after error@1921092835) -> (continuation of Deferred@1249871070 after retry RPC after error@2049884967) -> (continuation of Deferred@131719747 after retry RPC after error@2042728655) -> (continuation of Deferred@1336844893 after retry RPC after error@1133868916) -> (continuation of Deferred@194404031 after retry RPC after error@2116350186) -> (continuation of Deferred@1143085369 after retry RPC after error@744810526) -> (continuation of Deferred@364783755 after retry RPC after error@1287928182) -> (continuation of Deferred@410716678 after retry RPC after error@324285711) -> (continuation of Deferred@2009775518 after retry RPC after error@447231384) -> (continuation of Deferred@1514350577 after retry RPC after error@1745718779) -> (continuation of Deferred@1242164009 after retry RPC after error@290853637) -> (continuation of Deferred@1391051377 after retry RPC after error@1452273538) -> (continuation of Deferred@1406797529 after retry RPC after error@1924524444) -> (continuation of Deferred@1859344369 after retry RPC after error@1200178774) -> (continuation of Deferred@1147563184 after retry RPC after error@423793833) -> (continuation of Deferred@1834628271 after retry RPC after error@1626104996) -> (continuation of Deferred@395876325 after retry RPC after error@452116067) -> (continuation of Deferred@640749278 after retry RPC after error@628852728) -> (continuation of Deferred@1980697357 after retry RPC after error@2038542857), errback=(continuation of Deferred@1158455177 after retry RPC after error@1129056086) -> (continuation of Deferred@214969480 after retry RPC after error@784209755) -> (continuation of Deferred@267331026 after retry RPC after error@750446030) -> (continuation of Deferred@553859261 after retry RPC after error@2136602377) -> (continuation of Deferred@166628485 after retry RPC after error@1921092835) -> (continuation of Deferred@1249871070 after retry RPC after error@2049884967) -> (continuation of Deferred@131719747 after retry RPC after error@2042728655) -> (continuation of Deferred@1336844893 after retry RPC after error@1133868916) -> (continuation of Deferred@194404031 after retry RPC after error@2116350186) -> (continuation of Deferred@1143085369 after retry RPC after error@744810526) -> (continuation of Deferred@364783755 after retry RPC after error@1287928182) -> (continuation of Deferred@410716678 after retry RPC after error@324285711) -> (continuation of Deferred@2009775518 after retry RPC after error@447231384) -> (continuation of Deferred@1514350577 after retry RPC after error@1745718779) -> (continuation of Deferred@1242164009 after retry RPC after error@290853637) -> (continuation of Deferred@1391051377 after retry RPC after error@1452273538) -> (continuation of Deferred@1406797529 after retry RPC after error@1924524444) -> (continuation of Deferred@1859344369 after retry RPC after error@1200178774) -> (continuation of Deferred@1147563184 after retry RPC after error@423793833) -> (continuation of Deferred@1834628271 after retry RPC after error@1626104996) -> (continuation of Deferred@395876325 after retry RPC after error@452116067) -> (continuation of Deferred@640749278 after retry RPC after error@628852728) -> (continuation of Deferred@1980697357 after retry RPC after error@2038542857)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.188:41049
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:07:49.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.377185  1240 tablet_bootstrap.cc:492] T 3977edf91b3a4033a50087f2384482d2 P 253085249e36466eb1c769512f22e6cd: Bootstrap starting.
08:07:49.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.384388  1240 tablet_bootstrap.cc:654] T 3977edf91b3a4033a50087f2384482d2 P 253085249e36466eb1c769512f22e6cd: Neither blocks nor log segments found. Creating new log.
08:07:49.387 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:07:49.389 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#4) of source Source: KuduSource.
08:07:49.389 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_4.
08:07:49.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.402498  1237 tablet_bootstrap.cc:492] T 3977edf91b3a4033a50087f2384482d2 P ff0efe9052574a8fb425700eee4efb00: No bootstrap required, opened a new log
08:07:49.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.403000  1237 ts_tablet_manager.cc:1403] T 3977edf91b3a4033a50087f2384482d2 P ff0efe9052574a8fb425700eee4efb00: Time spent bootstrapping tablet: real 0.045s	user 0.005s	sys 0.010s
08:07:49.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.408890  1240 tablet_bootstrap.cc:492] T 3977edf91b3a4033a50087f2384482d2 P 253085249e36466eb1c769512f22e6cd: No bootstrap required, opened a new log
08:07:49.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.409439  1240 ts_tablet_manager.cc:1403] T 3977edf91b3a4033a50087f2384482d2 P 253085249e36466eb1c769512f22e6cd: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.009s
08:07:49.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.413730  1237 raft_consensus.cc:359] T 3977edf91b3a4033a50087f2384482d2 P ff0efe9052574a8fb425700eee4efb00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } }
08:07:49.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.414552  1237 raft_consensus.cc:385] T 3977edf91b3a4033a50087f2384482d2 P ff0efe9052574a8fb425700eee4efb00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:49.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.414820  1237 raft_consensus.cc:740] T 3977edf91b3a4033a50087f2384482d2 P ff0efe9052574a8fb425700eee4efb00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff0efe9052574a8fb425700eee4efb00, State: Initialized, Role: FOLLOWER
08:07:49.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.415446  1240 raft_consensus.cc:359] T 3977edf91b3a4033a50087f2384482d2 P 253085249e36466eb1c769512f22e6cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } }
08:07:49.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.416440  1240 raft_consensus.cc:385] T 3977edf91b3a4033a50087f2384482d2 P 253085249e36466eb1c769512f22e6cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:49.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.416658  1236 tablet_bootstrap.cc:492] T 3977edf91b3a4033a50087f2384482d2 P 0f355e70bcf64068abe0047310247ddf: No bootstrap required, opened a new log
08:07:49.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.416760  1240 raft_consensus.cc:740] T 3977edf91b3a4033a50087f2384482d2 P 253085249e36466eb1c769512f22e6cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 253085249e36466eb1c769512f22e6cd, State: Initialized, Role: FOLLOWER
08:07:49.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.417385  1236 ts_tablet_manager.cc:1403] T 3977edf91b3a4033a50087f2384482d2 P 0f355e70bcf64068abe0047310247ddf: Time spent bootstrapping tablet: real 0.059s	user 0.019s	sys 0.007s
08:07:49.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.417667  1237 consensus_queue.cc:260] T 3977edf91b3a4033a50087f2384482d2 P ff0efe9052574a8fb425700eee4efb00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } }
08:07:49.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.418871  1240 consensus_queue.cc:260] T 3977edf91b3a4033a50087f2384482d2 P 253085249e36466eb1c769512f22e6cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } }
08:07:49.434 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:49.435 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:49.435 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:49.435 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:49.435 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:49.435 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:49.436 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:49.436 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:49.436 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:49.436 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:49.436 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:49.436 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:49.436 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:49.436 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:49.436 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:49.437 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:49.437 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:49.437 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:49.439 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:49.440 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:49.440 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:49.440 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:49.441 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:49.441 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:49.441 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:49.441 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:49.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.423269  1237 ts_tablet_manager.cc:1434] T 3977edf91b3a4033a50087f2384482d2 P ff0efe9052574a8fb425700eee4efb00: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
08:07:49.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.425722  1240 ts_tablet_manager.cc:1434] T 3977edf91b3a4033a50087f2384482d2 P 253085249e36466eb1c769512f22e6cd: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
08:07:49.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.455102   422 catalog_manager.cc:6241] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11: replication_test_table [id=8b349d67027848718b0fda44e6180d3c] alter complete (version 0)
08:07:49.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.464561  1236 raft_consensus.cc:359] T 3977edf91b3a4033a50087f2384482d2 P 0f355e70bcf64068abe0047310247ddf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } }
08:07:49.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.467823  1236 raft_consensus.cc:385] T 3977edf91b3a4033a50087f2384482d2 P 0f355e70bcf64068abe0047310247ddf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:49.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.468220  1236 raft_consensus.cc:740] T 3977edf91b3a4033a50087f2384482d2 P 0f355e70bcf64068abe0047310247ddf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f355e70bcf64068abe0047310247ddf, State: Initialized, Role: FOLLOWER
08:07:49.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.469152  1236 consensus_queue.cc:260] T 3977edf91b3a4033a50087f2384482d2 P 0f355e70bcf64068abe0047310247ddf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } }
08:07:49.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.480432  1236 ts_tablet_manager.cc:1434] T 3977edf91b3a4033a50087f2384482d2 P 0f355e70bcf64068abe0047310247ddf: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.004s
08:07:49.505 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:49.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.511937   423 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58306:
08:07:49.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "replication_test_table" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\001\310\000\000\000\007\000" } } } schema { columns { name: "key1" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key2" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key3" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "data" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } }
08:07:49.538 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:49.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:49.545120   423 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3977edf91b3a4033a50087f2384482d2 consensus state has no leader
08:07:49.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:49.545676   423 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6af20e293853422c9c0251eb17f65ebe has no consensus state
08:07:49.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.554747  1243 consensus_queue.cc:1048] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:07:49.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.575397   763 tablet_service.cc:1511] Processing CreateTablet for tablet 6af20e293853422c9c0251eb17f65ebe (DEFAULT_TABLE table=replication_test_table [id=8b349d67027848718b0fda44e6180d3c]), partition=RANGE (key1) PARTITION 200 <= VALUES
08:07:49.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.576808   763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6af20e293853422c9c0251eb17f65ebe. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:49.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.576782  1048 tablet_service.cc:1511] Processing CreateTablet for tablet 6af20e293853422c9c0251eb17f65ebe (DEFAULT_TABLE table=replication_test_table [id=8b349d67027848718b0fda44e6180d3c]), partition=RANGE (key1) PARTITION 200 <= VALUES
08:07:49.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.578040  1048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6af20e293853422c9c0251eb17f65ebe. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:49.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.582324   905 tablet_service.cc:1511] Processing CreateTablet for tablet 6af20e293853422c9c0251eb17f65ebe (DEFAULT_TABLE table=replication_test_table [id=8b349d67027848718b0fda44e6180d3c]), partition=RANGE (key1) PARTITION 200 <= VALUES
08:07:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.583962   905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6af20e293853422c9c0251eb17f65ebe. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:49.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.604856  1240 tablet_bootstrap.cc:492] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd: Bootstrap starting.
08:07:49.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.615841  1240 tablet_bootstrap.cc:654] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd: Neither blocks nor log segments found. Creating new log.
08:07:49.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.619158  1236 tablet_bootstrap.cc:492] T 6af20e293853422c9c0251eb17f65ebe P 0f355e70bcf64068abe0047310247ddf: Bootstrap starting.
08:07:49.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.627790  1250 consensus_queue.cc:1048] T 9b2648a42d214c22b00f99eb0cf6a10d P ff0efe9052574a8fb425700eee4efb00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:07:49.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.628443  1237 tablet_bootstrap.cc:492] T 6af20e293853422c9c0251eb17f65ebe P ff0efe9052574a8fb425700eee4efb00: Bootstrap starting.
08:07:49.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.643162  1237 tablet_bootstrap.cc:654] T 6af20e293853422c9c0251eb17f65ebe P ff0efe9052574a8fb425700eee4efb00: Neither blocks nor log segments found. Creating new log.
08:07:49.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.644717  1236 tablet_bootstrap.cc:654] T 6af20e293853422c9c0251eb17f65ebe P 0f355e70bcf64068abe0047310247ddf: Neither blocks nor log segments found. Creating new log.
08:07:49.651 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:49.657 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:49.657 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:49.657 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:49.658 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:49.658 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:49.658 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:49.659 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:49.659 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:49.659 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:49.660 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:49.660 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:49.660 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:49.660 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:49.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.667596  1240 tablet_bootstrap.cc:492] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd: No bootstrap required, opened a new log
08:07:49.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.671839  1240 ts_tablet_manager.cc:1403] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.004s
08:07:49.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.677063  1237 tablet_bootstrap.cc:492] T 6af20e293853422c9c0251eb17f65ebe P ff0efe9052574a8fb425700eee4efb00: No bootstrap required, opened a new log
08:07:49.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.677716  1237 ts_tablet_manager.cc:1403] T 6af20e293853422c9c0251eb17f65ebe P ff0efe9052574a8fb425700eee4efb00: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.000s
08:07:49.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.681988  1240 raft_consensus.cc:359] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } }
08:07:49.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.683357  1237 raft_consensus.cc:359] T 6af20e293853422c9c0251eb17f65ebe P ff0efe9052574a8fb425700eee4efb00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } }
08:07:49.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.684790  1237 raft_consensus.cc:385] T 6af20e293853422c9c0251eb17f65ebe P ff0efe9052574a8fb425700eee4efb00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:49.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.685233  1237 raft_consensus.cc:740] T 6af20e293853422c9c0251eb17f65ebe P ff0efe9052574a8fb425700eee4efb00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff0efe9052574a8fb425700eee4efb00, State: Initialized, Role: FOLLOWER
08:07:49.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.683943  1240 raft_consensus.cc:385] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:49.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.686200  1237 consensus_queue.cc:260] T 6af20e293853422c9c0251eb17f65ebe P ff0efe9052574a8fb425700eee4efb00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } }
08:07:49.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.687178  1240 raft_consensus.cc:740] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 253085249e36466eb1c769512f22e6cd, State: Initialized, Role: FOLLOWER
08:07:49.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.687707  1243 raft_consensus.cc:493] T 3977edf91b3a4033a50087f2384482d2 P ff0efe9052574a8fb425700eee4efb00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:07:49.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.688172  1243 raft_consensus.cc:515] T 3977edf91b3a4033a50087f2384482d2 P ff0efe9052574a8fb425700eee4efb00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } }
08:07:49.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.690251  1243 leader_election.cc:290] T 3977edf91b3a4033a50087f2384482d2 P ff0efe9052574a8fb425700eee4efb00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f355e70bcf64068abe0047310247ddf (127.31.233.193:44827), 253085249e36466eb1c769512f22e6cd (127.31.233.194:37469)
08:07:49.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.692292   925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3977edf91b3a4033a50087f2384482d2" candidate_uuid: "ff0efe9052574a8fb425700eee4efb00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "253085249e36466eb1c769512f22e6cd" is_pre_election: true
08:07:49.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.693039   925 raft_consensus.cc:2468] T 3977edf91b3a4033a50087f2384482d2 P 253085249e36466eb1c769512f22e6cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff0efe9052574a8fb425700eee4efb00 in term 0.
08:07:49.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.700544   782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3977edf91b3a4033a50087f2384482d2" candidate_uuid: "ff0efe9052574a8fb425700eee4efb00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f355e70bcf64068abe0047310247ddf" is_pre_election: true
08:07:49.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.701063  1002 leader_election.cc:304] T 3977edf91b3a4033a50087f2384482d2 P ff0efe9052574a8fb425700eee4efb00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 253085249e36466eb1c769512f22e6cd, ff0efe9052574a8fb425700eee4efb00; no voters: 
08:07:49.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.701380   782 raft_consensus.cc:2468] T 3977edf91b3a4033a50087f2384482d2 P 0f355e70bcf64068abe0047310247ddf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff0efe9052574a8fb425700eee4efb00 in term 0.
08:07:49.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.702273  1250 raft_consensus.cc:2804] T 3977edf91b3a4033a50087f2384482d2 P ff0efe9052574a8fb425700eee4efb00 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:07:49.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.702659  1250 raft_consensus.cc:493] T 3977edf91b3a4033a50087f2384482d2 P ff0efe9052574a8fb425700eee4efb00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:07:49.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.703022  1250 raft_consensus.cc:3060] T 3977edf91b3a4033a50087f2384482d2 P ff0efe9052574a8fb425700eee4efb00 [term 0 FOLLOWER]: Advancing to term 1
08:07:49.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.711555  1236 tablet_bootstrap.cc:492] T 6af20e293853422c9c0251eb17f65ebe P 0f355e70bcf64068abe0047310247ddf: No bootstrap required, opened a new log
08:07:49.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.712186  1236 ts_tablet_manager.cc:1403] T 6af20e293853422c9c0251eb17f65ebe P 0f355e70bcf64068abe0047310247ddf: Time spent bootstrapping tablet: real 0.093s	user 0.015s	sys 0.000s
08:07:49.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.718227  1236 raft_consensus.cc:359] T 6af20e293853422c9c0251eb17f65ebe P 0f355e70bcf64068abe0047310247ddf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } }
08:07:49.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.719012  1236 raft_consensus.cc:385] T 6af20e293853422c9c0251eb17f65ebe P 0f355e70bcf64068abe0047310247ddf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:49.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.719283  1236 raft_consensus.cc:740] T 6af20e293853422c9c0251eb17f65ebe P 0f355e70bcf64068abe0047310247ddf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f355e70bcf64068abe0047310247ddf, State: Initialized, Role: FOLLOWER
08:07:49.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.716511  1240 consensus_queue.cc:260] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } }
08:07:49.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.729060  1240 ts_tablet_manager.cc:1434] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.002s
08:07:49.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.731534  1236 consensus_queue.cc:260] T 6af20e293853422c9c0251eb17f65ebe P 0f355e70bcf64068abe0047310247ddf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } }
08:07:49.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.736074  1236 ts_tablet_manager.cc:1434] T 6af20e293853422c9c0251eb17f65ebe P 0f355e70bcf64068abe0047310247ddf: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.004s
08:07:49.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.753213   422 catalog_manager.cc:6241] T 00000000000000000000000000000000 P cbc9f25062774200bb25d9f92adb7a11: replication_test_table [id=8b349d67027848718b0fda44e6180d3c] alter complete (version 0)
08:07:49.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.716020  1250 raft_consensus.cc:515] T 3977edf91b3a4033a50087f2384482d2 P ff0efe9052574a8fb425700eee4efb00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } }
08:07:49.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.756021  1237 ts_tablet_manager.cc:1434] T 6af20e293853422c9c0251eb17f65ebe P ff0efe9052574a8fb425700eee4efb00: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.000s
08:07:49.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.758711   925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3977edf91b3a4033a50087f2384482d2" candidate_uuid: "ff0efe9052574a8fb425700eee4efb00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "253085249e36466eb1c769512f22e6cd"
08:07:49.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.759371   925 raft_consensus.cc:3060] T 3977edf91b3a4033a50087f2384482d2 P 253085249e36466eb1c769512f22e6cd [term 0 FOLLOWER]: Advancing to term 1
08:07:49.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.762423  1250 leader_election.cc:290] T 3977edf91b3a4033a50087f2384482d2 P ff0efe9052574a8fb425700eee4efb00 [CANDIDATE]: Term 1 election: Requested vote from peers 0f355e70bcf64068abe0047310247ddf (127.31.233.193:44827), 253085249e36466eb1c769512f22e6cd (127.31.233.194:37469)
08:07:49.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.780354   783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3977edf91b3a4033a50087f2384482d2" candidate_uuid: "ff0efe9052574a8fb425700eee4efb00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f355e70bcf64068abe0047310247ddf"
08:07:49.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.781453   783 raft_consensus.cc:3060] T 3977edf91b3a4033a50087f2384482d2 P 0f355e70bcf64068abe0047310247ddf [term 0 FOLLOWER]: Advancing to term 1
08:07:49.792 [DEBUG - main] (Connection.java:575) [peer master-127.31.46.252:40541(127.31.46.252:40541)] disconnecting while in state READY
08:07:49.793 [DEBUG - main] (Connection.java:575) [peer master-127.31.46.253:46697(127.31.46.253:46697)] disconnecting while in state READY
08:07:49.793 [DEBUG - main] (Connection.java:575) [peer master-127.31.46.254:45015(127.31.46.254:45015)] disconnecting while in state READY
08:07:49.794 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.31.46.252:40541(127.31.46.252:40541)] handling channelInactive
08:07:49.794 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state READY due to: connection closed
08:07:49.794 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.31.46.253:46697(127.31.46.253:46697)] handling channelInactive
08:07:49.795 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state READY due to: connection closed
08:07:49.795 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:49.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.797258   783 raft_consensus.cc:2468] T 3977edf91b3a4033a50087f2384482d2 P 0f355e70bcf64068abe0047310247ddf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0efe9052574a8fb425700eee4efb00 in term 1.
08:07:49.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.798785  1004 leader_election.cc:304] T 3977edf91b3a4033a50087f2384482d2 P ff0efe9052574a8fb425700eee4efb00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f355e70bcf64068abe0047310247ddf, ff0efe9052574a8fb425700eee4efb00; no voters: 
08:07:49.800 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-1
08:07:49.801 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-2
08:07:49.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.801534  1250 raft_consensus.cc:2804] T 3977edf91b3a4033a50087f2384482d2 P ff0efe9052574a8fb425700eee4efb00 [term 1 FOLLOWER]: Leader election won for term 1
08:07:49.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.802098  1250 raft_consensus.cc:697] T 3977edf91b3a4033a50087f2384482d2 P ff0efe9052574a8fb425700eee4efb00 [term 1 LEADER]: Becoming Leader. State: Replica: ff0efe9052574a8fb425700eee4efb00, State: Running, Role: LEADER
08:07:49.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.802992  1250 consensus_queue.cc:237] T 3977edf91b3a4033a50087f2384482d2 P ff0efe9052574a8fb425700eee4efb00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } }
08:07:49.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.806243   925 raft_consensus.cc:2468] T 3977edf91b3a4033a50087f2384482d2 P 253085249e36466eb1c769512f22e6cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0efe9052574a8fb425700eee4efb00 in term 1.
08:07:49.813 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.31.46.254:45015(127.31.46.254:45015)] handling channelInactive
08:07:49.813 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state READY due to: connection closed
08:07:49.813 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
08:07:49.814 [DEBUG - main] (Connection.java:575) [peer master-127.31.233.252:36101(127.31.233.252:36101)] disconnecting while in state READY
08:07:49.814 [DEBUG - main] (Connection.java:575) [peer master-127.31.233.254:35197(127.31.233.254:35197)] disconnecting while in state READY
08:07:49.814 [DEBUG - main] (Connection.java:575) [peer master-127.31.233.253:33393(127.31.233.253:33393)] disconnecting while in state READY
08:07:49.815 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.31.233.252:36101(127.31.233.252:36101)] handling channelInactive
08:07:49.815 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state READY due to: connection closed
08:07:49.815 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.31.233.254:35197(127.31.233.254:35197)] handling channelInactive
08:07:49.815 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state READY due to: connection closed
08:07:49.816 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:49.824 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:07:49.824 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-2
08:07:49.836 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.31.233.253:33393(127.31.233.253:33393)] handling channelInactive
08:07:49.836 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state READY due to: connection closed
08:07:49.836 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-1
08:07:49.838 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:07:49.839 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
08:07:49.839 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
08:07:49.839 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:07:49.839 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:07:49.839 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:07:49.844 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:49.844 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:49.844 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:49.844 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:49.844 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:49.845 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:49.845 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:49.845 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:49.845 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:49.846 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:49.846 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:49.846 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:49.846 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:49.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.846913   422 catalog_manager.cc:5696] T 3977edf91b3a4033a50087f2384482d2 P ff0efe9052574a8fb425700eee4efb00 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff0efe9052574a8fb425700eee4efb00 (127.31.233.195). New cstate: current_term: 1 leader_uuid: "ff0efe9052574a8fb425700eee4efb00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } health_report { overall_health: HEALTHY } } }
08:07:49.857 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
08:07:49.857 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
08:07:49.857 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
08:07:49.857 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
08:07:49.857 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
08:07:49.857 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
08:07:49.858 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
08:07:49.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.991044  1253 raft_consensus.cc:493] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:07:49.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.991751  1253 raft_consensus.cc:515] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } }
08:07:49.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.994894  1241 raft_consensus.cc:493] T 6af20e293853422c9c0251eb17f65ebe P 0f355e70bcf64068abe0047310247ddf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:07:49.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.995496  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af20e293853422c9c0251eb17f65ebe" candidate_uuid: "253085249e36466eb1c769512f22e6cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0efe9052574a8fb425700eee4efb00" is_pre_election: true
08:07:49.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.995434  1241 raft_consensus.cc:515] T 6af20e293853422c9c0251eb17f65ebe P 0f355e70bcf64068abe0047310247ddf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } }
08:07:49.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.996337  1068 raft_consensus.cc:2468] T 6af20e293853422c9c0251eb17f65ebe P ff0efe9052574a8fb425700eee4efb00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 253085249e36466eb1c769512f22e6cd in term 0.
08:07:49.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.998229   783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af20e293853422c9c0251eb17f65ebe" candidate_uuid: "253085249e36466eb1c769512f22e6cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f355e70bcf64068abe0047310247ddf" is_pre_election: true
08:07:49.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.998272   858 leader_election.cc:304] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 253085249e36466eb1c769512f22e6cd, ff0efe9052574a8fb425700eee4efb00; no voters: 
08:07:49.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.998883   783 raft_consensus.cc:2468] T 6af20e293853422c9c0251eb17f65ebe P 0f355e70bcf64068abe0047310247ddf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 253085249e36466eb1c769512f22e6cd in term 0.
08:07:49.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:49.997550  1241 leader_election.cc:290] T 6af20e293853422c9c0251eb17f65ebe P 0f355e70bcf64068abe0047310247ddf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 253085249e36466eb1c769512f22e6cd (127.31.233.194:37469), ff0efe9052574a8fb425700eee4efb00 (127.31.233.195:40161)
08:07:50.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.000447   925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af20e293853422c9c0251eb17f65ebe" candidate_uuid: "0f355e70bcf64068abe0047310247ddf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "253085249e36466eb1c769512f22e6cd" is_pre_election: true
08:07:50.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.001170  1279 raft_consensus.cc:2804] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd [term 0 FOLLOWER]: Leader pre-election won for term 1
08:07:50.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.002121  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af20e293853422c9c0251eb17f65ebe" candidate_uuid: "0f355e70bcf64068abe0047310247ddf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0efe9052574a8fb425700eee4efb00" is_pre_election: true
08:07:50.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.001835  1279 raft_consensus.cc:493] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:07:50.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.002369  1253 leader_election.cc:290] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f355e70bcf64068abe0047310247ddf (127.31.233.193:44827), ff0efe9052574a8fb425700eee4efb00 (127.31.233.195:40161)
08:07:50.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.003083  1068 raft_consensus.cc:2468] T 6af20e293853422c9c0251eb17f65ebe P ff0efe9052574a8fb425700eee4efb00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f355e70bcf64068abe0047310247ddf in term 0.
08:07:50.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.003187  1279 raft_consensus.cc:3060] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd [term 0 FOLLOWER]: Advancing to term 1
08:07:50.006 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:50.007 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:50.007 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:50.008 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:50.008 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:50.008 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:50.008 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:50.009 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:50.009 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:50.009 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:50.009 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:50.009 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:50.009 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:50.010 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:50.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.005263   713 leader_election.cc:304] T 6af20e293853422c9c0251eb17f65ebe P 0f355e70bcf64068abe0047310247ddf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f355e70bcf64068abe0047310247ddf, ff0efe9052574a8fb425700eee4efb00; no voters: 
08:07:50.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.006276  1241 raft_consensus.cc:2804] T 6af20e293853422c9c0251eb17f65ebe P 0f355e70bcf64068abe0047310247ddf [term 0 FOLLOWER]: Leader pre-election won for term 1
08:07:50.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.006616  1241 raft_consensus.cc:493] T 6af20e293853422c9c0251eb17f65ebe P 0f355e70bcf64068abe0047310247ddf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:07:50.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.007161  1241 raft_consensus.cc:3060] T 6af20e293853422c9c0251eb17f65ebe P 0f355e70bcf64068abe0047310247ddf [term 0 FOLLOWER]: Advancing to term 1
08:07:50.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.017377  1279 raft_consensus.cc:515] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } }
08:07:50.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.017673  1241 raft_consensus.cc:515] T 6af20e293853422c9c0251eb17f65ebe P 0f355e70bcf64068abe0047310247ddf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } }
08:07:50.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.019042   925 raft_consensus.cc:2393] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f355e70bcf64068abe0047310247ddf in current term 1: Already voted for candidate 253085249e36466eb1c769512f22e6cd in this term.
08:07:50.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.021780  1279 leader_election.cc:290] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd [CANDIDATE]: Term 1 election: Requested vote from peers 0f355e70bcf64068abe0047310247ddf (127.31.233.193:44827), ff0efe9052574a8fb425700eee4efb00 (127.31.233.195:40161)
08:07:50.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.022743   783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af20e293853422c9c0251eb17f65ebe" candidate_uuid: "253085249e36466eb1c769512f22e6cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f355e70bcf64068abe0047310247ddf"
08:07:50.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.022712  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af20e293853422c9c0251eb17f65ebe" candidate_uuid: "253085249e36466eb1c769512f22e6cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0efe9052574a8fb425700eee4efb00"
08:07:50.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.023365  1068 raft_consensus.cc:3060] T 6af20e293853422c9c0251eb17f65ebe P ff0efe9052574a8fb425700eee4efb00 [term 0 FOLLOWER]: Advancing to term 1
08:07:50.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.024853   783 raft_consensus.cc:2393] T 6af20e293853422c9c0251eb17f65ebe P 0f355e70bcf64068abe0047310247ddf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 253085249e36466eb1c769512f22e6cd in current term 1: Already voted for candidate 0f355e70bcf64068abe0047310247ddf in this term.
08:07:50.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.029706  1241 leader_election.cc:290] T 6af20e293853422c9c0251eb17f65ebe P 0f355e70bcf64068abe0047310247ddf [CANDIDATE]: Term 1 election: Requested vote from peers 253085249e36466eb1c769512f22e6cd (127.31.233.194:37469), ff0efe9052574a8fb425700eee4efb00 (127.31.233.195:40161)
08:07:50.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.030558  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af20e293853422c9c0251eb17f65ebe" candidate_uuid: "0f355e70bcf64068abe0047310247ddf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0efe9052574a8fb425700eee4efb00"
08:07:50.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.033488   925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af20e293853422c9c0251eb17f65ebe" candidate_uuid: "0f355e70bcf64068abe0047310247ddf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "253085249e36466eb1c769512f22e6cd"
08:07:50.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.034313   925 raft_consensus.cc:2393] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f355e70bcf64068abe0047310247ddf in current term 1: Already voted for candidate 253085249e36466eb1c769512f22e6cd in this term.
08:07:50.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.035494   714 leader_election.cc:304] T 6af20e293853422c9c0251eb17f65ebe P 0f355e70bcf64068abe0047310247ddf [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f355e70bcf64068abe0047310247ddf; no voters: 253085249e36466eb1c769512f22e6cd, ff0efe9052574a8fb425700eee4efb00
08:07:50.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.036963  1241 raft_consensus.cc:2749] T 6af20e293853422c9c0251eb17f65ebe P 0f355e70bcf64068abe0047310247ddf [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
08:07:50.038 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:50.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.047895  1068 raft_consensus.cc:2468] T 6af20e293853422c9c0251eb17f65ebe P ff0efe9052574a8fb425700eee4efb00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 253085249e36466eb1c769512f22e6cd in term 1.
08:07:50.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.049343   858 leader_election.cc:304] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 253085249e36466eb1c769512f22e6cd, ff0efe9052574a8fb425700eee4efb00; no voters: 0f355e70bcf64068abe0047310247ddf
08:07:50.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.050411  1279 raft_consensus.cc:2804] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd [term 1 FOLLOWER]: Leader election won for term 1
08:07:50.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.051437  1279 raft_consensus.cc:697] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd [term 1 LEADER]: Becoming Leader. State: Replica: 253085249e36466eb1c769512f22e6cd, State: Running, Role: LEADER
08:07:50.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.053337  1279 consensus_queue.cc:237] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } }
08:07:50.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.067677   422 catalog_manager.cc:5696] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 253085249e36466eb1c769512f22e6cd (127.31.233.194). New cstate: current_term: 1 leader_uuid: "253085249e36466eb1c769512f22e6cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
08:07:50.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:50.093324   368 debug-util.cc:398] Leaking SignalData structure 0x7b0800097380 after lost signal to thread 32766
08:07:50.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:50.094244   368 debug-util.cc:398] Leaking SignalData structure 0x7b080009c940 after lost signal to thread 371
08:07:50.111 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
08:07:50.151 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:50.173 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
08:07:50.173 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
08:07:50.173 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
08:07:50.190 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
08:07:50.194 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:50.194 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:50.195 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:50.195 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:50.196 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:50.196 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:50.197 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:50.197 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:50.197 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:50.198 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:50.198 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:50.198 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:50.198 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:50.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.301015  1243 consensus_queue.cc:1048] T 3977edf91b3a4033a50087f2384482d2 P ff0efe9052574a8fb425700eee4efb00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:07:50.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.338819  1243 consensus_queue.cc:1048] T 3977edf91b3a4033a50087f2384482d2 P ff0efe9052574a8fb425700eee4efb00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "253085249e36466eb1c769512f22e6cd" member_type: VOTER last_known_addr { host: "127.31.233.194" port: 37469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:07:50.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:50.462412  1282 log.cc:927] Time spent T 3977edf91b3a4033a50087f2384482d2 P 0f355e70bcf64068abe0047310247ddf: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
08:07:50.501 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:50.501 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:50.502 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:50.502 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:50.502 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:50.502 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:50.503 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:50.503 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:50.503 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:50.503 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:50.503 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:50.503 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:50.503 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:50.505 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:50.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.511258  1279 consensus_queue.cc:1048] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f355e70bcf64068abe0047310247ddf" member_type: VOTER last_known_addr { host: "127.31.233.193" port: 44827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:07:50.537 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:50.607 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:50.608 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:50.608 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:50.608 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:50.609 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:50.609 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:50.609 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:50.609 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:50.609 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:50.610 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:50.610 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:50.610 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:50.610 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:50.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:50.587671  1279 consensus_queue.cc:1048] T 6af20e293853422c9c0251eb17f65ebe P 253085249e36466eb1c769512f22e6cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0efe9052574a8fb425700eee4efb00" member_type: VOTER last_known_addr { host: "127.31.233.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
08:07:50.650 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:50.657 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:50.657 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:50.657 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:50.657 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:50.658 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:50.658 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:50.658 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:50.658 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:50.658 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:50.658 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:50.658 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:50.658 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:50.658 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:50.734 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:50.734 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:50.735 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:50.735 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:50.736 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:50.736 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:50.736 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:50.736 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:50.736 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:50.737 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:50.737 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:50.737 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:50.737 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:50.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:50.822974 32756 debug-util.cc:398] Leaking SignalData structure 0x7b0800074dc0 after lost signal to thread 32692
08:07:50.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:50.823912 32756 debug-util.cc:398] Leaking SignalData structure 0x7b08000ac560 after lost signal to thread 32759
08:07:50.952 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:50.952 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:50.952 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:50.954 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:50.954 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:50.954 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:50.955 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:50.955 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:50.955 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:50.955 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:50.955 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:50.955 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:50.956 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:50.965 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:50.965 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:50.965 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:50.966 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:50.966 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:50.966 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:50.967 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:50.967 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:50.967 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:50.968 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:50.968 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:50.968 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:50.968 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:51.005 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:51.037 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:51.151 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:51.252 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:51.252 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:51.252 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:51.253 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:51.253 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:51.253 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:51.253 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:51.253 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:51.253 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:51.253 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:51.254 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:51.254 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:51.254 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:51.271 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:51.271 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:51.271 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:51.272 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:51.272 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:51.272 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:51.272 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:51.272 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:51.272 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:51.272 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:51.272 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:51.272 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:51.272 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:51.284 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:51.285 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:51.285 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:51.285 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:51.285 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:51.286 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:51.287 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:51.287 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:51.287 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:51.287 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:51.287 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:51.287 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:51.287 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:51.506 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:51.537 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:51.651 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:51.679 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:51.680 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:51.680 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:51.680 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:51.680 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:51.680 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:51.680 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:51.680 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:51.681 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:51.681 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:51.681 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:51.681 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:51.681 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:51.712 [INFO - flink-pekko.actor.default-dispatcher-5] (Slf4jLogger.scala:117) Slf4jLogger started
08:07:51.730 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:51.731 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:51.731 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:51.731 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:51.731 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:51.731 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:51.732 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:51.732 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:51.732 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:51.736 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:51.736 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:51.736 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:51.737 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:51.944 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
08:07:51.974 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
08:07:52.006 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:52.030 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
08:07:52.037 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:52.055 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:52.055 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:52.056 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:52.057 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:52.057 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:52.057 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:52.057 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:52.057 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:52.057 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:52.058 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:52.058 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:52.058 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:52.058 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:52.072 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
08:07:52.111 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
08:07:52.123 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
08:07:52.124 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
08:07:52.124 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
08:07:52.125 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
08:07:52.126 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
08:07:52.126 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
08:07:52.126 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
08:07:52.127 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
08:07:52.127 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
08:07:52.128 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
08:07:52.128 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
08:07:52.128 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
08:07:52.129 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
08:07:52.129 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
08:07:52.129 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
08:07:52.129 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
08:07:52.129 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
08:07:52.129 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
08:07:52.129 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
08:07:52.138 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
08:07:52.138 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
08:07:52.140 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
08:07:52.140 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
08:07:52.140 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
08:07:52.141 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_c54423d60c67eb7fea53cdafc5676741/blobStorage
08:07:52.142 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:44577 - max concurrent requests: 50 - max backlog: 1000
08:07:52.143 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_c54423d60c67eb7fea53cdafc5676741/blobStorage
08:07:52.143 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_c54423d60c67eb7fea53cdafc5676741/blobStorage
08:07:52.151 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:52.151 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
08:07:52.151 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: c1befdc5-4ac6-48c0-985f-201fc5cdc5a6
08:07:52.154 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 37 GB (77.08% usable)
08:07:52.154 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-5bab6237-1fe6-4ef8-bfad-b826caae505a
08:07:52.167 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-8ecdb205-2618-47c7-8209-20789c67bac4
08:07:52.248 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
08:07:52.251 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
08:07:52.251 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
08:07:52.251 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
08:07:52.253 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
08:07:52.260 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_16 .
08:07:52.272 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultJobLeaderService.java:127) Start job leader service.
08:07:52.273 [INFO - flink-pekko.actor.default-dispatcher-5] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-f177b395-d13f-4441-8cc4-af6da02b65ea
08:07:52.274 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
08:07:52.275 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
08:07:52.301 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
08:07:52.301 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
08:07:52.327 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:37743
08:07:52.327 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
08:07:52.354 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:37743 was granted leadership with leaderSessionID=79653120-45da-45c8-9822-23ac17d2487b
08:07:52.354 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:37743 , session=79653120-45da-45c8-9822-23ac17d2487b
08:07:52.355 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
08:07:52.356 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
08:07:52.356 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
08:07:52.357 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id 7be68d30-4ddb-4952-8709-15474c329ecc. Creating new DispatcherLeaderProcess.
08:07:52.357 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
08:07:52.358 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
08:07:52.378 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
08:07:52.378 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
08:07:52.383 [INFO - mini-cluster-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_17 .
08:07:52.412 [INFO - pool-287-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id b1a47545-27bc-4d5a-a259-f4c6ee0d470d.
08:07:52.418 [INFO - pool-287-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_18 .
08:07:52.426 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_17 , session=7be68d30-4ddb-4952-8709-15474c329ecc
08:07:52.449 [INFO - flink-pekko.actor.default-dispatcher-7] (ResourceManager.java:253) Starting the resource manager.
08:07:52.456 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:212) Starting the slot manager.
08:07:52.457 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultDelegationTokenManager.java:308) Starting tokens update task
08:07:52.457 [WARN - flink-pekko.actor.default-dispatcher-7] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
08:07:52.457 [WARN - flink-pekko.actor.default-dispatcher-7] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
08:07:52.458 [INFO - mini-cluster-io-thread-3] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_18 , session=b1a47545-27bc-4d5a-a259-f4c6ee0d470d
08:07:52.460 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_18(a259f4c6ee0d470db1a4754527bc4d5a).
08:07:52.484 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:52.484 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:52.485 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:52.485 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:52.485 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:52.486 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:52.486 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:52.486 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:52.486 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:52.486 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:52.486 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:52.486 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:52.486 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:52.506 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:52.538 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:52.541 [INFO - flink-pekko.actor.default-dispatcher-9] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
08:07:52.551 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:1080) Registering TaskManager with ResourceID c1befdc5-4ac6-48c0-985f-201fc5cdc5a6 (pekko://flink/user/rpc/taskmanager_16) at ResourceManager
08:07:52.557 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_18 under registration id 45987df942bd5d6448dc4253e188f534.
08:07:52.558 [INFO - flink-pekko.actor.default-dispatcher-9] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (da74ffd3de6ba1563e412fcb34de5c51).
08:07:52.559 [INFO - flink-pekko.actor.default-dispatcher-9] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (da74ffd3de6ba1563e412fcb34de5c51).
08:07:52.559 [INFO - flink-pekko.actor.default-dispatcher-9] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-da74ffd3de6ba1563e412fcb34de5c51'.
08:07:52.559 [INFO - mini-cluster-io-thread-3] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job da74ffd3de6ba1563e412fcb34de5c51 was granted leadership with leader id 7f8bc45b-9f04-49b7-a0ff-951a40bd1c65. Creating new JobMasterServiceProcess.
08:07:52.566 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:344) Registering task executor c1befdc5-4ac6-48c0-985f-201fc5cdc5a6 under 45987df942bd5d6448dc4253e188f534 at the slot manager.
08:07:52.602 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_19 .
08:07:52.607 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (da74ffd3de6ba1563e412fcb34de5c51).
08:07:52.609 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (da74ffd3de6ba1563e412fcb34de5c51).
08:07:52.609 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph baaac68dc5a1babc7c9d5ca51e5178bb for job da74ffd3de6ba1563e412fcb34de5c51.
08:07:52.610 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (da74ffd3de6ba1563e412fcb34de5c51).
08:07:52.610 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
08:07:52.611 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
08:07:52.612 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@52db56a8
08:07:52.612 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:07:52.612 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5660276855152915670/checkpoints")
08:07:52.614 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
08:07:52.614 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@4783047c for Flink Streaming Job (da74ffd3de6ba1563e412fcb34de5c51).
08:07:52.622 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_19 , session=7f8bc45b-9f04-49b7-a0ff-951a40bd1c65
08:07:52.622 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (da74ffd3de6ba1563e412fcb34de5c51) under job master id a0ff951a40bd1c657f8bc45b9f0449b7.
08:07:52.623 [INFO - flink-pekko.actor.default-dispatcher-8] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
08:07:52.625 [DEBUG - flink-pekko.actor.default-dispatcher-8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:52.630 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
08:07:52.631 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (da74ffd3de6ba1563e412fcb34de5c51) switched from state CREATED to RUNNING.
08:07:52.632 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
08:07:52.633 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
08:07:52.634 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
08:07:52.634 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
08:07:52.635 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_18(a259f4c6ee0d470db1a4754527bc4d5a)
08:07:52.637 [INFO - flink-pekko.actor.default-dispatcher-8] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
08:07:52.638 [INFO - flink-pekko.actor.default-dispatcher-8] (ResourceManager.java:390) Registering job manager a0ff951a40bd1c657f8bc45b9f0449b7@pekko://flink/user/rpc/jobmanager_19 for job da74ffd3de6ba1563e412fcb34de5c51.
08:07:52.647 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:1015) Registered job manager a0ff951a40bd1c657f8bc45b9f0449b7@pekko://flink/user/rpc/jobmanager_19 for job da74ffd3de6ba1563e412fcb34de5c51.
08:07:52.651 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:52.652 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:52.658 [DEBUG - main] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:07:52.659 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:07:52.682 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: a259f4c6ee0d470db1a4754527bc4d5a.
08:07:52.683 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job da74ffd3de6ba1563e412fcb34de5c51: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:07:52.694 [DEBUG - main] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:07:52.697 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.31.233.254:35197(127.31.233.254:35197)] Successfully connected to peer
08:07:52.710 [DEBUG - main] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:07:52.714 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.31.233.253:33393(127.31.233.253:33393)] Successfully connected to peer
08:07:52.719 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.233.254
08:07:52.739 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:52.742 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job da74ffd3de6ba1563e412fcb34de5c51
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager c1befdc5-4ac6-48c0-985f-201fc5cdc5a6
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
08:07:52.743 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot e0ded49cc18cf9d68a3f4d967ddb5165 from c1befdc5-4ac6-48c0-985f-201fc5cdc5a6 for job da74ffd3de6ba1563e412fcb34de5c51 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:07:52.744 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot fc644b3daf65704dd575ddb1e126a17f from c1befdc5-4ac6-48c0-985f-201fc5cdc5a6 for job da74ffd3de6ba1563e412fcb34de5c51 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:07:52.744 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1149) Receive slot request e0ded49cc18cf9d68a3f4d967ddb5165 for job da74ffd3de6ba1563e412fcb34de5c51 from resource manager with leader id a259f4c6ee0d470db1a4754527bc4d5a.
08:07:52.744 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:321) Allocated slot for e0ded49cc18cf9d68a3f4d967ddb5165 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:07:52.745 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 9b941a5fbbbdb04dacdc14d5e09c626f from c1befdc5-4ac6-48c0-985f-201fc5cdc5a6 for job da74ffd3de6ba1563e412fcb34de5c51 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:07:52.745 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot a7a5d41ebc10c1cb065f8992e3a1fcb8 from c1befdc5-4ac6-48c0-985f-201fc5cdc5a6 for job da74ffd3de6ba1563e412fcb34de5c51 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:07:52.753 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.233.253
08:07:52.753 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:07:52.758 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:07:52.759 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.31.46.253:46697(127.31.46.253:46697)] Successfully connected to peer
08:07:52.774 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.31.46.252:40541(127.31.46.252:40541)] Successfully connected to peer
08:07:52.782 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.31.233.252:36101(127.31.233.252:36101)] Successfully connected to peer
08:07:52.788 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultJobLeaderService.java:192) Add job da74ffd3de6ba1563e412fcb34de5c51 for job leader monitoring.
08:07:52.789 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1149) Receive slot request fc644b3daf65704dd575ddb1e126a17f for job da74ffd3de6ba1563e412fcb34de5c51 from resource manager with leader id a259f4c6ee0d470db1a4754527bc4d5a.
08:07:52.789 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:321) Allocated slot for fc644b3daf65704dd575ddb1e126a17f with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:07:52.789 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1149) Receive slot request 9b941a5fbbbdb04dacdc14d5e09c626f for job da74ffd3de6ba1563e412fcb34de5c51 from resource manager with leader id a259f4c6ee0d470db1a4754527bc4d5a.
08:07:52.790 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:321) Allocated slot for 9b941a5fbbbdb04dacdc14d5e09c626f with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:07:52.789 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:52.790 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1149) Receive slot request a7a5d41ebc10c1cb065f8992e3a1fcb8 for job da74ffd3de6ba1563e412fcb34de5c51 from resource manager with leader id a259f4c6ee0d470db1a4754527bc4d5a.
08:07:52.790 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:321) Allocated slot for a7a5d41ebc10c1cb065f8992e3a1fcb8 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:07:52.791 [INFO - mini-cluster-io-thread-3] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_19 with leader id 7f8bc45b-9f04-49b7-a0ff-951a40bd1c65.
08:07:52.793 [INFO - flink-pekko.actor.default-dispatcher-5] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
08:07:52.795 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.233.252
08:07:52.796 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_19 for job da74ffd3de6ba1563e412fcb34de5c51.
08:07:52.796 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1783) Establish JobManager connection for job da74ffd3de6ba1563e412fcb34de5c51.
08:07:52.797 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1633) Offer reserved slots to the leader of job da74ffd3de6ba1563e412fcb34de5c51.
08:07:52.798 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
08:07:52.798 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to c1befdc5-4ac6-48c0-985f-201fc5cdc5a6 @ 127.0.0.1 (dataPort=-1) with allocation id 9b941a5fbbbdb04dacdc14d5e09c626f
08:07:52.799 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 9b941a5fbbbdb04dacdc14d5e09c626f.
08:07:52.799 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
08:07:52.799 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to c1befdc5-4ac6-48c0-985f-201fc5cdc5a6 @ 127.0.0.1 (dataPort=-1) with allocation id fc644b3daf65704dd575ddb1e126a17f
08:07:52.800 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job da74ffd3de6ba1563e412fcb34de5c51.
08:07:52.800 [INFO - flink-pekko.actor.default-dispatcher-9] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
08:07:52.800 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id da74ffd3de6ba1563e412fcb34de5c51
08:07:52.801 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
08:07:52.801 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to c1befdc5-4ac6-48c0-985f-201fc5cdc5a6 @ 127.0.0.1 (dataPort=-1) with allocation id a7a5d41ebc10c1cb065f8992e3a1fcb8
08:07:52.803 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 9b941a5fbbbdb04dacdc14d5e09c626f.
08:07:52.807 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
08:07:52.807 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to c1befdc5-4ac6-48c0-985f-201fc5cdc5a6 @ 127.0.0.1 (dataPort=-1) with allocation id e0ded49cc18cf9d68a3f4d967ddb5165
08:07:52.809 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xdbd7b5c2, L:/127.0.0.1:41720 - R:/127.31.233.253:33393] using SASL/PLAIN
08:07:52.816 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:52.817 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:52.817 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:52.818 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:52.818 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:52.818 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd603d7a7, L:/127.0.0.1:49564 - R:/127.31.233.254:35197] using SASL/PLAIN
08:07:52.818 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:52.818 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:52.819 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:52.819 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:52.817 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.31.46.254:45015(127.31.46.254:45015)] Successfully connected to peer
08:07:52.820 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:52.821 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:52.822 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:52.822 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:52.822 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:52.898 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:52.898 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:52.898 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:52.899 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.46.253
08:07:52.899 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:52.899 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:52.899 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:52.900 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:52.900 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:52.900 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:52.900 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:52.900 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:52.900 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:52.901 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:52.902 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot fc644b3daf65704dd575ddb1e126a17f.
08:07:52.904 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id fc644b3daf65704dd575ddb1e126a17f.
08:07:52.905 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x945f990e, L:/127.0.0.1:58318 - R:/127.31.233.252:36101] using SASL/PLAIN
08:07:52.909 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:07:52.909 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=269), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [157ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: OK, [166ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: OK, [250ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: OK, deferred=null) after lookup
08:07:52.914 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot a7a5d41ebc10c1cb065f8992e3a1fcb8.
08:07:52.916 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id a7a5d41ebc10c1cb065f8992e3a1fcb8.
08:07:52.917 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8b349d67027848718b0fda44e6180d3c
08:07:52.919 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
08:07:52.919 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
08:07:52.920 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5e169bea
08:07:52.920 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:07:52.920 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5660276855152915670/checkpoints")
08:07:52.921 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
08:07:52.922 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
08:07:52.925 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@335edee0
08:07:52.928 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 9b2648a42d214c22b00f99eb0cf6a10d for table 'replication_test_table' with partition [<start>, 0x80000064)
08:07:52.928 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3977edf91b3a4033a50087f2384482d2 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
08:07:52.928 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 6af20e293853422c9c0251eb17f65ebe for table 'replication_test_table' with partition [0x800000C8, <end>)
08:07:52.928 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.46.254
08:07:52.928 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=9b2648a42d214c22b00f99eb0cf6a10d@[0f355e70bcf64068abe0047310247ddf(127.31.233.193:44827),253085249e36466eb1c769512f22e6cd(127.31.233.194:37469),ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=3977edf91b3a4033a50087f2384482d2@[0f355e70bcf64068abe0047310247ddf(127.31.233.193:44827),253085249e36466eb1c769512f22e6cd(127.31.233.194:37469),ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=6af20e293853422c9c0251eb17f65ebe@[0f355e70bcf64068abe0047310247ddf(127.31.233.193:44827),253085249e36466eb1c769512f22e6cd(127.31.233.194:37469)[L],ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)]}]
08:07:52.928 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=10), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.233.252:36101, [9ms] Sub RPC GetTableLocations: received response from server master-127.31.233.252:36101: OK, deferred=null)) after lookup
08:07:52.929 [DEBUG - kudu-nio-2] (Connection.java:748) [peer ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)] connecting to peer
08:07:52.930 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 9b941a5fbbbdb04dacdc14d5e09c626f.
08:07:52.930 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot fc644b3daf65704dd575ddb1e126a17f.
08:07:52.930 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot a7a5d41ebc10c1cb065f8992e3a1fcb8.
08:07:52.930 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot e0ded49cc18cf9d68a3f4d967ddb5165.
08:07:52.930 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot e0ded49cc18cf9d68a3f4d967ddb5165.
08:07:52.932 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id e0ded49cc18cf9d68a3f4d967ddb5165.
08:07:52.932 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
08:07:52.932 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
08:07:52.933 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
08:07:52.933 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
08:07:52.933 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7d07fba6
08:07:52.933 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:07:52.934 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5660276855152915670/checkpoints")
08:07:52.934 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
08:07:52.935 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
08:07:52.933 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6daff0db
08:07:52.939 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:07:52.939 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5660276855152915670/checkpoints")
08:07:52.939 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
08:07:52.940 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
08:07:52.940 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2cedd6a3
08:07:52.942 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
08:07:52.942 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
08:07:52.943 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@64fa1e8d
08:07:52.943 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:07:52.943 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5660276855152915670/checkpoints")
08:07:52.943 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
08:07:52.944 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
08:07:52.952 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3436f650
08:07:52.955 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.46.252
08:07:52.960 [DEBUG - kudu-nio-3] (Connection.java:757) [peer ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)] Successfully connected to peer
08:07:52.966 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:52.972 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:52.978 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x89ffc415, L:/127.0.0.1:45416 - R:/127.31.46.253:46697] using SASL/PLAIN
08:07:52.978 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:52.982 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:52.987 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:52.988 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:07:52.988 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@280a1063
08:07:52.990 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:52.991 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:52.994 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x8b8a8118, L:/127.0.0.1:55140 - R:/127.31.46.254:45015] using SASL/PLAIN
08:07:52.998 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x4549fc0e, L:/127.0.0.1:38840 - R:/127.31.46.252:40541] using SASL/PLAIN
08:07:53.003 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:07:53.003 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=366), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [328ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: OK, [338ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: OK, [343ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: OK, deferred=null) after lookup
08:07:53.006 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:53.007 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 75171ad0cb2448e380e6b1e23553a1df
08:07:53.007 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:07:53.010 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:53.011 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 98ec5300665e4981b383fed816312f05 for table 'replication_test_table' with partition [<start>, 0x80000064)
08:07:53.011 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2647411043ab45458706fde51f0f7d18 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
08:07:53.011 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 19dc48939efd43049bf739035d3707d5 for table 'replication_test_table' with partition [0x800000C8, <end>)
08:07:53.012 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=98ec5300665e4981b383fed816312f05@[4a91936aa3fc4705a7fb8e2e53edf637(127.31.46.195:38219)[L],7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719),cdab818f784c43329a4a6a164a1cf7c3(127.31.46.194:39687)]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=2647411043ab45458706fde51f0f7d18@[4a91936aa3fc4705a7fb8e2e53edf637(127.31.46.195:38219),7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)[L],cdab818f784c43329a4a6a164a1cf7c3(127.31.46.194:39687)]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=19dc48939efd43049bf739035d3707d5@[4a91936aa3fc4705a7fb8e2e53edf637(127.31.46.195:38219),7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)[L],cdab818f784c43329a4a6a164a1cf7c3(127.31.46.194:39687)]}]
08:07:53.032 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x29795fbb, L:/127.0.0.1:53882 - R:/127.31.233.195:40161] using TOKEN/null
08:07:53.036 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:53.036 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:53.036 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:53.037 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:53.037 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:53.037 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:53.038 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:53.038 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:53.038 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:53.038 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:53.039 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:53.039 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:53.039 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:53.040 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:53.044 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:53.044 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:53.044 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:53.045 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:53.045 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:53.045 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:53.045 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:53.045 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:53.045 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:53.046 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:53.046 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:53.046 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:53.046 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:53.047 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:07:53.050 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.31.233.254:35197(127.31.233.254:35197)] Successfully connected to peer
08:07:53.055 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:53.055 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:53.055 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:53.056 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:53.056 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:53.056 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:53.056 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:53.056 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:53.056 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:53.056 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:53.056 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:53.056 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:53.056 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:53.057 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:07:53.060 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.233.254
08:07:53.077 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:07:53.083 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9b2648a42d214c22b00f99eb0cf6a10d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:53.083 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9b2648a42d214c22b00f99eb0cf6a10d for partition [<start>, 0x80000064) with scanner id null
08:07:53.091 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3977edf91b3a4033a50087f2384482d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:53.092 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3977edf91b3a4033a50087f2384482d2 for partition [0x80000064, 0x800000C8) with scanner id null
08:07:53.092 [DEBUG - main] (Connection.java:748) [peer 253085249e36466eb1c769512f22e6cd(127.31.233.194:37469)] connecting to peer
08:07:53.092 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:07:53.094 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.31.233.254:35197(127.31.233.254:35197)] Successfully connected to peer
08:07:53.099 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:07:53.103 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.31.233.253:33393(127.31.233.253:33393)] Successfully connected to peer
08:07:53.108 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:53.115 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.233.253
08:07:53.125 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.31.233.252:36101(127.31.233.252:36101)] Successfully connected to peer
08:07:53.131 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.233.254
08:07:53.131 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.233.252
08:07:53.137 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x427132cf, L:/127.0.0.1:49570 - R:/127.31.233.254:35197] using SASL/PLAIN
08:07:53.140 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:53.147 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:07:53.148 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x9f83becf, L:/127.0.0.1:49586 - R:/127.31.233.254:35197] using SASL/PLAIN
08:07:53.151 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:53.151 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:53.151 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:53.152 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:53.152 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:53.152 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:53.152 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:53.152 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:53.152 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:53.152 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:53.152 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:53.153 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:53.153 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:53.153 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:53.153 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:53.160 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.31.233.254:35197(127.31.233.254:35197)] Successfully connected to peer
08:07:53.168 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:53.170 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 253085249e36466eb1c769512f22e6cd(127.31.233.194:37469)] Successfully connected to peer
08:07:53.174 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.233.254
08:07:53.176 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:53.179 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xa20659dc, L:/127.0.0.1:41726 - R:/127.31.233.253:33393] using SASL/PLAIN
08:07:53.182 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:07:53.183 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.31.233.253:33393(127.31.233.253:33393)] Successfully connected to peer
08:07:53.186 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.233.253
08:07:53.191 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xd845ad56, L:/127.0.0.1:58328 - R:/127.31.233.252:36101] using SASL/PLAIN
08:07:53.199 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:07:53.199 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=216), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [173ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: OK, [197ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: OK, [207ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: OK, deferred=null) after lookup
08:07:53.203 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8b349d67027848718b0fda44e6180d3c
08:07:53.205 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:53.208 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8b349d67027848718b0fda44e6180d3c
08:07:53.208 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xc4786b8a, L:/127.0.0.1:41730 - R:/127.31.233.253:33393] using SASL/PLAIN
08:07:53.209 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@45b2272d
08:07:53.218 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
08:07:53.218 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
08:07:53.221 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:53.233 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:53.237 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0xc7304bea, L:/127.0.0.1:53384 - R:/127.31.233.194:37469] using TOKEN/null
08:07:53.239 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:07:53.243 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:53.243 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:53.244 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:53.244 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:53.244 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:53.244 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:53.244 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:53.244 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:53.244 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:53.245 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:53.245 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:53.245 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:53.245 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:53.246 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:07:53.247 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.31.233.253:33393(127.31.233.253:33393)] Successfully connected to peer
08:07:53.248 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.31.233.252:36101(127.31.233.252:36101)] Successfully connected to peer
08:07:53.249 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.31.233.254:35197(127.31.233.254:35197)] Successfully connected to peer
08:07:53.253 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.233.252
08:07:53.261 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xeb0cdb8d, L:/127.0.0.1:49594 - R:/127.31.233.254:35197] using SASL/PLAIN
08:07:53.262 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.233.254
08:07:53.269 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.233.253
08:07:53.272 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:53.278 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
08:07:53.279 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='43b0a8960a83b7930e12feff4f11d2db0f7c9aafe5adef6e372bc542f025a37d'}]
08:07:53.281 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:53.285 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:07:53.286 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:53.287 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xb1069e7c, L:/127.0.0.1:58344 - R:/127.31.233.252:36101] using SASL/PLAIN
08:07:53.296 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299994, tablet=98ec5300665e4981b383fed816312f05@[4a91936aa3fc4705a7fb8e2e53edf637(127.31.46.195:38219)[L],7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719),cdab818f784c43329a4a6a164a1cf7c3(127.31.46.194:39687)]}]
08:07:53.297 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:07:53.297 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=307), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [190ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [240ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: OK, deferred=null) after lookup
08:07:53.308 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x5e4699c7, L:/127.0.0.1:41746 - R:/127.31.233.253:33393] using SASL/PLAIN
08:07:53.312 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8b349d67027848718b0fda44e6180d3c
08:07:53.316 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8b349d67027848718b0fda44e6180d3c
08:07:53.316 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@95af952
08:07:53.318 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.31.233.252:36101(127.31.233.252:36101)] Successfully connected to peer
08:07:53.324 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:53.324 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6af20e293853422c9c0251eb17f65ebe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:53.325 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.233.252
08:07:53.326 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
08:07:53.330 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
08:07:53.331 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
08:07:53.343 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf31cb74d, L:/127.0.0.1:49608 - R:/127.31.233.254:35197] using SASL/PLAIN
08:07:53.349 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:07:53.351 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.31.233.253:33393(127.31.233.253:33393)] Successfully connected to peer
08:07:53.352 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:53.357 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xc9da31f8, L:/127.0.0.1:58348 - R:/127.31.233.252:36101] using SASL/PLAIN
08:07:53.360 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.233.253
08:07:53.360 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:07:53.360 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=373), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [153ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: OK, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [227ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: OK, [353ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: OK, deferred=null) after lookup
08:07:53.364 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.31.233.252:36101(127.31.233.252:36101)] Successfully connected to peer
08:07:53.365 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8b349d67027848718b0fda44e6180d3c
08:07:53.368 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8b349d67027848718b0fda44e6180d3c
08:07:53.369 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1e70028d
08:07:53.371 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
08:07:53.371 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
08:07:53.372 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.233.252
08:07:53.384 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:53.387 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9b2648a42d214c22b00f99eb0cf6a10d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:53.388 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9b2648a42d214c22b00f99eb0cf6a10d for partition [<start>, 0x80000064) with scanner id null
08:07:53.390 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xfa0e731f, L:/127.0.0.1:58364 - R:/127.31.233.252:36101] using SASL/PLAIN
08:07:53.393 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3977edf91b3a4033a50087f2384482d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:53.393 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3977edf91b3a4033a50087f2384482d2 for partition [0x80000064, 0x800000C8) with scanner id null
08:07:53.394 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:07:53.394 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=402), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [190ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: OK, [273ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [317ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: OK, deferred=null) after lookup
08:07:53.398 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8b349d67027848718b0fda44e6180d3c
08:07:53.401 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8b349d67027848718b0fda44e6180d3c
08:07:53.402 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6e553f5
08:07:53.404 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
08:07:53.404 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
08:07:53.409 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
08:07:53.409 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='ae9f33283e356cf5e17efb9909a2b64205247cf8f948946f5ad7820b628aaace'}]
08:07:53.414 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:53.425 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6af20e293853422c9c0251eb17f65ebe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:53.422 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:53.448 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xabd736d3, L:/127.0.0.1:41754 - R:/127.31.233.253:33393] using SASL/PLAIN
08:07:53.466 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
08:07:53.468 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='1f6c7b90a40798a4d7a954f2295e931ae6d60c765b837bba1539f26bf2367d14'}]
08:07:53.473 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:53.481 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9b2648a42d214c22b00f99eb0cf6a10d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:53.482 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9b2648a42d214c22b00f99eb0cf6a10d for partition [<start>, 0x80000064) with scanner id null
08:07:53.487 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3977edf91b3a4033a50087f2384482d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:53.487 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3977edf91b3a4033a50087f2384482d2 for partition [0x80000064, 0x800000C8) with scanner id null
08:07:53.499 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
08:07:53.501 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6af20e293853422c9c0251eb17f65ebe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:53.506 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:53.516 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
08:07:53.538 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:53.541 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:53.541 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:53.541 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:53.542 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:53.542 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:53.542 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:53.542 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:53.542 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:53.542 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:53.542 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:53.542 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:53.542 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:53.543 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:53.555 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] connecting to peer
08:07:53.559 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9b2648a42d214c22b00f99eb0cf6a10d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:53.559 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9b2648a42d214c22b00f99eb0cf6a10d for partition [<start>, 0x80000064) with scanner id null
08:07:53.567 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:07:53.569 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3977edf91b3a4033a50087f2384482d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:53.569 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3977edf91b3a4033a50087f2384482d2 for partition [0x80000064, 0x800000C8) with scanner id null
08:07:53.581 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6af20e293853422c9c0251eb17f65ebe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:53.586 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299994, tablet=19dc48939efd43049bf739035d3707d5@[4a91936aa3fc4705a7fb8e2e53edf637(127.31.46.195:38219),7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719),cdab818f784c43329a4a6a164a1cf7c3(127.31.46.194:39687)[L]]}]
08:07:53.591 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
08:07:53.591 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
08:07:53.604 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] Successfully connected to peer
08:07:53.613 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:07:53.615 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299994, tablet=2647411043ab45458706fde51f0f7d18@[4a91936aa3fc4705a7fb8e2e53edf637(127.31.46.195:38219),7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719),cdab818f784c43329a4a6a164a1cf7c3(127.31.46.194:39687)[L]]}]
08:07:53.618 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.46.193
08:07:53.640 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9b2648a42d214c22b00f99eb0cf6a10d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:53.640 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9b2648a42d214c22b00f99eb0cf6a10d for partition [<start>, 0x80000064) with scanner id null
08:07:53.647 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:53.650 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3977edf91b3a4033a50087f2384482d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:53.650 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091673649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:07:53.650 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3977edf91b3a4033a50087f2384482d2 for partition [0x80000064, 0x800000C8) with scanner id null
08:07:53.660 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:53.676 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6af20e293853422c9c0251eb17f65ebe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:53.693 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa54e55ab, L:/127.0.0.1:32796 - R:/127.31.46.193:43719] using SASL/PLAIN
08:07:53.734 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9b2648a42d214c22b00f99eb0cf6a10d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:53.735 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9b2648a42d214c22b00f99eb0cf6a10d for partition [<start>, 0x80000064) with scanner id null
08:07:53.743 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] connecting to peer
08:07:53.747 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3977edf91b3a4033a50087f2384482d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:53.748 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3977edf91b3a4033a50087f2384482d2 for partition [0x80000064, 0x800000C8) with scanner id null
08:07:53.756 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6af20e293853422c9c0251eb17f65ebe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:53.805 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false, responseScanTimestamp = 7287159491117056001) for scanner KuduScanner(table=replication_test_table, tablet=98ec5300665e4981b383fed816312f05, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:53.806 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [43b0a8960a83b7930e12feff4f11d2db0f7c9aafe5adef6e372bc542f025a37d]
08:07:53.807 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
08:07:53.832 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9b2648a42d214c22b00f99eb0cf6a10d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:53.832 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9b2648a42d214c22b00f99eb0cf6a10d for partition [<start>, 0x80000064) with scanner id null
08:07:53.842 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 9b2648a42d214c22b00f99eb0cf6a10d for table 'replication_test_table' with partition [<start>, 0x80000064)
08:07:53.842 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3977edf91b3a4033a50087f2384482d2 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
08:07:53.842 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 6af20e293853422c9c0251eb17f65ebe for table 'replication_test_table' with partition [0x800000C8, <end>)
08:07:53.842 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=9b2648a42d214c22b00f99eb0cf6a10d@[0f355e70bcf64068abe0047310247ddf(127.31.233.193:44827),253085249e36466eb1c769512f22e6cd(127.31.233.194:37469),ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=3977edf91b3a4033a50087f2384482d2@[0f355e70bcf64068abe0047310247ddf(127.31.233.193:44827),253085249e36466eb1c769512f22e6cd(127.31.233.194:37469),ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=6af20e293853422c9c0251eb17f65ebe@[0f355e70bcf64068abe0047310247ddf(127.31.233.193:44827),253085249e36466eb1c769512f22e6cd(127.31.233.194:37469)[L],ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)]}]
08:07:53.844 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 9b2648a42d214c22b00f99eb0cf6a10d for table 'replication_test_table' with partition [<start>, 0x80000064)
08:07:53.844 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3977edf91b3a4033a50087f2384482d2 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
08:07:53.844 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 6af20e293853422c9c0251eb17f65ebe for table 'replication_test_table' with partition [0x800000C8, <end>)
08:07:53.845 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=9b2648a42d214c22b00f99eb0cf6a10d@[0f355e70bcf64068abe0047310247ddf(127.31.233.193:44827),253085249e36466eb1c769512f22e6cd(127.31.233.194:37469),ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=3977edf91b3a4033a50087f2384482d2@[0f355e70bcf64068abe0047310247ddf(127.31.233.193:44827),253085249e36466eb1c769512f22e6cd(127.31.233.194:37469),ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=6af20e293853422c9c0251eb17f65ebe@[0f355e70bcf64068abe0047310247ddf(127.31.233.193:44827),253085249e36466eb1c769512f22e6cd(127.31.233.194:37469)[L],ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)]}]
08:07:53.845 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 9b2648a42d214c22b00f99eb0cf6a10d for table 'replication_test_table' with partition [<start>, 0x80000064)
08:07:53.845 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3977edf91b3a4033a50087f2384482d2 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
08:07:53.845 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 6af20e293853422c9c0251eb17f65ebe for table 'replication_test_table' with partition [0x800000C8, <end>)
08:07:53.846 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=9b2648a42d214c22b00f99eb0cf6a10d@[0f355e70bcf64068abe0047310247ddf(127.31.233.193:44827),253085249e36466eb1c769512f22e6cd(127.31.233.194:37469),ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=3977edf91b3a4033a50087f2384482d2@[0f355e70bcf64068abe0047310247ddf(127.31.233.193:44827),253085249e36466eb1c769512f22e6cd(127.31.233.194:37469),ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=6af20e293853422c9c0251eb17f65ebe@[0f355e70bcf64068abe0047310247ddf(127.31.233.193:44827),253085249e36466eb1c769512f22e6cd(127.31.233.194:37469)[L],ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)]}]
08:07:53.846 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 9b2648a42d214c22b00f99eb0cf6a10d for table 'replication_test_table' with partition [<start>, 0x80000064)
08:07:53.846 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3977edf91b3a4033a50087f2384482d2 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
08:07:53.846 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 6af20e293853422c9c0251eb17f65ebe for table 'replication_test_table' with partition [0x800000C8, <end>)
08:07:53.846 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=9b2648a42d214c22b00f99eb0cf6a10d@[0f355e70bcf64068abe0047310247ddf(127.31.233.193:44827),253085249e36466eb1c769512f22e6cd(127.31.233.194:37469),ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=3977edf91b3a4033a50087f2384482d2@[0f355e70bcf64068abe0047310247ddf(127.31.233.193:44827),253085249e36466eb1c769512f22e6cd(127.31.233.194:37469),ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=6af20e293853422c9c0251eb17f65ebe@[0f355e70bcf64068abe0047310247ddf(127.31.233.193:44827),253085249e36466eb1c769512f22e6cd(127.31.233.194:37469)[L],ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)]}]
08:07:53.848 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 9b2648a42d214c22b00f99eb0cf6a10d for table 'replication_test_table' with partition [<start>, 0x80000064)
08:07:53.848 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3977edf91b3a4033a50087f2384482d2 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
08:07:53.848 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 6af20e293853422c9c0251eb17f65ebe for table 'replication_test_table' with partition [0x800000C8, <end>)
08:07:53.848 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=9b2648a42d214c22b00f99eb0cf6a10d@[0f355e70bcf64068abe0047310247ddf(127.31.233.193:44827),253085249e36466eb1c769512f22e6cd(127.31.233.194:37469),ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=3977edf91b3a4033a50087f2384482d2@[0f355e70bcf64068abe0047310247ddf(127.31.233.193:44827),253085249e36466eb1c769512f22e6cd(127.31.233.194:37469),ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=6af20e293853422c9c0251eb17f65ebe@[0f355e70bcf64068abe0047310247ddf(127.31.233.193:44827),253085249e36466eb1c769512f22e6cd(127.31.233.194:37469)[L],ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)]}]
08:07:53.849 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [43b0a8960a83b7930e12feff4f11d2db0f7c9aafe5adef6e372bc542f025a37d]
08:07:53.855 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 43b0a8960a83b7930e12feff4f11d2db0f7c9aafe5adef6e372bc542f025a37d finished by subtask 1; deferring removal (restored in pending)
08:07:53.855 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
08:07:53.855 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
08:07:53.856 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] disconnecting while in state READY
08:07:53.857 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:53.861 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3977edf91b3a4033a50087f2384482d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:53.861 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3977edf91b3a4033a50087f2384482d2 for partition [0x80000064, 0x800000C8) with scanner id null
08:07:53.868 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6af20e293853422c9c0251eb17f65ebe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:53.897 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job da74ffd3de6ba1563e412fcb34de5c51 (2868 bytes, checkpointDuration=247 ms, finalizationTime=0 ms).
08:07:53.899 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
08:07:53.899 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 43b0a8960a83b7930e12feff4f11d2db0f7c9aafe5adef6e372bc542f025a37d from pending
08:07:53.899 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 1 finished splits from enumerator state
08:07:53.905 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] connecting to peer
08:07:53.928 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] Successfully connected to peer
08:07:53.928 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9b2648a42d214c22b00f99eb0cf6a10d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:53.928 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9b2648a42d214c22b00f99eb0cf6a10d for partition [<start>, 0x80000064) with scanner id null
08:07:53.944 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3977edf91b3a4033a50087f2384482d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:53.944 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3977edf91b3a4033a50087f2384482d2 for partition [0x80000064, 0x800000C8) with scanner id null
08:07:53.959 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6af20e293853422c9c0251eb17f65ebe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:53.964 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.46.193
08:07:53.989 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] handling channelInactive
08:07:53.989 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] cleaning up while in state READY due to: connection closed
08:07:53.990 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:07:53.990 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
08:07:54.005 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:54.025 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9b2648a42d214c22b00f99eb0cf6a10d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.025 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9b2648a42d214c22b00f99eb0cf6a10d for partition [<start>, 0x80000064) with scanner id null
08:07:54.027 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] Successfully connected to peer
08:07:54.034 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3977edf91b3a4033a50087f2384482d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.034 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3977edf91b3a4033a50087f2384482d2 for partition [0x80000064, 0x800000C8) with scanner id null
08:07:54.038 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:54.040 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.46.193
08:07:54.042 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6af20e293853422c9c0251eb17f65ebe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.049 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:54.058 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:54.066 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x703b347a, L:/127.0.0.1:32798 - R:/127.31.46.193:43719] using SASL/PLAIN
08:07:54.067 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x18e58e2f, L:/127.0.0.1:32808 - R:/127.31.46.193:43719] using SASL/PLAIN
08:07:54.074 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:54.075 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:54.075 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:54.075 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:54.075 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:54.076 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:54.076 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:54.076 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:54.076 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:54.077 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:54.079 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:54.079 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:54.079 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:54.115 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9b2648a42d214c22b00f99eb0cf6a10d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.115 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9b2648a42d214c22b00f99eb0cf6a10d for partition [<start>, 0x80000064) with scanner id null
08:07:54.126 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3977edf91b3a4033a50087f2384482d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.127 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3977edf91b3a4033a50087f2384482d2 for partition [0x80000064, 0x800000C8) with scanner id null
08:07:54.136 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159491117056001) for scanner KuduScanner(table=replication_test_table, tablet=19dc48939efd43049bf739035d3707d5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.137 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [1f6c7b90a40798a4d7a954f2295e931ae6d60c765b837bba1539f26bf2367d14]
08:07:54.138 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [1f6c7b90a40798a4d7a954f2295e931ae6d60c765b837bba1539f26bf2367d14]
08:07:54.138 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
08:07:54.138 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
08:07:54.140 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 1f6c7b90a40798a4d7a954f2295e931ae6d60c765b837bba1539f26bf2367d14 finished by subtask 2; deferring removal (restored in pending)
08:07:54.140 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] disconnecting while in state READY
08:07:54.142 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:54.143 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159491117056001) for scanner KuduScanner(table=replication_test_table, tablet=2647411043ab45458706fde51f0f7d18, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.144 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [ae9f33283e356cf5e17efb9909a2b64205247cf8f948946f5ad7820b628aaace]
08:07:54.144 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [ae9f33283e356cf5e17efb9909a2b64205247cf8f948946f5ad7820b628aaace]
08:07:54.144 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
08:07:54.144 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
08:07:54.145 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] disconnecting while in state READY
08:07:54.145 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split ae9f33283e356cf5e17efb9909a2b64205247cf8f948946f5ad7820b628aaace finished by subtask 3; deferring removal (restored in pending)
08:07:54.150 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091674149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:07:54.151 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:54.151 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:54.154 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=15, operationSize=950, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@4d9af6d, flushNotification=Deferred@121097376(state=PENDING, result=null, callback=<none>, errback=<none>)}
08:07:54.155 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)] connecting to peer
08:07:54.161 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6af20e293853422c9c0251eb17f65ebe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.235 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:54.235 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:54.236 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:54.237 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:54.237 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:54.237 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:54.237 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:54.237 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:54.237 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:54.239 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:54.239 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:54.239 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:54.239 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:54.258 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:54.259 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:54.259 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:54.259 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:54.259 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:54.259 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:54.259 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:54.259 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:54.259 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:54.259 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:54.259 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:54.259 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:54.260 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:54.294 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:54.295 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:54.295 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:54.296 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:54.296 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:54.296 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:54.296 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:54.296 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:54.296 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:54.296 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:54.296 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:54.296 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:54.296 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:54.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:54.370296  1004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.31.233.193:44827, user_credentials={real_user=slave}} blocked reactor thread for 117499us
08:07:54.382 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9b2648a42d214c22b00f99eb0cf6a10d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.383 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9b2648a42d214c22b00f99eb0cf6a10d for partition [<start>, 0x80000064) with scanner id null
08:07:54.384 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:54.384 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:54.384 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:54.385 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:54.385 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:54.385 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:54.386 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:54.387 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:54.387 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:54.387 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:54.387 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:54.387 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:54.387 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:54.397 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] handling channelInactive
08:07:54.397 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] cleaning up while in state READY due to: connection closed
08:07:54.398 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:07:54.398 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
08:07:54.404 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:54.404 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:54.405 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:54.405 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3977edf91b3a4033a50087f2384482d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.406 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:54.406 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:54.406 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:54.406 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:54.406 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:54.406 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:54.407 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:54.407 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:54.407 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:54.407 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:54.407 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3977edf91b3a4033a50087f2384482d2 for partition [0x80000064, 0x800000C8) with scanner id null
08:07:54.409 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] handling channelInactive
08:07:54.410 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] cleaning up while in state READY due to: connection closed
08:07:54.410 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:07:54.410 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
08:07:54.417 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6af20e293853422c9c0251eb17f65ebe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.423 [DEBUG - kudu-nio-3] (Connection.java:757) [peer ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)] Successfully connected to peer
08:07:54.454 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:54.455 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:54.455 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:54.455 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:54.455 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:54.455 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:54.456 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:54.456 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:54.456 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:54.455 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:54.457 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:54.457 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:54.457 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:54.465 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:54.469 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x2227126e, L:/127.0.0.1:53890 - R:/127.31.233.195:40161] using TOKEN/null
08:07:54.475 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9b2648a42d214c22b00f99eb0cf6a10d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.475 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9b2648a42d214c22b00f99eb0cf6a10d for partition [<start>, 0x80000064) with scanner id null
08:07:54.482 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3977edf91b3a4033a50087f2384482d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.482 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3977edf91b3a4033a50087f2384482d2 for partition [0x80000064, 0x800000C8) with scanner id null
08:07:54.488 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6af20e293853422c9c0251eb17f65ebe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.505 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:54.536 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:54.537 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:54.537 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:54.537 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:54.538 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:54.538 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:54.538 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:54.538 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:54.538 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:54.538 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:54.538 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:54.538 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:54.538 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:54.539 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:54.544 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:54.544 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:54.544 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:54.545 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9b2648a42d214c22b00f99eb0cf6a10d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.545 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9b2648a42d214c22b00f99eb0cf6a10d for partition [<start>, 0x80000064) with scanner id null
08:07:54.546 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:54.546 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:54.546 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:54.546 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:54.546 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:54.546 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:54.547 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:54.547 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:54.547 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:54.547 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:54.552 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3977edf91b3a4033a50087f2384482d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.553 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3977edf91b3a4033a50087f2384482d2 for partition [0x80000064, 0x800000C8) with scanner id null
08:07:54.560 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6af20e293853422c9c0251eb17f65ebe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.618 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9b2648a42d214c22b00f99eb0cf6a10d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.618 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9b2648a42d214c22b00f99eb0cf6a10d for partition [<start>, 0x80000064) with scanner id null
08:07:54.625 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3977edf91b3a4033a50087f2384482d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.626 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3977edf91b3a4033a50087f2384482d2 for partition [0x80000064, 0x800000C8) with scanner id null
08:07:54.632 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6af20e293853422c9c0251eb17f65ebe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.646 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job e26b904229418d0e047d5d94c5b9f905 from Checkpoint 76 @ 1779091546865 for e26b904229418d0e047d5d94c5b9f905 located at file:/tmp/junit16937918701930502306/checkpoints/e26b904229418d0e047d5d94c5b9f905/chk-76.
08:07:54.647 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
08:07:54.647 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to SCHEDULED.
08:07:54.649 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from SCHEDULED to DEPLOYING.
08:07:54.649 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #5) with attempt id 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1) with allocation id 0f1066b174fb1f271b9fbb4939140659
08:07:54.649 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 76 for source Source: KuduSource to checkpoint.
08:07:54.649 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskSlotTableImpl.java:391) Activate slot 0f1066b174fb1f271b9fbb4939140659.
08:07:54.650 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:54.651 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#5 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_5), deploy into slot with allocation id 0f1066b174fb1f271b9fbb4939140659.
08:07:54.651 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:07:54.652 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (e26b904229418d0e047d5d94c5b9f905) switched from state RESTARTING to RUNNING.
08:07:54.654 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job e26b904229418d0e047d5d94c5b9f905 from Checkpoint 76 @ 1779091546865 for e26b904229418d0e047d5d94c5b9f905 located at file:/tmp/junit16937918701930502306/checkpoints/e26b904229418d0e047d5d94c5b9f905/chk-76.
08:07:54.655 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
08:07:54.655 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 2 to checkpoint 76 for source Source: KuduSource to checkpoint.
08:07:54.655 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CREATED to SCHEDULED.
08:07:54.656 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:07:54.657 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from SCHEDULED to DEPLOYING.
08:07:54.657 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #5) with attempt id 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1) with allocation id bc35714883422bae5e4de5056d4b8678
08:07:54.666 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskSlotTableImpl.java:391) Activate slot bc35714883422bae5e4de5056d4b8678.
08:07:54.668 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#5 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_5), deploy into slot with allocation id bc35714883422bae5e4de5056d4b8678.
08:07:54.682 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to DEPLOYING.
08:07:54.682 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#5 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_5) [DEPLOYING].
08:07:54.689 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9b2648a42d214c22b00f99eb0cf6a10d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.690 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9b2648a42d214c22b00f99eb0cf6a10d for partition [<start>, 0x80000064) with scanner id null
08:07:54.701 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3977edf91b3a4033a50087f2384482d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.701 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3977edf91b3a4033a50087f2384482d2 for partition [0x80000064, 0x800000C8) with scanner id null
08:07:54.711 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6af20e293853422c9c0251eb17f65ebe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.734 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CREATED to DEPLOYING.
08:07:54.734 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#5 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_5) [DEPLOYING].
08:07:54.735 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3a146200
08:07:54.735 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:07:54.737 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16937918701930502306/checkpoints")
08:07:54.737 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from DEPLOYING to INITIALIZING.
08:07:54.738 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from DEPLOYING to INITIALIZING.
08:07:54.738 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@716d6633
08:07:54.738 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:07:54.739 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16937918701930502306/checkpoints")
08:07:54.739 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
08:07:54.739 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
08:07:54.784 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9b2648a42d214c22b00f99eb0cf6a10d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.784 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9b2648a42d214c22b00f99eb0cf6a10d for partition [<start>, 0x80000064) with scanner id null
08:07:54.790 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3977edf91b3a4033a50087f2384482d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.791 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3977edf91b3a4033a50087f2384482d2 for partition [0x80000064, 0x800000C8) with scanner id null
08:07:54.797 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6af20e293853422c9c0251eb17f65ebe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.820 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6fe544d6
08:07:54.823 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:54.840 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2747de37
08:07:54.843 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:54.869 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:54.875 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:54.878 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:54.878 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:54.878 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:54.892 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:54.893 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:54.893 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:54.900 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:54.902 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:54.902 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:54.903 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:54.903 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:54.908 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:54.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:54.923 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:54.928 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9b2648a42d214c22b00f99eb0cf6a10d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.928 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9b2648a42d214c22b00f99eb0cf6a10d for partition [<start>, 0x80000064) with scanner id null
08:07:54.934 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job da74ffd3de6ba1563e412fcb34de5c51 (2236 bytes, checkpointDuration=785 ms, finalizationTime=0 ms).
08:07:54.936 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
08:07:54.936 [INFO - Checkpoint Timer] (CheckpointRequestDecider.java:220) checkpoint request time in queue: 287
08:07:54.936 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 1f6c7b90a40798a4d7a954f2295e931ae6d60c765b837bba1539f26bf2367d14 from pending
08:07:54.936 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split ae9f33283e356cf5e17efb9909a2b64205247cf8f948946f5ad7820b628aaace from pending
08:07:54.936 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 2 complete: removed 2 finished splits from enumerator state
08:07:54.937 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091674936 for job da74ffd3de6ba1563e412fcb34de5c51.
08:07:54.946 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3977edf91b3a4033a50087f2384482d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.946 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3977edf91b3a4033a50087f2384482d2 for partition [0x80000064, 0x800000C8) with scanner id null
08:07:54.953 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6af20e293853422c9c0251eb17f65ebe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:54.955 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=19 ms, finalizationTime=0 ms).
08:07:54.957 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
08:07:54.962 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:54.963 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:54.963 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:54.963 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:54.964 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:54.964 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:54.965 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:54.965 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:54.965 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:54.966 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:54.966 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:54.966 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:54.998 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:54.999 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:54.999 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.004 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:55.005 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:55.012 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:55.014 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9b2648a42d214c22b00f99eb0cf6a10d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:55.014 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9b2648a42d214c22b00f99eb0cf6a10d for partition [<start>, 0x80000064) with scanner id null
08:07:55.014 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.015 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.015 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.021 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3977edf91b3a4033a50087f2384482d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:55.022 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3977edf91b3a4033a50087f2384482d2 for partition [0x80000064, 0x800000C8) with scanner id null
08:07:55.023 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:55.024 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.024 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.024 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.024 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:55.028 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:55.031 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6af20e293853422c9c0251eb17f65ebe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:55.036 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 75171ad0cb2448e380e6b1e23553a1df
08:07:55.037 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:55.037 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:55.038 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.039 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.039 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.040 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8b349d67027848718b0fda44e6180d3c
08:07:55.044 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 75171ad0cb2448e380e6b1e23553a1df
08:07:55.044 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:55.046 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.046 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.046 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.047 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8b349d67027848718b0fda44e6180d3c
08:07:55.053 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 75171ad0cb2448e380e6b1e23553a1df
08:07:55.056 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8b349d67027848718b0fda44e6180d3c
08:07:55.076 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:55.080 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.080 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.080 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.081 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:55.082 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.082 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.082 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.082 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:55.083 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:55.083 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:55.084 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:55.084 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:55.084 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:55.084 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:55.084 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:55.084 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:55.085 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:55.085 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:55.085 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:55.085 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:55.085 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.085 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.086 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.086 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:55.086 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.087 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:55.087 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.087 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.087 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:55.087 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:55.087 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:55.088 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:55.088 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:55.088 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:55.089 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:55.089 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:55.089 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:55.090 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:55.090 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:55.090 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:55.090 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:55.103 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:55.103 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:55.104 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:55.104 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.104 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.104 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.104 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.104 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.105 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.104 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.105 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.105 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.105 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:55.108 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:55.122 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:55.122 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:55.123 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:55.123 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.123 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.123 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.123 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.123 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.123 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.124 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.124 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.124 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.124 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:55.150 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091675149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:07:55.151 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:55.161 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
08:07:55.161 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:55.162 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:55.162 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:55.163 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:55.163 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.163 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.164 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.164 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
08:07:55.164 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.164 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.165 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.165 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.165 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.165 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.165 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:55.165 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:55.166 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.166 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.166 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.166 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.167 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.167 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=98ec5300665e4981b383fed816312f05, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:55.167 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 98ec5300665e4981b383fed816312f05 for partition [<start>, 0x80000064) with scanner id null
08:07:55.167 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.168 [DEBUG - main] (Connection.java:748) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] connecting to peer
08:07:55.168 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.168 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.168 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.168 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:55.182 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:55.183 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:55.183 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:55.183 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.183 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.183 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.184 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.184 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.184 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.184 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.184 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.184 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.184 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:55.186 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] Successfully connected to peer
08:07:55.188 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:55.188 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:55.188 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:55.189 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.189 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.189 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.189 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.189 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.189 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.189 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.189 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.190 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.190 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:55.208 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:55.209 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:55.209 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:55.210 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.210 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.210 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.210 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.210 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.210 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.211 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.211 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.211 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.211 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:55.249 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:55.249 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:55.249 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:55.250 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.250 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.250 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.251 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.251 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.251 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.251 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.251 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.251 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.251 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:55.255 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:55.260 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x86baa848, L:/127.0.0.1:32816 - R:/127.31.46.193:43719] using TOKEN/null
08:07:55.263 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:55.263 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:55.263 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:55.264 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.264 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.264 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.265 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.265 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.265 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.265 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.265 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.265 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.266 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:55.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:55.280292 32665 debug-util.cc:398] Leaking SignalData structure 0x7b08000ccf80 after lost signal to thread 32539
08:07:55.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:55.281859 32665 debug-util.cc:398] Leaking SignalData structure 0x7b08000b5180 after lost signal to thread 32668
08:07:55.289 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:55.289 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:55.289 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:55.290 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.290 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.290 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.291 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.291 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.291 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.291 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.291 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.291 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.292 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:55.294 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2647411043ab45458706fde51f0f7d18, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:55.296 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2647411043ab45458706fde51f0f7d18 for partition [0x80000064, 0x800000C8) with scanner id null
08:07:55.304 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=19dc48939efd43049bf739035d3707d5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:55.316 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9b2648a42d214c22b00f99eb0cf6a10d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:55.317 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9b2648a42d214c22b00f99eb0cf6a10d for partition [<start>, 0x80000064) with scanner id null
08:07:55.323 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3977edf91b3a4033a50087f2384482d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:55.324 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3977edf91b3a4033a50087f2384482d2 for partition [0x80000064, 0x800000C8) with scanner id null
08:07:55.330 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6af20e293853422c9c0251eb17f65ebe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:55.350 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=98ec5300665e4981b383fed816312f05, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:55.350 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 98ec5300665e4981b383fed816312f05 for partition [<start>, 0x80000064) with scanner id null
08:07:55.368 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:55.368 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:55.368 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:55.369 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.369 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.369 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.370 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.370 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.370 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.370 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.370 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.371 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.371 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:55.382 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2647411043ab45458706fde51f0f7d18, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:55.382 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2647411043ab45458706fde51f0f7d18 for partition [0x80000064, 0x800000C8) with scanner id null
08:07:55.392 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=19dc48939efd43049bf739035d3707d5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:55.414 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:55.433 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9b2648a42d214c22b00f99eb0cf6a10d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:55.433 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 9b2648a42d214c22b00f99eb0cf6a10d for partition [<start>, 0x80000064) with scanner id null
08:07:55.443 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3977edf91b3a4033a50087f2384482d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:55.443 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3977edf91b3a4033a50087f2384482d2 for partition [0x80000064, 0x800000C8) with scanner id null
08:07:55.454 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6af20e293853422c9c0251eb17f65ebe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:55.454 [DEBUG - main] (Connection.java:575) [peer master-127.31.233.252:36101(127.31.233.252:36101)] disconnecting while in state READY
08:07:55.455 [DEBUG - main] (Connection.java:575) [peer ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)] disconnecting while in state READY
08:07:55.455 [DEBUG - main] (Connection.java:575) [peer master-127.31.233.254:35197(127.31.233.254:35197)] disconnecting while in state READY
08:07:55.455 [DEBUG - main] (Connection.java:575) [peer master-127.31.233.253:33393(127.31.233.253:33393)] disconnecting while in state READY
08:07:55.455 [DEBUG - main] (Connection.java:575) [peer 253085249e36466eb1c769512f22e6cd(127.31.233.194:37469)] disconnecting while in state READY
08:07:55.455 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.31.233.252:36101(127.31.233.252:36101)] handling channelInactive
08:07:55.455 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.31.233.254:35197(127.31.233.254:35197)] handling channelInactive
08:07:55.455 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state READY due to: connection closed
08:07:55.455 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state READY due to: connection closed
08:07:55.459 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 253085249e36466eb1c769512f22e6cd(127.31.233.194:37469)] handling channelInactive
08:07:55.459 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 253085249e36466eb1c769512f22e6cd(127.31.233.194:37469)] cleaning up while in state READY due to: connection closed
08:07:55.455 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.31.233.253:33393(127.31.233.253:33393)] handling channelInactive
08:07:55.460 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state READY due to: connection closed
08:07:55.461 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:55.462 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:07:55.462 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-2
08:07:55.462 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-1
08:07:55.463 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-4
08:07:55.468 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:55.469 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:55.469 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:55.470 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.470 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.470 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.471 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.471 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.471 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.471 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.471 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.471 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.472 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:55.478 [DEBUG - kudu-nio-3] (Connection.java:239) [peer ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)] handling channelInactive
08:07:55.478 [DEBUG - kudu-nio-3] (Connection.java:709) [peer ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)] cleaning up while in state READY due to: connection closed
08:07:55.478 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
08:07:55.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:55.479745 32679 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 534
08:07:55.504 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:55.505 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:55.505 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:55.505 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:55.506 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.506 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.506 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.506 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.506 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.506 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.507 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.507 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.507 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.507 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:55.537 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:55.563 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:55.564 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:55.564 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:55.565 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.565 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.565 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.565 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.565 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.565 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.566 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.566 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.566 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.566 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:55.574 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:55.575 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:55.575 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:55.576 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:55.576 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:55.576 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:55.576 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:55.577 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:55.577 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:55.578 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:55.578 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:55.578 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:55.578 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:55.651 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091675649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:07:55.652 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:55.663 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
08:07:55.665 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
08:07:55.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:55.695703   861 connection.cc:582] client connection to 127.31.233.193:44827 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:07:55.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:55.696290   861 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:07:55.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:55.704576 32679 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 837
08:07:55.808 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:55.809 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:55.809 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:55.810 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.810 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.810 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:55.811 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.811 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.811 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:55.811 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.811 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.811 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:55.811 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:55.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:55.847559  1002 connection.cc:582] client connection to 127.31.233.194:37469 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:07:55.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:07:55.848121  1002 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:07:55.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:55.850492 32679 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 980
08:07:55.910 [DEBUG - kudu-nio-3] (Connection.java:239) [peer ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)] handling channelInactive
08:07:55.911 [DEBUG - kudu-nio-3] (Connection.java:709) [peer ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)] cleaning up while in state READY due to: connection closed
08:07:55.911 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:55.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:55.914742 32679 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 32691
08:07:55.966 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.31.233.254:35197(127.31.233.254:35197)] handling channelInactive
08:07:55.966 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state READY due to: connection closed
08:07:55.966 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.31.233.254:35197(127.31.233.254:35197)] handling channelInactive
08:07:55.967 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state READY due to: connection closed
08:07:55.968 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.31.233.254:35197(127.31.233.254:35197)] handling channelInactive
08:07:55.968 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state READY due to: connection closed
08:07:55.969 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.31.233.254:35197(127.31.233.254:35197)] handling channelInactive
08:07:55.969 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state READY due to: connection closed
08:07:55.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:55.969631 32679 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 32762
08:07:56.006 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:56.037 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.31.233.253:33393(127.31.233.253:33393)] handling channelInactive
08:07:56.038 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state READY due to: connection closed
08:07:56.038 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:56.037 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.31.233.253:33393(127.31.233.253:33393)] handling channelInactive
08:07:56.039 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state READY due to: connection closed
08:07:56.039 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.31.233.253:33393(127.31.233.253:33393)] handling channelInactive
08:07:56.039 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state READY due to: connection closed
08:07:56.040 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.31.233.253:33393(127.31.233.253:33393)] handling channelInactive
08:07:56.040 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state READY due to: connection closed
08:07:56.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:56.040824 32679 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 374
08:07:56.099 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.31.233.252:36101(127.31.233.252:36101)] handling channelInactive
08:07:56.099 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state READY due to: connection closed
08:07:56.100 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.31.233.252:36101(127.31.233.252:36101)] handling channelInactive
08:07:56.100 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state READY due to: connection closed
08:07:56.100 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.31.233.252:36101(127.31.233.252:36101)] handling channelInactive
08:07:56.100 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state READY due to: connection closed
08:07:56.101 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.31.233.252:36101(127.31.233.252:36101)] handling channelInactive
08:07:56.101 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state READY due to: connection closed
08:07:56.149 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091676149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:07:56.150 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:56.166 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
08:07:56.170 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
08:07:56.241 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:56.241 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:56.241 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:56.242 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:56.242 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:56.242 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:56.242 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:56.242 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:56.242 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:56.242 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:56.242 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:56.242 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:56.243 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:56.254 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:56.255 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:56.255 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:56.255 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:56.256 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:56.256 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:56.257 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:56.257 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:56.257 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:56.257 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:56.258 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:56.258 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:56.258 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:56.348 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:56.349 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:56.349 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:56.349 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:56.350 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:56.350 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:56.350 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:56.350 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:56.350 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:56.351 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:56.351 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:56.351 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:56.351 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:56.383 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:56.383 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:56.384 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:56.384 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:56.384 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:56.384 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:56.385 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:56.385 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:56.385 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:56.385 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:56.385 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:56.385 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:56.385 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:56.411 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:56.506 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:56.538 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:56.637 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 75171ad0cb2448e380e6b1e23553a1df
08:07:56.644 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='8ca638e19d49e68b12081eab88985220eab18d9740211f46ed73b47397709937'}]
08:07:56.644 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='fba438c373049ad5fd20c969adcc0bc801e99e315f6ed6f832b0600bf079d8b7'}]
08:07:56.646 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:56.644 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='d46b4ca028d6e8bb0846cc6af7633d783cbdc27f07cb3d88dc46002cf2c7b544'}]
08:07:56.648 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:56.648 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
08:07:56.649 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:56.649 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
08:07:56.650 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=296372, tablet=19dc48939efd43049bf739035d3707d5@[4a91936aa3fc4705a7fb8e2e53edf637(127.31.46.195:38219),7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719),cdab818f784c43329a4a6a164a1cf7c3(127.31.46.194:39687)[L]]}]
08:07:56.650 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=296372, tablet=2647411043ab45458706fde51f0f7d18@[4a91936aa3fc4705a7fb8e2e53edf637(127.31.46.195:38219),7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719),cdab818f784c43329a4a6a164a1cf7c3(127.31.46.194:39687)[L]]}]
08:07:56.651 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091676650 for job da74ffd3de6ba1563e412fcb34de5c51.
08:07:56.653 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:56.658 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:07:56.661 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=296371, tablet=98ec5300665e4981b383fed816312f05@[4a91936aa3fc4705a7fb8e2e53edf637(127.31.46.195:38219)[L],7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719),cdab818f784c43329a4a6a164a1cf7c3(127.31.46.194:39687)]}]
08:07:56.664 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] connecting to peer
08:07:56.668 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job da74ffd3de6ba1563e412fcb34de5c51 (2898 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
08:07:56.669 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
08:07:56.672 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] connecting to peer
08:07:56.680 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] connecting to peer
08:07:56.690 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] Successfully connected to peer
08:07:56.701 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.46.193
08:07:56.716 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] Successfully connected to peer
08:07:56.734 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:56.753 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] Successfully connected to peer
08:07:56.759 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x8bb9839a, L:/127.0.0.1:32820 - R:/127.31.46.193:43719] using SASL/PLAIN
08:07:56.761 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.46.193
08:07:56.796 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.46.193
08:07:56.794 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159507484672001) for scanner KuduScanner(table=replication_test_table, tablet=2647411043ab45458706fde51f0f7d18, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:56.799 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [fba438c373049ad5fd20c969adcc0bc801e99e315f6ed6f832b0600bf079d8b7]
08:07:56.799 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [fba438c373049ad5fd20c969adcc0bc801e99e315f6ed6f832b0600bf079d8b7]
08:07:56.799 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
08:07:56.799 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
08:07:56.802 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split fba438c373049ad5fd20c969adcc0bc801e99e315f6ed6f832b0600bf079d8b7 finished by subtask 1; deferring removal (restored in pending)
08:07:56.802 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] disconnecting while in state READY
08:07:56.808 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:56.815 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:56.823 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa94037b2, L:/127.0.0.1:32822 - R:/127.31.46.193:43719] using SASL/PLAIN
08:07:56.840 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:56.847 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x5cd73bdc, L:/127.0.0.1:32826 - R:/127.31.46.193:43719] using SASL/PLAIN
08:07:56.861 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159507484672001) for scanner KuduScanner(table=replication_test_table, tablet=19dc48939efd43049bf739035d3707d5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:56.863 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [d46b4ca028d6e8bb0846cc6af7633d783cbdc27f07cb3d88dc46002cf2c7b544]
08:07:56.863 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [d46b4ca028d6e8bb0846cc6af7633d783cbdc27f07cb3d88dc46002cf2c7b544]
08:07:56.864 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
08:07:56.864 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
08:07:56.865 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split d46b4ca028d6e8bb0846cc6af7633d783cbdc27f07cb3d88dc46002cf2c7b544 finished by subtask 2; deferring removal (restored in pending)
08:07:56.866 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] disconnecting while in state READY
08:07:56.870 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:56.887 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159507484672001) for scanner KuduScanner(table=replication_test_table, tablet=98ec5300665e4981b383fed816312f05, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:56.887 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [8ca638e19d49e68b12081eab88985220eab18d9740211f46ed73b47397709937]
08:07:56.887 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [8ca638e19d49e68b12081eab88985220eab18d9740211f46ed73b47397709937]
08:07:56.888 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
08:07:56.888 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
08:07:56.889 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 8ca638e19d49e68b12081eab88985220eab18d9740211f46ed73b47397709937 finished by subtask 0; deferring removal (restored in pending)
08:07:56.889 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] disconnecting while in state READY
08:07:56.892 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:56.902 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] handling channelInactive
08:07:56.902 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] cleaning up while in state READY due to: connection closed
08:07:56.902 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
08:07:56.902 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
08:07:56.904 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] handling channelInactive
08:07:56.904 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] cleaning up while in state READY due to: connection closed
08:07:56.905 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
08:07:56.905 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
08:07:56.906 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] handling channelInactive
08:07:56.906 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] cleaning up while in state READY due to: connection closed
08:07:56.907 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:07:56.907 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
08:07:56.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:57.006 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:57.011 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:57.012 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:57.012 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:57.013 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:57.013 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:57.013 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:57.014 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:57.014 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:57.014 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:57.014 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:57.014 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:57.014 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:57.014 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:57.038 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:57.150 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091677149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:07:57.151 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:57.151 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:57.151 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:57.152 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:57.152 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:57.152 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:57.153 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:57.153 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:57.154 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:57.154 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:57.154 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:57.154 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:57.154 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:57.158 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:57.164 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job da74ffd3de6ba1563e412fcb34de5c51 (2898 bytes, checkpointDuration=13 ms, finalizationTime=2 ms).
08:07:57.167 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
08:07:57.167 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split d46b4ca028d6e8bb0846cc6af7633d783cbdc27f07cb3d88dc46002cf2c7b544 from pending
08:07:57.167 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 8ca638e19d49e68b12081eab88985220eab18d9740211f46ed73b47397709937 from pending
08:07:57.167 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split fba438c373049ad5fd20c969adcc0bc801e99e315f6ed6f832b0600bf079d8b7 from pending
08:07:57.167 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 8 complete: removed 3 finished splits from enumerator state
08:07:57.168 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:57.168 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:57.168 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:57.169 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:57.169 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:57.169 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:57.169 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:57.169 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:57.169 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:57.169 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:57.169 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:57.169 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:57.169 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:57.411 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:57.425 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:57.426 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:57.427 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:57.428 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:57.429 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:57.429 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:57.430 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:57.430 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:57.430 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:57.431 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:57.431 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:57.431 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:57.431 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:57.506 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:57.538 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:57.643 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:57.643 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:57.644 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:57.644 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:57.644 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:57.644 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:57.644 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:57.644 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:57.644 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:57.645 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:57.645 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:57.645 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:57.645 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:57.650 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091677649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:07:57.651 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:57.662 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
08:07:57.665 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
08:07:57.778 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:57.779 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:57.779 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:57.779 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:57.779 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:57.779 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:57.779 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:57.779 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:57.780 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:57.780 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:57.780 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:57.781 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:57.781 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:57.845 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:57.845 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:57.845 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:57.846 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:57.846 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:57.846 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:57.847 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:57.847 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:57.847 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:57.847 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:57.847 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:57.847 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:57.847 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:57.911 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:57.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:07:57Z chronyd exiting
08:07:58.006 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:58.038 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:58.150 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091678149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:07:58.151 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:58.167 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
08:07:58.169 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
08:07:58.255 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:58.256 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:58.256 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:58.257 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:58.257 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:58.257 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:58.257 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:58.258 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:58.258 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:58.258 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:58.258 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:58.259 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:58.259 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:58.264 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:58.264 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:58.265 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:58.265 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:58.265 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:58.265 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:58.265 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:58.265 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:58.265 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:58.265 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:58.265 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:58.265 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:58.265 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:58.322 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:07:58.325 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:07:58.325 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:07:58.326 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:58.326 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:58.326 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:58.326 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:58.326 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:58.326 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:07:58.326 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:07:58.326 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:58.331 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:07:58.331 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:07:58.387 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:58.388 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:58.388 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:58.388 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:58.388 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:58.388 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:58.388 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:58.388 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:58.388 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:58.389 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:58.389 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:58.389 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:58.389 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:58.411 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:58.505 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:58.536 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:58.539 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:58.540 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:58.540 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:58.540 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:58.541 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:58.541 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:58.545 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:58.545 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:58.545 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:58.546 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:58.546 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:58.546 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:58.546 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:58.571 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:58.571 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:58.572 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:58.572 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:58.572 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:58.572 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:58.572 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:58.572 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:58.572 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:58.573 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:58.573 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:58.573 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:58.573 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:58.636 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 75171ad0cb2448e380e6b1e23553a1df
08:07:58.639 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='bd3de176db2b8bedb5e22dc2304311d4e1872882401d22ca33e35c7cd51e979e'}]
08:07:58.640 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='12a47a4e939fe77186f7a4901b0bbf7803dd3b2c46d1247199cc65a085dbfa8f'}]
08:07:58.641 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='18e000cf9b94b6e824542fd969fea0e67c909e3a9eb3fd485dd7528ffdcc4324'}]
08:07:58.643 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:58.643 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
08:07:58.644 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=294373, tablet=19dc48939efd43049bf739035d3707d5@[4a91936aa3fc4705a7fb8e2e53edf637(127.31.46.195:38219),7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719),cdab818f784c43329a4a6a164a1cf7c3(127.31.46.194:39687)[L]]}]
08:07:58.646 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:58.646 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
08:07:58.647 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=294373, tablet=98ec5300665e4981b383fed816312f05@[4a91936aa3fc4705a7fb8e2e53edf637(127.31.46.195:38219)[L],7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719),cdab818f784c43329a4a6a164a1cf7c3(127.31.46.194:39687)]}]
08:07:58.649 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:58.649 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091678649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:07:58.649 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
08:07:58.650 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=294373, tablet=2647411043ab45458706fde51f0f7d18@[4a91936aa3fc4705a7fb8e2e53edf637(127.31.46.195:38219),7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719),cdab818f784c43329a4a6a164a1cf7c3(127.31.46.194:39687)[L]]}]
08:07:58.652 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:58.662 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] connecting to peer
08:07:58.664 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] connecting to peer
08:07:58.667 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job da74ffd3de6ba1563e412fcb34de5c51 (2898 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
08:07:58.668 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
08:07:58.674 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] connecting to peer
08:07:58.681 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:58.681 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:58.682 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:58.682 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:58.682 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:58.682 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] Successfully connected to peer
08:07:58.682 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:58.682 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:58.682 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:58.682 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:58.683 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:58.683 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:58.683 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:58.683 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:58.685 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.46.193
08:07:58.690 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] Successfully connected to peer
08:07:58.696 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.46.193
08:07:58.701 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] Successfully connected to peer
08:07:58.704 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:58.709 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.46.193
08:07:58.712 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x3d0ad117, L:/127.0.0.1:33110 - R:/127.31.46.193:43719] using SASL/PLAIN
08:07:58.714 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:58.718 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:07:58.718 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x561a94b9, L:/127.0.0.1:33114 - R:/127.31.46.193:43719] using SASL/PLAIN
08:07:58.721 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x1b2a7548, L:/127.0.0.1:33124 - R:/127.31.46.193:43719] using SASL/PLAIN
08:07:58.731 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159515676672001) for scanner KuduScanner(table=replication_test_table, tablet=19dc48939efd43049bf739035d3707d5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:58.732 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [18e000cf9b94b6e824542fd969fea0e67c909e3a9eb3fd485dd7528ffdcc4324]
08:07:58.732 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [18e000cf9b94b6e824542fd969fea0e67c909e3a9eb3fd485dd7528ffdcc4324]
08:07:58.733 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
08:07:58.733 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
08:07:58.734 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 18e000cf9b94b6e824542fd969fea0e67c909e3a9eb3fd485dd7528ffdcc4324 finished by subtask 2; deferring removal (restored in pending)
08:07:58.735 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] disconnecting while in state READY
08:07:58.740 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159515676672001) for scanner KuduScanner(table=replication_test_table, tablet=2647411043ab45458706fde51f0f7d18, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:58.740 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [12a47a4e939fe77186f7a4901b0bbf7803dd3b2c46d1247199cc65a085dbfa8f]
08:07:58.740 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [12a47a4e939fe77186f7a4901b0bbf7803dd3b2c46d1247199cc65a085dbfa8f]
08:07:58.741 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
08:07:58.741 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
08:07:58.741 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] disconnecting while in state READY
08:07:58.742 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:58.742 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 12a47a4e939fe77186f7a4901b0bbf7803dd3b2c46d1247199cc65a085dbfa8f finished by subtask 1; deferring removal (restored in pending)
08:07:58.750 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:58.758 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] handling channelInactive
08:07:58.758 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] cleaning up while in state READY due to: connection closed
08:07:58.758 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
08:07:58.758 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:07:58.760 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] handling channelInactive
08:07:58.760 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] cleaning up while in state READY due to: connection closed
08:07:58.760 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:07:58.761 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
08:07:58.879 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159515676672001) for scanner KuduScanner(table=replication_test_table, tablet=98ec5300665e4981b383fed816312f05, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:58.880 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [bd3de176db2b8bedb5e22dc2304311d4e1872882401d22ca33e35c7cd51e979e]
08:07:58.880 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [bd3de176db2b8bedb5e22dc2304311d4e1872882401d22ca33e35c7cd51e979e]
08:07:58.880 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
08:07:58.881 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
08:07:58.882 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split bd3de176db2b8bedb5e22dc2304311d4e1872882401d22ca33e35c7cd51e979e finished by subtask 3; deferring removal (restored in pending)
08:07:58.884 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] disconnecting while in state READY
08:07:58.884 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:58.887 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] handling channelInactive
08:07:58.887 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] cleaning up while in state READY due to: connection closed
08:07:58.887 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:07:58.888 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
08:07:58.911 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:58.914 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:07:58.915 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:07:58.915 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:07:58.915 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:58.915 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:58.915 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:58.915 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:58.915 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:07:58.915 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:07:58.916 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:58.916 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:58.917 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:07:58.917 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:07:58.998 [ERROR - main] (RetryRule.java:206) org.apache.kudu.replication.TestReplicationTableInitializer.testRangeOnlyPartitioning: failed attempt 1
org.apache.kudu.shaded.org.apache.commons.logging.LogConfigurationException: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl (Caused by java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1158)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory$2.run(LogFactory.java:960)
	at java.base/java.security.AccessController.doPrivileged(AccessController.java:318)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.newFactory(LogFactory.java:957)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getFactory(LogFactory.java:624)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getLog(LogFactory.java:655)
	at org.apache.kudu.shaded.org.apache.http.conn.ssl.DefaultHostnameVerifier.<init>(DefaultHostnameVerifier.java:82)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClientBuilder.build(HttpClientBuilder.java:970)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClients.createDefault(HttpClients.java:56)
	at org.apache.kudu.test.junit.ResultReporter.reportResult(ResultReporter.java:207)
	at org.apache.kudu.test.junit.ResultReporter.tryReportResult(ResultReporter.java:244)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.report(RetryRule.java:165)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:191)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
Caused by: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1020)
	... 42 more
08:07:59.005 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:59.034 [ERROR - main] (RetryRule.java:253) org.apache.kudu.replication.TestReplicationTableInitializer.testRangeOnlyPartitioning: giving up after 1 attempts
08:07:59.035 [DEBUG - main] (Connection.java:575) [peer 4a91936aa3fc4705a7fb8e2e53edf637(127.31.46.195:38219)] disconnecting while in state READY
08:07:59.035 [DEBUG - main] (Connection.java:575) [peer master-127.31.46.252:40541(127.31.46.252:40541)] disconnecting while in state READY
08:07:59.035 [DEBUG - main] (Connection.java:575) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] disconnecting while in state READY
08:07:59.035 [DEBUG - main] (Connection.java:575) [peer master-127.31.46.253:46697(127.31.46.253:46697)] disconnecting while in state READY
08:07:59.035 [DEBUG - main] (Connection.java:575) [peer master-127.31.46.254:45015(127.31.46.254:45015)] disconnecting while in state READY
08:07:59.035 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 4a91936aa3fc4705a7fb8e2e53edf637(127.31.46.195:38219)] handling channelInactive
08:07:59.035 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.31.46.252:40541(127.31.46.252:40541)] handling channelInactive
08:07:59.036 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state READY due to: connection closed
08:07:59.036 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 4a91936aa3fc4705a7fb8e2e53edf637(127.31.46.195:38219)] cleaning up while in state READY due to: connection closed
08:07:59.036 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.31.46.253:46697(127.31.46.253:46697)] handling channelInactive
08:07:59.036 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state READY due to: connection closed
08:07:59.036 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:59.035 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] handling channelInactive
08:07:59.037 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 7f8fa66c1d0f40fab64f16e98a980e56(127.31.46.193:43719)] cleaning up while in state READY due to: connection closed
08:07:59.040 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:59.041 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
08:07:59.041 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
08:07:59.041 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-4
08:07:59.041 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 28 thread-local buffer(s) from thread: kudu-nio-2
08:07:59.042 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.31.46.254:45015(127.31.46.254:45015)] handling channelInactive
08:07:59.042 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state READY due to: connection closed
08:07:59.042 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:07:59.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:59.043460 31931 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 32218
08:07:59.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:59.101936 31931 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 32378
08:07:59.127 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:07:59.128 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:07:59.128 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:07:59.129 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:59.129 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:59.129 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:07:59.129 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:59.129 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:59.129 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:07:59.130 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:59.130 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:59.130 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:07:59.130 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:07:59.150 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091679149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:07:59.150 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:59.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:59.151620 31931 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 32538
08:07:59.163 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job da74ffd3de6ba1563e412fcb34de5c51 (2898 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
08:07:59.164 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
08:07:59.164 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split bd3de176db2b8bedb5e22dc2304311d4e1872882401d22ca33e35c7cd51e979e from pending
08:07:59.164 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split 18e000cf9b94b6e824542fd969fea0e67c909e3a9eb3fd485dd7528ffdcc4324 from pending
08:07:59.165 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split 12a47a4e939fe77186f7a4901b0bbf7803dd3b2c46d1247199cc65a085dbfa8f from pending
08:07:59.165 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 12 complete: removed 3 finished splits from enumerator state
08:07:59.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:59.212872 31931 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 31943
08:07:59.254 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.31.46.254:45015(127.31.46.254:45015)] handling channelInactive
08:07:59.254 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state READY due to: connection closed
08:07:59.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:59.255071 31931 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 32014
08:07:59.296 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.31.46.253:46697(127.31.46.253:46697)] handling channelInactive
08:07:59.296 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state READY due to: connection closed
08:07:59.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:07:59.297776 31931 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 32089
08:07:59.315 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:07:59.315 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:07:59.315 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:07:59.315 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:59.315 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:59.316 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:59.316 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:59.316 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:59.316 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:07:59.316 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:07:59.316 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:59.316 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:07:59.316 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:07:59.343 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:07:59.343 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.31.46.252:40541(127.31.46.252:40541)] handling channelInactive
08:07:59.343 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:07:59.343 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state READY due to: connection closed
08:07:59.343 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:07:59.344 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:59.344 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:59.344 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:07:59.344 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:59.344 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:59.344 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:59.344 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:59.344 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:07:59.344 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:07:59.344 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:07:59.410 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:59.506 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:59.538 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:59.650 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091679649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:07:59.650 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:59.659 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
08:07:59.661 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
08:07:59.864 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:59.865 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:59.865 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:59.865 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:59.865 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:59.866 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:59.866 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:59.866 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:59.866 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:59.866 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:59.866 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:59.866 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:59.866 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:07:59.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:07:59.938 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:07:59.938 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:07:59.938 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:07:59.939 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:59.939 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:59.939 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:59.939 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:59.939 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:07:59.939 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:07:59.939 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:59.939 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:59.939 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:07:59.939 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:00.006 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:00.038 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:00.150 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091680149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:00.150 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:00.158 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
08:08:00.159 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
08:08:00.411 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:00.425 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:00.425 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:00.425 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:00.426 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:00.426 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:00.426 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:00.426 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:00.426 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:00.426 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:00.426 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:00.426 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:00.426 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:00.426 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:00.506 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:00.538 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:00.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:08:00Z chronyd exiting
08:08:00.632 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:00.634 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:00.634 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:00.634 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.31.46.252:40541(127.31.46.252:40541) for tablet Kudu Master: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:00.639 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:00.640 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:00.641 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:00.641 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:00.641 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:00.641 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:00.641 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:00.641 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:00.641 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:00.642 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:00.642 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:00.642 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:00.642 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:00.650 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091680649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:00.650 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:00.659 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
08:08:00.660 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:00.660 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
08:08:00.660 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:00.661 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:00.661 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:00.661 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:00.661 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:00.661 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:00.661 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:00.661 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:00.661 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:00.661 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:00.661 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:00.661 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:00.679 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:00.680 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:00.680 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:00.680 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:00.680 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:00.680 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:00.680 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:00.680 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:00.680 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:00.680 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:00.680 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:00.680 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:00.680 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:00.700 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:00.700 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:00.700 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:00.700 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:00.700 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:00.700 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:00.700 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:00.700 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:00.700 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:00.700 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:00.701 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:00.701 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:00.701 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:00.708 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:00.709 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:00.709 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:00.709 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:00.709 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:00.709 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:00.709 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:00.709 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:00.709 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:00.709 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:00.709 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:00.709 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:00.709 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:00.720 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:00.720 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:00.720 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:00.720 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:00.720 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:00.720 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:00.720 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:00.721 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:00.721 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:00.721 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:00.721 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:00.721 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:00.721 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:00.799 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:00.800 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:00.800 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:00.800 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:00.800 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:00.800 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:00.800 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:00.800 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:00.800 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:00.800 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:00.800 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:00.800 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:00.801 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:00.911 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:00.939 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:00.939 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:00.940 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:00.940 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:00.940 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:00.940 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:00.940 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:00.940 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:00.940 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:00.940 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:00.940 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:00.940 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:00.940 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:00.951 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:00.951 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:00.952 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:00.952 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:00.952 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:00.952 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:00.952 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:00.952 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:00.952 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:00.952 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:00.952 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:00.952 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:00.952 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:01.006 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:01.020 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:01.020 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:01.020 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:01.020 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:01.020 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:01.021 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:01.021 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:01.021 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:01.021 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:01.021 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:01.021 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:01.021 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:01.021 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:01.038 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:01.060 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:01.060 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:01.060 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:01.061 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:01.061 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:01.061 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:01.061 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:01.061 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:01.061 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:01.061 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:01.061 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:01.061 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:01.061 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:01.150 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091681149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:01.151 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:01.160 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:08:01.161 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
08:08:01.411 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:01.465 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:01.465 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:01.466 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:01.466 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:01.466 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:01.466 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:01.466 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:01.466 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:01.466 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:01.466 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:01.466 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:01.466 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:01.466 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:01.506 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:01.537 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:01.599 [ERROR - main] (RetryRule.java:206) org.apache.kudu.replication.TestReplicationTableInitializer.testRangeOnlyPartitioning: failed attempt 1
org.apache.kudu.shaded.org.apache.commons.logging.LogConfigurationException: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl (Caused by java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1158)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory$2.run(LogFactory.java:960)
	at java.base/java.security.AccessController.doPrivileged(AccessController.java:318)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.newFactory(LogFactory.java:957)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getFactory(LogFactory.java:624)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getLog(LogFactory.java:655)
	at org.apache.kudu.shaded.org.apache.http.conn.ssl.DefaultHostnameVerifier.<init>(DefaultHostnameVerifier.java:82)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClientBuilder.build(HttpClientBuilder.java:970)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClients.createDefault(HttpClients.java:56)
	at org.apache.kudu.test.junit.ResultReporter.reportResult(ResultReporter.java:207)
	at org.apache.kudu.test.junit.ResultReporter.tryReportResult(ResultReporter.java:244)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.report(RetryRule.java:165)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:216)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
Caused by: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1020)
	... 42 more
08:08:01.633 [ERROR - main] (RetryRule.java:253) org.apache.kudu.replication.TestReplicationTableInitializer.testRangeOnlyPartitioning: giving up after 1 attempts
E.08:08:01.634 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779091681634
08:08:01.634 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779091681634
08:08:01.640 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
08:08:01.644 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
08:08:01.645 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
08:08:01.645 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskk4_r_T/test-tmp
08:08:01.646 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
08:08:01.646 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskk4_r_T/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
08:08:01.650 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

08:08:01.650 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091681649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:01.651 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:01.654 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:01.655 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:01.655 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:01.655 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:01.655 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:01.656 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:01.656 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:01.656 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:01.656 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:01.658 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:01.658 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:01.659 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:01.659 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:01.660 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:08:01.661 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
08:08:01.700 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:01.701 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:01.701 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:01.701 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:01.701 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:01.701 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:01.701 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:01.701 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:01.701 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:01.701 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:01.701 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:01.701 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:01.701 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:01.911 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:01.911 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:01.911 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:01.912 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:01.912 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:01.912 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:01.912 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:01.912 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:01.912 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:01.912 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:01.912 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:01.912 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:01.912 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:01.912 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:01.921 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:01.921 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:01.921 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:01.922 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:01.922 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:01.922 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:01.922 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:01.922 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:01.922 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:01.922 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:01.922 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:01.922 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:01.922 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:02.005 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:02.037 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:02.060 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:08:02.060 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

08:08:02.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:02.064596  1563 mini_oidc.cc:150] Starting JWKS server
08:08:02.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:02.068898  1563 webserver.cc:533] Webserver started at http://127.0.0.1:33487/ using document root <none> and password file <none>
08:08:02.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:02.069362  1563 mini_oidc.cc:186] Starting OIDC Discovery server
08:08:02.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:02.071617  1563 webserver.cc:533] Webserver started at http://127.0.0.1:37839/ using document root <none> and password file <none>
08:08:02.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:08:02Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
08:08:02.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:08:02Z Disabled control of system clock
08:08:02.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:02.148594  1563 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:08:02.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:08:02.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-0/wal
08:08:02.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-0/data
08:08:02.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:08:02.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:08:02.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:08:02.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:02.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:02.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:02.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-0/logs
08:08:02.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-0/data/info.pb
08:08:02.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:02.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:08:02.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:08:02.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:08:02.149 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091682149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:02.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:08:02.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:02.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:02.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:02.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:08:02.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:08:02.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:08:02.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:08:02.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.134.254:38449
08:08:02.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.134.254
08:08:02.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:02.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.134.212:46153
08:08:02.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:02.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:02.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:02.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:08:02.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093
08:08:02.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:08:02.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33487/jwks.json with env {}
08:08:02.151 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:02.159 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
08:08:02.160 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
08:08:02.295 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:02.295 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:02.296 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:02.296 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:02.296 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:02.296 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:02.296 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:02.296 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:02.296 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:02.296 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:02.296 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:02.296 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:02.296 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:02.323 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:02.324 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:02.324 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:02.324 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:02.324 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:02.324 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:02.324 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:02.324 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:02.324 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:02.324 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:02.324 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:02.324 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:02.325 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:02.344 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:02.344 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:02.345 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:02.345 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:02.345 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:02.345 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:02.345 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:02.345 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:02.345 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:02.345 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:02.345 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:02.345 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:02.345 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:02.364 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:02.365 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:02.365 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:02.365 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:02.365 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:02.365 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:02.365 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:02.365 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:02.365 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:02.365 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:02.365 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:02.365 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:02.366 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:02.411 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:02.505 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:02.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:02.526381  1575 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:08:02.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:02.527277  1575 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:08:02.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:02.528307  1575 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:08:02.537 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:02.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:02.566646  1575 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:08:02.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:02.566996  1575 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:08:02.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:02.567279  1575 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:08:02.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:02.567554  1575 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:08:02.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:02.567822  1575 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:08:02.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:02.567992  1575 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33487/jwks.json
08:08:02.571 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:02.571 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:02.571 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:02.571 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:02.571 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:02.572 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:02.572 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:02.572 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:02.572 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:02.572 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:02.572 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:02.572 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:02.572 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:02.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:02.613263  1575 master_runner.cc:387] Master server non-default flags:
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.134.212:46153
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-0/data
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-0/wal
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.134.254:38449
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33487/jwks.json
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-0/data/info.pb
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.134.254
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-0/logs
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:08:02.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:08:02.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:02.615222  1575 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:08:02.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:02.617264  1575 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:08:02.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:02.632012  1581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:02.636 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:02.636 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:02.637 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:02.637 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:02.637 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:02.637 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:02.638 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:02.638 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:02.638 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:02.638 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:02.638 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:02.638 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:02.638 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:02.650 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091682649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:02.651 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:02.661 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
08:08:02.664 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
08:08:02.678 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:02.678 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:02.679 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:02.679 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:02.679 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:02.679 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:02.679 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:02.679 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:02.679 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:02.680 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:02.680 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:02.680 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:02.680 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:02.894 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:02.895 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:02.895 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:02.895 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:02.895 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:02.896 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:02.896 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:02.896 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:02.896 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:02.896 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:02.896 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:02.896 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:02.896 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:02.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:03.006 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:03.038 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:03.083 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:03.083 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:03.084 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:03.084 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:03.085 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:03.085 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:03.085 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:03.086 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:03.086 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:03.086 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:03.086 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:03.086 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:03.086 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:03.108 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:03.108 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:03.109 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:03.110 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:03.110 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:03.110 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:03.110 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:03.110 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:03.110 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:03.111 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:03.111 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:03.111 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:03.111 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:03.150 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091683149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:03.151 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:03.166 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
08:08:03.168 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
08:08:03.258 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:03.258 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:03.259 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:03.259 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:03.260 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:03.260 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:03.261 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:03.261 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:03.261 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:03.261 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:03.261 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:03.262 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:03.262 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:03.262 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:03.262 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:03.263 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:03.263 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:03.263 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:03.263 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:03.263 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:03.263 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:03.264 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:03.264 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:03.264 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:03.264 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:03.264 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:03.410 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:03.488 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:03.489 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:03.489 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:03.490 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:03.490 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:03.490 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:03.491 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:03.491 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:03.491 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:03.491 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:03.491 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:03.491 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:03.491 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:03.506 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:03.538 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:03.640 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:03.641 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:03.641 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:03.642 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:03.642 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:03.642 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:03.643 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:03.643 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:03.643 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:03.643 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:03.643 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:03.643 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:03.643 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:03.650 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091683649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:03.651 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:03.665 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
08:08:03.668 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
08:08:03.820 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:03.820 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:03.820 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:03.821 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:03.821 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:03.821 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:03.821 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:03.821 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:03.821 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:03.821 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:03.821 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:03.821 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:03.821 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:03.911 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:04.006 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:04.038 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:04.150 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:04.151 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091684149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:04.168 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
08:08:04.170 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
08:08:04.224 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:04.225 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:04.225 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:04.226 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:04.226 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:04.226 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:04.227 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:04.227 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:04.227 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:04.227 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:04.228 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:04.228 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:04.228 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:04.411 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:04.506 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:04.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:02.632603  1582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:04.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:04.036533  1580 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 1575
08:08:04.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:04.518293  1584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:04.514744  1575 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.882s	user 0.647s	sys 1.229s
08:08:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:04.519654  1575 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.887s	user 0.647s	sys 1.229s
08:08:04.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:04.523885  1583 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1885 milliseconds
08:08:04.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.523974  1575 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:08:04.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.525569  1575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:08:04.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.529013  1575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:08:04.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.530524  1575 hybrid_clock.cc:648] HybridClock initialized: now 1779091684530474 us; error 86 us; skew 500 ppm
08:08:04.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.531965  1575 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:08:04.538 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:04.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.540115  1575 webserver.cc:533] Webserver started at http://127.1.134.254:44049/ using document root <none> and password file <none>
08:08:04.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.541345  1575 fs_manager.cc:362] Metadata directory not provided
08:08:04.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.541641  1575 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:08:04.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.542253  1575 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:08:04.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.548084  1575 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-0/data/instance:
08:08:04.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e71aeaf669d64d85af17143e82ce987d"
08:08:04.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:04 on dist-test-slave-1jss"
08:08:04.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.549501  1575 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-0/wal/instance:
08:08:04.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e71aeaf669d64d85af17143e82ce987d"
08:08:04.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:04 on dist-test-slave-1jss"
08:08:04.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.559186  1575 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.006s	sys 0.002s
08:08:04.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.566725  1593 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:08:04.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.568002  1575 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.001s
08:08:04.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.568431  1575 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-0/wal
08:08:04.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e71aeaf669d64d85af17143e82ce987d"
08:08:04.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:04 on dist-test-slave-1jss"
08:08:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.568872  1575 fs_report.cc:389] FS layout report
08:08:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:08:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-0/wal
08:08:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-0/wal
08:08:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-0/data/data
08:08:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:08:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:08:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:08:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:08:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:08:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:08:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:08:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:08:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:08:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:08:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:08:04.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.628902  1575 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:08:04.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.630841  1575 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:08:04.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.631425  1575 kserver.cc:163] Server-wide thread pool size limit: 3276
08:08:04.650 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091684649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:04.650 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:04.659 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
08:08:04.659 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
08:08:04.708 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:04.709 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:04.709 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:04.709 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:04.709 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:04.709 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:04.710 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:04.710 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:04.710 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:04.710 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:04.710 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:04.710 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:04.710 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:04.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.729380  1575 rpc_server.cc:307] RPC server started. Bound to: 127.1.134.254:38449
08:08:04.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.729557  1644 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.134.254:38449 every 8 connection(s)
08:08:04.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.733084  1575 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-0/data/info.pb
08:08:04.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.740624  1563 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 1575
08:08:04.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.741011  1645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:04.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.741231  1563 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-0/wal/instance
08:08:04.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.747241  1563 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:08:04.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:08:04.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-1/wal
08:08:04.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-1/data
08:08:04.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:08:04.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:08:04.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:08:04.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:04.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:04.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:04.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-1/logs
08:08:04.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-1/data/info.pb
08:08:04.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:04.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:08:04.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:08:04.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:08:04.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:08:04.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:04.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:04.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:04.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:08:04.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:08:04.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:08:04.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:08:04.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.134.253:41425
08:08:04.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.134.253
08:08:04.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:04.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.134.212:46153
08:08:04.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:04.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:04.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:04.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:08:04.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093
08:08:04.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:08:04.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33487/jwks.json with env {}
08:08:04.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.759109  1645 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.134.254" port: 38449 } has no permanent_uuid. Determining permanent_uuid...
08:08:04.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.793785  1645 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } has no permanent_uuid. Determining permanent_uuid...
08:08:04.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:04.797233  1597 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.134.253:41425: connect: Connection refused (error 111)
08:08:04.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:04.802636  1645 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.134.253:41425: Network error: Client connection negotiation failed: client connection to 127.1.134.253:41425: connect: Connection refused (error 111)
08:08:04.823 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:04.823 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:04.824 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:04.824 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:04.824 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:04.824 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:04.824 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:04.824 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:04.824 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:04.824 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:04.824 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:04.824 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:04.824 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:04.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.852223  1645 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } attempt: 1
08:08:04.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:04.857596  1645 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.134.253:41425: Network error: Client connection negotiation failed: client connection to 127.1.134.253:41425: connect: Connection refused (error 111)
08:08:04.911 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:04.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:04.926112  1645 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } attempt: 2
08:08:04.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:04.931499  1645 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.134.253:41425: Network error: Client connection negotiation failed: client connection to 127.1.134.253:41425: connect: Connection refused (error 111)
08:08:04.971 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:04.972 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:04.972 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:04.972 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:04.972 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:04.973 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:04.973 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:04.973 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:04.973 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:04.973 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:04.973 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:04.973 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:04.973 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:04.974 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28687), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [69ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [76ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [85ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [89ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [371ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [372ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [373ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [374ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [439ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [441ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [525ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [573ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [573ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [574ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [575ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [582ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [586ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [602ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [603ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [603ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [603ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [643ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [645ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [646ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [646ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [723ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [723ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [725ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [725ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [764ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [765ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [766ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1004ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1004ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1040ms] refreshing cache from master, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1045ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1046ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1046ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1047ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1048ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1048ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2081ms] refreshing cache from master, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2083ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2084ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2084ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2355ms] refreshing cache from master, [2355ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2356ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2356ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2358ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2359ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2359ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2360ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [4901ms] refreshing cache from master, [4901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [4902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [4902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [4903ms] too many traces: truncated at 100 traces, deferred=Deferred@109165928(state=PENDING, result=null, callback=(continuation of Deferred@1693419531 after retry RPC after error@554555954) -> (continuation of Deferred@99265773 after retry RPC after error@244001733) -> (continuation of Deferred@381437391 after retry RPC after error@1504694624) -> (continuation of Deferred@166888316 after retry RPC after error@1592808580) -> (continuation of Deferred@714530984 after retry RPC after error@219484235) -> (continuation of Deferred@274828278 after retry RPC after error@1281992970) -> (continuation of Deferred@1365742479 after retry RPC after error@1960138400) -> (continuation of Deferred@1761037815 after retry RPC after error@1775732762) -> (continuation of Deferred@79791428 after retry RPC after error@1526706986) -> (continuation of Deferred@137745783 after retry RPC after error@1576475443) -> (continuation of Deferred@1427398252 after retry RPC after error@1926615303) -> (continuation of Deferred@1424833607 after retry RPC after error@824613738) -> (continuation of Deferred@1177965596 after retry RPC after error@439871540) -> (continuation of Deferred@654696497 after retry RPC after error@578671216) -> (continuation of Deferred@1444930711 after retry RPC after error@1942802472) -> (continuation of Deferred@2076221960 after retry RPC after error@929169746) -> (continuation of Deferred@519073909 after retry RPC after error@187215379) -> (continuation of Deferred@1963363740 after retry RPC after error@1388935935) -> (continuation of Deferred@1328007947 after retry RPC after error@28421322) -> (continuation of Deferred@1083882253 after retry RPC after error@1495088995) -> (continuation of Deferred@672389336 after retry RPC after error@617150188) -> (continuation of Deferred@832529323 after retry RPC after error@29992156) -> (continuation of Deferred@933919013 after retry RPC after error@1421252266) -> (continuation of Deferred@519972268 after retry RPC after error@1390255595) -> (continuation of Deferred@920298948 after retry RPC after error@1446602355), errback=(continuation of Deferred@1693419531 after retry RPC after error@554555954) -> (continuation of Deferred@99265773 after retry RPC after error@244001733) -> (continuation of Deferred@381437391 after retry RPC after error@1504694624) -> (continuation of Deferred@166888316 after retry RPC after error@1592808580) -> (continuation of Deferred@714530984 after retry RPC after error@219484235) -> (continuation of Deferred@274828278 after retry RPC after error@1281992970) -> (continuation of Deferred@1365742479 after retry RPC after error@1960138400) -> (continuation of Deferred@1761037815 after retry RPC after error@1775732762) -> (continuation of Deferred@79791428 after retry RPC after error@1526706986) -> (continuation of Deferred@137745783 after retry RPC after error@1576475443) -> (continuation of Deferred@1427398252 after retry RPC after error@1926615303) -> (continuation of Deferred@1424833607 after retry RPC after error@824613738) -> (continuation of Deferred@1177965596 after retry RPC after error@439871540) -> (continuation of Deferred@654696497 after retry RPC after error@578671216) -> (continuation of Deferred@1444930711 after retry RPC after error@1942802472) -> (continuation of Deferred@2076221960 after retry RPC after error@929169746) -> (continuation of Deferred@519073909 after retry RPC after error@187215379) -> (continuation of Deferred@1963363740 after retry RPC after error@1388935935) -> (continuation of Deferred@1328007947 after retry RPC after error@28421322) -> (continuation of Deferred@1083882253 after retry RPC after error@1495088995) -> (continuation of Deferred@672389336 after retry RPC after error@617150188) -> (continuation of Deferred@832529323 after retry RPC after error@29992156) -> (continuation of Deferred@933919013 after retry RPC after error@1421252266) -> (continuation of Deferred@519972268 after retry RPC after error@1390255595) -> (continuation of Deferred@920298948 after retry RPC after error@1446602355)))
08:08:04.976 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
08:08:04.976 [WARN - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28687), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [69ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [76ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [85ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [89ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [371ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [372ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [373ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [374ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [439ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [441ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [525ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [573ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [573ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [574ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [575ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [582ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [586ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [602ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [603ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [603ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [603ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [643ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [645ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [646ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [646ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [723ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [723ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [725ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [725ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [764ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [765ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [766ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1004ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1004ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1040ms] refreshing cache from master, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1045ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1046ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1046ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1047ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1048ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1048ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2081ms] refreshing cache from master, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2083ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2084ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2084ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2355ms] refreshing cache from master, [2355ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2356ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2356ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2358ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2359ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2359ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2360ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [4901ms] refreshing cache from master, [4901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [4902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [4902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [4903ms] too many traces: truncated at 100 traces, deferred=Deferred@109165928(state=PENDING, result=null, callback=(continuation of Deferred@1693419531 after retry RPC after error@554555954) -> (continuation of Deferred@99265773 after retry RPC after error@244001733) -> (continuation of Deferred@381437391 after retry RPC after error@1504694624) -> (continuation of Deferred@166888316 after retry RPC after error@1592808580) -> (continuation of Deferred@714530984 after retry RPC after error@219484235) -> (continuation of Deferred@274828278 after retry RPC after error@1281992970) -> (continuation of Deferred@1365742479 after retry RPC after error@1960138400) -> (continuation of Deferred@1761037815 after retry RPC after error@1775732762) -> (continuation of Deferred@79791428 after retry RPC after error@1526706986) -> (continuation of Deferred@137745783 after retry RPC after error@1576475443) -> (continuation of Deferred@1427398252 after retry RPC after error@1926615303) -> (continuation of Deferred@1424833607 after retry RPC after error@824613738) -> (continuation of Deferred@1177965596 after retry RPC after error@439871540) -> (continuation of Deferred@654696497 after retry RPC after error@578671216) -> (continuation of Deferred@1444930711 after retry RPC after error@1942802472) -> (continuation of Deferred@2076221960 after retry RPC after error@929169746) -> (continuation of Deferred@519073909 after retry RPC after error@187215379) -> (continuation of Deferred@1963363740 after retry RPC after error@1388935935) -> (continuation of Deferred@1328007947 after retry RPC after error@28421322) -> (continuation of Deferred@1083882253 after retry RPC after error@1495088995) -> (continuation of Deferred@672389336 after retry RPC after error@617150188) -> (continuation of Deferred@832529323 after retry RPC after error@29992156) -> (continuation of Deferred@933919013 after retry RPC after error@1421252266) -> (continuation of Deferred@519972268 after retry RPC after error@1390255595) -> (continuation of Deferred@920298948 after retry RPC after error@1446602355), errback=(continuation of Deferred@1693419531 after retry RPC after error@554555954) -> (continuation of Deferred@99265773 after retry RPC after error@244001733) -> (continuation of Deferred@381437391 after retry RPC after error@1504694624) -> (continuation of Deferred@166888316 after retry RPC after error@1592808580) -> (continuation of Deferred@714530984 after retry RPC after error@219484235) -> (continuation of Deferred@274828278 after retry RPC after error@1281992970) -> (continuation of Deferred@1365742479 after retry RPC after error@1960138400) -> (continuation of Deferred@1761037815 after retry RPC after error@1775732762) -> (continuation of Deferred@79791428 after retry RPC after error@1526706986) -> (continuation of Deferred@137745783 after retry RPC after error@1576475443) -> (continuation of Deferred@1427398252 after retry RPC after error@1926615303) -> (continuation of Deferred@1424833607 after retry RPC after error@824613738) -> (continuation of Deferred@1177965596 after retry RPC after error@439871540) -> (continuation of Deferred@654696497 after retry RPC after error@578671216) -> (continuation of Deferred@1444930711 after retry RPC after error@1942802472) -> (continuation of Deferred@2076221960 after retry RPC after error@929169746) -> (continuation of Deferred@519073909 after retry RPC after error@187215379) -> (continuation of Deferred@1963363740 after retry RPC after error@1388935935) -> (continuation of Deferred@1328007947 after retry RPC after error@28421322) -> (continuation of Deferred@1083882253 after retry RPC after error@1495088995) -> (continuation of Deferred@672389336 after retry RPC after error@617150188) -> (continuation of Deferred@832529323 after retry RPC after error@29992156) -> (continuation of Deferred@933919013 after retry RPC after error@1421252266) -> (continuation of Deferred@519972268 after retry RPC after error@1390255595) -> (continuation of Deferred@920298948 after retry RPC after error@1446602355)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.200.125:46459
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:04.978 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_3).
08:08:04.979 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#3 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_3.
08:08:04.981 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to FAILED on 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28687), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [69ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [76ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [85ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [89ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [371ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [372ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [373ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [374ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [439ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [441ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [525ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [573ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [573ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [574ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [575ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [582ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [586ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [602ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [603ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [603ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [603ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [643ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [645ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [646ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [646ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [723ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [723ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [725ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [725ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [764ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [765ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [766ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1004ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1004ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1040ms] refreshing cache from master, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1045ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1046ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1046ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1047ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1048ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1048ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2081ms] refreshing cache from master, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2083ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2084ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2084ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2355ms] refreshing cache from master, [2355ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2356ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2356ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2358ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2359ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2359ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2360ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [4901ms] refreshing cache from master, [4901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [4902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [4902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [4903ms] too many traces: truncated at 100 traces, deferred=Deferred@109165928(state=PENDING, result=null, callback=(continuation of Deferred@1693419531 after retry RPC after error@554555954) -> (continuation of Deferred@99265773 after retry RPC after error@244001733) -> (continuation of Deferred@381437391 after retry RPC after error@1504694624) -> (continuation of Deferred@166888316 after retry RPC after error@1592808580) -> (continuation of Deferred@714530984 after retry RPC after error@219484235) -> (continuation of Deferred@274828278 after retry RPC after error@1281992970) -> (continuation of Deferred@1365742479 after retry RPC after error@1960138400) -> (continuation of Deferred@1761037815 after retry RPC after error@1775732762) -> (continuation of Deferred@79791428 after retry RPC after error@1526706986) -> (continuation of Deferred@137745783 after retry RPC after error@1576475443) -> (continuation of Deferred@1427398252 after retry RPC after error@1926615303) -> (continuation of Deferred@1424833607 after retry RPC after error@824613738) -> (continuation of Deferred@1177965596 after retry RPC after error@439871540) -> (continuation of Deferred@654696497 after retry RPC after error@578671216) -> (continuation of Deferred@1444930711 after retry RPC after error@1942802472) -> (continuation of Deferred@2076221960 after retry RPC after error@929169746) -> (continuation of Deferred@519073909 after retry RPC after error@187215379) -> (continuation of Deferred@1963363740 after retry RPC after error@1388935935) -> (continuation of Deferred@1328007947 after retry RPC after error@28421322) -> (continuation of Deferred@1083882253 after retry RPC after error@1495088995) -> (continuation of Deferred@672389336 after retry RPC after error@617150188) -> (continuation of Deferred@832529323 after retry RPC after error@29992156) -> (continuation of Deferred@933919013 after retry RPC after error@1421252266) -> (continuation of Deferred@519972268 after retry RPC after error@1390255595) -> (continuation of Deferred@920298948 after retry RPC after error@1446602355), errback=(continuation of Deferred@1693419531 after retry RPC after error@554555954) -> (continuation of Deferred@99265773 after retry RPC after error@244001733) -> (continuation of Deferred@381437391 after retry RPC after error@1504694624) -> (continuation of Deferred@166888316 after retry RPC after error@1592808580) -> (continuation of Deferred@714530984 after retry RPC after error@219484235) -> (continuation of Deferred@274828278 after retry RPC after error@1281992970) -> (continuation of Deferred@1365742479 after retry RPC after error@1960138400) -> (continuation of Deferred@1761037815 after retry RPC after error@1775732762) -> (continuation of Deferred@79791428 after retry RPC after error@1526706986) -> (continuation of Deferred@137745783 after retry RPC after error@1576475443) -> (continuation of Deferred@1427398252 after retry RPC after error@1926615303) -> (continuation of Deferred@1424833607 after retry RPC after error@824613738) -> (continuation of Deferred@1177965596 after retry RPC after error@439871540) -> (continuation of Deferred@654696497 after retry RPC after error@578671216) -> (continuation of Deferred@1444930711 after retry RPC after error@1942802472) -> (continuation of Deferred@2076221960 after retry RPC after error@929169746) -> (continuation of Deferred@519073909 after retry RPC after error@187215379) -> (continuation of Deferred@1963363740 after retry RPC after error@1388935935) -> (continuation of Deferred@1328007947 after retry RPC after error@28421322) -> (continuation of Deferred@1083882253 after retry RPC after error@1495088995) -> (continuation of Deferred@672389336 after retry RPC after error@617150188) -> (continuation of Deferred@832529323 after retry RPC after error@29992156) -> (continuation of Deferred@933919013 after retry RPC after error@1421252266) -> (continuation of Deferred@519972268 after retry RPC after error@1390255595) -> (continuation of Deferred@920298948 after retry RPC after error@1446602355)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.200.125:46459
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:04.984 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:08:04.984 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#3) of source Source: KuduSource.
08:08:04.984 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_3.
08:08:04.984 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (0d2ddb76420639a9ec06ca05e894cb50) switched from state RUNNING to RESTARTING.
08:08:05.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:05.023077  1645 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } attempt: 3
08:08:05.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:05.027948  1645 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.134.253:41425: Network error: Client connection negotiation failed: client connection to 127.1.134.253:41425: connect: Connection refused (error 111)
08:08:05.038 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:05.054 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:05.055 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:05.055 [DEBUG - pool-259-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:05.055 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:05.055 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:05.055 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:05.056 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:05.056 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:05.056 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:05.056 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:05.056 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:05.056 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:05.056 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:05.057 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28805), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [299ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [305ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [320ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [322ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [340ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [457ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [459ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [459ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [460ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [461ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [461ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [482ms] refreshing cache from master, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [609ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [611ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [613ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [614ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [615ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [615ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [621ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [621ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [621ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [622ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [643ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [643ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [643ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [643ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [644ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [644ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [660ms] refreshing cache from master, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [661ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [661ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [662ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [662ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [702ms] refreshing cache from master, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [703ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [703ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [704ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [704ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [704ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [705ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [781ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [782ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [782ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [782ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1021ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1023ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1024ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1025ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1026ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1026ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1501ms] refreshing cache from master, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1503ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1504ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1505ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2341ms] refreshing cache from master, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2342ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2343ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2343ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2413ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2541ms] refreshing cache from master, [2541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2543ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2544ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2544ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2544ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [5761ms] refreshing cache from master, [5761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [5762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [5762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [5763ms] too many traces: truncated at 100 traces, deferred=Deferred@1093235101(state=PENDING, result=null, callback=(continuation of Deferred@847083246 after retry RPC after error@1184125337) -> (continuation of Deferred@1851612786 after retry RPC after error@1685225405) -> (continuation of Deferred@1038204891 after retry RPC after error@1495087463) -> (continuation of Deferred@1572291320 after retry RPC after error@718225764) -> (continuation of Deferred@450903169 after retry RPC after error@705095867) -> (continuation of Deferred@1304547201 after retry RPC after error@492135228) -> (continuation of Deferred@105533475 after retry RPC after error@454304609) -> (continuation of Deferred@1491753541 after retry RPC after error@1846583015) -> (continuation of Deferred@982450254 after retry RPC after error@3814229) -> (continuation of Deferred@168327525 after retry RPC after error@1619343717) -> (continuation of Deferred@583714891 after retry RPC after error@1941694428) -> (continuation of Deferred@976321439 after retry RPC after error@1932927917) -> (continuation of Deferred@122303760 after retry RPC after error@727951138) -> (continuation of Deferred@440388690 after retry RPC after error@1490468851) -> (continuation of Deferred@249750348 after retry RPC after error@948838149) -> (continuation of Deferred@1555499290 after retry RPC after error@829627480) -> (continuation of Deferred@672293305 after retry RPC after error@1621898633) -> (continuation of Deferred@70721375 after retry RPC after error@755978845) -> (continuation of Deferred@371978732 after retry RPC after error@388669149) -> (continuation of Deferred@727426688 after retry RPC after error@2081522700) -> (continuation of Deferred@897363699 after retry RPC after error@1986200311) -> (continuation of Deferred@16438557 after retry RPC after error@1891303658), errback=(continuation of Deferred@847083246 after retry RPC after error@1184125337) -> (continuation of Deferred@1851612786 after retry RPC after error@1685225405) -> (continuation of Deferred@1038204891 after retry RPC after error@1495087463) -> (continuation of Deferred@1572291320 after retry RPC after error@718225764) -> (continuation of Deferred@450903169 after retry RPC after error@705095867) -> (continuation of Deferred@1304547201 after retry RPC after error@492135228) -> (continuation of Deferred@105533475 after retry RPC after error@454304609) -> (continuation of Deferred@1491753541 after retry RPC after error@1846583015) -> (continuation of Deferred@982450254 after retry RPC after error@3814229) -> (continuation of Deferred@168327525 after retry RPC after error@1619343717) -> (continuation of Deferred@583714891 after retry RPC after error@1941694428) -> (continuation of Deferred@976321439 after retry RPC after error@1932927917) -> (continuation of Deferred@122303760 after retry RPC after error@727951138) -> (continuation of Deferred@440388690 after retry RPC after error@1490468851) -> (continuation of Deferred@249750348 after retry RPC after error@948838149) -> (continuation of Deferred@1555499290 after retry RPC after error@829627480) -> (continuation of Deferred@672293305 after retry RPC after error@1621898633) -> (continuation of Deferred@70721375 after retry RPC after error@755978845) -> (continuation of Deferred@371978732 after retry RPC after error@388669149) -> (continuation of Deferred@727426688 after retry RPC after error@2081522700) -> (continuation of Deferred@897363699 after retry RPC after error@1986200311) -> (continuation of Deferred@16438557 after retry RPC after error@1891303658)))
08:08:05.058 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
08:08:05.059 [WARN - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28805), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [299ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [305ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [320ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [322ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [340ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [457ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [459ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [459ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [460ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [461ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [461ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [482ms] refreshing cache from master, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [609ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [611ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [613ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [614ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [615ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [615ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [621ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [621ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [621ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [622ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [643ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [643ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [643ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [643ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [644ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [644ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [660ms] refreshing cache from master, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [661ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [661ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [662ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [662ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [702ms] refreshing cache from master, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [703ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [703ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [704ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [704ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [704ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [705ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [781ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [782ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [782ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [782ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1021ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1023ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1024ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1025ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1026ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1026ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1501ms] refreshing cache from master, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1503ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1504ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1505ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2341ms] refreshing cache from master, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2342ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2343ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2343ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2413ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2541ms] refreshing cache from master, [2541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2543ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2544ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2544ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2544ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [5761ms] refreshing cache from master, [5761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [5762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [5762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [5763ms] too many traces: truncated at 100 traces, deferred=Deferred@1093235101(state=PENDING, result=null, callback=(continuation of Deferred@847083246 after retry RPC after error@1184125337) -> (continuation of Deferred@1851612786 after retry RPC after error@1685225405) -> (continuation of Deferred@1038204891 after retry RPC after error@1495087463) -> (continuation of Deferred@1572291320 after retry RPC after error@718225764) -> (continuation of Deferred@450903169 after retry RPC after error@705095867) -> (continuation of Deferred@1304547201 after retry RPC after error@492135228) -> (continuation of Deferred@105533475 after retry RPC after error@454304609) -> (continuation of Deferred@1491753541 after retry RPC after error@1846583015) -> (continuation of Deferred@982450254 after retry RPC after error@3814229) -> (continuation of Deferred@168327525 after retry RPC after error@1619343717) -> (continuation of Deferred@583714891 after retry RPC after error@1941694428) -> (continuation of Deferred@976321439 after retry RPC after error@1932927917) -> (continuation of Deferred@122303760 after retry RPC after error@727951138) -> (continuation of Deferred@440388690 after retry RPC after error@1490468851) -> (continuation of Deferred@249750348 after retry RPC after error@948838149) -> (continuation of Deferred@1555499290 after retry RPC after error@829627480) -> (continuation of Deferred@672293305 after retry RPC after error@1621898633) -> (continuation of Deferred@70721375 after retry RPC after error@755978845) -> (continuation of Deferred@371978732 after retry RPC after error@388669149) -> (continuation of Deferred@727426688 after retry RPC after error@2081522700) -> (continuation of Deferred@897363699 after retry RPC after error@1986200311) -> (continuation of Deferred@16438557 after retry RPC after error@1891303658), errback=(continuation of Deferred@847083246 after retry RPC after error@1184125337) -> (continuation of Deferred@1851612786 after retry RPC after error@1685225405) -> (continuation of Deferred@1038204891 after retry RPC after error@1495087463) -> (continuation of Deferred@1572291320 after retry RPC after error@718225764) -> (continuation of Deferred@450903169 after retry RPC after error@705095867) -> (continuation of Deferred@1304547201 after retry RPC after error@492135228) -> (continuation of Deferred@105533475 after retry RPC after error@454304609) -> (continuation of Deferred@1491753541 after retry RPC after error@1846583015) -> (continuation of Deferred@982450254 after retry RPC after error@3814229) -> (continuation of Deferred@168327525 after retry RPC after error@1619343717) -> (continuation of Deferred@583714891 after retry RPC after error@1941694428) -> (continuation of Deferred@976321439 after retry RPC after error@1932927917) -> (continuation of Deferred@122303760 after retry RPC after error@727951138) -> (continuation of Deferred@440388690 after retry RPC after error@1490468851) -> (continuation of Deferred@249750348 after retry RPC after error@948838149) -> (continuation of Deferred@1555499290 after retry RPC after error@829627480) -> (continuation of Deferred@672293305 after retry RPC after error@1621898633) -> (continuation of Deferred@70721375 after retry RPC after error@755978845) -> (continuation of Deferred@371978732 after retry RPC after error@388669149) -> (continuation of Deferred@727426688 after retry RPC after error@2081522700) -> (continuation of Deferred@897363699 after retry RPC after error@1986200311) -> (continuation of Deferred@16438557 after retry RPC after error@1891303658)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.200.124:34439
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:05.061 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
08:08:05.062 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#3 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_3.
08:08:05.064 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to FAILED on 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28805), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [299ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [305ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [320ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [322ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [340ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [457ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [459ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [459ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [460ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [461ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [461ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [482ms] refreshing cache from master, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [609ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [611ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [613ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [614ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [615ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [615ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [621ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [621ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [621ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [622ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [643ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [643ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [643ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [643ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [644ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [644ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [660ms] refreshing cache from master, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [661ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [661ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [662ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [662ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [702ms] refreshing cache from master, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [703ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [703ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [704ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [704ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [704ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [705ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [781ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [782ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [782ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [782ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1021ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1023ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1024ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1025ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1026ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1026ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1501ms] refreshing cache from master, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1503ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1504ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1505ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2341ms] refreshing cache from master, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2342ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2343ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2343ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2413ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2541ms] refreshing cache from master, [2541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2543ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2544ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2544ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2544ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [5761ms] refreshing cache from master, [5761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [5762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [5762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [5763ms] too many traces: truncated at 100 traces, deferred=Deferred@1093235101(state=PENDING, result=null, callback=(continuation of Deferred@847083246 after retry RPC after error@1184125337) -> (continuation of Deferred@1851612786 after retry RPC after error@1685225405) -> (continuation of Deferred@1038204891 after retry RPC after error@1495087463) -> (continuation of Deferred@1572291320 after retry RPC after error@718225764) -> (continuation of Deferred@450903169 after retry RPC after error@705095867) -> (continuation of Deferred@1304547201 after retry RPC after error@492135228) -> (continuation of Deferred@105533475 after retry RPC after error@454304609) -> (continuation of Deferred@1491753541 after retry RPC after error@1846583015) -> (continuation of Deferred@982450254 after retry RPC after error@3814229) -> (continuation of Deferred@168327525 after retry RPC after error@1619343717) -> (continuation of Deferred@583714891 after retry RPC after error@1941694428) -> (continuation of Deferred@976321439 after retry RPC after error@1932927917) -> (continuation of Deferred@122303760 after retry RPC after error@727951138) -> (continuation of Deferred@440388690 after retry RPC after error@1490468851) -> (continuation of Deferred@249750348 after retry RPC after error@948838149) -> (continuation of Deferred@1555499290 after retry RPC after error@829627480) -> (continuation of Deferred@672293305 after retry RPC after error@1621898633) -> (continuation of Deferred@70721375 after retry RPC after error@755978845) -> (continuation of Deferred@371978732 after retry RPC after error@388669149) -> (continuation of Deferred@727426688 after retry RPC after error@2081522700) -> (continuation of Deferred@897363699 after retry RPC after error@1986200311) -> (continuation of Deferred@16438557 after retry RPC after error@1891303658), errback=(continuation of Deferred@847083246 after retry RPC after error@1184125337) -> (continuation of Deferred@1851612786 after retry RPC after error@1685225405) -> (continuation of Deferred@1038204891 after retry RPC after error@1495087463) -> (continuation of Deferred@1572291320 after retry RPC after error@718225764) -> (continuation of Deferred@450903169 after retry RPC after error@705095867) -> (continuation of Deferred@1304547201 after retry RPC after error@492135228) -> (continuation of Deferred@105533475 after retry RPC after error@454304609) -> (continuation of Deferred@1491753541 after retry RPC after error@1846583015) -> (continuation of Deferred@982450254 after retry RPC after error@3814229) -> (continuation of Deferred@168327525 after retry RPC after error@1619343717) -> (continuation of Deferred@583714891 after retry RPC after error@1941694428) -> (continuation of Deferred@976321439 after retry RPC after error@1932927917) -> (continuation of Deferred@122303760 after retry RPC after error@727951138) -> (continuation of Deferred@440388690 after retry RPC after error@1490468851) -> (continuation of Deferred@249750348 after retry RPC after error@948838149) -> (continuation of Deferred@1555499290 after retry RPC after error@829627480) -> (continuation of Deferred@672293305 after retry RPC after error@1621898633) -> (continuation of Deferred@70721375 after retry RPC after error@755978845) -> (continuation of Deferred@371978732 after retry RPC after error@388669149) -> (continuation of Deferred@727426688 after retry RPC after error@2081522700) -> (continuation of Deferred@897363699 after retry RPC after error@1986200311) -> (continuation of Deferred@16438557 after retry RPC after error@1891303658)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.200.124:34439
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:05.067 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:08:05.067 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#3) of source Source: KuduSource.
08:08:05.067 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_3.
08:08:05.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:05.146194  1647 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:08:05.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:05.146906  1647 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:08:05.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:05.147567  1647 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:08:05.150 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091685149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:05.150 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:05.160 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
08:08:05.161 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
08:08:05.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:05.171510  1645 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } attempt: 4
08:08:05.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:05.176482  1645 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.134.253:41425: Network error: Client connection negotiation failed: client connection to 127.1.134.253:41425: connect: Connection refused (error 111)
08:08:05.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:05.192793  1647 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:08:05.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:05.193246  1647 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:08:05.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:05.193601  1647 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:08:05.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:05.193960  1647 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:08:05.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:05.194283  1647 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:08:05.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:05.194543  1647 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33487/jwks.json
08:08:05.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:05.238933  1647 master_runner.cc:387] Master server non-default flags:
08:08:05.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:05.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.134.212:46153
08:08:05.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:05.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:05.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-1/data
08:08:05.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-1/wal
08:08:05.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:08:05.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093
08:08:05.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:05.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:05.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:08:05.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.134.253:41425
08:08:05.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:08:05.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:08:05.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:08:05.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33487/jwks.json
08:08:05.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:05.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:05.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-1/data/info.pb
08:08:05.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.134.253
08:08:05.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:05.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:08:05.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:05.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:08:05.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:08:05.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:05.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-1/logs
08:08:05.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:05.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:08:05.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:08:05.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:08:05.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:08:05.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:08:05.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:08:05.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:08:05.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:08:05.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:08:05.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:05.241026  1647 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:08:05.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:05.243206  1647 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:08:05.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:05.257151  1656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:05.334 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:05.335 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:05.335 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:05.336 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.336 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.336 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.337 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.337 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.337 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.338 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.338 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.338 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.338 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:05.339 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28934), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [108ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [120ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [126ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [126ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [229ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [230ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [232ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [237ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [237ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [301ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [303ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [303ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [323ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [343ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [344ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [380ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [384ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [443ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [443ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [444ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [444ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [562ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [562ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [563ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [563ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [764ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [765ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1244ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1881ms] refreshing cache from master, [1881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1883ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1883ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1884ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1884ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2981ms] refreshing cache from master, [2981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2982ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2982ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2983ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2983ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [3720ms] refreshing cache from master, [3720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [3722ms] too many traces: truncated at 100 traces, deferred=Deferred@804398577(state=PENDING, result=null, callback=(continuation of Deferred@570212908 after retry RPC after error@2025830808) -> (continuation of Deferred@344773564 after retry RPC after error@720351601) -> (continuation of Deferred@1841691554 after retry RPC after error@1756622075) -> (continuation of Deferred@441504610 after retry RPC after error@1298369888) -> (continuation of Deferred@263812997 after retry RPC after error@2015004349) -> (continuation of Deferred@1682805023 after retry RPC after error@890509435) -> (continuation of Deferred@1901413379 after retry RPC after error@1565920250) -> (continuation of Deferred@1436265510 after retry RPC after error@1088008494) -> (continuation of Deferred@460816490 after retry RPC after error@1989366053) -> (continuation of Deferred@2128685389 after retry RPC after error@1941747582) -> (continuation of Deferred@1416568243 after retry RPC after error@941188194) -> (continuation of Deferred@1338349933 after retry RPC after error@1498726572) -> (continuation of Deferred@1970982064 after retry RPC after error@104045577) -> (continuation of Deferred@1709077331 after retry RPC after error@443584228) -> (continuation of Deferred@961334870 after retry RPC after error@595975842) -> (continuation of Deferred@894920042 after retry RPC after error@726583946) -> (continuation of Deferred@1957662667 after retry RPC after error@2035429170) -> (continuation of Deferred@2007001415 after retry RPC after error@719845283) -> (continuation of Deferred@582935779 after retry RPC after error@1249735737) -> (continuation of Deferred@1046730336 after retry RPC after error@732718304) -> (continuation of Deferred@2128614538 after retry RPC after error@1595767763) -> (continuation of Deferred@2146268806 after retry RPC after error@934188799) -> (continuation of Deferred@1234469060 after retry RPC after error@2112076230) -> (continuation of Deferred@1773054394 after retry RPC after error@712299294), errback=(continuation of Deferred@570212908 after retry RPC after error@2025830808) -> (continuation of Deferred@344773564 after retry RPC after error@720351601) -> (continuation of Deferred@1841691554 after retry RPC after error@1756622075) -> (continuation of Deferred@441504610 after retry RPC after error@1298369888) -> (continuation of Deferred@263812997 after retry RPC after error@2015004349) -> (continuation of Deferred@1682805023 after retry RPC after error@890509435) -> (continuation of Deferred@1901413379 after retry RPC after error@1565920250) -> (continuation of Deferred@1436265510 after retry RPC after error@1088008494) -> (continuation of Deferred@460816490 after retry RPC after error@1989366053) -> (continuation of Deferred@2128685389 after retry RPC after error@1941747582) -> (continuation of Deferred@1416568243 after retry RPC after error@941188194) -> (continuation of Deferred@1338349933 after retry RPC after error@1498726572) -> (continuation of Deferred@1970982064 after retry RPC after error@104045577) -> (continuation of Deferred@1709077331 after retry RPC after error@443584228) -> (continuation of Deferred@961334870 after retry RPC after error@595975842) -> (continuation of Deferred@894920042 after retry RPC after error@726583946) -> (continuation of Deferred@1957662667 after retry RPC after error@2035429170) -> (continuation of Deferred@2007001415 after retry RPC after error@719845283) -> (continuation of Deferred@582935779 after retry RPC after error@1249735737) -> (continuation of Deferred@1046730336 after retry RPC after error@732718304) -> (continuation of Deferred@2128614538 after retry RPC after error@1595767763) -> (continuation of Deferred@2146268806 after retry RPC after error@934188799) -> (continuation of Deferred@1234469060 after retry RPC after error@2112076230) -> (continuation of Deferred@1773054394 after retry RPC after error@712299294)))
08:08:05.341 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:05.341 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28934), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [108ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [120ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [126ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [126ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [229ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [230ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [232ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [237ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [237ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [301ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [303ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [303ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [323ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [343ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [344ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [380ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [384ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [443ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [443ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [444ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [444ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [562ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [562ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [563ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [563ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [764ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [765ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1244ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1881ms] refreshing cache from master, [1881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1883ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1883ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1884ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1884ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2981ms] refreshing cache from master, [2981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2982ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2982ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2983ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2983ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [3720ms] refreshing cache from master, [3720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [3722ms] too many traces: truncated at 100 traces, deferred=Deferred@804398577(state=PENDING, result=null, callback=(continuation of Deferred@570212908 after retry RPC after error@2025830808) -> (continuation of Deferred@344773564 after retry RPC after error@720351601) -> (continuation of Deferred@1841691554 after retry RPC after error@1756622075) -> (continuation of Deferred@441504610 after retry RPC after error@1298369888) -> (continuation of Deferred@263812997 after retry RPC after error@2015004349) -> (continuation of Deferred@1682805023 after retry RPC after error@890509435) -> (continuation of Deferred@1901413379 after retry RPC after error@1565920250) -> (continuation of Deferred@1436265510 after retry RPC after error@1088008494) -> (continuation of Deferred@460816490 after retry RPC after error@1989366053) -> (continuation of Deferred@2128685389 after retry RPC after error@1941747582) -> (continuation of Deferred@1416568243 after retry RPC after error@941188194) -> (continuation of Deferred@1338349933 after retry RPC after error@1498726572) -> (continuation of Deferred@1970982064 after retry RPC after error@104045577) -> (continuation of Deferred@1709077331 after retry RPC after error@443584228) -> (continuation of Deferred@961334870 after retry RPC after error@595975842) -> (continuation of Deferred@894920042 after retry RPC after error@726583946) -> (continuation of Deferred@1957662667 after retry RPC after error@2035429170) -> (continuation of Deferred@2007001415 after retry RPC after error@719845283) -> (continuation of Deferred@582935779 after retry RPC after error@1249735737) -> (continuation of Deferred@1046730336 after retry RPC after error@732718304) -> (continuation of Deferred@2128614538 after retry RPC after error@1595767763) -> (continuation of Deferred@2146268806 after retry RPC after error@934188799) -> (continuation of Deferred@1234469060 after retry RPC after error@2112076230) -> (continuation of Deferred@1773054394 after retry RPC after error@712299294), errback=(continuation of Deferred@570212908 after retry RPC after error@2025830808) -> (continuation of Deferred@344773564 after retry RPC after error@720351601) -> (continuation of Deferred@1841691554 after retry RPC after error@1756622075) -> (continuation of Deferred@441504610 after retry RPC after error@1298369888) -> (continuation of Deferred@263812997 after retry RPC after error@2015004349) -> (continuation of Deferred@1682805023 after retry RPC after error@890509435) -> (continuation of Deferred@1901413379 after retry RPC after error@1565920250) -> (continuation of Deferred@1436265510 after retry RPC after error@1088008494) -> (continuation of Deferred@460816490 after retry RPC after error@1989366053) -> (continuation of Deferred@2128685389 after retry RPC after error@1941747582) -> (continuation of Deferred@1416568243 after retry RPC after error@941188194) -> (continuation of Deferred@1338349933 after retry RPC after error@1498726572) -> (continuation of Deferred@1970982064 after retry RPC after error@104045577) -> (continuation of Deferred@1709077331 after retry RPC after error@443584228) -> (continuation of Deferred@961334870 after retry RPC after error@595975842) -> (continuation of Deferred@894920042 after retry RPC after error@726583946) -> (continuation of Deferred@1957662667 after retry RPC after error@2035429170) -> (continuation of Deferred@2007001415 after retry RPC after error@719845283) -> (continuation of Deferred@582935779 after retry RPC after error@1249735737) -> (continuation of Deferred@1046730336 after retry RPC after error@732718304) -> (continuation of Deferred@2128614538 after retry RPC after error@1595767763) -> (continuation of Deferred@2146268806 after retry RPC after error@934188799) -> (continuation of Deferred@1234469060 after retry RPC after error@2112076230) -> (continuation of Deferred@1773054394 after retry RPC after error@712299294)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28934), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [108ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [120ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [126ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [126ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [229ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [230ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [232ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [237ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [237ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [301ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [303ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [303ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [323ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [343ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [344ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [380ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [384ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [443ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [443ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [444ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [444ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [562ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [562ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [563ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [563ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [764ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [765ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1244ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1881ms] refreshing cache from master, [1881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1883ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1883ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1884ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1884ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2981ms] refreshing cache from master, [2981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2982ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2982ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2983ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2983ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [3720ms] refreshing cache from master, [3720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [3722ms] too many traces: truncated at 100 traces, deferred=Deferred@804398577(state=PENDING, result=null, callback=(continuation of Deferred@570212908 after retry RPC after error@2025830808) -> (continuation of Deferred@344773564 after retry RPC after error@720351601) -> (continuation of Deferred@1841691554 after retry RPC after error@1756622075) -> (continuation of Deferred@441504610 after retry RPC after error@1298369888) -> (continuation of Deferred@263812997 after retry RPC after error@2015004349) -> (continuation of Deferred@1682805023 after retry RPC after error@890509435) -> (continuation of Deferred@1901413379 after retry RPC after error@1565920250) -> (continuation of Deferred@1436265510 after retry RPC after error@1088008494) -> (continuation of Deferred@460816490 after retry RPC after error@1989366053) -> (continuation of Deferred@2128685389 after retry RPC after error@1941747582) -> (continuation of Deferred@1416568243 after retry RPC after error@941188194) -> (continuation of Deferred@1338349933 after retry RPC after error@1498726572) -> (continuation of Deferred@1970982064 after retry RPC after error@104045577) -> (continuation of Deferred@1709077331 after retry RPC after error@443584228) -> (continuation of Deferred@961334870 after retry RPC after error@595975842) -> (continuation of Deferred@894920042 after retry RPC after error@726583946) -> (continuation of Deferred@1957662667 after retry RPC after error@2035429170) -> (continuation of Deferred@2007001415 after retry RPC after error@719845283) -> (continuation of Deferred@582935779 after retry RPC after error@1249735737) -> (continuation of Deferred@1046730336 after retry RPC after error@732718304) -> (continuation of Deferred@2128614538 after retry RPC after error@1595767763) -> (continuation of Deferred@2146268806 after retry RPC after error@934188799) -> (continuation of Deferred@1234469060 after retry RPC after error@2112076230) -> (continuation of Deferred@1773054394 after retry RPC after error@712299294), errback=(continuation of Deferred@570212908 after retry RPC after error@2025830808) -> (continuation of Deferred@344773564 after retry RPC after error@720351601) -> (continuation of Deferred@1841691554 after retry RPC after error@1756622075) -> (continuation of Deferred@441504610 after retry RPC after error@1298369888) -> (continuation of Deferred@263812997 after retry RPC after error@2015004349) -> (continuation of Deferred@1682805023 after retry RPC after error@890509435) -> (continuation of Deferred@1901413379 after retry RPC after error@1565920250) -> (continuation of Deferred@1436265510 after retry RPC after error@1088008494) -> (continuation of Deferred@460816490 after retry RPC after error@1989366053) -> (continuation of Deferred@2128685389 after retry RPC after error@1941747582) -> (continuation of Deferred@1416568243 after retry RPC after error@941188194) -> (continuation of Deferred@1338349933 after retry RPC after error@1498726572) -> (continuation of Deferred@1970982064 after retry RPC after error@104045577) -> (continuation of Deferred@1709077331 after retry RPC after error@443584228) -> (continuation of Deferred@961334870 after retry RPC after error@595975842) -> (continuation of Deferred@894920042 after retry RPC after error@726583946) -> (continuation of Deferred@1957662667 after retry RPC after error@2035429170) -> (continuation of Deferred@2007001415 after retry RPC after error@719845283) -> (continuation of Deferred@582935779 after retry RPC after error@1249735737) -> (continuation of Deferred@1046730336 after retry RPC after error@732718304) -> (continuation of Deferred@2128614538 after retry RPC after error@1595767763) -> (continuation of Deferred@2146268806 after retry RPC after error@934188799) -> (continuation of Deferred@1234469060 after retry RPC after error@2112076230) -> (continuation of Deferred@1773054394 after retry RPC after error@712299294)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.17.253:37621
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:05.342 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:05.342 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:05.343 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.344 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.344 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.344 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.345 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.345 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.350 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.350 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.350 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.350 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:05.352 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28934), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [108ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [120ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [126ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [126ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [229ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [230ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [232ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [237ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [237ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [301ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [303ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [303ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [323ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [343ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [344ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [380ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [384ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [443ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [443ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [444ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [444ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [562ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [562ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [563ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [563ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [764ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [765ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1244ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1881ms] refreshing cache from master, [1881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1883ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1883ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1884ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1884ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2981ms] refreshing cache from master, [2981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2982ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2982ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2983ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2983ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [3720ms] refreshing cache from master, [3720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [3722ms] too many traces: truncated at 100 traces, deferred=Deferred@804398577(state=PENDING, result=null, callback=(continuation of Deferred@570212908 after retry RPC after error@2025830808) -> (continuation of Deferred@344773564 after retry RPC after error@720351601) -> (continuation of Deferred@1841691554 after retry RPC after error@1756622075) -> (continuation of Deferred@441504610 after retry RPC after error@1298369888) -> (continuation of Deferred@263812997 after retry RPC after error@2015004349) -> (continuation of Deferred@1682805023 after retry RPC after error@890509435) -> (continuation of Deferred@1901413379 after retry RPC after error@1565920250) -> (continuation of Deferred@1436265510 after retry RPC after error@1088008494) -> (continuation of Deferred@460816490 after retry RPC after error@1989366053) -> (continuation of Deferred@2128685389 after retry RPC after error@1941747582) -> (continuation of Deferred@1416568243 after retry RPC after error@941188194) -> (continuation of Deferred@1338349933 after retry RPC after error@1498726572) -> (continuation of Deferred@1970982064 after retry RPC after error@104045577) -> (continuation of Deferred@1709077331 after retry RPC after error@443584228) -> (continuation of Deferred@961334870 after retry RPC after error@595975842) -> (continuation of Deferred@894920042 after retry RPC after error@726583946) -> (continuation of Deferred@1957662667 after retry RPC after error@2035429170) -> (continuation of Deferred@2007001415 after retry RPC after error@719845283) -> (continuation of Deferred@582935779 after retry RPC after error@1249735737) -> (continuation of Deferred@1046730336 after retry RPC after error@732718304) -> (continuation of Deferred@2128614538 after retry RPC after error@1595767763) -> (continuation of Deferred@2146268806 after retry RPC after error@934188799) -> (continuation of Deferred@1234469060 after retry RPC after error@2112076230) -> (continuation of Deferred@1773054394 after retry RPC after error@712299294), errback=(continuation of Deferred@570212908 after retry RPC after error@2025830808) -> (continuation of Deferred@344773564 after retry RPC after error@720351601) -> (continuation of Deferred@1841691554 after retry RPC after error@1756622075) -> (continuation of Deferred@441504610 after retry RPC after error@1298369888) -> (continuation of Deferred@263812997 after retry RPC after error@2015004349) -> (continuation of Deferred@1682805023 after retry RPC after error@890509435) -> (continuation of Deferred@1901413379 after retry RPC after error@1565920250) -> (continuation of Deferred@1436265510 after retry RPC after error@1088008494) -> (continuation of Deferred@460816490 after retry RPC after error@1989366053) -> (continuation of Deferred@2128685389 after retry RPC after error@1941747582) -> (continuation of Deferred@1416568243 after retry RPC after error@941188194) -> (continuation of Deferred@1338349933 after retry RPC after error@1498726572) -> (continuation of Deferred@1970982064 after retry RPC after error@104045577) -> (continuation of Deferred@1709077331 after retry RPC after error@443584228) -> (continuation of Deferred@961334870 after retry RPC after error@595975842) -> (continuation of Deferred@894920042 after retry RPC after error@726583946) -> (continuation of Deferred@1957662667 after retry RPC after error@2035429170) -> (continuation of Deferred@2007001415 after retry RPC after error@719845283) -> (continuation of Deferred@582935779 after retry RPC after error@1249735737) -> (continuation of Deferred@1046730336 after retry RPC after error@732718304) -> (continuation of Deferred@2128614538 after retry RPC after error@1595767763) -> (continuation of Deferred@2146268806 after retry RPC after error@934188799) -> (continuation of Deferred@1234469060 after retry RPC after error@2112076230) -> (continuation of Deferred@1773054394 after retry RPC after error@712299294)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28934), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [108ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [120ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [126ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [126ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [229ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [230ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [232ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [237ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [237ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [301ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [303ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [303ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [323ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [343ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [344ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [380ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [384ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [443ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [443ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [444ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [444ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [562ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [562ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [563ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [563ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [764ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [765ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1244ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1881ms] refreshing cache from master, [1881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1883ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1883ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1884ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1884ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2981ms] refreshing cache from master, [2981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2982ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2982ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2983ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2983ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [3720ms] refreshing cache from master, [3720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [3722ms] too many traces: truncated at 100 traces, deferred=Deferred@804398577(state=PENDING, result=null, callback=(continuation of Deferred@570212908 after retry RPC after error@2025830808) -> (continuation of Deferred@344773564 after retry RPC after error@720351601) -> (continuation of Deferred@1841691554 after retry RPC after error@1756622075) -> (continuation of Deferred@441504610 after retry RPC after error@1298369888) -> (continuation of Deferred@263812997 after retry RPC after error@2015004349) -> (continuation of Deferred@1682805023 after retry RPC after error@890509435) -> (continuation of Deferred@1901413379 after retry RPC after error@1565920250) -> (continuation of Deferred@1436265510 after retry RPC after error@1088008494) -> (continuation of Deferred@460816490 after retry RPC after error@1989366053) -> (continuation of Deferred@2128685389 after retry RPC after error@1941747582) -> (continuation of Deferred@1416568243 after retry RPC after error@941188194) -> (continuation of Deferred@1338349933 after retry RPC after error@1498726572) -> (continuation of Deferred@1970982064 after retry RPC after error@104045577) -> (continuation of Deferred@1709077331 after retry RPC after error@443584228) -> (continuation of Deferred@961334870 after retry RPC after error@595975842) -> (continuation of Deferred@894920042 after retry RPC after error@726583946) -> (continuation of Deferred@1957662667 after retry RPC after error@2035429170) -> (continuation of Deferred@2007001415 after retry RPC after error@719845283) -> (continuation of Deferred@582935779 after retry RPC after error@1249735737) -> (continuation of Deferred@1046730336 after retry RPC after error@732718304) -> (continuation of Deferred@2128614538 after retry RPC after error@1595767763) -> (continuation of Deferred@2146268806 after retry RPC after error@934188799) -> (continuation of Deferred@1234469060 after retry RPC after error@2112076230) -> (continuation of Deferred@1773054394 after retry RPC after error@712299294), errback=(continuation of Deferred@570212908 after retry RPC after error@2025830808) -> (continuation of Deferred@344773564 after retry RPC after error@720351601) -> (continuation of Deferred@1841691554 after retry RPC after error@1756622075) -> (continuation of Deferred@441504610 after retry RPC after error@1298369888) -> (continuation of Deferred@263812997 after retry RPC after error@2015004349) -> (continuation of Deferred@1682805023 after retry RPC after error@890509435) -> (continuation of Deferred@1901413379 after retry RPC after error@1565920250) -> (continuation of Deferred@1436265510 after retry RPC after error@1088008494) -> (continuation of Deferred@460816490 after retry RPC after error@1989366053) -> (continuation of Deferred@2128685389 after retry RPC after error@1941747582) -> (continuation of Deferred@1416568243 after retry RPC after error@941188194) -> (continuation of Deferred@1338349933 after retry RPC after error@1498726572) -> (continuation of Deferred@1970982064 after retry RPC after error@104045577) -> (continuation of Deferred@1709077331 after retry RPC after error@443584228) -> (continuation of Deferred@961334870 after retry RPC after error@595975842) -> (continuation of Deferred@894920042 after retry RPC after error@726583946) -> (continuation of Deferred@1957662667 after retry RPC after error@2035429170) -> (continuation of Deferred@2007001415 after retry RPC after error@719845283) -> (continuation of Deferred@582935779 after retry RPC after error@1249735737) -> (continuation of Deferred@1046730336 after retry RPC after error@732718304) -> (continuation of Deferred@2128614538 after retry RPC after error@1595767763) -> (continuation of Deferred@2146268806 after retry RPC after error@934188799) -> (continuation of Deferred@1234469060 after retry RPC after error@2112076230) -> (continuation of Deferred@1773054394 after retry RPC after error@712299294)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.17.253:37621
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:05.354 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:05.354 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:05.355 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.356 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.356 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.356 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
08:08:05.357 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#3) of source Source: KuduSource.
08:08:05.357 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:05.357 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to CANCELING.
08:08:05.357 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.357 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.357 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.358 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#3) of source Source: KuduSource.
08:08:05.358 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to CANCELING.
08:08:05.358 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.358 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.358 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.358 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:05.358 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
08:08:05.358 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to CANCELING.
08:08:05.359 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
08:08:05.360 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
08:08:05.360 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CANCELING to CANCELED.
08:08:05.361 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
08:08:05.361 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
08:08:05.361 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to CANCELING.
08:08:05.361 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
08:08:05.363 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#3 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_3.
08:08:05.364 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CANCELING to CANCELED.
08:08:05.365 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:08:05.366 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
08:08:05.366 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CANCELING to CANCELED.
08:08:05.366 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#3 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
08:08:05.367 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#3 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_3.
08:08:05.368 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CANCELING to CANCELED.
08:08:05.369 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 0d2ddb76420639a9ec06ca05e894cb50
08:08:05.374 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:05.375 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:05.375 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:05.375 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.375 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.375 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.375 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.376 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.376 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.376 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.376 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.376 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.376 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:05.394 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:05.395 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:05.395 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:05.395 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.396 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.396 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.396 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.396 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.396 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.396 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.396 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.396 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.396 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:05.411 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:05.414 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:05.414 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:05.415 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.415 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.415 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.415 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:05.416 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.416 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.416 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.416 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.417 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.417 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.417 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:05.458 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:05.458 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:05.459 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.459 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.459 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.460 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.460 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:05.460 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.460 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.461 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.461 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.461 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.461 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:05.474 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:05.475 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:05.475 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.475 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.476 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.476 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.476 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.476 [INFO - pool-256-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.476 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:05.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:05.475979  1645 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } attempt: 5
08:08:05.477 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.477 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.477 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.477 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:05.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:05.483494  1645 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.134.253:41425: Network error: Client connection negotiation failed: client connection to 127.1.134.253:41425: connect: Connection refused (error 111)
08:08:05.514 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:05.515 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:05.515 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:05.515 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.515 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.515 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.516 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.516 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.516 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.516 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.516 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.516 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.517 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:05.538 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:05.603 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:05.603 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:05.603 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:05.604 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:05.604 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:05.604 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:05.604 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:05.605 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:05.605 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:05.604 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:05.605 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:05.605 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:05.605 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:05.608 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29346), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [125ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [140ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [145ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [145ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [249ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [255ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [258ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [331ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [332ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [501ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [507ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [508ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [509ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [509ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [523ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [523ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [524ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [524ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [542ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [542ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [543ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [543ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [562ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [562ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [563ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [563ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [623ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [623ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [624ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [624ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [625ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [625ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [742ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [742ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [743ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [743ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [762ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [762ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [762ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [762ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1041ms] refreshing cache from master, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1042ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1043ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1045ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1045ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1045ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1100ms] refreshing cache from master, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1102ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1481ms] refreshing cache from master, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1482ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1482ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1483ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1483ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [4280ms] refreshing cache from master, [4280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [4281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [4281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [4283ms] too many traces: truncated at 100 traces, deferred=Deferred@1134805852(state=PENDING, result=null, callback=(continuation of Deferred@139037322 after retry RPC after error@725333257) -> (continuation of Deferred@472916790 after retry RPC after error@1104460495) -> (continuation of Deferred@84768165 after retry RPC after error@1944587248) -> (continuation of Deferred@1851567912 after retry RPC after error@179987182) -> (continuation of Deferred@1693748801 after retry RPC after error@1475395236) -> (continuation of Deferred@1549692573 after retry RPC after error@95083242) -> (continuation of Deferred@1173150360 after retry RPC after error@398154015) -> (continuation of Deferred@943646707 after retry RPC after error@1796216724) -> (continuation of Deferred@1217083508 after retry RPC after error@95810523) -> (continuation of Deferred@1249615329 after retry RPC after error@557617037) -> (continuation of Deferred@820333382 after retry RPC after error@451169706) -> (continuation of Deferred@216420226 after retry RPC after error@1239677300) -> (continuation of Deferred@1397105781 after retry RPC after error@1811393194) -> (continuation of Deferred@1439920649 after retry RPC after error@53283230) -> (continuation of Deferred@1638592514 after retry RPC after error@928949351) -> (continuation of Deferred@2043927487 after retry RPC after error@307846370) -> (continuation of Deferred@608539723 after retry RPC after error@1727689016) -> (continuation of Deferred@26427515 after retry RPC after error@1509270247) -> (continuation of Deferred@1360691806 after retry RPC after error@1683770100) -> (continuation of Deferred@2144816796 after retry RPC after error@197212443) -> (continuation of Deferred@239882831 after retry RPC after error@146911896) -> (continuation of Deferred@1302834866 after retry RPC after error@1328304124), errback=(continuation of Deferred@139037322 after retry RPC after error@725333257) -> (continuation of Deferred@472916790 after retry RPC after error@1104460495) -> (continuation of Deferred@84768165 after retry RPC after error@1944587248) -> (continuation of Deferred@1851567912 after retry RPC after error@179987182) -> (continuation of Deferred@1693748801 after retry RPC after error@1475395236) -> (continuation of Deferred@1549692573 after retry RPC after error@95083242) -> (continuation of Deferred@1173150360 after retry RPC after error@398154015) -> (continuation of Deferred@943646707 after retry RPC after error@1796216724) -> (continuation of Deferred@1217083508 after retry RPC after error@95810523) -> (continuation of Deferred@1249615329 after retry RPC after error@557617037) -> (continuation of Deferred@820333382 after retry RPC after error@451169706) -> (continuation of Deferred@216420226 after retry RPC after error@1239677300) -> (continuation of Deferred@1397105781 after retry RPC after error@1811393194) -> (continuation of Deferred@1439920649 after retry RPC after error@53283230) -> (continuation of Deferred@1638592514 after retry RPC after error@928949351) -> (continuation of Deferred@2043927487 after retry RPC after error@307846370) -> (continuation of Deferred@608539723 after retry RPC after error@1727689016) -> (continuation of Deferred@26427515 after retry RPC after error@1509270247) -> (continuation of Deferred@1360691806 after retry RPC after error@1683770100) -> (continuation of Deferred@2144816796 after retry RPC after error@197212443) -> (continuation of Deferred@239882831 after retry RPC after error@146911896) -> (continuation of Deferred@1302834866 after retry RPC after error@1328304124)))
08:08:05.610 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
08:08:05.611 [WARN - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#6 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29346), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [125ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [140ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [145ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [145ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [249ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [255ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [258ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [331ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [332ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [501ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [507ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [508ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [509ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [509ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [523ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [523ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [524ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [524ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [542ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [542ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [543ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [543ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [562ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [562ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [563ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [563ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [623ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [623ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [624ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [624ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [625ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [625ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [742ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [742ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [743ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [743ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [762ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [762ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [762ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [762ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1041ms] refreshing cache from master, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1042ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1043ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1045ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1045ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1045ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1100ms] refreshing cache from master, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1102ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1481ms] refreshing cache from master, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1482ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1482ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1483ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1483ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [4280ms] refreshing cache from master, [4280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [4281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [4281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [4283ms] too many traces: truncated at 100 traces, deferred=Deferred@1134805852(state=PENDING, result=null, callback=(continuation of Deferred@139037322 after retry RPC after error@725333257) -> (continuation of Deferred@472916790 after retry RPC after error@1104460495) -> (continuation of Deferred@84768165 after retry RPC after error@1944587248) -> (continuation of Deferred@1851567912 after retry RPC after error@179987182) -> (continuation of Deferred@1693748801 after retry RPC after error@1475395236) -> (continuation of Deferred@1549692573 after retry RPC after error@95083242) -> (continuation of Deferred@1173150360 after retry RPC after error@398154015) -> (continuation of Deferred@943646707 after retry RPC after error@1796216724) -> (continuation of Deferred@1217083508 after retry RPC after error@95810523) -> (continuation of Deferred@1249615329 after retry RPC after error@557617037) -> (continuation of Deferred@820333382 after retry RPC after error@451169706) -> (continuation of Deferred@216420226 after retry RPC after error@1239677300) -> (continuation of Deferred@1397105781 after retry RPC after error@1811393194) -> (continuation of Deferred@1439920649 after retry RPC after error@53283230) -> (continuation of Deferred@1638592514 after retry RPC after error@928949351) -> (continuation of Deferred@2043927487 after retry RPC after error@307846370) -> (continuation of Deferred@608539723 after retry RPC after error@1727689016) -> (continuation of Deferred@26427515 after retry RPC after error@1509270247) -> (continuation of Deferred@1360691806 after retry RPC after error@1683770100) -> (continuation of Deferred@2144816796 after retry RPC after error@197212443) -> (continuation of Deferred@239882831 after retry RPC after error@146911896) -> (continuation of Deferred@1302834866 after retry RPC after error@1328304124), errback=(continuation of Deferred@139037322 after retry RPC after error@725333257) -> (continuation of Deferred@472916790 after retry RPC after error@1104460495) -> (continuation of Deferred@84768165 after retry RPC after error@1944587248) -> (continuation of Deferred@1851567912 after retry RPC after error@179987182) -> (continuation of Deferred@1693748801 after retry RPC after error@1475395236) -> (continuation of Deferred@1549692573 after retry RPC after error@95083242) -> (continuation of Deferred@1173150360 after retry RPC after error@398154015) -> (continuation of Deferred@943646707 after retry RPC after error@1796216724) -> (continuation of Deferred@1217083508 after retry RPC after error@95810523) -> (continuation of Deferred@1249615329 after retry RPC after error@557617037) -> (continuation of Deferred@820333382 after retry RPC after error@451169706) -> (continuation of Deferred@216420226 after retry RPC after error@1239677300) -> (continuation of Deferred@1397105781 after retry RPC after error@1811393194) -> (continuation of Deferred@1439920649 after retry RPC after error@53283230) -> (continuation of Deferred@1638592514 after retry RPC after error@928949351) -> (continuation of Deferred@2043927487 after retry RPC after error@307846370) -> (continuation of Deferred@608539723 after retry RPC after error@1727689016) -> (continuation of Deferred@26427515 after retry RPC after error@1509270247) -> (continuation of Deferred@1360691806 after retry RPC after error@1683770100) -> (continuation of Deferred@2144816796 after retry RPC after error@197212443) -> (continuation of Deferred@239882831 after retry RPC after error@146911896) -> (continuation of Deferred@1302834866 after retry RPC after error@1328304124)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:05.615 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#6 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_6).
08:08:05.617 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#6 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_6.
08:08:05.620 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from INITIALIZING to FAILED on 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29346), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [125ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [140ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [145ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [145ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [249ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [255ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [258ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [331ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [332ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [501ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [507ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [508ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [509ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [509ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [523ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [523ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [524ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [524ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [542ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [542ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [543ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [543ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [562ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [562ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [563ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [563ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [623ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [623ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [624ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [624ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [625ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [625ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [742ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [742ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [743ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [743ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [762ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [762ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [762ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [762ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1041ms] refreshing cache from master, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1042ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1043ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1045ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1045ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1045ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1100ms] refreshing cache from master, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1102ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1481ms] refreshing cache from master, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1482ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1482ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1483ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1483ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [4280ms] refreshing cache from master, [4280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [4281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [4281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [4283ms] too many traces: truncated at 100 traces, deferred=Deferred@1134805852(state=PENDING, result=null, callback=(continuation of Deferred@139037322 after retry RPC after error@725333257) -> (continuation of Deferred@472916790 after retry RPC after error@1104460495) -> (continuation of Deferred@84768165 after retry RPC after error@1944587248) -> (continuation of Deferred@1851567912 after retry RPC after error@179987182) -> (continuation of Deferred@1693748801 after retry RPC after error@1475395236) -> (continuation of Deferred@1549692573 after retry RPC after error@95083242) -> (continuation of Deferred@1173150360 after retry RPC after error@398154015) -> (continuation of Deferred@943646707 after retry RPC after error@1796216724) -> (continuation of Deferred@1217083508 after retry RPC after error@95810523) -> (continuation of Deferred@1249615329 after retry RPC after error@557617037) -> (continuation of Deferred@820333382 after retry RPC after error@451169706) -> (continuation of Deferred@216420226 after retry RPC after error@1239677300) -> (continuation of Deferred@1397105781 after retry RPC after error@1811393194) -> (continuation of Deferred@1439920649 after retry RPC after error@53283230) -> (continuation of Deferred@1638592514 after retry RPC after error@928949351) -> (continuation of Deferred@2043927487 after retry RPC after error@307846370) -> (continuation of Deferred@608539723 after retry RPC after error@1727689016) -> (continuation of Deferred@26427515 after retry RPC after error@1509270247) -> (continuation of Deferred@1360691806 after retry RPC after error@1683770100) -> (continuation of Deferred@2144816796 after retry RPC after error@197212443) -> (continuation of Deferred@239882831 after retry RPC after error@146911896) -> (continuation of Deferred@1302834866 after retry RPC after error@1328304124), errback=(continuation of Deferred@139037322 after retry RPC after error@725333257) -> (continuation of Deferred@472916790 after retry RPC after error@1104460495) -> (continuation of Deferred@84768165 after retry RPC after error@1944587248) -> (continuation of Deferred@1851567912 after retry RPC after error@179987182) -> (continuation of Deferred@1693748801 after retry RPC after error@1475395236) -> (continuation of Deferred@1549692573 after retry RPC after error@95083242) -> (continuation of Deferred@1173150360 after retry RPC after error@398154015) -> (continuation of Deferred@943646707 after retry RPC after error@1796216724) -> (continuation of Deferred@1217083508 after retry RPC after error@95810523) -> (continuation of Deferred@1249615329 after retry RPC after error@557617037) -> (continuation of Deferred@820333382 after retry RPC after error@451169706) -> (continuation of Deferred@216420226 after retry RPC after error@1239677300) -> (continuation of Deferred@1397105781 after retry RPC after error@1811393194) -> (continuation of Deferred@1439920649 after retry RPC after error@53283230) -> (continuation of Deferred@1638592514 after retry RPC after error@928949351) -> (continuation of Deferred@2043927487 after retry RPC after error@307846370) -> (continuation of Deferred@608539723 after retry RPC after error@1727689016) -> (continuation of Deferred@26427515 after retry RPC after error@1509270247) -> (continuation of Deferred@1360691806 after retry RPC after error@1683770100) -> (continuation of Deferred@2144816796 after retry RPC after error@197212443) -> (continuation of Deferred@239882831 after retry RPC after error@146911896) -> (continuation of Deferred@1302834866 after retry RPC after error@1328304124)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:05.625 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:08:05.625 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#6) of source Source: KuduSource.
08:08:05.626 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_6.
08:08:05.626 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (b42812d69c586178cf7556c3c92998f3) switched from state RUNNING to RESTARTING.
08:08:05.650 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091685649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:05.669 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
08:08:05.671 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
08:08:05.685 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:05.685 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:05.685 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:05.686 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:05.686 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:05.686 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:05.688 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:05.688 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:05.688 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:05.689 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:05.689 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:05.722 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:05.723 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:05.775 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:05.776 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:05.776 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:05.779 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.779 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.780 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.780 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.780 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.780 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.781 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.781 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.781 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.781 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:05.782 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:05.782 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:05.783 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:05.783 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:05.783 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:05.783 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:05.783 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:05.783 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:05.783 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:05.784 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:05.784 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:05.784 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:05.784 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:05.785 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29534), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [129ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [435ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [437ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [440ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [440ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [515ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [520ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [528ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [532ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [535ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [535ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [603ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [611ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [611ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [612ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [614ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [622ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [622ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [622ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [623ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [642ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [642ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [642ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [642ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [663ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [664ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [664ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [664ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [682ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [682ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [683ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [683ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [740ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [743ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [743ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [744ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [744ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [980ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [982ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [983ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [984ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [984ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1301ms] refreshing cache from master, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1302ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1304ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1640ms] refreshing cache from master, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1643ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1643ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1643ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2981ms] refreshing cache from master, [2981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [2983ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [2984ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [2984ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2984ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [5802ms] refreshing cache from master, [5802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [5802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [5803ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [5804ms] too many traces: truncated at 100 traces, deferred=Deferred@1158011049(state=PENDING, result=null, callback=(continuation of Deferred@519911085 after retry RPC after error@1484834201) -> (continuation of Deferred@1902401011 after retry RPC after error@449780710) -> (continuation of Deferred@1836064332 after retry RPC after error@855814774) -> (continuation of Deferred@1612358184 after retry RPC after error@48797158) -> (continuation of Deferred@1871149449 after retry RPC after error@1236330253) -> (continuation of Deferred@2081298417 after retry RPC after error@982514227) -> (continuation of Deferred@1854969818 after retry RPC after error@542543242) -> (continuation of Deferred@753645550 after retry RPC after error@1768988194) -> (continuation of Deferred@53803665 after retry RPC after error@387587488) -> (continuation of Deferred@1723829354 after retry RPC after error@198418193) -> (continuation of Deferred@798428296 after retry RPC after error@1755837383) -> (continuation of Deferred@1919024741 after retry RPC after error@1709034543) -> (continuation of Deferred@1916366672 after retry RPC after error@626492187) -> (continuation of Deferred@1488507650 after retry RPC after error@1393541262) -> (continuation of Deferred@1786082896 after retry RPC after error@1931706206) -> (continuation of Deferred@1830650619 after retry RPC after error@1086006374) -> (continuation of Deferred@20782551 after retry RPC after error@1762413345) -> (continuation of Deferred@1745290913 after retry RPC after error@1896257491) -> (continuation of Deferred@406646657 after retry RPC after error@333638372) -> (continuation of Deferred@1124127799 after retry RPC after error@117275531) -> (continuation of Deferred@2042809394 after retry RPC after error@2104732708), errback=(continuation of Deferred@519911085 after retry RPC after error@1484834201) -> (continuation of Deferred@1902401011 after retry RPC after error@449780710) -> (continuation of Deferred@1836064332 after retry RPC after error@855814774) -> (continuation of Deferred@1612358184 after retry RPC after error@48797158) -> (continuation of Deferred@1871149449 after retry RPC after error@1236330253) -> (continuation of Deferred@2081298417 after retry RPC after error@982514227) -> (continuation of Deferred@1854969818 after retry RPC after error@542543242) -> (continuation of Deferred@753645550 after retry RPC after error@1768988194) -> (continuation of Deferred@53803665 after retry RPC after error@387587488) -> (continuation of Deferred@1723829354 after retry RPC after error@198418193) -> (continuation of Deferred@798428296 after retry RPC after error@1755837383) -> (continuation of Deferred@1919024741 after retry RPC after error@1709034543) -> (continuation of Deferred@1916366672 after retry RPC after error@626492187) -> (continuation of Deferred@1488507650 after retry RPC after error@1393541262) -> (continuation of Deferred@1786082896 after retry RPC after error@1931706206) -> (continuation of Deferred@1830650619 after retry RPC after error@1086006374) -> (continuation of Deferred@20782551 after retry RPC after error@1762413345) -> (continuation of Deferred@1745290913 after retry RPC after error@1896257491) -> (continuation of Deferred@406646657 after retry RPC after error@333638372) -> (continuation of Deferred@1124127799 after retry RPC after error@117275531) -> (continuation of Deferred@2042809394 after retry RPC after error@2104732708)))
08:08:05.788 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
08:08:05.788 [WARN - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#6 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29534), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [129ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [435ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [437ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [440ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [440ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [515ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [520ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [528ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [532ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [535ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [535ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [603ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [611ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [611ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [612ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [614ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [622ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [622ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [622ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [623ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [642ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [642ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [642ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [642ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [663ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [664ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [664ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [664ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [682ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [682ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [683ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [683ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [740ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [743ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [743ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [744ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [744ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [980ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [982ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [983ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [984ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [984ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1301ms] refreshing cache from master, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1302ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1304ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1640ms] refreshing cache from master, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1643ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1643ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1643ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2981ms] refreshing cache from master, [2981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [2983ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [2984ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [2984ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2984ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [5802ms] refreshing cache from master, [5802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [5802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [5803ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [5804ms] too many traces: truncated at 100 traces, deferred=Deferred@1158011049(state=PENDING, result=null, callback=(continuation of Deferred@519911085 after retry RPC after error@1484834201) -> (continuation of Deferred@1902401011 after retry RPC after error@449780710) -> (continuation of Deferred@1836064332 after retry RPC after error@855814774) -> (continuation of Deferred@1612358184 after retry RPC after error@48797158) -> (continuation of Deferred@1871149449 after retry RPC after error@1236330253) -> (continuation of Deferred@2081298417 after retry RPC after error@982514227) -> (continuation of Deferred@1854969818 after retry RPC after error@542543242) -> (continuation of Deferred@753645550 after retry RPC after error@1768988194) -> (continuation of Deferred@53803665 after retry RPC after error@387587488) -> (continuation of Deferred@1723829354 after retry RPC after error@198418193) -> (continuation of Deferred@798428296 after retry RPC after error@1755837383) -> (continuation of Deferred@1919024741 after retry RPC after error@1709034543) -> (continuation of Deferred@1916366672 after retry RPC after error@626492187) -> (continuation of Deferred@1488507650 after retry RPC after error@1393541262) -> (continuation of Deferred@1786082896 after retry RPC after error@1931706206) -> (continuation of Deferred@1830650619 after retry RPC after error@1086006374) -> (continuation of Deferred@20782551 after retry RPC after error@1762413345) -> (continuation of Deferred@1745290913 after retry RPC after error@1896257491) -> (continuation of Deferred@406646657 after retry RPC after error@333638372) -> (continuation of Deferred@1124127799 after retry RPC after error@117275531) -> (continuation of Deferred@2042809394 after retry RPC after error@2104732708), errback=(continuation of Deferred@519911085 after retry RPC after error@1484834201) -> (continuation of Deferred@1902401011 after retry RPC after error@449780710) -> (continuation of Deferred@1836064332 after retry RPC after error@855814774) -> (continuation of Deferred@1612358184 after retry RPC after error@48797158) -> (continuation of Deferred@1871149449 after retry RPC after error@1236330253) -> (continuation of Deferred@2081298417 after retry RPC after error@982514227) -> (continuation of Deferred@1854969818 after retry RPC after error@542543242) -> (continuation of Deferred@753645550 after retry RPC after error@1768988194) -> (continuation of Deferred@53803665 after retry RPC after error@387587488) -> (continuation of Deferred@1723829354 after retry RPC after error@198418193) -> (continuation of Deferred@798428296 after retry RPC after error@1755837383) -> (continuation of Deferred@1919024741 after retry RPC after error@1709034543) -> (continuation of Deferred@1916366672 after retry RPC after error@626492187) -> (continuation of Deferred@1488507650 after retry RPC after error@1393541262) -> (continuation of Deferred@1786082896 after retry RPC after error@1931706206) -> (continuation of Deferred@1830650619 after retry RPC after error@1086006374) -> (continuation of Deferred@20782551 after retry RPC after error@1762413345) -> (continuation of Deferred@1745290913 after retry RPC after error@1896257491) -> (continuation of Deferred@406646657 after retry RPC after error@333638372) -> (continuation of Deferred@1124127799 after retry RPC after error@117275531) -> (continuation of Deferred@2042809394 after retry RPC after error@2104732708)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.125:38689
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:05.793 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#6 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_6).
08:08:05.794 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:05.795 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:05.795 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:05.795 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.795 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.795 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:05.795 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.795 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.796 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:05.796 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.796 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.796 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:05.796 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:05.798 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#6 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_6.
08:08:05.802 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from INITIALIZING to FAILED on 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29534), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [129ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [435ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [437ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [440ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [440ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [515ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [520ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [528ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [532ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [535ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [535ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [603ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [611ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [611ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [612ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [614ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [622ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [622ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [622ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [623ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [642ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [642ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [642ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [642ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [663ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [664ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [664ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [664ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [682ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [682ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [683ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [683ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [740ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [743ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [743ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [744ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [744ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [980ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [982ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [983ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [984ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [984ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1301ms] refreshing cache from master, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1302ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1304ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1640ms] refreshing cache from master, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1643ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1643ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1643ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2981ms] refreshing cache from master, [2981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [2983ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [2984ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [2984ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2984ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [5802ms] refreshing cache from master, [5802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [5802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [5803ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [5804ms] too many traces: truncated at 100 traces, deferred=Deferred@1158011049(state=PENDING, result=null, callback=(continuation of Deferred@519911085 after retry RPC after error@1484834201) -> (continuation of Deferred@1902401011 after retry RPC after error@449780710) -> (continuation of Deferred@1836064332 after retry RPC after error@855814774) -> (continuation of Deferred@1612358184 after retry RPC after error@48797158) -> (continuation of Deferred@1871149449 after retry RPC after error@1236330253) -> (continuation of Deferred@2081298417 after retry RPC after error@982514227) -> (continuation of Deferred@1854969818 after retry RPC after error@542543242) -> (continuation of Deferred@753645550 after retry RPC after error@1768988194) -> (continuation of Deferred@53803665 after retry RPC after error@387587488) -> (continuation of Deferred@1723829354 after retry RPC after error@198418193) -> (continuation of Deferred@798428296 after retry RPC after error@1755837383) -> (continuation of Deferred@1919024741 after retry RPC after error@1709034543) -> (continuation of Deferred@1916366672 after retry RPC after error@626492187) -> (continuation of Deferred@1488507650 after retry RPC after error@1393541262) -> (continuation of Deferred@1786082896 after retry RPC after error@1931706206) -> (continuation of Deferred@1830650619 after retry RPC after error@1086006374) -> (continuation of Deferred@20782551 after retry RPC after error@1762413345) -> (continuation of Deferred@1745290913 after retry RPC after error@1896257491) -> (continuation of Deferred@406646657 after retry RPC after error@333638372) -> (continuation of Deferred@1124127799 after retry RPC after error@117275531) -> (continuation of Deferred@2042809394 after retry RPC after error@2104732708), errback=(continuation of Deferred@519911085 after retry RPC after error@1484834201) -> (continuation of Deferred@1902401011 after retry RPC after error@449780710) -> (continuation of Deferred@1836064332 after retry RPC after error@855814774) -> (continuation of Deferred@1612358184 after retry RPC after error@48797158) -> (continuation of Deferred@1871149449 after retry RPC after error@1236330253) -> (continuation of Deferred@2081298417 after retry RPC after error@982514227) -> (continuation of Deferred@1854969818 after retry RPC after error@542543242) -> (continuation of Deferred@753645550 after retry RPC after error@1768988194) -> (continuation of Deferred@53803665 after retry RPC after error@387587488) -> (continuation of Deferred@1723829354 after retry RPC after error@198418193) -> (continuation of Deferred@798428296 after retry RPC after error@1755837383) -> (continuation of Deferred@1919024741 after retry RPC after error@1709034543) -> (continuation of Deferred@1916366672 after retry RPC after error@626492187) -> (continuation of Deferred@1488507650 after retry RPC after error@1393541262) -> (continuation of Deferred@1786082896 after retry RPC after error@1931706206) -> (continuation of Deferred@1830650619 after retry RPC after error@1086006374) -> (continuation of Deferred@20782551 after retry RPC after error@1762413345) -> (continuation of Deferred@1745290913 after retry RPC after error@1896257491) -> (continuation of Deferred@406646657 after retry RPC after error@333638372) -> (continuation of Deferred@1124127799 after retry RPC after error@117275531) -> (continuation of Deferred@2042809394 after retry RPC after error@2104732708)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.125:38689
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:05.807 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#6) of source Source: KuduSource.
08:08:05.808 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:08:05.809 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_6.
08:08:05.844 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:05.845 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:05.845 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:05.846 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:05.846 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:05.846 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:05.847 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:05.847 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:05.847 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:05.847 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:05.847 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:05.847 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:05.847 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:05.911 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:06.063 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:06.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.031184  1645 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } attempt: 6
08:08:06.064 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:06.064 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:06.064 [DEBUG - pool-268-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:06.064 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:06.065 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:06.065 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:06.065 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:06.065 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:06.065 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:06.065 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:06.066 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:06.066 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:06.066 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:06.066 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29664), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [170ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [171ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [469ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [471ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [482ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [482ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [542ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [547ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [553ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [561ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [561ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [594ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [595ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [603ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [604ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [606ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [606ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [622ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [622ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [623ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [623ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [640ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [641ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [642ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [642ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [642ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [681ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [681ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [682ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [682ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [702ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [702ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [703ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [703ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [781ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [781ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [782ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [782ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [800ms] refreshing cache from master, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [802ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [802ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [803ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [803ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1280ms] refreshing cache from master, [1280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1283ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2220ms] refreshing cache from master, [2220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2223ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2224ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2224ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2224ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [3161ms] refreshing cache from master, [3161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [3161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [3162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [3163ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [3163ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3164ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [3164ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [6481ms] refreshing cache from master, [6481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [6482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [6483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [6483ms] too many traces: truncated at 100 traces, deferred=Deferred@1455013891(state=PENDING, result=null, callback=(continuation of Deferred@1856902149 after retry RPC after error@1469901642) -> (continuation of Deferred@1705958947 after retry RPC after error@2098176845) -> (continuation of Deferred@1663012565 after retry RPC after error@1407840071) -> (continuation of Deferred@1076194527 after retry RPC after error@1085323869) -> (continuation of Deferred@1606872504 after retry RPC after error@1137291984) -> (continuation of Deferred@685862370 after retry RPC after error@1841715441) -> (continuation of Deferred@92656604 after retry RPC after error@198487694) -> (continuation of Deferred@679038059 after retry RPC after error@1999079493) -> (continuation of Deferred@1553448526 after retry RPC after error@1914293132) -> (continuation of Deferred@274844592 after retry RPC after error@1540295769) -> (continuation of Deferred@978042016 after retry RPC after error@112350670) -> (continuation of Deferred@412103395 after retry RPC after error@1000228972) -> (continuation of Deferred@1549229315 after retry RPC after error@1214213986) -> (continuation of Deferred@1363233696 after retry RPC after error@408270028) -> (continuation of Deferred@2114739584 after retry RPC after error@1302006108) -> (continuation of Deferred@383534852 after retry RPC after error@588935879) -> (continuation of Deferred@1072094073 after retry RPC after error@706933808) -> (continuation of Deferred@1588748823 after retry RPC after error@776912716) -> (continuation of Deferred@670729455 after retry RPC after error@449083220) -> (continuation of Deferred@1462443201 after retry RPC after error@205811127) -> (continuation of Deferred@2137673004 after retry RPC after error@1185807170) -> (continuation of Deferred@1240410690 after retry RPC after error@1726598941), errback=(continuation of Deferred@1856902149 after retry RPC after error@1469901642) -> (continuation of Deferred@1705958947 after retry RPC after error@2098176845) -> (continuation of Deferred@1663012565 after retry RPC after error@1407840071) -> (continuation of Deferred@1076194527 after retry RPC after error@1085323869) -> (continuation of Deferred@1606872504 after retry RPC after error@1137291984) -> (continuation of Deferred@685862370 after retry RPC after error@1841715441) -> (continuation of Deferred@92656604 after retry RPC after error@198487694) -> (continuation of Deferred@679038059 after retry RPC after error@1999079493) -> (continuation of Deferred@1553448526 after retry RPC after error@1914293132) -> (continuation of Deferred@274844592 after retry RPC after error@1540295769) -> (continuation of Deferred@978042016 after retry RPC after error@112350670) -> (continuation of Deferred@412103395 after retry RPC after error@1000228972) -> (continuation of Deferred@1549229315 after retry RPC after error@1214213986) -> (continuation of Deferred@1363233696 after retry RPC after error@408270028) -> (continuation of Deferred@2114739584 after retry RPC after error@1302006108) -> (continuation of Deferred@383534852 after retry RPC after error@588935879) -> (continuation of Deferred@1072094073 after retry RPC after error@706933808) -> (continuation of Deferred@1588748823 after retry RPC after error@776912716) -> (continuation of Deferred@670729455 after retry RPC after error@449083220) -> (continuation of Deferred@1462443201 after retry RPC after error@205811127) -> (continuation of Deferred@2137673004 after retry RPC after error@1185807170) -> (continuation of Deferred@1240410690 after retry RPC after error@1726598941)))
08:08:06.075 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:06.075 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:06.075 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:06.076 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:06.076 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:06.076 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:06.076 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:06.076 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:06.076 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:06.076 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:06.076 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:06.077 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:06.077 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:06.079 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29815), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [39ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [149ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [159ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [160ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [329ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [331ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [331ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [333ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [339ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [341ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [373ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [378ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [615ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [616ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [620ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [620ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [641ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [641ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [642ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [642ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [660ms] refreshing cache from master, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [661ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [661ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [664ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [664ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [702ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [703ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [704ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [704ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [762ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [764ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [820ms] refreshing cache from master, [820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [822ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [822ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [823ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [823ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1080ms] refreshing cache from master, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1084ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1085ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1085ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1600ms] refreshing cache from master, [1600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1601ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1603ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1603ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2040ms] refreshing cache from master, [2041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2043ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2043ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2044ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2044ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2840ms] refreshing cache from master, [2840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2843ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2843ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [5340ms] refreshing cache from master, [5340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [5341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [5341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [5342ms] too many traces: truncated at 100 traces, deferred=Deferred@1084790586(state=PENDING, result=null, callback=(continuation of Deferred@562270714 after retry RPC after error@954074070) -> (continuation of Deferred@1643414594 after retry RPC after error@1700912641) -> (continuation of Deferred@1490063126 after retry RPC after error@274265961) -> (continuation of Deferred@1431025588 after retry RPC after error@1043458762) -> (continuation of Deferred@1648720421 after retry RPC after error@896613051) -> (continuation of Deferred@1024449974 after retry RPC after error@215553895) -> (continuation of Deferred@1166332043 after retry RPC after error@2040303202) -> (continuation of Deferred@985468554 after retry RPC after error@2115720341) -> (continuation of Deferred@502846293 after retry RPC after error@9089302) -> (continuation of Deferred@1376855763 after retry RPC after error@1980395512) -> (continuation of Deferred@758343703 after retry RPC after error@2019851942) -> (continuation of Deferred@597227719 after retry RPC after error@105391843) -> (continuation of Deferred@806196717 after retry RPC after error@1799838724) -> (continuation of Deferred@268291947 after retry RPC after error@1212522313) -> (continuation of Deferred@339462481 after retry RPC after error@1171062958) -> (continuation of Deferred@606734827 after retry RPC after error@1089566192) -> (continuation of Deferred@181034494 after retry RPC after error@665842809) -> (continuation of Deferred@1396622390 after retry RPC after error@405501268) -> (continuation of Deferred@1087827458 after retry RPC after error@411227741) -> (continuation of Deferred@1035517455 after retry RPC after error@2130373945) -> (continuation of Deferred@162245146 after retry RPC after error@127247692), errback=(continuation of Deferred@562270714 after retry RPC after error@954074070) -> (continuation of Deferred@1643414594 after retry RPC after error@1700912641) -> (continuation of Deferred@1490063126 after retry RPC after error@274265961) -> (continuation of Deferred@1431025588 after retry RPC after error@1043458762) -> (continuation of Deferred@1648720421 after retry RPC after error@896613051) -> (continuation of Deferred@1024449974 after retry RPC after error@215553895) -> (continuation of Deferred@1166332043 after retry RPC after error@2040303202) -> (continuation of Deferred@985468554 after retry RPC after error@2115720341) -> (continuation of Deferred@502846293 after retry RPC after error@9089302) -> (continuation of Deferred@1376855763 after retry RPC after error@1980395512) -> (continuation of Deferred@758343703 after retry RPC after error@2019851942) -> (continuation of Deferred@597227719 after retry RPC after error@105391843) -> (continuation of Deferred@806196717 after retry RPC after error@1799838724) -> (continuation of Deferred@268291947 after retry RPC after error@1212522313) -> (continuation of Deferred@339462481 after retry RPC after error@1171062958) -> (continuation of Deferred@606734827 after retry RPC after error@1089566192) -> (continuation of Deferred@181034494 after retry RPC after error@665842809) -> (continuation of Deferred@1396622390 after retry RPC after error@405501268) -> (continuation of Deferred@1087827458 after retry RPC after error@411227741) -> (continuation of Deferred@1035517455 after retry RPC after error@2130373945) -> (continuation of Deferred@162245146 after retry RPC after error@127247692)))
08:08:06.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:06.098248  1645 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.134.253:41425: Network error: Client connection negotiation failed: client connection to 127.1.134.253:41425: connect: Connection refused (error 111)
08:08:06.150 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091686149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:06.166 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
08:08:06.168 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
08:08:06.256 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:06.257 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:06.257 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:06.258 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:06.258 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:06.258 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:06.258 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:06.258 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:06.258 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:06.259 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:06.258 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:06.259 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:06.259 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:06.261 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28741), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [28ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [37ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [77ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [78ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [132ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [133ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [288ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [288ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [329ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [332ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [344ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [344ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [345ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [363ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [363ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [382ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [382ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [382ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [382ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [423ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [424ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [424ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [424ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [503ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [504ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [505ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [578ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [602ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [603ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [603ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [604ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [782ms] refreshing cache from master, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [783ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [783ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [784ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [784ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [961ms] refreshing cache from master, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [962ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [963ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [963ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [963ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1920ms] refreshing cache from master, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1922ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1923ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1923ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1924ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2241ms] refreshing cache from master, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2242ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [2242ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [2243ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2243ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [5281ms] refreshing cache from master, [5281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [5282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [5282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [5283ms] too many traces: truncated at 100 traces, deferred=Deferred@2146773843(state=PENDING, result=null, callback=(continuation of Deferred@1037502229 after retry RPC after error@1129391778) -> (continuation of Deferred@225662890 after retry RPC after error@1527405284) -> (continuation of Deferred@1591742783 after retry RPC after error@349063287) -> (continuation of Deferred@51872579 after retry RPC after error@180561087) -> (continuation of Deferred@1425319217 after retry RPC after error@840946216) -> (continuation of Deferred@229458611 after retry RPC after error@509110629) -> (continuation of Deferred@1869908658 after retry RPC after error@590781414) -> (continuation of Deferred@1147792873 after retry RPC after error@422033216) -> (continuation of Deferred@1389203404 after retry RPC after error@1161025496) -> (continuation of Deferred@1312713778 after retry RPC after error@1787256578) -> (continuation of Deferred@1418337905 after retry RPC after error@257723951) -> (continuation of Deferred@842935306 after retry RPC after error@1653676544) -> (continuation of Deferred@1726802357 after retry RPC after error@220868273) -> (continuation of Deferred@1320619362 after retry RPC after error@614223790) -> (continuation of Deferred@633125833 after retry RPC after error@2042578537) -> (continuation of Deferred@253069345 after retry RPC after error@1236424530) -> (continuation of Deferred@152096606 after retry RPC after error@169827355) -> (continuation of Deferred@703105529 after retry RPC after error@1916490577) -> (continuation of Deferred@2103314551 after retry RPC after error@223444035) -> (continuation of Deferred@1612417873 after retry RPC after error@1209204184) -> (continuation of Deferred@1166166301 after retry RPC after error@1127716490), errback=(continuation of Deferred@1037502229 after retry RPC after error@1129391778) -> (continuation of Deferred@225662890 after retry RPC after error@1527405284) -> (continuation of Deferred@1591742783 after retry RPC after error@349063287) -> (continuation of Deferred@51872579 after retry RPC after error@180561087) -> (continuation of Deferred@1425319217 after retry RPC after error@840946216) -> (continuation of Deferred@229458611 after retry RPC after error@509110629) -> (continuation of Deferred@1869908658 after retry RPC after error@590781414) -> (continuation of Deferred@1147792873 after retry RPC after error@422033216) -> (continuation of Deferred@1389203404 after retry RPC after error@1161025496) -> (continuation of Deferred@1312713778 after retry RPC after error@1787256578) -> (continuation of Deferred@1418337905 after retry RPC after error@257723951) -> (continuation of Deferred@842935306 after retry RPC after error@1653676544) -> (continuation of Deferred@1726802357 after retry RPC after error@220868273) -> (continuation of Deferred@1320619362 after retry RPC after error@614223790) -> (continuation of Deferred@633125833 after retry RPC after error@2042578537) -> (continuation of Deferred@253069345 after retry RPC after error@1236424530) -> (continuation of Deferred@152096606 after retry RPC after error@169827355) -> (continuation of Deferred@703105529 after retry RPC after error@1916490577) -> (continuation of Deferred@2103314551 after retry RPC after error@223444035) -> (continuation of Deferred@1612417873 after retry RPC after error@1209204184) -> (continuation of Deferred@1166166301 after retry RPC after error@1127716490)))
08:08:06.263 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
08:08:06.264 [WARN - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28741), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [28ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [37ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [77ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [78ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [132ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [133ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [288ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [288ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [329ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [332ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [344ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [344ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [345ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [363ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [363ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [382ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [382ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [382ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [382ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [423ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [424ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [424ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [424ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [503ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [504ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [505ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [578ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [602ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [603ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [603ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [604ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [782ms] refreshing cache from master, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [783ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [783ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [784ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [784ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [961ms] refreshing cache from master, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [962ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [963ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [963ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [963ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1920ms] refreshing cache from master, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1922ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1923ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1923ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1924ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2241ms] refreshing cache from master, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2242ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [2242ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [2243ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2243ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [5281ms] refreshing cache from master, [5281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [5282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [5282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [5283ms] too many traces: truncated at 100 traces, deferred=Deferred@2146773843(state=PENDING, result=null, callback=(continuation of Deferred@1037502229 after retry RPC after error@1129391778) -> (continuation of Deferred@225662890 after retry RPC after error@1527405284) -> (continuation of Deferred@1591742783 after retry RPC after error@349063287) -> (continuation of Deferred@51872579 after retry RPC after error@180561087) -> (continuation of Deferred@1425319217 after retry RPC after error@840946216) -> (continuation of Deferred@229458611 after retry RPC after error@509110629) -> (continuation of Deferred@1869908658 after retry RPC after error@590781414) -> (continuation of Deferred@1147792873 after retry RPC after error@422033216) -> (continuation of Deferred@1389203404 after retry RPC after error@1161025496) -> (continuation of Deferred@1312713778 after retry RPC after error@1787256578) -> (continuation of Deferred@1418337905 after retry RPC after error@257723951) -> (continuation of Deferred@842935306 after retry RPC after error@1653676544) -> (continuation of Deferred@1726802357 after retry RPC after error@220868273) -> (continuation of Deferred@1320619362 after retry RPC after error@614223790) -> (continuation of Deferred@633125833 after retry RPC after error@2042578537) -> (continuation of Deferred@253069345 after retry RPC after error@1236424530) -> (continuation of Deferred@152096606 after retry RPC after error@169827355) -> (continuation of Deferred@703105529 after retry RPC after error@1916490577) -> (continuation of Deferred@2103314551 after retry RPC after error@223444035) -> (continuation of Deferred@1612417873 after retry RPC after error@1209204184) -> (continuation of Deferred@1166166301 after retry RPC after error@1127716490), errback=(continuation of Deferred@1037502229 after retry RPC after error@1129391778) -> (continuation of Deferred@225662890 after retry RPC after error@1527405284) -> (continuation of Deferred@1591742783 after retry RPC after error@349063287) -> (continuation of Deferred@51872579 after retry RPC after error@180561087) -> (continuation of Deferred@1425319217 after retry RPC after error@840946216) -> (continuation of Deferred@229458611 after retry RPC after error@509110629) -> (continuation of Deferred@1869908658 after retry RPC after error@590781414) -> (continuation of Deferred@1147792873 after retry RPC after error@422033216) -> (continuation of Deferred@1389203404 after retry RPC after error@1161025496) -> (continuation of Deferred@1312713778 after retry RPC after error@1787256578) -> (continuation of Deferred@1418337905 after retry RPC after error@257723951) -> (continuation of Deferred@842935306 after retry RPC after error@1653676544) -> (continuation of Deferred@1726802357 after retry RPC after error@220868273) -> (continuation of Deferred@1320619362 after retry RPC after error@614223790) -> (continuation of Deferred@633125833 after retry RPC after error@2042578537) -> (continuation of Deferred@253069345 after retry RPC after error@1236424530) -> (continuation of Deferred@152096606 after retry RPC after error@169827355) -> (continuation of Deferred@703105529 after retry RPC after error@1916490577) -> (continuation of Deferred@2103314551 after retry RPC after error@223444035) -> (continuation of Deferred@1612417873 after retry RPC after error@1209204184) -> (continuation of Deferred@1166166301 after retry RPC after error@1127716490)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.29.158.190:38071
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:06.269 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
08:08:06.272 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#1 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
08:08:06.277 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to FAILED on b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28741), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [28ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [37ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [77ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [78ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [132ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [133ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [288ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [288ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [329ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [332ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [344ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [344ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [345ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [363ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [363ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [382ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [382ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [382ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [382ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [423ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [424ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [424ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [424ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [503ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [504ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [505ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [578ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [602ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [603ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [603ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [604ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [782ms] refreshing cache from master, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [783ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [783ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [784ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [784ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [961ms] refreshing cache from master, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [962ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [963ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [963ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [963ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1920ms] refreshing cache from master, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1922ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1923ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1923ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1924ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2241ms] refreshing cache from master, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2242ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [2242ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [2243ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2243ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [5281ms] refreshing cache from master, [5281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [5282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [5282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [5283ms] too many traces: truncated at 100 traces, deferred=Deferred@2146773843(state=PENDING, result=null, callback=(continuation of Deferred@1037502229 after retry RPC after error@1129391778) -> (continuation of Deferred@225662890 after retry RPC after error@1527405284) -> (continuation of Deferred@1591742783 after retry RPC after error@349063287) -> (continuation of Deferred@51872579 after retry RPC after error@180561087) -> (continuation of Deferred@1425319217 after retry RPC after error@840946216) -> (continuation of Deferred@229458611 after retry RPC after error@509110629) -> (continuation of Deferred@1869908658 after retry RPC after error@590781414) -> (continuation of Deferred@1147792873 after retry RPC after error@422033216) -> (continuation of Deferred@1389203404 after retry RPC after error@1161025496) -> (continuation of Deferred@1312713778 after retry RPC after error@1787256578) -> (continuation of Deferred@1418337905 after retry RPC after error@257723951) -> (continuation of Deferred@842935306 after retry RPC after error@1653676544) -> (continuation of Deferred@1726802357 after retry RPC after error@220868273) -> (continuation of Deferred@1320619362 after retry RPC after error@614223790) -> (continuation of Deferred@633125833 after retry RPC after error@2042578537) -> (continuation of Deferred@253069345 after retry RPC after error@1236424530) -> (continuation of Deferred@152096606 after retry RPC after error@169827355) -> (continuation of Deferred@703105529 after retry RPC after error@1916490577) -> (continuation of Deferred@2103314551 after retry RPC after error@223444035) -> (continuation of Deferred@1612417873 after retry RPC after error@1209204184) -> (continuation of Deferred@1166166301 after retry RPC after error@1127716490), errback=(continuation of Deferred@1037502229 after retry RPC after error@1129391778) -> (continuation of Deferred@225662890 after retry RPC after error@1527405284) -> (continuation of Deferred@1591742783 after retry RPC after error@349063287) -> (continuation of Deferred@51872579 after retry RPC after error@180561087) -> (continuation of Deferred@1425319217 after retry RPC after error@840946216) -> (continuation of Deferred@229458611 after retry RPC after error@509110629) -> (continuation of Deferred@1869908658 after retry RPC after error@590781414) -> (continuation of Deferred@1147792873 after retry RPC after error@422033216) -> (continuation of Deferred@1389203404 after retry RPC after error@1161025496) -> (continuation of Deferred@1312713778 after retry RPC after error@1787256578) -> (continuation of Deferred@1418337905 after retry RPC after error@257723951) -> (continuation of Deferred@842935306 after retry RPC after error@1653676544) -> (continuation of Deferred@1726802357 after retry RPC after error@220868273) -> (continuation of Deferred@1320619362 after retry RPC after error@614223790) -> (continuation of Deferred@633125833 after retry RPC after error@2042578537) -> (continuation of Deferred@253069345 after retry RPC after error@1236424530) -> (continuation of Deferred@152096606 after retry RPC after error@169827355) -> (continuation of Deferred@703105529 after retry RPC after error@1916490577) -> (continuation of Deferred@2103314551 after retry RPC after error@223444035) -> (continuation of Deferred@1612417873 after retry RPC after error@1209204184) -> (continuation of Deferred@1166166301 after retry RPC after error@1127716490)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.29.158.190:38071
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:06.283 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#1) of source Source: KuduSource.
08:08:06.283 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
08:08:06.283 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:08:06.283 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (a72e6b48022ef36361b5eef11ee7c683) switched from state RUNNING to RESTARTING.
08:08:06.284 [WARN - flink-pekko.actor.default-dispatcher-7] (TaskManagerLocation.java:276) No hostname could be resolved for the IP address 127.0.0.1, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted.
08:08:06.375 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:06.375 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:06.376 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:06.376 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:06.376 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:06.377 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:06.377 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:06.377 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:06.377 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:06.377 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:06.377 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:06.378 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:06.378 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:06.411 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:06.445 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:06.446 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:06.446 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:06.446 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:06.446 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:06.446 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:06.446 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:06.447 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:06.447 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:06.447 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:06.447 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:06.447 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:06.448 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:06.525 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:06.525 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:06.526 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:06.526 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:06.526 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:06.526 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:06.526 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:06.526 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:06.526 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:06.526 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:06.526 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:06.527 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:06.527 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:06.560 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:06.561 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:06.561 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:06.562 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:06.562 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:06.562 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:06.563 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:06.563 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:06.563 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:06.563 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:06.563 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:06.564 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:06.564 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:06.570 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:06.571 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:06.571 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:06.571 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:06.571 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:06.571 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:06.571 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:06.571 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:06.571 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:06.572 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:06.572 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:06.572 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:06.572 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:06.573 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29063), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [55ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [60ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [65ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [67ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [88ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [94ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [96ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [97ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [146ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [152ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [152ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [153ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [161ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [161ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [161ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [162ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [183ms] refreshing cache from master, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [184ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [184ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [185ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [185ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [223ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [225ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [227ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [227ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [285ms] refreshing cache from master, [285ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [285ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [286ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [286ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [287ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [287ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [287ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [361ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [362ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [603ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [604ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [605ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [605ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [660ms] refreshing cache from master, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [661ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [662ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [662ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [662ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1581ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1584ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1584ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1584ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1585ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [2120ms] refreshing cache from master, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [2124ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2124ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2461ms] refreshing cache from master, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [2462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2463ms] too many traces: truncated at 100 traces, deferred=Deferred@1527074107(state=PENDING, result=null, callback=(continuation of Deferred@681173956 after retry RPC after error@554553285) -> (continuation of Deferred@2116230177 after retry RPC after error@255781451) -> (continuation of Deferred@1751035819 after retry RPC after error@669132418) -> (continuation of Deferred@1095169099 after retry RPC after error@970072730) -> (continuation of Deferred@619504124 after retry RPC after error@302781909) -> (continuation of Deferred@1688096627 after retry RPC after error@1282434952) -> (continuation of Deferred@256941307 after retry RPC after error@2097185401) -> (continuation of Deferred@1811132285 after retry RPC after error@619764140) -> (continuation of Deferred@801914509 after retry RPC after error@1445356103) -> (continuation of Deferred@551073721 after retry RPC after error@46606263) -> (continuation of Deferred@1286691124 after retry RPC after error@694169279) -> (continuation of Deferred@1281372501 after retry RPC after error@1998675441) -> (continuation of Deferred@824165080 after retry RPC after error@421664658) -> (continuation of Deferred@1418033018 after retry RPC after error@699823822) -> (continuation of Deferred@1727035426 after retry RPC after error@1877437929) -> (continuation of Deferred@270985672 after retry RPC after error@180153604) -> (continuation of Deferred@1869128985 after retry RPC after error@993264952) -> (continuation of Deferred@477877055 after retry RPC after error@1908595065) -> (continuation of Deferred@1537796661 after retry RPC after error@1085155773) -> (continuation of Deferred@34535612 after retry RPC after error@1709240469) -> (continuation of Deferred@2038777694 after retry RPC after error@1222081042) -> (continuation of Deferred@1038721196 after retry RPC after error@1609534428), errback=(continuation of Deferred@681173956 after retry RPC after error@554553285) -> (continuation of Deferred@2116230177 after retry RPC after error@255781451) -> (continuation of Deferred@1751035819 after retry RPC after error@669132418) -> (continuation of Deferred@1095169099 after retry RPC after error@970072730) -> (continuation of Deferred@619504124 after retry RPC after error@302781909) -> (continuation of Deferred@1688096627 after retry RPC after error@1282434952) -> (continuation of Deferred@256941307 after retry RPC after error@2097185401) -> (continuation of Deferred@1811132285 after retry RPC after error@619764140) -> (continuation of Deferred@801914509 after retry RPC after error@1445356103) -> (continuation of Deferred@551073721 after retry RPC after error@46606263) -> (continuation of Deferred@1286691124 after retry RPC after error@694169279) -> (continuation of Deferred@1281372501 after retry RPC after error@1998675441) -> (continuation of Deferred@824165080 after retry RPC after error@421664658) -> (continuation of Deferred@1418033018 after retry RPC after error@699823822) -> (continuation of Deferred@1727035426 after retry RPC after error@1877437929) -> (continuation of Deferred@270985672 after retry RPC after error@180153604) -> (continuation of Deferred@1869128985 after retry RPC after error@993264952) -> (continuation of Deferred@477877055 after retry RPC after error@1908595065) -> (continuation of Deferred@1537796661 after retry RPC after error@1085155773) -> (continuation of Deferred@34535612 after retry RPC after error@1709240469) -> (continuation of Deferred@2038777694 after retry RPC after error@1222081042) -> (continuation of Deferred@1038721196 after retry RPC after error@1609534428)))
08:08:06.575 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
08:08:06.575 [WARN - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29063), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [55ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [60ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [65ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [67ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [88ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [94ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [96ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [97ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [146ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [152ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [152ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [153ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [161ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [161ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [161ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [162ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [183ms] refreshing cache from master, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [184ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [184ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [185ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [185ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [223ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [225ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [227ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [227ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [285ms] refreshing cache from master, [285ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [285ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [286ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [286ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [287ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [287ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [287ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [361ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [362ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [603ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [604ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [605ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [605ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [660ms] refreshing cache from master, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [661ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [662ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [662ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [662ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1581ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1584ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1584ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1584ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1585ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [2120ms] refreshing cache from master, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [2124ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2124ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2461ms] refreshing cache from master, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [2462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2463ms] too many traces: truncated at 100 traces, deferred=Deferred@1527074107(state=PENDING, result=null, callback=(continuation of Deferred@681173956 after retry RPC after error@554553285) -> (continuation of Deferred@2116230177 after retry RPC after error@255781451) -> (continuation of Deferred@1751035819 after retry RPC after error@669132418) -> (continuation of Deferred@1095169099 after retry RPC after error@970072730) -> (continuation of Deferred@619504124 after retry RPC after error@302781909) -> (continuation of Deferred@1688096627 after retry RPC after error@1282434952) -> (continuation of Deferred@256941307 after retry RPC after error@2097185401) -> (continuation of Deferred@1811132285 after retry RPC after error@619764140) -> (continuation of Deferred@801914509 after retry RPC after error@1445356103) -> (continuation of Deferred@551073721 after retry RPC after error@46606263) -> (continuation of Deferred@1286691124 after retry RPC after error@694169279) -> (continuation of Deferred@1281372501 after retry RPC after error@1998675441) -> (continuation of Deferred@824165080 after retry RPC after error@421664658) -> (continuation of Deferred@1418033018 after retry RPC after error@699823822) -> (continuation of Deferred@1727035426 after retry RPC after error@1877437929) -> (continuation of Deferred@270985672 after retry RPC after error@180153604) -> (continuation of Deferred@1869128985 after retry RPC after error@993264952) -> (continuation of Deferred@477877055 after retry RPC after error@1908595065) -> (continuation of Deferred@1537796661 after retry RPC after error@1085155773) -> (continuation of Deferred@34535612 after retry RPC after error@1709240469) -> (continuation of Deferred@2038777694 after retry RPC after error@1222081042) -> (continuation of Deferred@1038721196 after retry RPC after error@1609534428), errback=(continuation of Deferred@681173956 after retry RPC after error@554553285) -> (continuation of Deferred@2116230177 after retry RPC after error@255781451) -> (continuation of Deferred@1751035819 after retry RPC after error@669132418) -> (continuation of Deferred@1095169099 after retry RPC after error@970072730) -> (continuation of Deferred@619504124 after retry RPC after error@302781909) -> (continuation of Deferred@1688096627 after retry RPC after error@1282434952) -> (continuation of Deferred@256941307 after retry RPC after error@2097185401) -> (continuation of Deferred@1811132285 after retry RPC after error@619764140) -> (continuation of Deferred@801914509 after retry RPC after error@1445356103) -> (continuation of Deferred@551073721 after retry RPC after error@46606263) -> (continuation of Deferred@1286691124 after retry RPC after error@694169279) -> (continuation of Deferred@1281372501 after retry RPC after error@1998675441) -> (continuation of Deferred@824165080 after retry RPC after error@421664658) -> (continuation of Deferred@1418033018 after retry RPC after error@699823822) -> (continuation of Deferred@1727035426 after retry RPC after error@1877437929) -> (continuation of Deferred@270985672 after retry RPC after error@180153604) -> (continuation of Deferred@1869128985 after retry RPC after error@993264952) -> (continuation of Deferred@477877055 after retry RPC after error@1908595065) -> (continuation of Deferred@1537796661 after retry RPC after error@1085155773) -> (continuation of Deferred@34535612 after retry RPC after error@1709240469) -> (continuation of Deferred@2038777694 after retry RPC after error@1222081042) -> (continuation of Deferred@1038721196 after retry RPC after error@1609534428)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.29.158.190:38071
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:06.579 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
08:08:06.581 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#1 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
08:08:06.582 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:06.583 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:06.583 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:06.583 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:06.584 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:06.584 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:06.584 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:06.584 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:06.584 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:06.584 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:06.585 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:06.585 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:06.585 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:06.586 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED on b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29063), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [55ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [60ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [65ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [67ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [88ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [94ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [96ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [97ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [146ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [152ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [152ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [153ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [161ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [161ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [161ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [162ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [183ms] refreshing cache from master, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [184ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [184ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [185ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [185ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [223ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [225ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [227ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [227ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [285ms] refreshing cache from master, [285ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [285ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [286ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [286ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [287ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [287ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [287ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [361ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [362ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [603ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [604ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [605ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [605ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [660ms] refreshing cache from master, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [661ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [662ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [662ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [662ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1581ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1584ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1584ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1584ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1585ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [2120ms] refreshing cache from master, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [2124ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2124ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2461ms] refreshing cache from master, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [2462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2463ms] too many traces: truncated at 100 traces, deferred=Deferred@1527074107(state=PENDING, result=null, callback=(continuation of Deferred@681173956 after retry RPC after error@554553285) -> (continuation of Deferred@2116230177 after retry RPC after error@255781451) -> (continuation of Deferred@1751035819 after retry RPC after error@669132418) -> (continuation of Deferred@1095169099 after retry RPC after error@970072730) -> (continuation of Deferred@619504124 after retry RPC after error@302781909) -> (continuation of Deferred@1688096627 after retry RPC after error@1282434952) -> (continuation of Deferred@256941307 after retry RPC after error@2097185401) -> (continuation of Deferred@1811132285 after retry RPC after error@619764140) -> (continuation of Deferred@801914509 after retry RPC after error@1445356103) -> (continuation of Deferred@551073721 after retry RPC after error@46606263) -> (continuation of Deferred@1286691124 after retry RPC after error@694169279) -> (continuation of Deferred@1281372501 after retry RPC after error@1998675441) -> (continuation of Deferred@824165080 after retry RPC after error@421664658) -> (continuation of Deferred@1418033018 after retry RPC after error@699823822) -> (continuation of Deferred@1727035426 after retry RPC after error@1877437929) -> (continuation of Deferred@270985672 after retry RPC after error@180153604) -> (continuation of Deferred@1869128985 after retry RPC after error@993264952) -> (continuation of Deferred@477877055 after retry RPC after error@1908595065) -> (continuation of Deferred@1537796661 after retry RPC after error@1085155773) -> (continuation of Deferred@34535612 after retry RPC after error@1709240469) -> (continuation of Deferred@2038777694 after retry RPC after error@1222081042) -> (continuation of Deferred@1038721196 after retry RPC after error@1609534428), errback=(continuation of Deferred@681173956 after retry RPC after error@554553285) -> (continuation of Deferred@2116230177 after retry RPC after error@255781451) -> (continuation of Deferred@1751035819 after retry RPC after error@669132418) -> (continuation of Deferred@1095169099 after retry RPC after error@970072730) -> (continuation of Deferred@619504124 after retry RPC after error@302781909) -> (continuation of Deferred@1688096627 after retry RPC after error@1282434952) -> (continuation of Deferred@256941307 after retry RPC after error@2097185401) -> (continuation of Deferred@1811132285 after retry RPC after error@619764140) -> (continuation of Deferred@801914509 after retry RPC after error@1445356103) -> (continuation of Deferred@551073721 after retry RPC after error@46606263) -> (continuation of Deferred@1286691124 after retry RPC after error@694169279) -> (continuation of Deferred@1281372501 after retry RPC after error@1998675441) -> (continuation of Deferred@824165080 after retry RPC after error@421664658) -> (continuation of Deferred@1418033018 after retry RPC after error@699823822) -> (continuation of Deferred@1727035426 after retry RPC after error@1877437929) -> (continuation of Deferred@270985672 after retry RPC after error@180153604) -> (continuation of Deferred@1869128985 after retry RPC after error@993264952) -> (continuation of Deferred@477877055 after retry RPC after error@1908595065) -> (continuation of Deferred@1537796661 after retry RPC after error@1085155773) -> (continuation of Deferred@34535612 after retry RPC after error@1709240469) -> (continuation of Deferred@2038777694 after retry RPC after error@1222081042) -> (continuation of Deferred@1038721196 after retry RPC after error@1609534428)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.29.158.190:38071
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:06.591 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#1) of source Source: KuduSource.
08:08:06.591 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
08:08:06.592 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:08:06.594 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:06.594 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:06.594 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:06.595 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:06.595 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:06.595 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:06.595 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:06.595 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:06.595 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:06.595 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:06.596 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:06.596 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:06.596 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:06.650 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091686649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:06.660 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:08:06.661 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
08:08:06.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:05.258749  1657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:06.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:06.715283  1659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:06.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:06.717864  1658 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1454 milliseconds
08:08:06.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.718019  1647 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:08:06.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.719594  1647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:08:06.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.722839  1647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:08:06.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.724289  1647 hybrid_clock.cc:648] HybridClock initialized: now 1779091686724252 us; error 43 us; skew 500 ppm
08:08:06.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.725335  1647 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:08:06.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.735139  1647 webserver.cc:533] Webserver started at http://127.1.134.253:42073/ using document root <none> and password file <none>
08:08:06.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.736603  1647 fs_manager.cc:362] Metadata directory not provided
08:08:06.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.736917  1647 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:08:06.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.737630  1647 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:08:06.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.743391  1647 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-1/data/instance:
08:08:06.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "943ab925f9514c34b43356d83a1698bf"
08:08:06.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:06 on dist-test-slave-1jss"
08:08:06.744 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:06.744 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:06.745 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:06.745 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:06.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.745141  1647 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-1/wal/instance:
08:08:06.745 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:06.745 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:06.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "943ab925f9514c34b43356d83a1698bf"
08:08:06.745 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:06.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:06 on dist-test-slave-1jss"
08:08:06.745 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:06.746 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:06.746 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:06.745 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:06.746 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:06.746 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:06.747 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=31, TimeoutTracker(timeout=30000, elapsed=29244), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [123ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [124ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [138ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [143ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [269ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [271ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [273ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [275ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [286ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [286ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [300ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [312ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [315ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [328ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [332ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [332ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [341ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [341ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [342ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [342ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [361ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [362ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [401ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [402ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [403ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [403ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [441ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [442ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [443ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [443ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [589ms] refreshing cache from master, [589ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [590ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [590ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [591ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [594ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [594ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [595ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [682ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [682ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [682ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [683ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [940ms] refreshing cache from master, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [943ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [943ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [944ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [944ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1080ms] refreshing cache from master, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1083ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [2180ms] refreshing cache from master, [2180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [2181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2182ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [2182ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2182ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [2183ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [5160ms] refreshing cache from master, [5161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [5161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [5161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [5162ms] too many traces: truncated at 100 traces, deferred=Deferred@1886853790(state=PENDING, result=null, callback=(continuation of Deferred@1843561853 after retry RPC after error@1952081799) -> (continuation of Deferred@1350294172 after retry RPC after error@403741159) -> (continuation of Deferred@1637887733 after retry RPC after error@1189153561) -> (continuation of Deferred@1220576867 after retry RPC after error@1409544509) -> (continuation of Deferred@875866830 after retry RPC after error@2051262098) -> (continuation of Deferred@922526759 after retry RPC after error@2101162460) -> (continuation of Deferred@1817085551 after retry RPC after error@140356130) -> (continuation of Deferred@1532226194 after retry RPC after error@1333040117) -> (continuation of Deferred@1460738442 after retry RPC after error@855156208) -> (continuation of Deferred@1992019527 after retry RPC after error@498794590) -> (continuation of Deferred@1119459114 after retry RPC after error@890863016) -> (continuation of Deferred@502813882 after retry RPC after error@1485049515) -> (continuation of Deferred@1451934294 after retry RPC after error@671088914) -> (continuation of Deferred@1996676396 after retry RPC after error@260797489) -> (continuation of Deferred@252944356 after retry RPC after error@657655685) -> (continuation of Deferred@1186551282 after retry RPC after error@315067368) -> (continuation of Deferred@28891883 after retry RPC after error@1040771702) -> (continuation of Deferred@848445056 after retry RPC after error@472153073) -> (continuation of Deferred@1527547164 after retry RPC after error@573480785) -> (continuation of Deferred@23843754 after retry RPC after error@1043319685) -> (continuation of Deferred@28609849 after retry RPC after error@1471569481) -> (continuation of Deferred@144646550 after retry RPC after error@1219272931) -> (continuation of Deferred@1834230154 after retry RPC after error@150302335) -> (continuation of Deferred@2031578470 after retry RPC after error@1410429215) -> (continuation of Deferred@402997862 after retry RPC after error@991969679) -> (continuation of Deferred@2040424400 after retry RPC after error@643328117) -> (continuation of Deferred@352065706 after retry RPC after error@770248579) -> (continuation of Deferred@658722057 after retry RPC after error@1111331412) -> (continuation of Deferred@921758705 after retry RPC after error@1392541627) -> (continuation of Deferred@1846954967 after retry RPC after error@1075301235), errback=(continuation of Deferred@1843561853 after retry RPC after error@1952081799) -> (continuation of Deferred@1350294172 after retry RPC after error@403741159) -> (continuation of Deferred@1637887733 after retry RPC after error@1189153561) -> (continuation of Deferred@1220576867 after retry RPC after error@1409544509) -> (continuation of Deferred@875866830 after retry RPC after error@2051262098) -> (continuation of Deferred@922526759 after retry RPC after error@2101162460) -> (continuation of Deferred@1817085551 after retry RPC after error@140356130) -> (continuation of Deferred@1532226194 after retry RPC after error@1333040117) -> (continuation of Deferred@1460738442 after retry RPC after error@855156208) -> (continuation of Deferred@1992019527 after retry RPC after error@498794590) -> (continuation of Deferred@1119459114 after retry RPC after error@890863016) -> (continuation of Deferred@502813882 after retry RPC after error@1485049515) -> (continuation of Deferred@1451934294 after retry RPC after error@671088914) -> (continuation of Deferred@1996676396 after retry RPC after error@260797489) -> (continuation of Deferred@252944356 after retry RPC after error@657655685) -> (continuation of Deferred@1186551282 after retry RPC after error@315067368) -> (continuation of Deferred@28891883 after retry RPC after error@1040771702) -> (continuation of Deferred@848445056 after retry RPC after error@472153073) -> (continuation of Deferred@1527547164 after retry RPC after error@573480785) -> (continuation of Deferred@23843754 after retry RPC after error@1043319685) -> (continuation of Deferred@28609849 after retry RPC after error@1471569481) -> (continuation of Deferred@144646550 after retry RPC after error@1219272931) -> (continuation of Deferred@1834230154 after retry RPC after error@150302335) -> (continuation of Deferred@2031578470 after retry RPC after error@1410429215) -> (continuation of Deferred@402997862 after retry RPC after error@991969679) -> (continuation of Deferred@2040424400 after retry RPC after error@643328117) -> (continuation of Deferred@352065706 after retry RPC after error@770248579) -> (continuation of Deferred@658722057 after retry RPC after error@1111331412) -> (continuation of Deferred@921758705 after retry RPC after error@1392541627) -> (continuation of Deferred@1846954967 after retry RPC after error@1075301235)))
08:08:06.749 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
08:08:06.749 [WARN - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=31, TimeoutTracker(timeout=30000, elapsed=29244), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [123ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [124ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [138ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [143ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [269ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [271ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [273ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [275ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [286ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [286ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [300ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [312ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [315ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [328ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [332ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [332ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [341ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [341ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [342ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [342ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [361ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [362ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [401ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [402ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [403ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [403ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [441ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [442ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [443ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [443ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [589ms] refreshing cache from master, [589ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [590ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [590ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [591ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [594ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [594ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [595ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [682ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [682ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [682ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [683ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [940ms] refreshing cache from master, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [943ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [943ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [944ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [944ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1080ms] refreshing cache from master, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1083ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [2180ms] refreshing cache from master, [2180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [2181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2182ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [2182ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2182ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [2183ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [5160ms] refreshing cache from master, [5161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [5161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [5161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [5162ms] too many traces: truncated at 100 traces, deferred=Deferred@1886853790(state=PENDING, result=null, callback=(continuation of Deferred@1843561853 after retry RPC after error@1952081799) -> (continuation of Deferred@1350294172 after retry RPC after error@403741159) -> (continuation of Deferred@1637887733 after retry RPC after error@1189153561) -> (continuation of Deferred@1220576867 after retry RPC after error@1409544509) -> (continuation of Deferred@875866830 after retry RPC after error@2051262098) -> (continuation of Deferred@922526759 after retry RPC after error@2101162460) -> (continuation of Deferred@1817085551 after retry RPC after error@140356130) -> (continuation of Deferred@1532226194 after retry RPC after error@1333040117) -> (continuation of Deferred@1460738442 after retry RPC after error@855156208) -> (continuation of Deferred@1992019527 after retry RPC after error@498794590) -> (continuation of Deferred@1119459114 after retry RPC after error@890863016) -> (continuation of Deferred@502813882 after retry RPC after error@1485049515) -> (continuation of Deferred@1451934294 after retry RPC after error@671088914) -> (continuation of Deferred@1996676396 after retry RPC after error@260797489) -> (continuation of Deferred@252944356 after retry RPC after error@657655685) -> (continuation of Deferred@1186551282 after retry RPC after error@315067368) -> (continuation of Deferred@28891883 after retry RPC after error@1040771702) -> (continuation of Deferred@848445056 after retry RPC after error@472153073) -> (continuation of Deferred@1527547164 after retry RPC after error@573480785) -> (continuation of Deferred@23843754 after retry RPC after error@1043319685) -> (continuation of Deferred@28609849 after retry RPC after error@1471569481) -> (continuation of Deferred@144646550 after retry RPC after error@1219272931) -> (continuation of Deferred@1834230154 after retry RPC after error@150302335) -> (continuation of Deferred@2031578470 after retry RPC after error@1410429215) -> (continuation of Deferred@402997862 after retry RPC after error@991969679) -> (continuation of Deferred@2040424400 after retry RPC after error@643328117) -> (continuation of Deferred@352065706 after retry RPC after error@770248579) -> (continuation of Deferred@658722057 after retry RPC after error@1111331412) -> (continuation of Deferred@921758705 after retry RPC after error@1392541627) -> (continuation of Deferred@1846954967 after retry RPC after error@1075301235), errback=(continuation of Deferred@1843561853 after retry RPC after error@1952081799) -> (continuation of Deferred@1350294172 after retry RPC after error@403741159) -> (continuation of Deferred@1637887733 after retry RPC after error@1189153561) -> (continuation of Deferred@1220576867 after retry RPC after error@1409544509) -> (continuation of Deferred@875866830 after retry RPC after error@2051262098) -> (continuation of Deferred@922526759 after retry RPC after error@2101162460) -> (continuation of Deferred@1817085551 after retry RPC after error@140356130) -> (continuation of Deferred@1532226194 after retry RPC after error@1333040117) -> (continuation of Deferred@1460738442 after retry RPC after error@855156208) -> (continuation of Deferred@1992019527 after retry RPC after error@498794590) -> (continuation of Deferred@1119459114 after retry RPC after error@890863016) -> (continuation of Deferred@502813882 after retry RPC after error@1485049515) -> (continuation of Deferred@1451934294 after retry RPC after error@671088914) -> (continuation of Deferred@1996676396 after retry RPC after error@260797489) -> (continuation of Deferred@252944356 after retry RPC after error@657655685) -> (continuation of Deferred@1186551282 after retry RPC after error@315067368) -> (continuation of Deferred@28891883 after retry RPC after error@1040771702) -> (continuation of Deferred@848445056 after retry RPC after error@472153073) -> (continuation of Deferred@1527547164 after retry RPC after error@573480785) -> (continuation of Deferred@23843754 after retry RPC after error@1043319685) -> (continuation of Deferred@28609849 after retry RPC after error@1471569481) -> (continuation of Deferred@144646550 after retry RPC after error@1219272931) -> (continuation of Deferred@1834230154 after retry RPC after error@150302335) -> (continuation of Deferred@2031578470 after retry RPC after error@1410429215) -> (continuation of Deferred@402997862 after retry RPC after error@991969679) -> (continuation of Deferred@2040424400 after retry RPC after error@643328117) -> (continuation of Deferred@352065706 after retry RPC after error@770248579) -> (continuation of Deferred@658722057 after retry RPC after error@1111331412) -> (continuation of Deferred@921758705 after retry RPC after error@1392541627) -> (continuation of Deferred@1846954967 after retry RPC after error@1075301235)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.29.158.189:41727
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:06.751 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
08:08:06.753 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#1 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
08:08:06.755 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to FAILED on b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=31, TimeoutTracker(timeout=30000, elapsed=29244), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [123ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [124ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [138ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [143ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [269ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [271ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [273ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [275ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [286ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [286ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [300ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [312ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [315ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [328ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [332ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [332ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [341ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [341ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [342ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [342ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [361ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [362ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [401ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [402ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [403ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [403ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [441ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [442ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [443ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [443ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [589ms] refreshing cache from master, [589ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [590ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [590ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [591ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [594ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [594ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [595ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [682ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [682ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [682ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [683ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [940ms] refreshing cache from master, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [943ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [943ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [944ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [944ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1080ms] refreshing cache from master, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1083ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [2180ms] refreshing cache from master, [2180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [2181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2182ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [2182ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2182ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [2183ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [5160ms] refreshing cache from master, [5161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [5161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [5161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [5162ms] too many traces: truncated at 100 traces, deferred=Deferred@1886853790(state=PENDING, result=null, callback=(continuation of Deferred@1843561853 after retry RPC after error@1952081799) -> (continuation of Deferred@1350294172 after retry RPC after error@403741159) -> (continuation of Deferred@1637887733 after retry RPC after error@1189153561) -> (continuation of Deferred@1220576867 after retry RPC after error@1409544509) -> (continuation of Deferred@875866830 after retry RPC after error@2051262098) -> (continuation of Deferred@922526759 after retry RPC after error@2101162460) -> (continuation of Deferred@1817085551 after retry RPC after error@140356130) -> (continuation of Deferred@1532226194 after retry RPC after error@1333040117) -> (continuation of Deferred@1460738442 after retry RPC after error@855156208) -> (continuation of Deferred@1992019527 after retry RPC after error@498794590) -> (continuation of Deferred@1119459114 after retry RPC after error@890863016) -> (continuation of Deferred@502813882 after retry RPC after error@1485049515) -> (continuation of Deferred@1451934294 after retry RPC after error@671088914) -> (continuation of Deferred@1996676396 after retry RPC after error@260797489) -> (continuation of Deferred@252944356 after retry RPC after error@657655685) -> (continuation of Deferred@1186551282 after retry RPC after error@315067368) -> (continuation of Deferred@28891883 after retry RPC after error@1040771702) -> (continuation of Deferred@848445056 after retry RPC after error@472153073) -> (continuation of Deferred@1527547164 after retry RPC after error@573480785) -> (continuation of Deferred@23843754 after retry RPC after error@1043319685) -> (continuation of Deferred@28609849 after retry RPC after error@1471569481) -> (continuation of Deferred@144646550 after retry RPC after error@1219272931) -> (continuation of Deferred@1834230154 after retry RPC after error@150302335) -> (continuation of Deferred@2031578470 after retry RPC after error@1410429215) -> (continuation of Deferred@402997862 after retry RPC after error@991969679) -> (continuation of Deferred@2040424400 after retry RPC after error@643328117) -> (continuation of Deferred@352065706 after retry RPC after error@770248579) -> (continuation of Deferred@658722057 after retry RPC after error@1111331412) -> (continuation of Deferred@921758705 after retry RPC after error@1392541627) -> (continuation of Deferred@1846954967 after retry RPC after error@1075301235), errback=(continuation of Deferred@1843561853 after retry RPC after error@1952081799) -> (continuation of Deferred@1350294172 after retry RPC after error@403741159) -> (continuation of Deferred@1637887733 after retry RPC after error@1189153561) -> (continuation of Deferred@1220576867 after retry RPC after error@1409544509) -> (continuation of Deferred@875866830 after retry RPC after error@2051262098) -> (continuation of Deferred@922526759 after retry RPC after error@2101162460) -> (continuation of Deferred@1817085551 after retry RPC after error@140356130) -> (continuation of Deferred@1532226194 after retry RPC after error@1333040117) -> (continuation of Deferred@1460738442 after retry RPC after error@855156208) -> (continuation of Deferred@1992019527 after retry RPC after error@498794590) -> (continuation of Deferred@1119459114 after retry RPC after error@890863016) -> (continuation of Deferred@502813882 after retry RPC after error@1485049515) -> (continuation of Deferred@1451934294 after retry RPC after error@671088914) -> (continuation of Deferred@1996676396 after retry RPC after error@260797489) -> (continuation of Deferred@252944356 after retry RPC after error@657655685) -> (continuation of Deferred@1186551282 after retry RPC after error@315067368) -> (continuation of Deferred@28891883 after retry RPC after error@1040771702) -> (continuation of Deferred@848445056 after retry RPC after error@472153073) -> (continuation of Deferred@1527547164 after retry RPC after error@573480785) -> (continuation of Deferred@23843754 after retry RPC after error@1043319685) -> (continuation of Deferred@28609849 after retry RPC after error@1471569481) -> (continuation of Deferred@144646550 after retry RPC after error@1219272931) -> (continuation of Deferred@1834230154 after retry RPC after error@150302335) -> (continuation of Deferred@2031578470 after retry RPC after error@1410429215) -> (continuation of Deferred@402997862 after retry RPC after error@991969679) -> (continuation of Deferred@2040424400 after retry RPC after error@643328117) -> (continuation of Deferred@352065706 after retry RPC after error@770248579) -> (continuation of Deferred@658722057 after retry RPC after error@1111331412) -> (continuation of Deferred@921758705 after retry RPC after error@1392541627) -> (continuation of Deferred@1846954967 after retry RPC after error@1075301235)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.29.158.189:41727
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:06.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.757594  1647 fs_manager.cc:696] Time spent creating directory manager: real 0.011s	user 0.009s	sys 0.001s
08:08:06.758 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:08:06.758 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#1) of source Source: KuduSource.
08:08:06.758 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
08:08:06.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.765781  1674 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:08:06.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.767513  1647 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.001s
08:08:06.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.767956  1647 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-1/wal
08:08:06.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "943ab925f9514c34b43356d83a1698bf"
08:08:06.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:06 on dist-test-slave-1jss"
08:08:06.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.768425  1647 fs_report.cc:389] FS layout report
08:08:06.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:08:06.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-1/wal
08:08:06.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-1/wal
08:08:06.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-1/data/data
08:08:06.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:08:06.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:08:06.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:08:06.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:08:06.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:08:06.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:08:06.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:08:06.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:08:06.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:08:06.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:08:06.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:08:06.807 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:06.808 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:06.808 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:06.808 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.809 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.809 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.809 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.809 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.809 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.809 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.809 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.809 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.810 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:06.810 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29310), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [37ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [41ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [55ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [55ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [187ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [195ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [196ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [315ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [315ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [392ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [393ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [393ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [394ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [394ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [394ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [402ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [421ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [421ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [422ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [443ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [502ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [621ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [622ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [682ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [683ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [683ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [683ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [740ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [742ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [742ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [744ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1760ms] refreshing cache from master, [1760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1763ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [3640ms] refreshing cache from master, [3640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [3641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [3641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [3642ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [3643ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [3644ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [3644ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [7700ms] refreshing cache from master, [7700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [7701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [7701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [7701ms] too many traces: truncated at 100 traces, deferred=Deferred@2051020380(state=PENDING, result=null, callback=(continuation of Deferred@2127968650 after retry RPC after error@2038560217) -> (continuation of Deferred@2004816784 after retry RPC after error@234297813) -> (continuation of Deferred@1117940616 after retry RPC after error@888893752) -> (continuation of Deferred@999753636 after retry RPC after error@236689586) -> (continuation of Deferred@1605651666 after retry RPC after error@808027309) -> (continuation of Deferred@864034603 after retry RPC after error@1636622305) -> (continuation of Deferred@480501214 after retry RPC after error@1616064011) -> (continuation of Deferred@1402543213 after retry RPC after error@1424859688) -> (continuation of Deferred@1445124166 after retry RPC after error@804816895) -> (continuation of Deferred@882482201 after retry RPC after error@232559680) -> (continuation of Deferred@1300012373 after retry RPC after error@651177082) -> (continuation of Deferred@1590756845 after retry RPC after error@927392995) -> (continuation of Deferred@511267179 after retry RPC after error@963452194) -> (continuation of Deferred@1866832271 after retry RPC after error@1873021304) -> (continuation of Deferred@998436846 after retry RPC after error@1792500145) -> (continuation of Deferred@689771653 after retry RPC after error@1715283735) -> (continuation of Deferred@1256999329 after retry RPC after error@459764644) -> (continuation of Deferred@1520432497 after retry RPC after error@1427465386) -> (continuation of Deferred@2107416296 after retry RPC after error@1564879020) -> (continuation of Deferred@2027387400 after retry RPC after error@110719372) -> (continuation of Deferred@535544937 after retry RPC after error@1929677936), errback=(continuation of Deferred@2127968650 after retry RPC after error@2038560217) -> (continuation of Deferred@2004816784 after retry RPC after error@234297813) -> (continuation of Deferred@1117940616 after retry RPC after error@888893752) -> (continuation of Deferred@999753636 after retry RPC after error@236689586) -> (continuation of Deferred@1605651666 after retry RPC after error@808027309) -> (continuation of Deferred@864034603 after retry RPC after error@1636622305) -> (continuation of Deferred@480501214 after retry RPC after error@1616064011) -> (continuation of Deferred@1402543213 after retry RPC after error@1424859688) -> (continuation of Deferred@1445124166 after retry RPC after error@804816895) -> (continuation of Deferred@882482201 after retry RPC after error@232559680) -> (continuation of Deferred@1300012373 after retry RPC after error@651177082) -> (continuation of Deferred@1590756845 after retry RPC after error@927392995) -> (continuation of Deferred@511267179 after retry RPC after error@963452194) -> (continuation of Deferred@1866832271 after retry RPC after error@1873021304) -> (continuation of Deferred@998436846 after retry RPC after error@1792500145) -> (continuation of Deferred@689771653 after retry RPC after error@1715283735) -> (continuation of Deferred@1256999329 after retry RPC after error@459764644) -> (continuation of Deferred@1520432497 after retry RPC after error@1427465386) -> (continuation of Deferred@2107416296 after retry RPC after error@1564879020) -> (continuation of Deferred@2027387400 after retry RPC after error@110719372) -> (continuation of Deferred@535544937 after retry RPC after error@1929677936)))
08:08:06.812 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:06.812 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:06.812 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29310), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [37ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [41ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [55ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [55ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [187ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [195ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [196ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [315ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [315ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [392ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [393ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [393ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [394ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [394ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [394ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [402ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [421ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [421ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [422ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [443ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [502ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [621ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [622ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [682ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [683ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [683ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [683ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [740ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [742ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [742ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [744ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1760ms] refreshing cache from master, [1760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1763ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [3640ms] refreshing cache from master, [3640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [3641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [3641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [3642ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [3643ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [3644ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [3644ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [7700ms] refreshing cache from master, [7700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [7701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [7701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [7701ms] too many traces: truncated at 100 traces, deferred=Deferred@2051020380(state=PENDING, result=null, callback=(continuation of Deferred@2127968650 after retry RPC after error@2038560217) -> (continuation of Deferred@2004816784 after retry RPC after error@234297813) -> (continuation of Deferred@1117940616 after retry RPC after error@888893752) -> (continuation of Deferred@999753636 after retry RPC after error@236689586) -> (continuation of Deferred@1605651666 after retry RPC after error@808027309) -> (continuation of Deferred@864034603 after retry RPC after error@1636622305) -> (continuation of Deferred@480501214 after retry RPC after error@1616064011) -> (continuation of Deferred@1402543213 after retry RPC after error@1424859688) -> (continuation of Deferred@1445124166 after retry RPC after error@804816895) -> (continuation of Deferred@882482201 after retry RPC after error@232559680) -> (continuation of Deferred@1300012373 after retry RPC after error@651177082) -> (continuation of Deferred@1590756845 after retry RPC after error@927392995) -> (continuation of Deferred@511267179 after retry RPC after error@963452194) -> (continuation of Deferred@1866832271 after retry RPC after error@1873021304) -> (continuation of Deferred@998436846 after retry RPC after error@1792500145) -> (continuation of Deferred@689771653 after retry RPC after error@1715283735) -> (continuation of Deferred@1256999329 after retry RPC after error@459764644) -> (continuation of Deferred@1520432497 after retry RPC after error@1427465386) -> (continuation of Deferred@2107416296 after retry RPC after error@1564879020) -> (continuation of Deferred@2027387400 after retry RPC after error@110719372) -> (continuation of Deferred@535544937 after retry RPC after error@1929677936), errback=(continuation of Deferred@2127968650 after retry RPC after error@2038560217) -> (continuation of Deferred@2004816784 after retry RPC after error@234297813) -> (continuation of Deferred@1117940616 after retry RPC after error@888893752) -> (continuation of Deferred@999753636 after retry RPC after error@236689586) -> (continuation of Deferred@1605651666 after retry RPC after error@808027309) -> (continuation of Deferred@864034603 after retry RPC after error@1636622305) -> (continuation of Deferred@480501214 after retry RPC after error@1616064011) -> (continuation of Deferred@1402543213 after retry RPC after error@1424859688) -> (continuation of Deferred@1445124166 after retry RPC after error@804816895) -> (continuation of Deferred@882482201 after retry RPC after error@232559680) -> (continuation of Deferred@1300012373 after retry RPC after error@651177082) -> (continuation of Deferred@1590756845 after retry RPC after error@927392995) -> (continuation of Deferred@511267179 after retry RPC after error@963452194) -> (continuation of Deferred@1866832271 after retry RPC after error@1873021304) -> (continuation of Deferred@998436846 after retry RPC after error@1792500145) -> (continuation of Deferred@689771653 after retry RPC after error@1715283735) -> (continuation of Deferred@1256999329 after retry RPC after error@459764644) -> (continuation of Deferred@1520432497 after retry RPC after error@1427465386) -> (continuation of Deferred@2107416296 after retry RPC after error@1564879020) -> (continuation of Deferred@2027387400 after retry RPC after error@110719372) -> (continuation of Deferred@535544937 after retry RPC after error@1929677936)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29310), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [37ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [41ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [55ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [55ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [187ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [195ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [196ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [315ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [315ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [392ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [393ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [393ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [394ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [394ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [394ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [402ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [421ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [421ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [422ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [443ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [502ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [621ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [622ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [682ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [683ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [683ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [683ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [740ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [742ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [742ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [744ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1760ms] refreshing cache from master, [1760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1763ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [3640ms] refreshing cache from master, [3640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [3641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [3641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [3642ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [3643ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [3644ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [3644ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [7700ms] refreshing cache from master, [7700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [7701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [7701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [7701ms] too many traces: truncated at 100 traces, deferred=Deferred@2051020380(state=PENDING, result=null, callback=(continuation of Deferred@2127968650 after retry RPC after error@2038560217) -> (continuation of Deferred@2004816784 after retry RPC after error@234297813) -> (continuation of Deferred@1117940616 after retry RPC after error@888893752) -> (continuation of Deferred@999753636 after retry RPC after error@236689586) -> (continuation of Deferred@1605651666 after retry RPC after error@808027309) -> (continuation of Deferred@864034603 after retry RPC after error@1636622305) -> (continuation of Deferred@480501214 after retry RPC after error@1616064011) -> (continuation of Deferred@1402543213 after retry RPC after error@1424859688) -> (continuation of Deferred@1445124166 after retry RPC after error@804816895) -> (continuation of Deferred@882482201 after retry RPC after error@232559680) -> (continuation of Deferred@1300012373 after retry RPC after error@651177082) -> (continuation of Deferred@1590756845 after retry RPC after error@927392995) -> (continuation of Deferred@511267179 after retry RPC after error@963452194) -> (continuation of Deferred@1866832271 after retry RPC after error@1873021304) -> (continuation of Deferred@998436846 after retry RPC after error@1792500145) -> (continuation of Deferred@689771653 after retry RPC after error@1715283735) -> (continuation of Deferred@1256999329 after retry RPC after error@459764644) -> (continuation of Deferred@1520432497 after retry RPC after error@1427465386) -> (continuation of Deferred@2107416296 after retry RPC after error@1564879020) -> (continuation of Deferred@2027387400 after retry RPC after error@110719372) -> (continuation of Deferred@535544937 after retry RPC after error@1929677936), errback=(continuation of Deferred@2127968650 after retry RPC after error@2038560217) -> (continuation of Deferred@2004816784 after retry RPC after error@234297813) -> (continuation of Deferred@1117940616 after retry RPC after error@888893752) -> (continuation of Deferred@999753636 after retry RPC after error@236689586) -> (continuation of Deferred@1605651666 after retry RPC after error@808027309) -> (continuation of Deferred@864034603 after retry RPC after error@1636622305) -> (continuation of Deferred@480501214 after retry RPC after error@1616064011) -> (continuation of Deferred@1402543213 after retry RPC after error@1424859688) -> (continuation of Deferred@1445124166 after retry RPC after error@804816895) -> (continuation of Deferred@882482201 after retry RPC after error@232559680) -> (continuation of Deferred@1300012373 after retry RPC after error@651177082) -> (continuation of Deferred@1590756845 after retry RPC after error@927392995) -> (continuation of Deferred@511267179 after retry RPC after error@963452194) -> (continuation of Deferred@1866832271 after retry RPC after error@1873021304) -> (continuation of Deferred@998436846 after retry RPC after error@1792500145) -> (continuation of Deferred@689771653 after retry RPC after error@1715283735) -> (continuation of Deferred@1256999329 after retry RPC after error@459764644) -> (continuation of Deferred@1520432497 after retry RPC after error@1427465386) -> (continuation of Deferred@2107416296 after retry RPC after error@1564879020) -> (continuation of Deferred@2027387400 after retry RPC after error@110719372) -> (continuation of Deferred@535544937 after retry RPC after error@1929677936)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.220.253:45079
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:06.812 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.813 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.813 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.813 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.812 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:06.814 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.815 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.815 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.815 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.816 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.816 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:06.823 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29310), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [37ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [41ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [55ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [55ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [187ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [195ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [196ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [315ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [315ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [392ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [393ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [393ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [394ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [394ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [394ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [402ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [421ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [421ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [422ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [443ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [502ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [621ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [622ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [682ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [683ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [683ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [683ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [740ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [742ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [742ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [744ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1760ms] refreshing cache from master, [1760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1763ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [3640ms] refreshing cache from master, [3640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [3641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [3641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [3642ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [3643ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [3644ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [3644ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [7700ms] refreshing cache from master, [7700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [7701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [7701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [7701ms] too many traces: truncated at 100 traces, deferred=Deferred@2051020380(state=PENDING, result=null, callback=(continuation of Deferred@2127968650 after retry RPC after error@2038560217) -> (continuation of Deferred@2004816784 after retry RPC after error@234297813) -> (continuation of Deferred@1117940616 after retry RPC after error@888893752) -> (continuation of Deferred@999753636 after retry RPC after error@236689586) -> (continuation of Deferred@1605651666 after retry RPC after error@808027309) -> (continuation of Deferred@864034603 after retry RPC after error@1636622305) -> (continuation of Deferred@480501214 after retry RPC after error@1616064011) -> (continuation of Deferred@1402543213 after retry RPC after error@1424859688) -> (continuation of Deferred@1445124166 after retry RPC after error@804816895) -> (continuation of Deferred@882482201 after retry RPC after error@232559680) -> (continuation of Deferred@1300012373 after retry RPC after error@651177082) -> (continuation of Deferred@1590756845 after retry RPC after error@927392995) -> (continuation of Deferred@511267179 after retry RPC after error@963452194) -> (continuation of Deferred@1866832271 after retry RPC after error@1873021304) -> (continuation of Deferred@998436846 after retry RPC after error@1792500145) -> (continuation of Deferred@689771653 after retry RPC after error@1715283735) -> (continuation of Deferred@1256999329 after retry RPC after error@459764644) -> (continuation of Deferred@1520432497 after retry RPC after error@1427465386) -> (continuation of Deferred@2107416296 after retry RPC after error@1564879020) -> (continuation of Deferred@2027387400 after retry RPC after error@110719372) -> (continuation of Deferred@535544937 after retry RPC after error@1929677936), errback=(continuation of Deferred@2127968650 after retry RPC after error@2038560217) -> (continuation of Deferred@2004816784 after retry RPC after error@234297813) -> (continuation of Deferred@1117940616 after retry RPC after error@888893752) -> (continuation of Deferred@999753636 after retry RPC after error@236689586) -> (continuation of Deferred@1605651666 after retry RPC after error@808027309) -> (continuation of Deferred@864034603 after retry RPC after error@1636622305) -> (continuation of Deferred@480501214 after retry RPC after error@1616064011) -> (continuation of Deferred@1402543213 after retry RPC after error@1424859688) -> (continuation of Deferred@1445124166 after retry RPC after error@804816895) -> (continuation of Deferred@882482201 after retry RPC after error@232559680) -> (continuation of Deferred@1300012373 after retry RPC after error@651177082) -> (continuation of Deferred@1590756845 after retry RPC after error@927392995) -> (continuation of Deferred@511267179 after retry RPC after error@963452194) -> (continuation of Deferred@1866832271 after retry RPC after error@1873021304) -> (continuation of Deferred@998436846 after retry RPC after error@1792500145) -> (continuation of Deferred@689771653 after retry RPC after error@1715283735) -> (continuation of Deferred@1256999329 after retry RPC after error@459764644) -> (continuation of Deferred@1520432497 after retry RPC after error@1427465386) -> (continuation of Deferred@2107416296 after retry RPC after error@1564879020) -> (continuation of Deferred@2027387400 after retry RPC after error@110719372) -> (continuation of Deferred@535544937 after retry RPC after error@1929677936)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29310), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [37ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [41ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [55ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [55ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [187ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [195ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [196ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [315ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [315ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [392ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [393ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [393ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [394ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [394ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [394ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [402ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [421ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [421ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [422ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [443ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [502ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [621ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [622ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [682ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [683ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [683ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [683ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [740ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [742ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [742ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [744ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1760ms] refreshing cache from master, [1760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1763ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [3640ms] refreshing cache from master, [3640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [3641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [3641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [3642ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [3643ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [3644ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [3644ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [7700ms] refreshing cache from master, [7700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [7701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [7701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [7701ms] too many traces: truncated at 100 traces, deferred=Deferred@2051020380(state=PENDING, result=null, callback=(continuation of Deferred@2127968650 after retry RPC after error@2038560217) -> (continuation of Deferred@2004816784 after retry RPC after error@234297813) -> (continuation of Deferred@1117940616 after retry RPC after error@888893752) -> (continuation of Deferred@999753636 after retry RPC after error@236689586) -> (continuation of Deferred@1605651666 after retry RPC after error@808027309) -> (continuation of Deferred@864034603 after retry RPC after error@1636622305) -> (continuation of Deferred@480501214 after retry RPC after error@1616064011) -> (continuation of Deferred@1402543213 after retry RPC after error@1424859688) -> (continuation of Deferred@1445124166 after retry RPC after error@804816895) -> (continuation of Deferred@882482201 after retry RPC after error@232559680) -> (continuation of Deferred@1300012373 after retry RPC after error@651177082) -> (continuation of Deferred@1590756845 after retry RPC after error@927392995) -> (continuation of Deferred@511267179 after retry RPC after error@963452194) -> (continuation of Deferred@1866832271 after retry RPC after error@1873021304) -> (continuation of Deferred@998436846 after retry RPC after error@1792500145) -> (continuation of Deferred@689771653 after retry RPC after error@1715283735) -> (continuation of Deferred@1256999329 after retry RPC after error@459764644) -> (continuation of Deferred@1520432497 after retry RPC after error@1427465386) -> (continuation of Deferred@2107416296 after retry RPC after error@1564879020) -> (continuation of Deferred@2027387400 after retry RPC after error@110719372) -> (continuation of Deferred@535544937 after retry RPC after error@1929677936), errback=(continuation of Deferred@2127968650 after retry RPC after error@2038560217) -> (continuation of Deferred@2004816784 after retry RPC after error@234297813) -> (continuation of Deferred@1117940616 after retry RPC after error@888893752) -> (continuation of Deferred@999753636 after retry RPC after error@236689586) -> (continuation of Deferred@1605651666 after retry RPC after error@808027309) -> (continuation of Deferred@864034603 after retry RPC after error@1636622305) -> (continuation of Deferred@480501214 after retry RPC after error@1616064011) -> (continuation of Deferred@1402543213 after retry RPC after error@1424859688) -> (continuation of Deferred@1445124166 after retry RPC after error@804816895) -> (continuation of Deferred@882482201 after retry RPC after error@232559680) -> (continuation of Deferred@1300012373 after retry RPC after error@651177082) -> (continuation of Deferred@1590756845 after retry RPC after error@927392995) -> (continuation of Deferred@511267179 after retry RPC after error@963452194) -> (continuation of Deferred@1866832271 after retry RPC after error@1873021304) -> (continuation of Deferred@998436846 after retry RPC after error@1792500145) -> (continuation of Deferred@689771653 after retry RPC after error@1715283735) -> (continuation of Deferred@1256999329 after retry RPC after error@459764644) -> (continuation of Deferred@1520432497 after retry RPC after error@1427465386) -> (continuation of Deferred@2107416296 after retry RPC after error@1564879020) -> (continuation of Deferred@2027387400 after retry RPC after error@110719372) -> (continuation of Deferred@535544937 after retry RPC after error@1929677936)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.220.253:45079
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:06.826 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
08:08:06.827 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#1) of source Source: KuduSource.
08:08:06.828 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:06.828 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:06.828 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:06.828 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.828 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.829 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.829 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.829 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.829 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.829 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to CANCELING.
08:08:06.829 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.829 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.829 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.829 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:06.830 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
08:08:06.830 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to CANCELING.
08:08:06.830 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
08:08:06.831 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
08:08:06.831 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CANCELING to CANCELED.
08:08:06.831 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#1 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
08:08:06.834 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#1 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
08:08:06.835 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CANCELING to CANCELED.
08:08:06.835 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:318) Clearing resource requirements of job a72e6b48022ef36361b5eef11ee7c683
08:08:06.848 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:06.848 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:06.848 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:06.849 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.849 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.849 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.849 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.849 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.849 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.849 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.849 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.849 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.849 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:06.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.851604  1647 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:08:06.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.853639  1647 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:08:06.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.854274  1647 kserver.cc:163] Server-wide thread pool size limit: 3276
08:08:06.867 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:06.867 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:06.868 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:06.868 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.868 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.868 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.868 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.868 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.868 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.868 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.868 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.868 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.868 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:06.887 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:06.888 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:06.888 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:06.888 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.888 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.888 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.888 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.888 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.889 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.889 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.889 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.888 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.889 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:06.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:06.928 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:06.928 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:06.928 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:06.929 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.929 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.929 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.929 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.929 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.929 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.929 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.929 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.929 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.929 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:06.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.950318  1647 rpc_server.cc:307] RPC server started. Bound to: 127.1.134.253:41425
08:08:06.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.950371  1728 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.134.253:41425 every 8 connection(s)
08:08:06.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.953853  1647 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-1/data/info.pb
08:08:06.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.955889  1563 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 1647
08:08:06.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.956521  1563 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-1/wal/instance
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.959811  1563 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-2/wal
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-2/data
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-2/logs
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-2/data/info.pb
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.134.252:42093
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.134.252
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.134.212:46153
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:08:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33487/jwks.json with env {}
08:08:06.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.962265  1729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:06.967 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:06.967 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:06.967 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:06.968 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.968 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.968 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.968 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.968 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.968 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.968 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.968 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.968 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.968 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:06.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:06.976217  1729 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.134.254" port: 38449 } has no permanent_uuid. Determining permanent_uuid...
08:08:06.987 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:06.987 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:06.988 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:06.988 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.988 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.988 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:06.988 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.988 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.988 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:06.989 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.989 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.989 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:06.989 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:07.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:07.003093  1729 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } has no permanent_uuid. Determining permanent_uuid...
08:08:07.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:07.022043  1729 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } has no permanent_uuid. Determining permanent_uuid...
08:08:07.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:07.024935  1675 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.134.252:42093: connect: Connection refused (error 111)
08:08:07.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:07.030090  1729 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.134.252:42093: Network error: Client connection negotiation failed: client connection to 127.1.134.252:42093: connect: Connection refused (error 111)
08:08:07.047 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:07.048 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:07.048 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:07.048 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:07.048 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:07.048 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:07.048 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:07.048 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:07.049 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:07.049 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:07.049 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:07.049 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:07.049 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:07.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:07.079768  1729 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } attempt: 1
08:08:07.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:07.084466  1729 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.134.252:42093: Network error: Client connection negotiation failed: client connection to 127.1.134.252:42093: connect: Connection refused (error 111)
08:08:07.150 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091687149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:07.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:07.152913  1729 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } attempt: 2
08:08:07.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:07.158963  1645 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } attempt: 7
08:08:07.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:07.159313  1729 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.134.252:42093: Network error: Client connection negotiation failed: client connection to 127.1.134.252:42093: connect: Connection refused (error 111)
08:08:07.161 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:08:07.163 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
08:08:07.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:07.175114  1645 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } has no permanent_uuid. Determining permanent_uuid...
08:08:07.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:07.182143  1645 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.134.252:42093: Network error: Client connection negotiation failed: client connection to 127.1.134.252:42093: connect: Connection refused (error 111)
08:08:07.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:07.240590  1645 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } attempt: 1
08:08:07.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:07.245337  1645 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.134.252:42093: Network error: Client connection negotiation failed: client connection to 127.1.134.252:42093: connect: Connection refused (error 111)
08:08:07.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:07.250733  1729 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } attempt: 3
08:08:07.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:07.255774  1729 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.134.252:42093: Network error: Client connection negotiation failed: client connection to 127.1.134.252:42093: connect: Connection refused (error 111)
08:08:07.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:07.326886  1645 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } attempt: 2
08:08:07.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:07.332103  1645 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.134.252:42093: Network error: Client connection negotiation failed: client connection to 127.1.134.252:42093: connect: Connection refused (error 111)
08:08:07.338 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:07.338 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:07.338 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:07.338 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:07.338 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:07.339 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:07.339 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:07.339 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:07.339 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:07.339 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:07.339 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:07.339 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:07.339 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:07.340 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29773), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [65ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [85ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [255ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [255ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [325ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [325ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [326ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [326ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [342ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [343ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [343ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [343ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [361ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [361ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [362ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [381ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [381ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [382ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [382ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [401ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [402ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [402ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [402ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [441ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [442ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [442ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [442ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [561ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [561ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [561ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [561ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [720ms] refreshing cache from master, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [722ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [723ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [723ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [723ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [981ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [982ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [983ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [983ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [983ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1841ms] refreshing cache from master, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1843ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2520ms] refreshing cache from master, [2520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [2521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2522ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [2522ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [2523ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2523ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [3040ms] refreshing cache from master, [3040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [3041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [3041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [3042ms] too many traces: truncated at 100 traces, deferred=Deferred@1565376858(state=PENDING, result=null, callback=(continuation of Deferred@1146507757 after retry RPC after error@1631745890) -> (continuation of Deferred@1279842014 after retry RPC after error@2143066396) -> (continuation of Deferred@160659007 after retry RPC after error@2065234184) -> (continuation of Deferred@1902919315 after retry RPC after error@1786985947) -> (continuation of Deferred@2025032762 after retry RPC after error@1147140765) -> (continuation of Deferred@1423432739 after retry RPC after error@659115655) -> (continuation of Deferred@1140835336 after retry RPC after error@2018465272) -> (continuation of Deferred@303278102 after retry RPC after error@2135155109) -> (continuation of Deferred@1109505473 after retry RPC after error@1086576872) -> (continuation of Deferred@1327467518 after retry RPC after error@791741809) -> (continuation of Deferred@1618031339 after retry RPC after error@1051439765) -> (continuation of Deferred@223907525 after retry RPC after error@719653010) -> (continuation of Deferred@1131053391 after retry RPC after error@540454061) -> (continuation of Deferred@1766924488 after retry RPC after error@1811027176) -> (continuation of Deferred@2089123872 after retry RPC after error@1766004953) -> (continuation of Deferred@166998617 after retry RPC after error@1918513883) -> (continuation of Deferred@579741744 after retry RPC after error@1408919912) -> (continuation of Deferred@2067070900 after retry RPC after error@1490798307) -> (continuation of Deferred@197638752 after retry RPC after error@200680281) -> (continuation of Deferred@1466148044 after retry RPC after error@1367968797) -> (continuation of Deferred@1739274486 after retry RPC after error@1568482225) -> (continuation of Deferred@401783062 after retry RPC after error@176567953), errback=(continuation of Deferred@1146507757 after retry RPC after error@1631745890) -> (continuation of Deferred@1279842014 after retry RPC after error@2143066396) -> (continuation of Deferred@160659007 after retry RPC after error@2065234184) -> (continuation of Deferred@1902919315 after retry RPC after error@1786985947) -> (continuation of Deferred@2025032762 after retry RPC after error@1147140765) -> (continuation of Deferred@1423432739 after retry RPC after error@659115655) -> (continuation of Deferred@1140835336 after retry RPC after error@2018465272) -> (continuation of Deferred@303278102 after retry RPC after error@2135155109) -> (continuation of Deferred@1109505473 after retry RPC after error@1086576872) -> (continuation of Deferred@1327467518 after retry RPC after error@791741809) -> (continuation of Deferred@1618031339 after retry RPC after error@1051439765) -> (continuation of Deferred@223907525 after retry RPC after error@719653010) -> (continuation of Deferred@1131053391 after retry RPC after error@540454061) -> (continuation of Deferred@1766924488 after retry RPC after error@1811027176) -> (continuation of Deferred@2089123872 after retry RPC after error@1766004953) -> (continuation of Deferred@166998617 after retry RPC after error@1918513883) -> (continuation of Deferred@579741744 after retry RPC after error@1408919912) -> (continuation of Deferred@2067070900 after retry RPC after error@1490798307) -> (continuation of Deferred@197638752 after retry RPC after error@200680281) -> (continuation of Deferred@1466148044 after retry RPC after error@1367968797) -> (continuation of Deferred@1739274486 after retry RPC after error@1568482225) -> (continuation of Deferred@401783062 after retry RPC after error@176567953)))
08:08:07.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:07.351495  1731 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:08:07.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:07.352265  1731 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:08:07.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:07.352792  1731 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:08:07.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:07.392968  1731 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:08:07.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:07.393368  1731 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:08:07.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:07.393603  1731 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:08:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:07.393885  1731 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:08:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:07.394292  1731 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:08:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:07.394572  1731 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33487/jwks.json
08:08:07.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:07.399279  1729 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } attempt: 4
08:08:07.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:07.404526  1729 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.134.252:42093: Network error: Client connection negotiation failed: client connection to 127.1.134.252:42093: connect: Connection refused (error 111)
08:08:07.410 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:07.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:07.417657  1645 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } attempt: 3
08:08:07.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:07.422444  1645 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.134.252:42093: Network error: Client connection negotiation failed: client connection to 127.1.134.252:42093: connect: Connection refused (error 111)
08:08:07.427 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:07.428 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:07.428 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:07.428 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:07.428 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:07.428 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:07.428 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:07.429 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:07.429 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:07.429 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:07.429 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:07.429 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:07.429 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:07.444021  1731 master_runner.cc:387] Master server non-default flags:
08:08:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.134.212:46153
08:08:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-2/data
08:08:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-2/wal
08:08:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:08:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093
08:08:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:08:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.134.252:42093
08:08:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:08:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:08:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:08:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33487/jwks.json
08:08:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-2/data/info.pb
08:08:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.134.252
08:08:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:08:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:08:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:08:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-2/logs
08:08:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:08:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:08:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:08:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:08:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:08:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:08:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:08:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:08:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:08:07.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:07.446084  1731 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:08:07.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:07.448362  1731 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:08:07.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:07.462373  1743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:07.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:07.562952  1645 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } attempt: 4
08:08:07.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:07.573231  1645 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.134.252:42093: Network error: Client connection negotiation failed: client connection to 127.1.134.252:42093: connect: Connection refused (error 111)
08:08:07.650 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091687649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:07.664 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
08:08:07.666 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
08:08:07.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:07.704063  1729 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } attempt: 5
08:08:07.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:07.716719  1729 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.134.252:42093: Network error: Client connection negotiation failed: client connection to 127.1.134.252:42093: connect: Connection refused (error 111)
08:08:07.814 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (a72e6b48022ef36361b5eef11ee7c683) switched from state RESTARTING to RUNNING.
08:08:07.816 [INFO - flink-pekko.actor.default-dispatcher-4] (CheckpointCoordinator.java:1805) Restoring job a72e6b48022ef36361b5eef11ee7c683 from Checkpoint 78 @ 1779091656118 for a72e6b48022ef36361b5eef11ee7c683 located at file:/tmp/junit13140095929423248446/checkpoints/a72e6b48022ef36361b5eef11ee7c683/chk-78.
08:08:07.818 [INFO - flink-pekko.actor.default-dispatcher-4] (MasterHooks.java:201) No master state to restore
08:08:07.819 [INFO - flink-pekko.actor.default-dispatcher-4] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
08:08:07.820 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to SCHEDULED.
08:08:07.821 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:08:07.822 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from SCHEDULED to DEPLOYING.
08:08:07.822 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #2) with attempt id 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1) with allocation id 68aed56532af9c33564af146c662175d
08:08:07.822 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to SCHEDULED.
08:08:07.823 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:08:07.829 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 68aed56532af9c33564af146c662175d.
08:08:07.831 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_2), deploy into slot with allocation id 68aed56532af9c33564af146c662175d.
08:08:07.832 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from SCHEDULED to DEPLOYING.
08:08:07.832 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #2) with attempt id 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1) with allocation id 99f4948912648970d945ee4b7d180287
08:08:07.835 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to SCHEDULED.
08:08:07.836 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:08:07.837 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 99f4948912648970d945ee4b7d180287.
08:08:07.838 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from SCHEDULED to DEPLOYING.
08:08:07.838 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #2) with attempt id 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1) with allocation id 4d91c4a4289e885e1ccd40283ee9eec0
08:08:07.838 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_2), deploy into slot with allocation id 99f4948912648970d945ee4b7d180287.
08:08:07.839 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to DEPLOYING.
08:08:07.839 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_2) [DEPLOYING].
08:08:07.839 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to SCHEDULED.
08:08:07.840 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4ce762de
08:08:07.840 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:07.840 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:08:07.840 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 4d91c4a4289e885e1ccd40283ee9eec0.
08:08:07.841 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13140095929423248446/checkpoints")
08:08:07.841 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
08:08:07.842 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_2), deploy into slot with allocation id 4d91c4a4289e885e1ccd40283ee9eec0.
08:08:07.842 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from SCHEDULED to DEPLOYING.
08:08:07.842 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #2) with attempt id 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1) with allocation id 0a17552dd40f187ff1067ce2b4829466
08:08:07.842 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to DEPLOYING.
08:08:07.843 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_2) [DEPLOYING].
08:08:07.843 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@45249426
08:08:07.843 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:07.843 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
08:08:07.844 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13140095929423248446/checkpoints")
08:08:07.844 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
08:08:07.844 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@28a4f8d9
08:08:07.845 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
08:08:07.846 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5f5ba6d5
08:08:07.846 [INFO - Thread-45] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
08:08:07.848 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:07.848 [DEBUG - Thread-45] (Connection.java:575) [peer master-127.28.220.253:45079(127.28.220.253:45079)] disconnecting while in state TERMINATED
08:08:07.848 [DEBUG - Thread-45] (Connection.java:575) [peer master-127.28.220.254:37365(127.28.220.254:37365)] disconnecting while in state TERMINATED
08:08:07.848 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:07.848 [DEBUG - Thread-45] (Connection.java:575) [peer master-127.28.220.252:33543(127.28.220.252:33543)] disconnecting while in state TERMINATED
08:08:07.849 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:07.849 [DEBUG - Thread-45] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:07.849 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:07.849 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:07.849 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:07.849 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:07.850 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:07.850 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:07.850 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:07.850 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:07.850 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:07.850 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:07.850 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:07.852 [INFO - Thread-45] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
08:08:07.852 [INFO - Thread-45] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
08:08:07.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:07.856922  1645 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } attempt: 5
08:08:07.858 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:07.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:07.867314  1645 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.134.252:42093: Network error: Client connection negotiation failed: client connection to 127.1.134.252:42093: connect: Connection refused (error 111)
08:08:07.873 [DEBUG - Thread-45] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:07.874 [INFO - Thread-45] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
08:08:07.874 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 0a17552dd40f187ff1067ce2b4829466.
08:08:07.876 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_2), deploy into slot with allocation id 0a17552dd40f187ff1067ce2b4829466.
08:08:07.876 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to DEPLOYING.
08:08:07.877 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_2) [DEPLOYING].
08:08:07.878 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:07.878 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3aed6ee8
08:08:07.880 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:07.881 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13140095929423248446/checkpoints")
08:08:07.882 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
08:08:07.883 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
08:08:07.897 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6f68999f
08:08:07.901 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:08:07.901 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:08:07.902 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:08:07.902 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:08:07.904 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to DEPLOYING.
08:08:07.904 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_2) [DEPLOYING].
08:08:07.905 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@9a82a60
08:08:07.905 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:07.905 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13140095929423248446/checkpoints")
08:08:07.906 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
08:08:07.906 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
08:08:07.906 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:07.908 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:07.908 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:07.909 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:07.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:07.910 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:07.917 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@45d51e99
08:08:07.918 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:07.921 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:07.940 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:07.944 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:07.944 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:07.944 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:07.948 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:07.958 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:07.959 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:07.959 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:07.959 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:07.963 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:07.978 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:07.989 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:07.990 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.004 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.004 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.005 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.005 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.006 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.006 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.006 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.006 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.007 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.007 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.007 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.008 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.008 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.008 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.009 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.010 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.010 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.010 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.011 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.011 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.011 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.011 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.011 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.011 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.011 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.011 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.018 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.018 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.023 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.026 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:08.027 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.027 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.028 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.031 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:08.032 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.032 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.032 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.039 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.040 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.046 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.046 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.048 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.049 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.050 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.050 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.050 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.050 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.050 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.050 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.050 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.050 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.050 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.050 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.050 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.050 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.050 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:08.050 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.051 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.051 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.051 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.051 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.052 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.052 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.052 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.052 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.053 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.054 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.054 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.054 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.056 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.056 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.057 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:08.058 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.058 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:08.058 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.059 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.059 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.059 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.059 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.061 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.062 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.062 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.062 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.065 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:08.065 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.066 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.066 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.066 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.066 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.067 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.067 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.069 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.073 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:08.074 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.074 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.074 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.074 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.075 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.075 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.075 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.075 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.075 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.075 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.075 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.075 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:08.075 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.076 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.076 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.076 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.076 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.076 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.076 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.078 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.078 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.078 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:08.079 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.079 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.079 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.080 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.080 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.080 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.080 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.082 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.082 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.082 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.082 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.083 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.084 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.084 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.084 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.085 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.087 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:08.087 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:08.087 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.087 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.087 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.087 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.088 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.088 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.088 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.089 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.089 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.089 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.089 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:08.091 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.091 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.091 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.091 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.092 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.092 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.092 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.092 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.092 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.092 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.092 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.092 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.097 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:08.098 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:08.098 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:08.099 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.099 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.099 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.099 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.100 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.100 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.100 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.100 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.100 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.101 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.101 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.101 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.101 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.101 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.101 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.101 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:08.102 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.102 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.102 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.102 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.102 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.102 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.103 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.103 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.103 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.103 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.103 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.104 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.104 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.104 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.104 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.104 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.104 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.104 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.105 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.105 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.106 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.106 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.106 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.107 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.107 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.107 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.108 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.108 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.108 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.109 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.109 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.109 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.110 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.110 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.110 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.110 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.111 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.111 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.111 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.111 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.118 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.118 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.118 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.118 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.118 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:08.118 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.119 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.119 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:08.119 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:08.119 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.119 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.119 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.119 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.119 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.119 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.119 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.119 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.119 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.119 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.119 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.119 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.119 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.119 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.119 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.120 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.120 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:08.120 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.120 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.121 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.121 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.121 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.121 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.121 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.121 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.121 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.121 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.121 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.121 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.121 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.123 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.123 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.123 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.124 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.124 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.124 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.124 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.124 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.125 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.125 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.125 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.125 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.125 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.128 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.128 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.129 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.129 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.129 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.129 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.129 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.129 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.129 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.130 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.130 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.130 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.130 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.138 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.138 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.138 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.139 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.139 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.139 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.139 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:08.139 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:08.140 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:08.140 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.140 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.140 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.140 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.140 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.140 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.141 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.141 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.141 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.141 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.141 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.141 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.141 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.144 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.144 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.144 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.144 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.144 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.145 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.145 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.145 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.144 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.145 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.145 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.145 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.145 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.146 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.146 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.146 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.146 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:08.148 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.148 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.148 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.148 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.148 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.148 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.149 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.149 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.149 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.149 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.149 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.149 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.149 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.149 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (0d2ddb76420639a9ec06ca05e894cb50) switched from state RESTARTING to RUNNING.
08:08:08.150 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job 0d2ddb76420639a9ec06ca05e894cb50 from Checkpoint 69 @ 1779091595847 for 0d2ddb76420639a9ec06ca05e894cb50 located at file:/tmp/junit4405728108231754423/checkpoints/0d2ddb76420639a9ec06ca05e894cb50/chk-69.
08:08:08.150 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091688149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:08.150 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
08:08:08.151 [INFO - flink-pekko.actor.default-dispatcher-8] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
08:08:08.160 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.160 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.161 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.161 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.161 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.161 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.162 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.162 [INFO - Thread-46] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
08:08:08.162 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to SCHEDULED.
08:08:08.163 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.163 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.164 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from SCHEDULED to DEPLOYING.
08:08:08.164 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #4) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id 23d75c1cae20f6d786d6e473edbc6825
08:08:08.164 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
08:08:08.164 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to SCHEDULED.
08:08:08.165 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:08:08.165 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from SCHEDULED to DEPLOYING.
08:08:08.165 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #4) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id 562b84b71b659c92bf587d4c4d45167a
08:08:08.165 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:08:08.165 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to SCHEDULED.
08:08:08.165 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.166 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 23d75c1cae20f6d786d6e473edbc6825.
08:08:08.162 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.166 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
08:08:08.166 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:08:08.167 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.167 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.167 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.169 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_4), deploy into slot with allocation id 23d75c1cae20f6d786d6e473edbc6825.
08:08:08.170 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.170 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.170 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.171 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.171 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.171 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.171 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.171 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.171 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.171 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.171 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.171 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.171 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.172 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.172 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.172 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.172 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.173 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.173 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.173 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.173 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.173 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.173 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.173 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.174 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.174 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from SCHEDULED to DEPLOYING.
08:08:08.174 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #4) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id 51ba13794eaa695dfcc17a66fc9521a4
08:08:08.175 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to SCHEDULED.
08:08:08.175 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:08:08.176 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from SCHEDULED to DEPLOYING.
08:08:08.176 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #4) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id e7235da53f93c0af3219c2857bfb1cae
08:08:08.177 [DEBUG - Thread-46] (Connection.java:575) [peer master-127.27.17.253:37621(127.27.17.253:37621)] disconnecting while in state TERMINATED
08:08:08.177 [DEBUG - Thread-46] (Connection.java:575) [peer master-127.27.17.252:43595(127.27.17.252:43595)] disconnecting while in state TERMINATED
08:08:08.177 [DEBUG - Thread-46] (Connection.java:575) [peer master-127.27.17.254:45447(127.27.17.254:45447)] disconnecting while in state TERMINATED
08:08:08.178 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:08.178 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.178 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.178 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.179 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:08.179 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:08.179 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:08.180 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.180 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.180 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.180 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.180 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.181 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.181 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.181 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.181 [INFO - Thread-46] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
08:08:08.181 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.181 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.181 [INFO - Thread-46] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
08:08:08.182 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.182 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.182 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.182 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.182 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.182 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.183 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.183 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.183 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.183 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:08.183 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.184 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.184 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.184 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.184 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.184 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.184 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.184 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.184 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.185 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.185 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.185 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.185 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.186 [DEBUG - Thread-46] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:08.186 [INFO - Thread-46] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
08:08:08.187 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 562b84b71b659c92bf587d4c4d45167a.
08:08:08.189 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_4), deploy into slot with allocation id 562b84b71b659c92bf587d4c4d45167a.
08:08:08.191 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to DEPLOYING.
08:08:08.191 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_4) [DEPLOYING].
08:08:08.193 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7fc55715
08:08:08.193 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:08.193 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:08:08.194 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
08:08:08.194 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
08:08:08.198 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.198 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.198 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.199 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to DEPLOYING.
08:08:08.199 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_4) [DEPLOYING].
08:08:08.199 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.199 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.199 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.200 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.200 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.200 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.200 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@cb76ce7
08:08:08.200 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:08.200 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:08:08.200 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.200 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.200 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.200 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.201 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 51ba13794eaa695dfcc17a66fc9521a4.
08:08:08.202 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_4), deploy into slot with allocation id 51ba13794eaa695dfcc17a66fc9521a4.
08:08:08.205 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
08:08:08.205 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
08:08:08.214 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2ea3db57
08:08:08.223 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:08:08.224 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:08:08.224 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:08:08.224 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:08:08.228 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.229 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.229 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.229 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.229 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.229 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.229 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.229 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.229 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.230 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.230 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.230 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.230 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.230 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3f9e97a9
08:08:08.238 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.238 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.239 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.239 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:08.239 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.239 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.239 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.239 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.239 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.239 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.239 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.239 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.239 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.239 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.240 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:08.241 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot e7235da53f93c0af3219c2857bfb1cae.
08:08:08.243 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_4), deploy into slot with allocation id e7235da53f93c0af3219c2857bfb1cae.
08:08:08.244 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to DEPLOYING.
08:08:08.244 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_4) [DEPLOYING].
08:08:08.245 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@63e00821
08:08:08.245 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:08.245 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:08:08.247 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
08:08:08.248 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
08:08:08.252 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to DEPLOYING.
08:08:08.252 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_4) [DEPLOYING].
08:08:08.255 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5ba40125
08:08:08.256 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:08.256 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:08:08.258 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
08:08:08.258 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
08:08:08.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:08.264384  1729 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } attempt: 6
08:08:08.267 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4ec26dc
08:08:08.268 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.274 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@24bc2ea3
08:08:08.278 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:08.278 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:08.279 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:08.279 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:08.279 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.279 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.279 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.279 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.279 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.279 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.279 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.279 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.280 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.280 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.280 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.280 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.280 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:08.280 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.280 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.280 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.281 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.281 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.281 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.281 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.280 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.282 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.282 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.282 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.282 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:08.289 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.290 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.291 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.291 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.297 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.298 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.298 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.298 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.304 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.305 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.305 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.305 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.308 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:08.307737  1729 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.134.252:42093: Network error: Client connection negotiation failed: client connection to 127.1.134.252:42093: connect: Connection refused (error 111)
08:08:08.319 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:08.320 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:08.320 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:08.321 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.321 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.321 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.324 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.324 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.324 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.325 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.325 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.325 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.325 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.325 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.325 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.325 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.325 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.326 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.326 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.328 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.328 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.328 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.328 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.329 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.329 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.329 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:08.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:08.336 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:08.343 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.343 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.344 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.344 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.344 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.344 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.345 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.346 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.346 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.346 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.346 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.347 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.347 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.347 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.348 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.348 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.348 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.348 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.350 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.350 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.351 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.351 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.352 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.352 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.352 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.352 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.354 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.354 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.354 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.355 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.355 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.357 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.357 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.357 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.358 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.359 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.359 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.359 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.359 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.359 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.359 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.359 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.359 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.359 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.360 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.360 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.360 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.360 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.360 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.360 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.360 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.360 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.361 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.361 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.361 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.361 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.362 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.362 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.362 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.362 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.363 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.363 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.363 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.363 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.363 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:08.364 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.364 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.364 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.365 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.365 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:08.366 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.366 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.366 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.367 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.368 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.368 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.368 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.370 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.370 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.370 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.370 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.370 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.370 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.370 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.371 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.371 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.371 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.371 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.371 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.371 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.371 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.383 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.398 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.398 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.398 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.399 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.399 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.400 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.400 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.400 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.400 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.401 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.401 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.401 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.401 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.403 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.406 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.406 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.406 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.410 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:08.411 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.412 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.415 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.416 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.416 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.416 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.417 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.418 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.418 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.418 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.418 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.418 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.420 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:08.419939  1645 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } attempt: 6
08:08:08.421 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.421 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.421 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.422 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.422 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.423 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.423 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.423 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.424 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.424 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.424 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.425 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.425 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.425 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.425 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.425 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.426 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.426 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.426 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.426 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.426 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.434 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.434 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.434 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.434 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.443 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.445 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.445 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.445 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.454 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.459 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:08.459313  1645 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.134.252:42093: Network error: Client connection negotiation failed: client connection to 127.1.134.252:42093: connect: Connection refused (error 111)
08:08:08.460 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.460 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.460 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.461 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.461 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.461 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.461 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.463 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.463 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.463 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.463 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.465 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.467 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.467 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.467 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.468 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.468 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.468 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.469 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.469 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.469 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.469 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.469 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.469 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.469 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.469 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.469 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.470 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.470 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.470 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.470 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.470 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.470 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.470 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.471 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.471 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.471 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.472 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.472 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.472 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.474 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.474 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.474 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.474 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.475 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.475 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.475 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.475 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.477 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.477 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.477 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.477 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:08.482 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.483 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.483 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.483 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.483 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.483 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.483 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.483 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.483 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.483 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.484 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.484 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.484 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.484 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.484 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.484 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.484 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.484 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.484 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.484 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.485 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.485 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.485 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.485 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.485 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.485 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.485 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.486 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.486 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.486 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.486 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.486 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.487 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.487 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.487 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.487 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.488 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.488 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.488 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.488 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.488 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.489 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.489 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.489 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.489 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.489 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.489 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.490 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.490 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.490 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.490 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.490 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.490 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.490 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.490 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.492 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.492 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.493 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.493 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.493 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.493 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.494 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.494 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.494 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.494 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.496 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:08.498 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:08.499 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.499 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.499 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.499 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:08.500 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.500 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.500 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.501 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.501 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.501 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.501 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:08.503 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.503 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.503 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.504 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.504 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.504 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.504 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.504 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.504 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.505 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.505 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.505 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.505 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.505 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.505 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.506 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.506 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.506 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.506 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.507 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.507 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.507 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.507 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.507 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.508 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.508 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.508 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.508 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.508 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.509 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.509 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.509 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.510 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.510 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.510 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.511 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.512 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.512 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.512 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.512 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.512 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.512 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.512 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.512 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.512 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.513 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.513 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.513 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.513 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.513 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.513 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.513 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.516 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:08.516 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:08.522 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.523 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.523 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.523 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.523 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.524 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.524 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.524 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.524 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.524 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.525 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.525 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.525 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.525 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.525 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.526 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.526 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.526 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.527 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.527 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.527 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.527 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.527 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.527 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.528 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.528 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.528 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.528 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.529 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.531 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:08.532 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.532 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.532 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.533 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.533 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.533 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.534 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:08.542 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.543 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.543 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.543 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.543 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.544 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.544 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.544 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.544 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.544 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.544 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.545 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.545 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.545 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.545 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.545 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.545 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.545 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.545 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.545 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.545 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.546 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.546 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.546 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.546 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.550 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.550 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.550 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.550 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.550 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.550 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.550 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.551 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.551 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.551 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.551 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.552 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.552 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.552 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.552 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.552 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.553 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.553 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.553 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.553 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.553 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.553 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.553 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.554 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.554 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.554 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.554 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.556 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:08.556 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:08.556 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:08.557 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.557 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.557 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.557 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.557 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:08.558 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.560 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.560 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.560 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.560 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.560 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:08.576 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:08.576 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:08.577 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:08.578 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.578 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.578 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.579 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.579 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.579 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.585 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.585 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.585 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.586 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.586 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.586 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.587 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.587 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.587 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.587 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.587 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.587 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.587 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.588 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.588 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.588 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.588 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:08.589 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.589 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.589 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.590 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.590 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.590 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.591 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.591 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.591 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.591 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.592 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.592 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.592 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.596 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:08.596 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:08.597 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:08.598 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.598 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.598 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.598 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.598 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.598 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.599 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.599 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.599 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.599 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:08.608 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.608 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.609 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.609 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.609 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.609 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.610 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.610 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.610 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.610 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.610 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.611 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.611 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.618 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.618 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.618 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.619 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:08.619 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:08.619 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:08.619 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.619 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.619 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.620 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:08.620 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.620 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.620 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.620 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.620 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.621 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.621 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.621 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:08.621 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.621 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.621 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:08.621 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:08.622 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.622 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.622 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.622 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.624 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.624 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.624 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.624 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.625 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.625 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.625 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.625 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.625 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.626 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.626 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.626 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.626 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.639 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:08.640 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:08.640 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:08.641 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:08.641 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:08.641 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:08.642 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:08.642 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:08.642 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:08.643 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:08.643 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:08.643 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:08.644 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:08.650 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091688649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:08.656 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:08.657 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:08.657 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:08.658 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.658 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.658 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.658 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.658 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.659 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.659 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.659 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.659 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.659 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:08.660 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.660 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.660 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.661 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.661 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.661 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.661 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.661 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.661 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.662 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.662 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.662 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.662 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:08.665 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
08:08:08.667 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
08:08:08.682 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.683 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.683 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.683 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.684 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.684 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.684 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.684 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.684 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.685 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.685 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.685 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.685 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.685 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.686 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.686 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.687 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.687 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.687 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.687 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.687 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.687 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.688 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.688 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.688 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.688 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.688 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.689 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.689 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.689 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.689 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.690 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.690 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.690 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.690 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.691 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.691 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.691 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.691 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.705 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.706 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.706 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.707 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.707 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.707 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.707 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.707 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.708 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.708 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.708 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.709 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.709 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.796 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:08.797 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:08.797 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:08.798 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.798 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.798 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.799 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.799 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.799 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.799 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.799 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.799 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.799 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:08.824 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.825 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.825 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.825 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.826 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.826 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.826 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.827 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.827 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.826 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.827 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.827 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.827 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.831 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:08.902 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.903 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.903 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.904 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.904 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.904 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.904 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.904 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.904 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.904 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.905 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.905 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.905 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:08.925 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:08.926 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:08.926 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:08.927 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.927 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.927 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:08.927 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.928 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.928 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:08.928 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.928 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.928 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:08.928 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:08.936 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:08.936 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:08.937 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:08.937 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.937 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.937 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:08.938 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.938 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.938 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:08.938 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.939 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.939 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:08.939 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:08.950 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:08.950 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:08.950 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:08.951 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.951 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.951 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:08.952 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.952 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.952 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:08.952 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.953 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.953 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:08.953 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:09.038 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:09.039 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:09.039 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:09.040 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:09.040 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:09.040 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:09.041 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:09.041 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:09.041 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:09.041 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:09.041 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:09.041 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:09.042 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:09.038 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:09.042 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:09.043 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:09.043 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:09.043 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:09.043 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:09.044 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:09.044 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:09.044 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:09.044 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:09.044 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:09.045 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:09.045 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:09.058 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:09.104 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:09.104 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:09.104 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:09.105 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.105 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.105 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.105 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.105 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.105 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.106 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.106 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.106 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.106 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:09.119 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:09.119 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:09.119 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:09.120 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:09.120 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:09.120 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:09.120 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:09.120 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:09.120 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:09.120 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:09.121 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:09.121 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:09.121 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:09.149 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091689148 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:09.164 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
08:08:09.166 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
08:08:09.209 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:09.209 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:09.209 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:09.210 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.210 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.210 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.210 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.210 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.210 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.211 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.211 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.211 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.211 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:09.245 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:09.245 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:09.245 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:09.246 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.246 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.246 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.247 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.247 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.247 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.248 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.248 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.248 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.248 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:09.268 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:09.269 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:09.269 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:09.270 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.270 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.270 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.271 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.271 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.271 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.271 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.271 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.271 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.271 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:09.331 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:09.344 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:09.344 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:09.344 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:09.345 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.346 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.346 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.346 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.346 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.346 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.347 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.347 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.347 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.347 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:09.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.368474  1729 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } attempt: 7
08:08:09.382 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:09.383 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:09.383 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:09.384 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.384 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.384 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.385 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.385 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.385 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.386 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.386 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.386 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.386 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:09.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:09.396420  1729 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.134.252:42093: Network error: Client connection negotiation failed: client connection to 127.1.134.252:42093: connect: Connection refused (error 111)
08:08:09.411 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:09.457 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:09.457 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:09.457 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:09.458 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:09.458 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:09.459 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:09.459 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:09.459 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:09.459 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:09.460 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:09.460 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:09.460 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:09.460 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:09.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.493022  1645 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } attempt: 7
08:08:09.503 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:09.504 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:09.504 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:09.505 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:09.505 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:09.505 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:09.506 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:09.506 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:09.506 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:09.506 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:09.506 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:09.506 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:09.506 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:09.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:09.534489  1645 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.134.252:42093: Network error: Client connection negotiation failed: client connection to 127.1.134.252:42093: connect: Connection refused (error 111)
08:08:09.558 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:09.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:09.559906  1731 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.097s	user 0.702s	sys 1.266s
08:08:09.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:08.867630  1742 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 1731
08:08:09.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:09.560488  1731 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.098s	user 0.702s	sys 1.266s
08:08:09.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:07.463793  1744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:09.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:09.561685  1745 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2096 milliseconds
08:08:09.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:09.563745  1746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:09.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.563674  1731 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:08:09.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.568941  1731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:08:09.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.572254  1731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:08:09.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.573654  1731 hybrid_clock.cc:648] HybridClock initialized: now 1779091689573606 us; error 55 us; skew 500 ppm
08:08:09.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.574715  1731 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:08:09.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.582662  1731 webserver.cc:533] Webserver started at http://127.1.134.252:33645/ using document root <none> and password file <none>
08:08:09.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.583982  1731 fs_manager.cc:362] Metadata directory not provided
08:08:09.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.584260  1731 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:08:09.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.584843  1731 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:08:09.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.590665  1731 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-2/data/instance:
08:08:09.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a088535638cb44f7843b68a80142e4d6"
08:08:09.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:09 on dist-test-slave-1jss"
08:08:09.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.592167  1731 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-2/wal/instance:
08:08:09.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a088535638cb44f7843b68a80142e4d6"
08:08:09.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:09 on dist-test-slave-1jss"
08:08:09.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.600966  1731 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.005s
08:08:09.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.607950  1868 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:08:09.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.609345  1731 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.006s	sys 0.000s
08:08:09.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.609848  1731 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-2/wal
08:08:09.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a088535638cb44f7843b68a80142e4d6"
08:08:09.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:09 on dist-test-slave-1jss"
08:08:09.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.610364  1731 fs_report.cc:389] FS layout report
08:08:09.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:08:09.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-2/wal
08:08:09.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-2/wal
08:08:09.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-2/data/data
08:08:09.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:08:09.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:08:09.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:08:09.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:08:09.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:08:09.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:08:09.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:08:09.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:08:09.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:08:09.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:08:09.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:08:09.650 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091689649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:09.662 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
08:08:09.663 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
08:08:09.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.690208  1731 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:08:09.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.692216  1731 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:08:09.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.692781  1731 kserver.cc:163] Server-wide thread pool size limit: 3276
08:08:09.703 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:09.704 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:09.704 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:09.704 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.704 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.704 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.704 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.704 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.704 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.704 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.704 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.704 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.705 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:09.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.791975  1731 rpc_server.cc:307] RPC server started. Bound to: 127.1.134.252:42093
08:08:09.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.792097  1919 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.134.252:42093 every 8 connection(s)
08:08:09.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.795496  1731 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-2/data/info.pb
08:08:09.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.799839  1563 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 1731
08:08:09.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.800403  1563 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/master-2/wal/instance
08:08:09.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.803841  1920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:09.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.823688  1920 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.134.254" port: 38449 } has no permanent_uuid. Determining permanent_uuid...
08:08:09.828 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:09.829 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:09.829 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:09.829 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:09.829 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:09.829 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:09.829 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:09.829 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:09.830 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:09.830 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:09.830 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:09.830 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:09.830 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:09.831 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:09.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.851723  1920 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } has no permanent_uuid. Determining permanent_uuid...
08:08:09.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.864284  1920 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } has no permanent_uuid. Determining permanent_uuid...
08:08:09.868 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:09.869 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:09.869 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:09.870 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.870 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.870 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.870 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.870 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.870 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.871 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.871 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.871 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.871 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:09.880 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:09.880 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:09.880 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:09.881 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:09.881 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:09.881 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:09.881 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:09.881 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:09.881 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:09.881 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:09.881 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:09.881 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:09.881 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:09.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.884737  1920 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6: Bootstrap starting.
08:08:09.885 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:09.885 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:09.885 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:09.885 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.885 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.886 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:09.886 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.886 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.886 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:09.886 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.886 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.886 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:09.886 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:09.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.893996  1920 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6: Neither blocks nor log segments found. Creating new log.
08:08:09.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.896543  1920 log.cc:826] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6: Log is configured to *not* fsync() on all Append() calls
08:08:09.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.903234  1920 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6: No bootstrap required, opened a new log
08:08:09.911 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:09.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.927551  1920 raft_consensus.cc:359] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e71aeaf669d64d85af17143e82ce987d" member_type: VOTER last_known_addr { host: "127.1.134.254" port: 38449 } } peers { permanent_uuid: "943ab925f9514c34b43356d83a1698bf" member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } } peers { permanent_uuid: "a088535638cb44f7843b68a80142e4d6" member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } }
08:08:09.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.928490  1920 raft_consensus.cc:385] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:09.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.928743  1920 raft_consensus.cc:740] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a088535638cb44f7843b68a80142e4d6, State: Initialized, Role: FOLLOWER
08:08:09.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.929600  1920 consensus_queue.cc:260] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e71aeaf669d64d85af17143e82ce987d" member_type: VOTER last_known_addr { host: "127.1.134.254" port: 38449 } } peers { permanent_uuid: "943ab925f9514c34b43356d83a1698bf" member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } } peers { permanent_uuid: "a088535638cb44f7843b68a80142e4d6" member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } }
08:08:09.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.932870  1929 sys_catalog.cc:455] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e71aeaf669d64d85af17143e82ce987d" member_type: VOTER last_known_addr { host: "127.1.134.254" port: 38449 } } peers { permanent_uuid: "943ab925f9514c34b43356d83a1698bf" member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } } peers { permanent_uuid: "a088535638cb44f7843b68a80142e4d6" member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } } }
08:08:09.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.933917  1929 sys_catalog.cc:458] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [sys.catalog]: This master's current role is: FOLLOWER
08:08:09.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.935484  1920 sys_catalog.cc:565] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [sys.catalog]: configured and running, proceeding with master startup.
08:08:09.936 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:09.936 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:09.936 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:09.937 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:09.937 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:09.937 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:09.937 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:09.937 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:09.937 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:09.937 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:09.937 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:09.937 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:09.937 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:09.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:09.949265  1874 tablet.cc:2404] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:08:09.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:09.977720  1940 catalog_manager.cc:1593] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:08:09.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:09.978133  1940 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:08:10.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:09.970376  1731 master_runner.cc:187] Error getting master registration for 127.1.134.254:38449: OK, instance_id { permanent_uuid: "e71aeaf669d64d85af17143e82ce987d" instance_seqno: 1779091684702984 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:08:10.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:10.008621  1731 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:08:10.058 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:10.148 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:10.149 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:10.149 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:10.149 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:10.149 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:10.149 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:10.149 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:10.149 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:10.149 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:10.149 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091690149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:10.150 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:10.150 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:10.150 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:10.150 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:10.157 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
08:08:10.157 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
08:08:10.183 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:10.183 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:10.184 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:10.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:10.183548  1929 raft_consensus.cc:493] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:10.184 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:10.184 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:10.184 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:10.184 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:10.184 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:10.185 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:10.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:10.184396  1929 raft_consensus.cc:515] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e71aeaf669d64d85af17143e82ce987d" member_type: VOTER last_known_addr { host: "127.1.134.254" port: 38449 } } peers { permanent_uuid: "943ab925f9514c34b43356d83a1698bf" member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } } peers { permanent_uuid: "a088535638cb44f7843b68a80142e4d6" member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } }
08:08:10.185 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:10.185 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:10.185 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:10.185 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:10.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:10.189499  1929 leader_election.cc:290] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e71aeaf669d64d85af17143e82ce987d (127.1.134.254:38449), 943ab925f9514c34b43356d83a1698bf (127.1.134.253:41425)
08:08:10.263 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:10.264 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:10.264 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:10.264 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:10.264 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:10.265 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:10.265 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:10.265 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:10.265 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:10.265 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:10.265 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:10.265 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:10.266 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:10.278 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:10.279 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:10.279 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:10.279 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:10.279 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:10.279 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:10.279 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:10.279 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:10.279 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:10.280 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:10.280 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:10.280 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:10.280 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:10.331 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:10.411 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:10.438 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:10.439 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:10.439 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:10.439 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:10.440 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:10.440 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:10.440 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:10.440 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:10.440 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:10.440 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:10.441 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:10.441 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:10.441 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:10.499 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:10.499 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:10.499 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:10.499 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:10.500 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:10.500 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:10.500 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:10.500 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:10.500 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:10.500 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:10.500 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:10.500 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:10.500 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:10.558 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:10.629 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:10.629 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:10.629 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:10.630 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:10.630 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:10.630 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:10.630 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:10.630 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:10.630 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:10.630 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:10.630 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:10.630 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:10.630 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:10.650 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091690649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:10.659 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
08:08:10.660 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
08:08:10.763 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:10.764 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:10.764 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:10.764 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:10.764 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:10.764 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:10.764 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:10.764 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:10.765 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:10.765 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:10.765 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:10.764 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:10.765 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:10.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:10.856 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:10.857 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:10.857 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:10.857 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:10.857 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:10.857 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:10.857 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:10.857 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:10.858 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:10.858 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:10.858 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:10.858 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:10.858 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:10.858 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:10.858 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:10.858 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:10.858 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:10.859 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:10.859 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:10.859 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:10.859 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:10.859 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:10.860 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:10.860 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:10.860 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:10.860 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:10.884 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:10.884 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:10.884 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:10.885 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:10.885 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:10.885 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:10.885 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:10.885 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:10.885 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:10.885 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:10.885 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:10.885 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:10.886 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:10.911 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:10.983531  1940 catalog_manager.cc:1593] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:08:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:10.984269  1940 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:08:10.988 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:10.989 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:10.989 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:10.990 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:10.990 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:10.990 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:10.990 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:10.990 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:10.990 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:10.991 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:10.991 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:10.991 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:10.991 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:11.058 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:11.078 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:11.078 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:11.079 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:11.079 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:11.079 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:11.079 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:11.079 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:11.079 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:11.079 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:11.080 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:11.080 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:11.080 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:11.080 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:11.150 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091691149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:11.158 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
08:08:11.159 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
08:08:11.185 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:11.186 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:11.186 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:11.186 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:11.186 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:11.186 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:11.186 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:11.186 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:11.187 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:11.187 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:11.187 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:11.187 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:11.187 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:11.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:11.410 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:11.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.487028  1729 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } attempt: 8
08:08:11.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.512027  1729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 943ab925f9514c34b43356d83a1698bf: Bootstrap starting.
08:08:11.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.518805  1729 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 943ab925f9514c34b43356d83a1698bf: Neither blocks nor log segments found. Creating new log.
08:08:11.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.521075  1729 log.cc:826] T 00000000000000000000000000000000 P 943ab925f9514c34b43356d83a1698bf: Log is configured to *not* fsync() on all Append() calls
08:08:11.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.530006  1729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 943ab925f9514c34b43356d83a1698bf: No bootstrap required, opened a new log
08:08:11.558 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:11.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.561848  1729 raft_consensus.cc:359] T 00000000000000000000000000000000 P 943ab925f9514c34b43356d83a1698bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e71aeaf669d64d85af17143e82ce987d" member_type: VOTER last_known_addr { host: "127.1.134.254" port: 38449 } } peers { permanent_uuid: "943ab925f9514c34b43356d83a1698bf" member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } } peers { permanent_uuid: "a088535638cb44f7843b68a80142e4d6" member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } }
08:08:11.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.562892  1729 raft_consensus.cc:385] T 00000000000000000000000000000000 P 943ab925f9514c34b43356d83a1698bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:11.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.563235  1729 raft_consensus.cc:740] T 00000000000000000000000000000000 P 943ab925f9514c34b43356d83a1698bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 943ab925f9514c34b43356d83a1698bf, State: Initialized, Role: FOLLOWER
08:08:11.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.564347  1729 consensus_queue.cc:260] T 00000000000000000000000000000000 P 943ab925f9514c34b43356d83a1698bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e71aeaf669d64d85af17143e82ce987d" member_type: VOTER last_known_addr { host: "127.1.134.254" port: 38449 } } peers { permanent_uuid: "943ab925f9514c34b43356d83a1698bf" member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } } peers { permanent_uuid: "a088535638cb44f7843b68a80142e4d6" member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } }
08:08:11.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.567811  1946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 943ab925f9514c34b43356d83a1698bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e71aeaf669d64d85af17143e82ce987d" member_type: VOTER last_known_addr { host: "127.1.134.254" port: 38449 } } peers { permanent_uuid: "943ab925f9514c34b43356d83a1698bf" member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } } peers { permanent_uuid: "a088535638cb44f7843b68a80142e4d6" member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } } }
08:08:11.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.568996  1946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 943ab925f9514c34b43356d83a1698bf [sys.catalog]: This master's current role is: FOLLOWER
08:08:11.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.569836  1729 sys_catalog.cc:565] T 00000000000000000000000000000000 P 943ab925f9514c34b43356d83a1698bf [sys.catalog]: configured and running, proceeding with master startup.
08:08:11.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.570050  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a088535638cb44f7843b68a80142e4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "943ab925f9514c34b43356d83a1698bf" is_pre_election: true
08:08:11.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.571102  1704 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 943ab925f9514c34b43356d83a1698bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a088535638cb44f7843b68a80142e4d6 in term 0.
08:08:11.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.571929  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44112 (request call id 1) took 1381 ms. Trace:
08:08:11.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.572650  1704 rpcz_store.cc:276] 0518 08:08:10.190247 (+     0us) service_pool.cc:167] Inserting onto call queue
08:08:11.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 08:08:10.190419 (+   172us) service_pool.cc:224] Handling call
08:08:11.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 08:08:11.571861 (+1381442us) inbound_call.cc:177] Queueing success response
08:08:11.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
08:08:11.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.575392  1872 leader_election.cc:304] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 943ab925f9514c34b43356d83a1698bf, a088535638cb44f7843b68a80142e4d6; no voters: 
08:08:11.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.590855  1950 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:08:11.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.591328  1950 raft_consensus.cc:493] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:08:11.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.591842  1950 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [term 0 FOLLOWER]: Advancing to term 1
08:08:11.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.596107  1645 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } attempt: 8
08:08:11.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.602403  1950 raft_consensus.cc:515] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e71aeaf669d64d85af17143e82ce987d" member_type: VOTER last_known_addr { host: "127.1.134.254" port: 38449 } } peers { permanent_uuid: "943ab925f9514c34b43356d83a1698bf" member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } } peers { permanent_uuid: "a088535638cb44f7843b68a80142e4d6" member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } }
08:08:11.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.605262  1950 leader_election.cc:290] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [CANDIDATE]: Term 1 election: Requested vote from peers e71aeaf669d64d85af17143e82ce987d (127.1.134.254:38449), 943ab925f9514c34b43356d83a1698bf (127.1.134.253:41425)
08:08:11.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.607246  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a088535638cb44f7843b68a80142e4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "943ab925f9514c34b43356d83a1698bf"
08:08:11.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.608317  1704 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 943ab925f9514c34b43356d83a1698bf [term 0 FOLLOWER]: Advancing to term 1
08:08:11.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:11.616875  1683 tablet.cc:2404] T 00000000000000000000000000000000 P 943ab925f9514c34b43356d83a1698bf: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:08:11.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.624759  1704 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 943ab925f9514c34b43356d83a1698bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a088535638cb44f7843b68a80142e4d6 in term 1.
08:08:11.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.627126  1872 leader_election.cc:304] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 943ab925f9514c34b43356d83a1698bf, a088535638cb44f7843b68a80142e4d6; no voters: 
08:08:11.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.628667  1950 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [term 1 FOLLOWER]: Leader election won for term 1
08:08:11.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.645833  1950 raft_consensus.cc:697] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [term 1 LEADER]: Becoming Leader. State: Replica: a088535638cb44f7843b68a80142e4d6, State: Running, Role: LEADER
08:08:11.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.647876  1950 consensus_queue.cc:237] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e71aeaf669d64d85af17143e82ce987d" member_type: VOTER last_known_addr { host: "127.1.134.254" port: 38449 } } peers { permanent_uuid: "943ab925f9514c34b43356d83a1698bf" member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } } peers { permanent_uuid: "a088535638cb44f7843b68a80142e4d6" member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } }
08:08:11.650 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091691649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:11.660 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
08:08:11.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.663115  1645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e71aeaf669d64d85af17143e82ce987d: Bootstrap starting.
08:08:11.666 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
08:08:11.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.667699  1961 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
08:08:11.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.688046  1959 sys_catalog.cc:455] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a088535638cb44f7843b68a80142e4d6. Latest consensus state: current_term: 1 leader_uuid: "a088535638cb44f7843b68a80142e4d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e71aeaf669d64d85af17143e82ce987d" member_type: VOTER last_known_addr { host: "127.1.134.254" port: 38449 } } peers { permanent_uuid: "943ab925f9514c34b43356d83a1698bf" member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } } peers { permanent_uuid: "a088535638cb44f7843b68a80142e4d6" member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } } }
08:08:11.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.688988  1959 sys_catalog.cc:458] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [sys.catalog]: This master's current role is: LEADER
08:08:11.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.678493  1645 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e71aeaf669d64d85af17143e82ce987d: Neither blocks nor log segments found. Creating new log.
08:08:11.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.694084  1645 log.cc:826] T 00000000000000000000000000000000 P e71aeaf669d64d85af17143e82ce987d: Log is configured to *not* fsync() on all Append() calls
08:08:11.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.694154  1962 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
08:08:11.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.710422  1962 catalog_manager.cc:1519] Initializing Kudu cluster ID...
08:08:11.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.711926  1645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e71aeaf669d64d85af17143e82ce987d: No bootstrap required, opened a new log
08:08:11.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.672787  1647 master_runner.cc:187] Error getting master registration for 127.1.134.254:38449: OK, instance_id { permanent_uuid: "e71aeaf669d64d85af17143e82ce987d" instance_seqno: 1779091684702984 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:08:11.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.717344  1647 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:08:11.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.738912  1704 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 943ab925f9514c34b43356d83a1698bf [term 1 FOLLOWER]: Refusing update from remote peer a088535638cb44f7843b68a80142e4d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:08:11.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.741920  1959 consensus_queue.cc:1048] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "943ab925f9514c34b43356d83a1698bf" member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:08:11.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.748312  1645 raft_consensus.cc:359] T 00000000000000000000000000000000 P e71aeaf669d64d85af17143e82ce987d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e71aeaf669d64d85af17143e82ce987d" member_type: VOTER last_known_addr { host: "127.1.134.254" port: 38449 } } peers { permanent_uuid: "943ab925f9514c34b43356d83a1698bf" member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } } peers { permanent_uuid: "a088535638cb44f7843b68a80142e4d6" member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } }
08:08:11.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.749320  1645 raft_consensus.cc:385] T 00000000000000000000000000000000 P e71aeaf669d64d85af17143e82ce987d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:11.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.749660  1645 raft_consensus.cc:740] T 00000000000000000000000000000000 P e71aeaf669d64d85af17143e82ce987d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e71aeaf669d64d85af17143e82ce987d, State: Initialized, Role: FOLLOWER
08:08:11.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.750862  1645 consensus_queue.cc:260] T 00000000000000000000000000000000 P e71aeaf669d64d85af17143e82ce987d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e71aeaf669d64d85af17143e82ce987d" member_type: VOTER last_known_addr { host: "127.1.134.254" port: 38449 } } peers { permanent_uuid: "943ab925f9514c34b43356d83a1698bf" member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } } peers { permanent_uuid: "a088535638cb44f7843b68a80142e4d6" member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } }
08:08:11.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.759455  1965 sys_catalog.cc:455] T 00000000000000000000000000000000 P e71aeaf669d64d85af17143e82ce987d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e71aeaf669d64d85af17143e82ce987d" member_type: VOTER last_known_addr { host: "127.1.134.254" port: 38449 } } peers { permanent_uuid: "943ab925f9514c34b43356d83a1698bf" member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } } peers { permanent_uuid: "a088535638cb44f7843b68a80142e4d6" member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } } }
08:08:11.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.760385  1965 sys_catalog.cc:458] T 00000000000000000000000000000000 P e71aeaf669d64d85af17143e82ce987d [sys.catalog]: This master's current role is: FOLLOWER
08:08:11.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.764499  1645 sys_catalog.cc:565] T 00000000000000000000000000000000 P e71aeaf669d64d85af17143e82ce987d [sys.catalog]: configured and running, proceeding with master startup.
08:08:11.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.764729  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a088535638cb44f7843b68a80142e4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e71aeaf669d64d85af17143e82ce987d"
08:08:11.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.765620  1619 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e71aeaf669d64d85af17143e82ce987d [term 0 FOLLOWER]: Advancing to term 1
08:08:11.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.770215  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a088535638cb44f7843b68a80142e4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e71aeaf669d64d85af17143e82ce987d" is_pre_election: true
08:08:11.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:11.772171  1620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35446 (request call id 2) took 1584 ms (client timeout 1933 ms). Trace:
08:08:11.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:11.773636  1620 rpcz_store.cc:269] 0518 08:08:10.188078 (+     0us) service_pool.cc:167] Inserting onto call queue
08:08:11.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 08:08:10.188231 (+   153us) service_pool.cc:224] Handling call
08:08:11.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 08:08:11.772047 (+1583816us) inbound_call.cc:177] Queueing success response
08:08:11.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
08:08:11.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.797953  1619 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e71aeaf669d64d85af17143e82ce987d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a088535638cb44f7843b68a80142e4d6 in term 1.
08:08:11.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.801043  1618 raft_consensus.cc:1275] T 00000000000000000000000000000000 P e71aeaf669d64d85af17143e82ce987d [term 1 FOLLOWER]: Refusing update from remote peer a088535638cb44f7843b68a80142e4d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:08:11.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.807493  1959 consensus_queue.cc:1048] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71aeaf669d64d85af17143e82ce987d" member_type: VOTER last_known_addr { host: "127.1.134.254" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:08:11.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:11.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.838798  1946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 943ab925f9514c34b43356d83a1698bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader a088535638cb44f7843b68a80142e4d6. Latest consensus state: current_term: 1 leader_uuid: "a088535638cb44f7843b68a80142e4d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e71aeaf669d64d85af17143e82ce987d" member_type: VOTER last_known_addr { host: "127.1.134.254" port: 38449 } } peers { permanent_uuid: "943ab925f9514c34b43356d83a1698bf" member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } } peers { permanent_uuid: "a088535638cb44f7843b68a80142e4d6" member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } } }
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.843096  1946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 943ab925f9514c34b43356d83a1698bf [sys.catalog]: This master's current role is: FOLLOWER
08:08:11.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.850771  1965 sys_catalog.cc:455] T 00000000000000000000000000000000 P e71aeaf669d64d85af17143e82ce987d [sys.catalog]: SysCatalogTable state changed. Reason: New leader a088535638cb44f7843b68a80142e4d6. Latest consensus state: current_term: 1 leader_uuid: "a088535638cb44f7843b68a80142e4d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e71aeaf669d64d85af17143e82ce987d" member_type: VOTER last_known_addr { host: "127.1.134.254" port: 38449 } } peers { permanent_uuid: "943ab925f9514c34b43356d83a1698bf" member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } } peers { permanent_uuid: "a088535638cb44f7843b68a80142e4d6" member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } } }
08:08:11.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.851756  1965 sys_catalog.cc:458] T 00000000000000000000000000000000 P e71aeaf669d64d85af17143e82ce987d [sys.catalog]: This master's current role is: FOLLOWER
08:08:11.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.858418  1964 mvcc.cc:204] Tried to move back new op lower bound from 7287159569338511360 to 7287159569006923776. Current Snapshot: MvccSnapshot[applied={T|T < 7287159569338511360}]
08:08:11.878 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:11.878 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:11.879 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:11.879 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:11.879 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:11.879 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:11.880 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:11.880 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:11.880 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:11.880 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:11.880 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:11.880 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:11.881 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:11.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.888531  1946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 943ab925f9514c34b43356d83a1698bf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a088535638cb44f7843b68a80142e4d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e71aeaf669d64d85af17143e82ce987d" member_type: VOTER last_known_addr { host: "127.1.134.254" port: 38449 } } peers { permanent_uuid: "943ab925f9514c34b43356d83a1698bf" member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } } peers { permanent_uuid: "a088535638cb44f7843b68a80142e4d6" member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } } }
08:08:11.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.889638  1946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 943ab925f9514c34b43356d83a1698bf [sys.catalog]: This master's current role is: FOLLOWER
08:08:11.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.894460  1959 sys_catalog.cc:455] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a088535638cb44f7843b68a80142e4d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e71aeaf669d64d85af17143e82ce987d" member_type: VOTER last_known_addr { host: "127.1.134.254" port: 38449 } } peers { permanent_uuid: "943ab925f9514c34b43356d83a1698bf" member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } } peers { permanent_uuid: "a088535638cb44f7843b68a80142e4d6" member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } } }
08:08:11.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.895292  1959 sys_catalog.cc:458] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [sys.catalog]: This master's current role is: LEADER
08:08:11.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:11.901594  1599 tablet.cc:2404] T 00000000000000000000000000000000 P e71aeaf669d64d85af17143e82ce987d: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:08:11.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:11.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.914754  1959 sys_catalog.cc:455] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a088535638cb44f7843b68a80142e4d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e71aeaf669d64d85af17143e82ce987d" member_type: VOTER last_known_addr { host: "127.1.134.254" port: 38449 } } peers { permanent_uuid: "943ab925f9514c34b43356d83a1698bf" member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } } peers { permanent_uuid: "a088535638cb44f7843b68a80142e4d6" member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } } }
08:08:11.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.915529  1959 sys_catalog.cc:458] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6 [sys.catalog]: This master's current role is: LEADER
08:08:11.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.921514  1965 sys_catalog.cc:455] T 00000000000000000000000000000000 P e71aeaf669d64d85af17143e82ce987d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a088535638cb44f7843b68a80142e4d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e71aeaf669d64d85af17143e82ce987d" member_type: VOTER last_known_addr { host: "127.1.134.254" port: 38449 } } peers { permanent_uuid: "943ab925f9514c34b43356d83a1698bf" member_type: VOTER last_known_addr { host: "127.1.134.253" port: 41425 } } peers { permanent_uuid: "a088535638cb44f7843b68a80142e4d6" member_type: VOTER last_known_addr { host: "127.1.134.252" port: 42093 } } }
08:08:11.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.922297  1965 sys_catalog.cc:458] T 00000000000000000000000000000000 P e71aeaf669d64d85af17143e82ce987d [sys.catalog]: This master's current role is: FOLLOWER
08:08:11.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.924490  1962 catalog_manager.cc:1382] Generated new cluster ID: 88e3ef67722147a6b885f36e08032007
08:08:11.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:11.924814  1962 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
08:08:11.989 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:11.989 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:11.989 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:11.990 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:11.990 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:11.990 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:11.991 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:11.991 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:11.991 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:11.991 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:11.991 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:11.991 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:11.991 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:12.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:12.000626  1962 catalog_manager.cc:1405] Generated new certificate authority record
08:08:12.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:12.003149  1962 catalog_manager.cc:1539] Loading token signing keys...
08:08:12.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:12.012252  1982 catalog_manager.cc:1294] Loaded cluster ID: 88e3ef67722147a6b885f36e08032007
08:08:12.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:12.013772  1982 catalog_manager.cc:1587] T 00000000000000000000000000000000 P e71aeaf669d64d85af17143e82ce987d: loading cluster ID for follower catalog manager: success
08:08:12.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:12.044054  1982 catalog_manager.cc:1609] T 00000000000000000000000000000000 P e71aeaf669d64d85af17143e82ce987d: acquiring CA information for follower catalog manager: success
08:08:12.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:12.044364  1962 catalog_manager.cc:6069] T 00000000000000000000000000000000 P a088535638cb44f7843b68a80142e4d6: Generated new TSK 0
08:08:12.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:12.045683  1962 catalog_manager.cc:1549] Initializing in-progress tserver states...
08:08:12.048 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:12.049 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:12.049 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:12.050 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:12.050 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:12.050 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:12.050 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:12.050 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:12.050 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:12.051 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:12.051 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:12.051 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:12.051 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:12.058 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:12.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:12.066659  1982 catalog_manager.cc:1637] T 00000000000000000000000000000000 P e71aeaf669d64d85af17143e82ce987d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:08:12.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:12.134161  1563 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-0/wal
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-0/data
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-0/logs
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-0/data/info.pb
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.134.193:0
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.134.193
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.134.193
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.134.212:46153
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:12.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:08:12.150 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091692149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:12.166 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
08:08:12.167 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
08:08:12.242 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:12.242 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:12.243 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:12.243 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:12.243 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:12.243 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:12.244 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:12.244 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:12.244 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:12.244 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:12.244 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:12.244 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:12.244 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:12.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:12.411 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:12.558 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:12.651 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091692649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:12.659 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
08:08:12.661 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
08:08:12.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:12.686663  1961 catalog_manager.cc:1294] Loaded cluster ID: 88e3ef67722147a6b885f36e08032007
08:08:12.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:12.687273  1961 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 943ab925f9514c34b43356d83a1698bf: loading cluster ID for follower catalog manager: success
08:08:12.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:12.695227  1961 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 943ab925f9514c34b43356d83a1698bf: acquiring CA information for follower catalog manager: success
08:08:12.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:12.701136  1987 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:08:12.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:12.702214  1987 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:08:12.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:12.703150  1987 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:08:12.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:12.707683  1961 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 943ab925f9514c34b43356d83a1698bf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:08:12.748 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:12.749 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:12.749 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:12.749 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:12.749 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:12.749 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:12.749 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:12.750 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:12.750 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:12.750 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:12.750 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:12.750 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:12.751 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:12.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:12.793614  1987 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:08:12.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:12.795424  1987 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.134.193
08:08:12.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:12.845 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:12.845 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:12.846 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:12.846 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:12.846 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:12.846 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:12.846 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:12.846 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:12.846 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:12.847 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:12.847 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:12.847 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:12.847 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:12.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:12.877146  1987 tablet_server_runner.cc:78] Tablet server non-default flags:
08:08:12.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:12.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.134.212:46153
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-0/data
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-0/wal
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.134.193:0
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-0/data/info.pb
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.134.193
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.134.193
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-0/logs
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:08:12.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:08:12.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:12.880895  1987 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:08:12.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:12.884212  1987 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:08:12.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:12.904495  1995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:12.911 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:13.058 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:13.124 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:13.125 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:13.125 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:13.125 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:13.125 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:13.125 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:13.125 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:13.125 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:13.125 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:13.126 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:13.126 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:13.126 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:13.126 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:13.150 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091693149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:13.158 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
08:08:13.162 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
08:08:13.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:13.389 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:13.389 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:13.390 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:13.390 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:13.391 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:13.391 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:13.391 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:13.391 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:13.391 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:13.392 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:13.392 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:13.392 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:13.392 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:13.411 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:13.558 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:13.578 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:13.579 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:13.579 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:13.580 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:13.580 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:13.580 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:13.580 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:13.580 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:13.580 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:13.581 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:13.581 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:13.581 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:13.581 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:13.623 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:13.623 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:13.623 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:13.624 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:13.624 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:13.624 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:13.625 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:13.625 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:13.625 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:13.625 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:13.626 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:13.626 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:13.626 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:13.640 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:13.640 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:13.640 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:13.640 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:13.640 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:13.640 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:13.640 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:13.640 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:13.641 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:13.641 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:13.641 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:13.641 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:13.641 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:13.649 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091693649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:13.658 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
08:08:13.659 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
08:08:13.704 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:13.704 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:13.704 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:13.705 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:13.705 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:13.705 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:13.705 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:13.705 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:13.705 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:13.705 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:13.706 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:13.705 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:13.706 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:13.831 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:13.862 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:13.863 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:13.863 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:13.864 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:13.864 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:13.864 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:13.864 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:13.864 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:13.864 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:13.865 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:13.865 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:13.865 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:13.865 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:13.911 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:14.058 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:14.150 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091694149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:14.162 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
08:08:14.163 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
08:08:14.183 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:14.183 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:14.183 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:14.184 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:14.184 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:14.184 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:14.185 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:14.185 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:14.185 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:14.184 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:14.186 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:14.186 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:14.186 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:14.331 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:14.383 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:14.383 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:14.384 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:14.385 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:14.385 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:14.385 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:14.385 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:14.385 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:14.385 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:14.386 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:14.386 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:14.386 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:14.386 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:14.410 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:14.528 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:14.528 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:14.529 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:14.530 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:14.530 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:14.530 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:14.530 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:14.530 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:14.530 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:14.530 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:14.530 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:14.530 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:14.530 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:14.557 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:14.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:14.306154  1994 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 1987
08:08:14.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:14.579404  1994 kernel_stack_watchdog.cc:198] Thread 1987 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 397ms:
08:08:14.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:08:14.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:08:14.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:08:14.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:08:14.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:12.908262  1996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:14.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:14.582135  1987 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.676s	user 0.575s	sys 0.913s
08:08:14.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:14.582614  1987 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.676s	user 0.575s	sys 0.913s
08:08:14.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:14.590143  1987 server_base.cc:1061] running on GCE node
08:08:14.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:14.591616  2000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:14.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:14.593333  1987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:08:14.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:14.596483  1987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:08:14.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:14.598074  1987 hybrid_clock.cc:648] HybridClock initialized: now 1779091694597981 us; error 87 us; skew 500 ppm
08:08:14.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:14.599472  1987 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:08:14.603 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:14.603 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:14.603 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:14.604 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:14.604 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:14.604 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:14.604 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:14.604 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:14.604 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:14.605 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:14.605 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:14.605 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:14.605 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:14.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:14.611634  1987 webserver.cc:533] Webserver started at http://127.1.134.193:41111/ using document root <none> and password file <none>
08:08:14.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:14.613046  1987 fs_manager.cc:362] Metadata directory not provided
08:08:14.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:14.613329  1987 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:08:14.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:14.614020  1987 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:08:14.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:14.621471  1987 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-0/data/instance:
08:08:14.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ad1db063d05747e7970018aed83fc0b5"
08:08:14.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:14 on dist-test-slave-1jss"
08:08:14.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:14.623241  1987 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-0/wal/instance:
08:08:14.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ad1db063d05747e7970018aed83fc0b5"
08:08:14.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:14 on dist-test-slave-1jss"
08:08:14.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:14.635109  1987 fs_manager.cc:696] Time spent creating directory manager: real 0.011s	user 0.009s	sys 0.000s
08:08:14.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:14.643959  2005 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:08:14.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:14.645926  1987 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.004s	sys 0.000s
08:08:14.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:14.646373  1987 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-0/wal
08:08:14.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ad1db063d05747e7970018aed83fc0b5"
08:08:14.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:14 on dist-test-slave-1jss"
08:08:14.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:14.646869  1987 fs_report.cc:389] FS layout report
08:08:14.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:08:14.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-0/wal
08:08:14.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-0/wal
08:08:14.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-0/data/data
08:08:14.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:08:14.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:08:14.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:08:14.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:08:14.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:08:14.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:08:14.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:08:14.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:08:14.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:08:14.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:08:14.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:08:14.650 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091694649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:14.660 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
08:08:14.661 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
08:08:14.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:14.718154  1987 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:08:14.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:14.720463  1987 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:08:14.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:14.721091  1987 kserver.cc:163] Server-wide thread pool size limit: 3276
08:08:14.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:14.725219  1987 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:08:14.736 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:14.736 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:14.736 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:14.737 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:14.737 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:14.737 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:14.737 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:14.737 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:14.738 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:14.738 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:14.738 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:14.738 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:14.738 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:14.739 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:14.739 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:14.739 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:14.740 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:14.740 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:14.740 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:14.740 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:14.740 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:14.740 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:14.740 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:14.740 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:14.740 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:14.741 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:14.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:14.755461  1987 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:08:14.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:14.755827  1987 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:08:14.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:14.756196  1987 ts_tablet_manager.cc:616] Registered 0 tablets
08:08:14.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:14.756429  1987 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:08:14.818 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:14.819 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:14.819 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:14.819 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:14.820 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:14.820 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:14.820 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:14.820 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:14.820 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:14.820 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:14.820 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:14.820 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:14.820 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:14.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:14.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:15.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:15.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:15.122190  2117 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.134.193:41847 every 8 connection(s)
08:08:15.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:15.122807  1987 rpc_server.cc:307] RPC server started. Bound to: 127.1.134.193:41847
08:08:15.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:15.126274  1987 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-0/data/info.pb
08:08:15.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:15.129520  1563 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 1987
08:08:15.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:15.130199  1563 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-0/wal/instance
08:08:15.138 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:15.139 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:15.139 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:15.140 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:15.140 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:15.140 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:15.140 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:15.140 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:15.140 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:15.141 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:15.141 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:15.141 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:15.141 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:15.150 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091695149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:15.159 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
08:08:15.161 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
08:08:15.169 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:15.169 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:15.170 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:15.170 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:15.170 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:15.171 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:15.171 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:15.171 [INFO - pool-326-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:15.172 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:15.172 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:15.172 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:15.172 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:15.172 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:15.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:15.185704  1563 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:08:15.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:08:15.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-1/wal
08:08:15.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-1/data
08:08:15.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:08:15.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:08:15.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:08:15.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:15.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:15.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:15.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-1/logs
08:08:15.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-1/data/info.pb
08:08:15.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:15.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:08:15.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:08:15.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:08:15.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:08:15.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:15.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:15.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:15.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:08:15.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:08:15.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.134.194:0
08:08:15.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.134.194
08:08:15.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.134.194
08:08:15.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:15.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093
08:08:15.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.134.212:46153
08:08:15.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:15.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:15.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:08:15.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:15.275007  2118 heartbeater.cc:344] Connected to a master server at 127.1.134.252:42093
08:08:15.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:15.275668  2118 heartbeater.cc:461] Registering TS with master...
08:08:15.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:15.277312  2118 heartbeater.cc:507] Master 127.1.134.252:42093 requested a full tablet report, sending...
08:08:15.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:15.280992  1885 ts_manager.cc:194] Registered new tserver with Master: ad1db063d05747e7970018aed83fc0b5 (127.1.134.193:41847)
08:08:15.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:15.284700  1885 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.134.193:49897
08:08:15.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:15.291584  2120 heartbeater.cc:344] Connected to a master server at 127.1.134.253:41425
08:08:15.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:15.292003  2120 heartbeater.cc:461] Registering TS with master...
08:08:15.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:15.292790  2120 heartbeater.cc:507] Master 127.1.134.253:41425 requested a full tablet report, sending...
08:08:15.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:15.297567  1694 ts_manager.cc:194] Registered new tserver with Master: ad1db063d05747e7970018aed83fc0b5 (127.1.134.193:41847)
08:08:15.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:15.302229  2121 heartbeater.cc:344] Connected to a master server at 127.1.134.254:38449
08:08:15.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:15.302673  2121 heartbeater.cc:461] Registering TS with master...
08:08:15.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:15.303510  2121 heartbeater.cc:507] Master 127.1.134.254:38449 requested a full tablet report, sending...
08:08:15.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:15.307387  1609 ts_manager.cc:194] Registered new tserver with Master: ad1db063d05747e7970018aed83fc0b5 (127.1.134.193:41847)
08:08:15.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:15.384 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:15.384 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:15.384 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:15.385 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:15.385 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:15.385 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:15.386 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:15.386 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:15.386 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:15.386 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:15.386 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:15.386 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:15.387 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:15.411 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:15.468 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:15.468 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:15.469 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:15.469 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:15.469 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:15.470 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:15.470 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:15.470 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:15.470 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:15.470 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:15.470 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:15.471 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:15.471 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:15.498 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:15.499 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:15.499 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:15.499 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:15.499 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:15.499 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:15.499 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:15.500 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:15.500 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:15.500 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:15.500 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:15.500 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:15.501 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:15.523 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:15.523 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:15.523 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:15.524 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:15.524 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:15.524 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:15.525 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:15.525 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:15.525 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:15.525 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:15.525 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:15.525 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:15.525 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:15.558 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:15.650 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091695649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:15.664 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
08:08:15.666 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
08:08:15.789 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:15.789 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:15.789 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:15.790 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:15.790 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:15.790 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:15.791 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:15.791 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:15.791 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:15.794 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:15.794 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:15.794 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:15.794 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:15.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:15.797693  2129 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:08:15.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:15.799152  2129 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:08:15.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:15.800082  2129 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:08:15.808 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:15.809 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:15.809 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:15.809 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:15.809 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:15.809 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:15.810 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:15.810 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:15.810 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:15.810 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:15.810 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:15.810 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:15.810 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:15.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:15.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:15.855288  2129 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:08:15.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:15.856422  2129 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.134.194
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:15.903494  2129 tablet_server_runner.cc:78] Tablet server non-default flags:
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.134.212:46153
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-1/data
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-1/wal
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.134.194:0
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-1/data/info.pb
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.134.194
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.134.194
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-1/logs
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:08:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:08:15.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:15.905397  2129 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:08:15.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:15.907766  2129 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:08:15.911 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:15.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:15.925565  2135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:16.058 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:16.122 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:16.123 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:16.123 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:16.124 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:16.124 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:16.124 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:16.125 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:16.125 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:16.125 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:16.126 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:16.126 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:16.126 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:16.126 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:16.150 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091696149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:16.161 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
08:08:16.162 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
08:08:16.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:16.290248  2118 heartbeater.cc:499] Master 127.1.134.252:42093 was elected leader, sending a full tablet report...
08:08:16.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:16.359 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:16.359 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:16.359 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:16.360 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:16.360 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:16.360 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:16.361 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:16.361 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:16.361 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:16.362 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:16.362 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:16.362 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:16.362 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:16.412 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:16.558 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:16.650 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091696649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:16.661 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:08:16.662 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
08:08:16.684 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:16.684 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:16.685 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:16.685 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:16.686 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:16.686 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:16.686 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:16.686 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:16.686 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:16.687 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:16.687 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:16.687 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:16.687 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:16.688 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:16.688 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:16.688 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:16.688 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:16.688 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:16.688 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:16.689 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:16.689 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:16.689 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:16.689 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:16.689 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:16.689 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:16.689 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:16.831 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:16.911 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:16.988 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:16.989 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:16.989 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:16.990 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:16.990 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:16.990 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:16.991 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:16.991 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:16.991 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:16.992 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:16.992 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:16.992 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:16.992 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:17.059 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:17.064 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:17.064 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:17.065 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:17.065 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:17.065 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:17.065 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:17.065 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:17.065 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:17.066 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:17.066 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:17.066 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:17.065 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:17.066 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:17.151 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091697149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:17.196 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=46 ms, finalizationTime=1 ms).
08:08:17.198 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
08:08:17.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:17.411 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:17.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:17.327126  2134 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 2129
08:08:17.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:15.930339  2136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:17.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:17.457365  2134 kernel_stack_watchdog.cc:198] Thread 2129 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 399ms:
08:08:17.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:08:17.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:08:17.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:08:17.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:08:17.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:17.463014  2129 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.537s	user 0.550s	sys 0.972s
08:08:17.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:17.463449  2129 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.538s	user 0.550s	sys 0.972s
08:08:17.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.463779  2129 server_base.cc:1061] running on GCE node
08:08:17.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:17.465535  2138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:17.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.467130  2129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:08:17.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.469692  2129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:08:17.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.471123  2129 hybrid_clock.cc:648] HybridClock initialized: now 1779091697471092 us; error 38 us; skew 500 ppm
08:08:17.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.472128  2129 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:08:17.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.479704  2129 webserver.cc:533] Webserver started at http://127.1.134.194:36975/ using document root <none> and password file <none>
08:08:17.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.480903  2129 fs_manager.cc:362] Metadata directory not provided
08:08:17.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.481194  2129 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:08:17.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.481748  2129 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:08:17.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.487147  2129 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-1/data/instance:
08:08:17.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1c9c5ea12af94143abc1d9b757f8a3c2"
08:08:17.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:17 on dist-test-slave-1jss"
08:08:17.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.488443  2129 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-1/wal/instance:
08:08:17.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1c9c5ea12af94143abc1d9b757f8a3c2"
08:08:17.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:17 on dist-test-slave-1jss"
08:08:17.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.497371  2129 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.009s	sys 0.001s
08:08:17.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.503998  2147 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:08:17.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.505209  2129 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.006s	sys 0.000s
08:08:17.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.505589  2129 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-1/wal
08:08:17.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1c9c5ea12af94143abc1d9b757f8a3c2"
08:08:17.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:17 on dist-test-slave-1jss"
08:08:17.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.506003  2129 fs_report.cc:389] FS layout report
08:08:17.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:08:17.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-1/wal
08:08:17.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-1/wal
08:08:17.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-1/data/data
08:08:17.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:08:17.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:08:17.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:08:17.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:08:17.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:08:17.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:08:17.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:08:17.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:08:17.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:08:17.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:08:17.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:08:17.558 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:17.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.564042  2129 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:08:17.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.566057  2129 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:08:17.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.566604  2129 kserver.cc:163] Server-wide thread pool size limit: 3276
08:08:17.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.570367  2129 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:08:17.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.575603  2129 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:08:17.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.575876  2129 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:08:17.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.576104  2129 ts_tablet_manager.cc:616] Registered 0 tablets
08:08:17.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.576246  2129 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:08:17.639 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:17.639 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:17.639 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:17.640 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:17.640 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:17.640 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:17.640 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:17.640 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:17.640 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:17.641 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:17.640 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:17.641 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:17.641 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:17.650 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091697650 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:17.660 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
08:08:17.660 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
08:08:17.676 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:17.677 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:17.677 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:17.677 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:17.677 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:17.677 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:17.678 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:17.678 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:17.678 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:17.678 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:17.678 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:17.678 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:17.678 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:17.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.770910  2129 rpc_server.cc:307] RPC server started. Bound to: 127.1.134.194:43489
08:08:17.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.771020  2259 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.134.194:43489 every 8 connection(s)
08:08:17.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.774886  2129 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-1/data/info.pb
08:08:17.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.777652  1563 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 2129
08:08:17.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.778225  1563 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-1/wal/instance
08:08:17.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.800941  1563 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:08:17.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:08:17.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-2/wal
08:08:17.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-2/data
08:08:17.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:08:17.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:08:17.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:08:17.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:17.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:17.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:17.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-2/logs
08:08:17.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-2/data/info.pb
08:08:17.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:17.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:08:17.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:08:17.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:08:17.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:08:17.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:17.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:17.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:17.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:08:17.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:08:17.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.134.195:0
08:08:17.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.134.195
08:08:17.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.134.195
08:08:17.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:17.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093
08:08:17.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.134.212:46153
08:08:17.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:17.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:17.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:08:17.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:17.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.856405  2261 heartbeater.cc:344] Connected to a master server at 127.1.134.253:41425
08:08:17.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.857090  2261 heartbeater.cc:461] Registering TS with master...
08:08:17.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.861720  2261 heartbeater.cc:507] Master 127.1.134.253:41425 requested a full tablet report, sending...
08:08:17.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.865523  1694 ts_manager.cc:194] Registered new tserver with Master: 1c9c5ea12af94143abc1d9b757f8a3c2 (127.1.134.194:43489)
08:08:17.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.868227  2260 heartbeater.cc:344] Connected to a master server at 127.1.134.252:42093
08:08:17.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.868630  2260 heartbeater.cc:461] Registering TS with master...
08:08:17.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.869701  2260 heartbeater.cc:507] Master 127.1.134.252:42093 requested a full tablet report, sending...
08:08:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.873092  1885 ts_manager.cc:194] Registered new tserver with Master: 1c9c5ea12af94143abc1d9b757f8a3c2 (127.1.134.194:43489)
08:08:17.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.875597  1885 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.134.194:38353
08:08:17.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.878530  2266 heartbeater.cc:344] Connected to a master server at 127.1.134.254:38449
08:08:17.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.878875  2266 heartbeater.cc:461] Registering TS with master...
08:08:17.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.879880  2266 heartbeater.cc:507] Master 127.1.134.254:38449 requested a full tablet report, sending...
08:08:17.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:17.882491  1609 ts_manager.cc:194] Registered new tserver with Master: 1c9c5ea12af94143abc1d9b757f8a3c2 (127.1.134.194:43489)
08:08:17.898 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:17.899 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:17.899 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:17.899 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:17.899 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:17.899 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:17.899 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:17.899 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:17.899 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:17.899 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:17.899 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:17.899 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:17.899 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:17.911 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:18.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:18.149 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091698149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:18.159 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
08:08:18.160 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
08:08:18.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:18.268146  2268 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:08:18.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:18.268814  2268 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:08:18.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:18.269343  2268 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:08:18.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:18.310701  2268 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:08:18.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:18.311872  2268 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.134.195
08:08:18.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:18.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:18.361461  2268 tablet_server_runner.cc:78] Tablet server non-default flags:
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.134.212:46153
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-2/data
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-2/wal
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.134.195:0
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-2/data/info.pb
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.134.195
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.134.195
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-2/logs
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:08:18.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:08:18.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:18.363360  2268 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:08:18.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:18.365371  2268 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:08:18.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:18.382009  2276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:18.411 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:18.558 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:18.625 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:18.625 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:18.626 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:18.626 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:18.626 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:18.626 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:18.626 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:18.626 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:18.627 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:18.626 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:18.627 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:18.627 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:18.628 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:18.650 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091698649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:18.660 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:18.660 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:18.661 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:18.661 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:18.661 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:18.661 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:18.661 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:18.662 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:18.662 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:18.662 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:18.662 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:18.663 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:18.663 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:18.665 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=12 ms, finalizationTime=4 ms).
08:08:18.668 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
08:08:18.770 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:18.771 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:18.771 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:18.772 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:18.772 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:18.772 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:18.772 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:18.773 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:18.772 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:18.773 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:18.773 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:18.773 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:18.773 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:18.824 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:18.824 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:18.825 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:18.825 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:18.825 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:18.825 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:18.825 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:18.826 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:18.826 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:18.826 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:18.826 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:18.827 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:18.827 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:18.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:18.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:18.881220  2260 heartbeater.cc:499] Master 127.1.134.252:42093 was elected leader, sending a full tablet report...
08:08:18.912 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:19.058 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:19.150 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091699149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:19.206 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=56 ms, finalizationTime=1 ms).
08:08:19.208 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
08:08:19.216 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:19.217 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:19.217 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:19.218 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:19.218 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:19.218 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:19.218 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:19.218 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:19.218 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:19.218 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:19.218 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:19.219 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:19.219 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:19.222 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:19.223 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:19.223 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:19.223 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:19.223 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:19.224 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:19.224 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:19.223 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:19.224 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:19.224 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:19.224 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:19.224 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:19.224 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:19.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:19.362 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:19.363 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:19.363 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:19.364 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:19.365 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:19.365 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:19.365 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:19.365 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:19.364 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:19.365 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:19.365 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:19.365 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:19.365 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:19.383 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:19.383 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:19.383 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:19.384 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:19.384 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:19.384 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:19.384 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:19.384 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:19.384 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:19.385 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:19.385 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:19.385 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:19.385 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:19.410 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:19.528 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:19.529 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:19.529 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:19.530 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:19.530 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:19.530 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:19.530 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:19.530 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:19.530 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:19.530 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:19.531 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:19.530 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:19.531 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:19.558 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:19.650 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091699649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:19.658 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:19.658 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:19.658 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:19.659 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:19.659 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:19.659 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:19.659 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:19.659 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:19.659 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:19.659 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:19.659 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:19.659 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:19.659 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:19.662 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
08:08:19.663 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
08:08:19.689 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:19.689 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:19.690 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:19.690 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:19.690 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:19.690 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:19.690 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:19.690 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:19.690 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:19.691 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:19.691 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:19.691 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:19.691 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:19.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:18.383818  2277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:19.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:19.822831  2278 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1438 milliseconds
08:08:19.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:19.823467  2279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:19.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:19.823974  2268 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:08:19.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:19.828125  2268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:08:19.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:19.830951  2268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:08:19.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:19.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:19.832533  2268 hybrid_clock.cc:648] HybridClock initialized: now 1779091699832465 us; error 51 us; skew 500 ppm
08:08:19.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:19.833473  2268 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:08:19.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:19.841636  2268 webserver.cc:533] Webserver started at http://127.1.134.195:38511/ using document root <none> and password file <none>
08:08:19.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:19.842777  2268 fs_manager.cc:362] Metadata directory not provided
08:08:19.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:19.842978  2268 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:08:19.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:19.843448  2268 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:08:19.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:19.849018  2268 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-2/data/instance:
08:08:19.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a8c1971e3b584658ab4174f8d0ac12de"
08:08:19.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:19 on dist-test-slave-1jss"
08:08:19.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:19.850512  2268 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-2/wal/instance:
08:08:19.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a8c1971e3b584658ab4174f8d0ac12de"
08:08:19.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:19 on dist-test-slave-1jss"
08:08:19.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:19.859382  2268 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.003s	sys 0.005s
08:08:19.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:19.866242  2287 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:08:19.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:19.867627  2268 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.001s
08:08:19.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:19.868108  2268 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-2/wal
08:08:19.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a8c1971e3b584658ab4174f8d0ac12de"
08:08:19.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:19 on dist-test-slave-1jss"
08:08:19.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:19.868455  2268 fs_report.cc:389] FS layout report
08:08:19.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:08:19.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-2/wal
08:08:19.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-2/wal
08:08:19.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-2/data/data
08:08:19.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:08:19.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:08:19.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:08:19.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:08:19.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:08:19.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:08:19.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:08:19.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:08:19.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:08:19.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:08:19.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:08:19.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:19.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:19.959376  2268 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:08:19.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:19.961308  2268 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:08:19.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:19.961863  2268 kserver.cc:163] Server-wide thread pool size limit: 3276
08:08:19.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:19.965242  2268 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:08:19.968 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:19.969 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:19.969 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:19.969 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:19.969 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:19.969 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:19.969 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:19.969 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:19.969 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:19.970 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:19.970 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:19.970 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:19.970 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:19.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:19.971174  2268 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:08:19.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:19.971508  2268 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:08:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:19.971828  2268 ts_tablet_manager.cc:616] Registered 0 tablets
08:08:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:19.972023  2268 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:08:20.058 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:20.062 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:20.063 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:20.063 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:20.063 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:20.064 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:20.064 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:20.064 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:20.064 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:20.064 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:20.063 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:20.064 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:20.064 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:20.064 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:20.150 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091700149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:20.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:20.153923  2268 rpc_server.cc:307] RPC server started. Bound to: 127.1.134.195:39383
08:08:20.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:20.154073  2399 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.134.195:39383 every 8 connection(s)
08:08:20.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:20.158008  2268 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-2/data/info.pb
08:08:20.158 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
08:08:20.159 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
08:08:20.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:20.162487  1563 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 2268
08:08:20.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:20.163029  1563 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5919260270421564996/ts-2/wal/instance
08:08:20.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:20.208479  2402 heartbeater.cc:344] Connected to a master server at 127.1.134.254:38449
08:08:20.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:20.208408  2400 heartbeater.cc:344] Connected to a master server at 127.1.134.252:42093
08:08:20.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:20.209218  2400 heartbeater.cc:461] Registering TS with master...
08:08:20.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:20.209216  2402 heartbeater.cc:461] Registering TS with master...
08:08:20.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:20.210974  2402 heartbeater.cc:507] Master 127.1.134.254:38449 requested a full tablet report, sending...
08:08:20.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:20.211880  2401 heartbeater.cc:344] Connected to a master server at 127.1.134.253:41425
08:08:20.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:20.212319  2401 heartbeater.cc:461] Registering TS with master...
08:08:20.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:20.213176  2401 heartbeater.cc:507] Master 127.1.134.253:41425 requested a full tablet report, sending...
08:08:20.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:20.214229  2400 heartbeater.cc:507] Master 127.1.134.252:42093 requested a full tablet report, sending...
08:08:20.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:20.216516  1694 ts_manager.cc:194] Registered new tserver with Master: a8c1971e3b584658ab4174f8d0ac12de (127.1.134.195:39383)
08:08:20.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:20.216825  1885 ts_manager.cc:194] Registered new tserver with Master: a8c1971e3b584658ab4174f8d0ac12de (127.1.134.195:39383)
08:08:20.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:20.217470  1609 ts_manager.cc:194] Registered new tserver with Master: a8c1971e3b584658ab4174f8d0ac12de (127.1.134.195:39383)
08:08:20.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:20.218691  1885 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.134.195:56071
08:08:20.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:20.240572  1563 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
08:08:20.254 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:08:20.255 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

08:08:20.256 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.1.134.254"
      port: 38449
    }
    bound_http_address {
      host: "127.1.134.254"
      port: 44049
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.1.134.253"
      port: 41425
    }
    bound_http_address {
      host: "127.1.134.253"
      port: 42073
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.1.134.252"
      port: 42093
    }
    bound_http_address {
      host: "127.1.134.252"
      port: 33645
    }
  }
}

08:08:20.256 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

08:08:20.257 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.1.134.193"
      port: 41847
    }
    bound_http_address {
      host: "127.1.134.193"
      port: 41111
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.1.134.194"
      port: 43489
    }
    bound_http_address {
      host: "127.1.134.194"
      port: 36975
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.1.134.195"
      port: 39383
    }
    bound_http_address {
      host: "127.1.134.195"
      port: 38511
    }
  }
}

08:08:20.257 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
08:08:20.259 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:20.260 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
08:08:20.260 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskk4_r_T/test-tmp
08:08:20.260 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
08:08:20.260 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskk4_r_T/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
08:08:20.263 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:20.263 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:20.263 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:20.264 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:20.264 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:20.264 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:20.264 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:20.264 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:20.264 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:20.264 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:20.264 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:20.264 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:20.264 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:20.265 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

08:08:20.331 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:20.344 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:20.344 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:20.345 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:20.345 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:20.345 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:20.345 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:20.345 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:20.345 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:20.345 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:20.345 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:20.345 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:20.345 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:20.346 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:20.358 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:20.358 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:20.358 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:20.359 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:20.359 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:20.359 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:20.359 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:20.359 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:20.359 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:20.359 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:20.359 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:20.359 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:20.359 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:20.411 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:20.558 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:20.650 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091700649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:20.659 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
08:08:20.659 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
08:08:20.680 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:08:20.681 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

08:08:20.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:20.685583  2410 mini_oidc.cc:150] Starting JWKS server
08:08:20.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:20.689932  2410 webserver.cc:533] Webserver started at http://127.0.0.1:35589/ using document root <none> and password file <none>
08:08:20.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:20.690408  2410 mini_oidc.cc:186] Starting OIDC Discovery server
08:08:20.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:20.692454  2410 webserver.cc:533] Webserver started at http://127.0.0.1:37933/ using document root <none> and password file <none>
08:08:20.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:08:20Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
08:08:20.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:08:20Z Disabled control of system clock
08:08:20.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:20.773133  2410 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:08:20.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-0/wal
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-0/data
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-0/logs
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-0/data/info.pb
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.90.190:42265
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.90.190
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.90.148:36029
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.90.190:42265,127.2.90.189:41065,127.2.90.188:42457
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:08:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35589/jwks.json with env {}
08:08:20.818 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:20.818 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:20.818 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:20.819 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:20.819 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:20.819 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:20.819 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:20.819 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:20.819 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:20.819 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:20.819 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:20.819 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:20.820 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:20.831 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:20.911 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:21.058 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:21.063 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:21.064 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:21.064 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:21.064 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:21.064 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:21.064 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:21.064 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:21.064 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:21.064 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:21.064 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:21.065 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:21.065 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:21.065 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:21.150 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091701149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:21.161 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:08:21.162 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
08:08:21.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:21.163820  2422 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:08:21.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:21.164803  2422 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:08:21.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:21.165427  2422 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:08:21.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:21.206741  2422 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:08:21.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:21.207526  2422 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:08:21.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:21.208176  2422 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:08:21.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:21.208585  2422 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:08:21.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:21.209074  2422 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:08:21.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:21.209335  2422 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:35589/jwks.json
08:08:21.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:21.221999  2400 heartbeater.cc:499] Master 127.1.134.252:42093 was elected leader, sending a full tablet report...
08:08:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:21.261749  2422 master_runner.cc:387] Master server non-default flags:
08:08:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.90.148:36029
08:08:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-0/data
08:08:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-0/wal
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.90.190:42265,127.2.90.189:41065,127.2.90.188:42457
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.90.190:42265
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35589/jwks.json
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-0/data/info.pb
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.90.190
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-0/logs
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:08:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:08:21.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:21.263974  2422 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:08:21.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:21.266273  2422 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:08:21.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:21.280484  2428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:21.325 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:21.325 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:21.325 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:21.326 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:21.326 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:21.326 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:21.326 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:21.326 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:21.326 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:21.326 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:21.327 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:21.327 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:21.327 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:21.331 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:21.348 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:21.349 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:21.349 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:21.350 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:21.350 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:21.350 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:21.351 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:21.351 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:21.351 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:21.352 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:21.352 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:21.352 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:21.352 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:21.365 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:21.366 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:21.366 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:21.366 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:21.367 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:21.367 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:21.366 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:21.367 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:21.367 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:21.367 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:21.367 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:21.367 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:21.367 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:21.412 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:21.459 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:21.460 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:21.460 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:21.460 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:21.460 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:21.461 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:21.461 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:21.461 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:21.461 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:21.462 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:21.462 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:21.462 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:21.462 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:21.503 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:21.503 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:21.503 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:21.504 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:21.505 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:21.505 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:21.506 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:21.506 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:21.506 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:21.507 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:21.507 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:21.507 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:21.507 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:21.557 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:21.649 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091701649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:21.659 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
08:08:21.660 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
08:08:21.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:21.889 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:21.889 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:21.890 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:21.890 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:21.890 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:21.890 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:21.890 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:21.890 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:21.890 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:21.890 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:21.890 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:21.891 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:21.891 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:21.902 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:21.903 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:21.903 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:21.904 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:21.904 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:21.904 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:21.904 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:21.904 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:21.904 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:21.904 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:21.904 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:21.904 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:21.904 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:21.905 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:21.905 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:21.905 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:21.905 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:21.905 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:21.905 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:21.905 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:21.905 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:21.906 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:21.906 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:21.906 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27082), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [9ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [29ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [33ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [34ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [54ms] refreshing cache from master, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [96ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [97ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [130ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [136ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [154ms] refreshing cache from master, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [170ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [212ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [213ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [218ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [220ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [234ms] refreshing cache from master, [234ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [234ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [234ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [235ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [236ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [236ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [236ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [253ms] refreshing cache from master, [253ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [253ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [254ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [254ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [254ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [255ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [255ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [293ms] refreshing cache from master, [293ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [293ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [294ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [294ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [296ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [296ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [296ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [313ms] refreshing cache from master, [313ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [314ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [314ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [314ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [315ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [315ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [315ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [394ms] refreshing cache from master, [394ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [394ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [394ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [395ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [396ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [396ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [397ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [635ms] refreshing cache from master, [635ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [636ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [636ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [637ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [637ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [638ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [638ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [694ms] refreshing cache from master, [694ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [694ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [695ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [696ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [696ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [697ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [697ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1513ms] refreshing cache from master, [1514ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1514ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1515ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1515ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1516ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1516ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1516ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [3453ms] refreshing cache from master, [3453ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [3455ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [3456ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [3457ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [3457ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [3462ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [3463ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [7454ms] refreshing cache from master, [7454ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [7454ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [7455ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [7455ms] too many traces: truncated at 100 traces, deferred=Deferred@997767686(state=PENDING, result=null, callback=(continuation of Deferred@6321827 after retry RPC after error@1800290595) -> (continuation of Deferred@610125843 after retry RPC after error@1519123988) -> (continuation of Deferred@1499291272 after retry RPC after error@1082350553) -> (continuation of Deferred@181673610 after retry RPC after error@254425754) -> (continuation of Deferred@1018207465 after retry RPC after error@1723286837) -> (continuation of Deferred@1279080231 after retry RPC after error@303901392) -> (continuation of Deferred@712162222 after retry RPC after error@1991302456) -> (continuation of Deferred@1402030278 after retry RPC after error@681681870) -> (continuation of Deferred@389137087 after retry RPC after error@1729660028) -> (continuation of Deferred@1041639201 after retry RPC after error@462183678) -> (continuation of Deferred@36786442 after retry RPC after error@564727380) -> (continuation of Deferred@780737135 after retry RPC after error@1461438700) -> (continuation of Deferred@1596619268 after retry RPC after error@907547675) -> (continuation of Deferred@1352936149 after retry RPC after error@1500628101) -> (continuation of Deferred@1426550773 after retry RPC after error@591987074) -> (continuation of Deferred@1380611516 after retry RPC after error@97048220) -> (continuation of Deferred@1801349399 after retry RPC after error@7348463) -> (continuation of Deferred@18236104 after retry RPC after error@1109985344) -> (continuation of Deferred@1512556483 after retry RPC after error@1532093232) -> (continuation of Deferred@1759701648 after retry RPC after error@1652790468) -> (continuation of Deferred@117329544 after retry RPC after error@1382184196) -> (continuation of Deferred@757834674 after retry RPC after error@1408247655), errback=(continuation of Deferred@6321827 after retry RPC after error@1800290595) -> (continuation of Deferred@610125843 after retry RPC after error@1519123988) -> (continuation of Deferred@1499291272 after retry RPC after error@1082350553) -> (continuation of Deferred@181673610 after retry RPC after error@254425754) -> (continuation of Deferred@1018207465 after retry RPC after error@1723286837) -> (continuation of Deferred@1279080231 after retry RPC after error@303901392) -> (continuation of Deferred@712162222 after retry RPC after error@1991302456) -> (continuation of Deferred@1402030278 after retry RPC after error@681681870) -> (continuation of Deferred@389137087 after retry RPC after error@1729660028) -> (continuation of Deferred@1041639201 after retry RPC after error@462183678) -> (continuation of Deferred@36786442 after retry RPC after error@564727380) -> (continuation of Deferred@780737135 after retry RPC after error@1461438700) -> (continuation of Deferred@1596619268 after retry RPC after error@907547675) -> (continuation of Deferred@1352936149 after retry RPC after error@1500628101) -> (continuation of Deferred@1426550773 after retry RPC after error@591987074) -> (continuation of Deferred@1380611516 after retry RPC after error@97048220) -> (continuation of Deferred@1801349399 after retry RPC after error@7348463) -> (continuation of Deferred@18236104 after retry RPC after error@1109985344) -> (continuation of Deferred@1512556483 after retry RPC after error@1532093232) -> (continuation of Deferred@1759701648 after retry RPC after error@1652790468) -> (continuation of Deferred@117329544 after retry RPC after error@1382184196) -> (continuation of Deferred@757834674 after retry RPC after error@1408247655)))
08:08:21.909 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:21.909 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:21.909 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:21.911 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
08:08:21.911 [WARN - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#5 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27082), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [9ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [29ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [33ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [34ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [54ms] refreshing cache from master, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [96ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [97ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [130ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [136ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [154ms] refreshing cache from master, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [170ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [212ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [213ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [218ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [220ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [234ms] refreshing cache from master, [234ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [234ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [234ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [235ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [236ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [236ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [236ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [253ms] refreshing cache from master, [253ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [253ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [254ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [254ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [254ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [255ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [255ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [293ms] refreshing cache from master, [293ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [293ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [294ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [294ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [296ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [296ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [296ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [313ms] refreshing cache from master, [313ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [314ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [314ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [314ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [315ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [315ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [315ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [394ms] refreshing cache from master, [394ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [394ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [394ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [395ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [396ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [396ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [397ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [635ms] refreshing cache from master, [635ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [636ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [636ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [637ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [637ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [638ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [638ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [694ms] refreshing cache from master, [694ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [694ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [695ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [696ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [696ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [697ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [697ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1513ms] refreshing cache from master, [1514ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1514ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1515ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1515ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1516ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1516ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1516ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [3453ms] refreshing cache from master, [3453ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [3455ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [3456ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [3457ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [3457ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [3462ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [3463ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [7454ms] refreshing cache from master, [7454ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [7454ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [7455ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [7455ms] too many traces: truncated at 100 traces, deferred=Deferred@997767686(state=PENDING, result=null, callback=(continuation of Deferred@6321827 after retry RPC after error@1800290595) -> (continuation of Deferred@610125843 after retry RPC after error@1519123988) -> (continuation of Deferred@1499291272 after retry RPC after error@1082350553) -> (continuation of Deferred@181673610 after retry RPC after error@254425754) -> (continuation of Deferred@1018207465 after retry RPC after error@1723286837) -> (continuation of Deferred@1279080231 after retry RPC after error@303901392) -> (continuation of Deferred@712162222 after retry RPC after error@1991302456) -> (continuation of Deferred@1402030278 after retry RPC after error@681681870) -> (continuation of Deferred@389137087 after retry RPC after error@1729660028) -> (continuation of Deferred@1041639201 after retry RPC after error@462183678) -> (continuation of Deferred@36786442 after retry RPC after error@564727380) -> (continuation of Deferred@780737135 after retry RPC after error@1461438700) -> (continuation of Deferred@1596619268 after retry RPC after error@907547675) -> (continuation of Deferred@1352936149 after retry RPC after error@1500628101) -> (continuation of Deferred@1426550773 after retry RPC after error@591987074) -> (continuation of Deferred@1380611516 after retry RPC after error@97048220) -> (continuation of Deferred@1801349399 after retry RPC after error@7348463) -> (continuation of Deferred@18236104 after retry RPC after error@1109985344) -> (continuation of Deferred@1512556483 after retry RPC after error@1532093232) -> (continuation of Deferred@1759701648 after retry RPC after error@1652790468) -> (continuation of Deferred@117329544 after retry RPC after error@1382184196) -> (continuation of Deferred@757834674 after retry RPC after error@1408247655), errback=(continuation of Deferred@6321827 after retry RPC after error@1800290595) -> (continuation of Deferred@610125843 after retry RPC after error@1519123988) -> (continuation of Deferred@1499291272 after retry RPC after error@1082350553) -> (continuation of Deferred@181673610 after retry RPC after error@254425754) -> (continuation of Deferred@1018207465 after retry RPC after error@1723286837) -> (continuation of Deferred@1279080231 after retry RPC after error@303901392) -> (continuation of Deferred@712162222 after retry RPC after error@1991302456) -> (continuation of Deferred@1402030278 after retry RPC after error@681681870) -> (continuation of Deferred@389137087 after retry RPC after error@1729660028) -> (continuation of Deferred@1041639201 after retry RPC after error@462183678) -> (continuation of Deferred@36786442 after retry RPC after error@564727380) -> (continuation of Deferred@780737135 after retry RPC after error@1461438700) -> (continuation of Deferred@1596619268 after retry RPC after error@907547675) -> (continuation of Deferred@1352936149 after retry RPC after error@1500628101) -> (continuation of Deferred@1426550773 after retry RPC after error@591987074) -> (continuation of Deferred@1380611516 after retry RPC after error@97048220) -> (continuation of Deferred@1801349399 after retry RPC after error@7348463) -> (continuation of Deferred@18236104 after retry RPC after error@1109985344) -> (continuation of Deferred@1512556483 after retry RPC after error@1532093232) -> (continuation of Deferred@1759701648 after retry RPC after error@1652790468) -> (continuation of Deferred@117329544 after retry RPC after error@1382184196) -> (continuation of Deferred@757834674 after retry RPC after error@1408247655)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.189:46677
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:21.915 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:21.919 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#5 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_5).
08:08:21.922 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#5 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_5.
08:08:21.926 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from INITIALIZING to FAILED on 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27082), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [9ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [29ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [33ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [34ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [54ms] refreshing cache from master, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [96ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [97ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [130ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [136ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [154ms] refreshing cache from master, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [170ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [212ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [213ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [218ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [220ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [234ms] refreshing cache from master, [234ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [234ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [234ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [235ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [236ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [236ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [236ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [253ms] refreshing cache from master, [253ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [253ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [254ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [254ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [254ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [255ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [255ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [293ms] refreshing cache from master, [293ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [293ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [294ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [294ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [296ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [296ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [296ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [313ms] refreshing cache from master, [313ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [314ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [314ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [314ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [315ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [315ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [315ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [394ms] refreshing cache from master, [394ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [394ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [394ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [395ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [396ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [396ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [397ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [635ms] refreshing cache from master, [635ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [636ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [636ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [637ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [637ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [638ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [638ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [694ms] refreshing cache from master, [694ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [694ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [695ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [696ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [696ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [697ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [697ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1513ms] refreshing cache from master, [1514ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1514ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1515ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1515ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1516ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1516ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1516ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [3453ms] refreshing cache from master, [3453ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [3455ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [3456ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [3457ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [3457ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [3462ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [3463ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [7454ms] refreshing cache from master, [7454ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [7454ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [7455ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [7455ms] too many traces: truncated at 100 traces, deferred=Deferred@997767686(state=PENDING, result=null, callback=(continuation of Deferred@6321827 after retry RPC after error@1800290595) -> (continuation of Deferred@610125843 after retry RPC after error@1519123988) -> (continuation of Deferred@1499291272 after retry RPC after error@1082350553) -> (continuation of Deferred@181673610 after retry RPC after error@254425754) -> (continuation of Deferred@1018207465 after retry RPC after error@1723286837) -> (continuation of Deferred@1279080231 after retry RPC after error@303901392) -> (continuation of Deferred@712162222 after retry RPC after error@1991302456) -> (continuation of Deferred@1402030278 after retry RPC after error@681681870) -> (continuation of Deferred@389137087 after retry RPC after error@1729660028) -> (continuation of Deferred@1041639201 after retry RPC after error@462183678) -> (continuation of Deferred@36786442 after retry RPC after error@564727380) -> (continuation of Deferred@780737135 after retry RPC after error@1461438700) -> (continuation of Deferred@1596619268 after retry RPC after error@907547675) -> (continuation of Deferred@1352936149 after retry RPC after error@1500628101) -> (continuation of Deferred@1426550773 after retry RPC after error@591987074) -> (continuation of Deferred@1380611516 after retry RPC after error@97048220) -> (continuation of Deferred@1801349399 after retry RPC after error@7348463) -> (continuation of Deferred@18236104 after retry RPC after error@1109985344) -> (continuation of Deferred@1512556483 after retry RPC after error@1532093232) -> (continuation of Deferred@1759701648 after retry RPC after error@1652790468) -> (continuation of Deferred@117329544 after retry RPC after error@1382184196) -> (continuation of Deferred@757834674 after retry RPC after error@1408247655), errback=(continuation of Deferred@6321827 after retry RPC after error@1800290595) -> (continuation of Deferred@610125843 after retry RPC after error@1519123988) -> (continuation of Deferred@1499291272 after retry RPC after error@1082350553) -> (continuation of Deferred@181673610 after retry RPC after error@254425754) -> (continuation of Deferred@1018207465 after retry RPC after error@1723286837) -> (continuation of Deferred@1279080231 after retry RPC after error@303901392) -> (continuation of Deferred@712162222 after retry RPC after error@1991302456) -> (continuation of Deferred@1402030278 after retry RPC after error@681681870) -> (continuation of Deferred@389137087 after retry RPC after error@1729660028) -> (continuation of Deferred@1041639201 after retry RPC after error@462183678) -> (continuation of Deferred@36786442 after retry RPC after error@564727380) -> (continuation of Deferred@780737135 after retry RPC after error@1461438700) -> (continuation of Deferred@1596619268 after retry RPC after error@907547675) -> (continuation of Deferred@1352936149 after retry RPC after error@1500628101) -> (continuation of Deferred@1426550773 after retry RPC after error@591987074) -> (continuation of Deferred@1380611516 after retry RPC after error@97048220) -> (continuation of Deferred@1801349399 after retry RPC after error@7348463) -> (continuation of Deferred@18236104 after retry RPC after error@1109985344) -> (continuation of Deferred@1512556483 after retry RPC after error@1532093232) -> (continuation of Deferred@1759701648 after retry RPC after error@1652790468) -> (continuation of Deferred@117329544 after retry RPC after error@1382184196) -> (continuation of Deferred@757834674 after retry RPC after error@1408247655)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.189:46677
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:21.933 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:08:21.935 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#5) of source Source: KuduSource.
08:08:21.936 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_5.
08:08:21.936 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (e26b904229418d0e047d5d94c5b9f905) switched from state RUNNING to RESTARTING.
08:08:22.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:22.136 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:22.137 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:22.137 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:22.138 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:22.138 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:22.138 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:22.139 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:22.139 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:22.139 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:22.141 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:22.141 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:22.141 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:22.141 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:22.149 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091702149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:22.164 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
08:08:22.167 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
08:08:22.299 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:22.299 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:22.299 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:22.300 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:22.300 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:22.300 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:22.300 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:22.300 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:22.300 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:22.301 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:22.301 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:22.301 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:22.301 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:22.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:22.440 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:22.440 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:22.440 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:22.442 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:22.442 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:22.442 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:22.442 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:22.446 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:22.446 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:22.446 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:22.446 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:22.446 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:22.446 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:22.545 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:22.546 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:22.546 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:22.547 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:22.547 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:22.547 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:22.547 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:22.547 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:22.548 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:22.548 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:22.548 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:22.548 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:22.548 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:22.557 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:22.609 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:22.610 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:22.610 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:22.612 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:22.612 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:22.612 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:22.613 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:22.613 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:22.613 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:22.614 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:22.614 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:22.614 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:22.614 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:22.650 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091702649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:22.675 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=22 ms, finalizationTime=2 ms).
08:08:22.677 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
08:08:22.756 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:22.756 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:22.757 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:22.757 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:22.758 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:22.758 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:22.759 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:22.759 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:22.759 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:22.759 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:22.759 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:22.759 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:22.759 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:22.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:22.848 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:22.849 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:22.849 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:22.849 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:22.850 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:22.850 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:22.850 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:22.850 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:22.850 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:22.850 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:22.850 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:22.850 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:22.850 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:22.894 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job b42812d69c586178cf7556c3c92998f3 from Checkpoint 65 @ 1779091487380 for b42812d69c586178cf7556c3c92998f3 located at file:/tmp/junit1738461414297871817/checkpoints/b42812d69c586178cf7556c3c92998f3/chk-65.
08:08:22.896 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
08:08:22.896 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from CREATED to SCHEDULED.
08:08:22.897 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:08:22.898 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from SCHEDULED to DEPLOYING.
08:08:22.898 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 0 to checkpoint 65 for source Source: KuduSource to checkpoint.
08:08:22.898 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #7) with attempt id 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1) with allocation id 2f9a5ebd231a465571d2109e36591407
08:08:22.899 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (b42812d69c586178cf7556c3c92998f3) switched from state RESTARTING to RUNNING.
08:08:22.899 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job b42812d69c586178cf7556c3c92998f3 from Checkpoint 65 @ 1779091487380 for b42812d69c586178cf7556c3c92998f3 located at file:/tmp/junit1738461414297871817/checkpoints/b42812d69c586178cf7556c3c92998f3/chk-65.
08:08:22.900 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
08:08:22.901 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from CREATED to SCHEDULED.
08:08:22.901 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:08:22.902 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 2f9a5ebd231a465571d2109e36591407.
08:08:22.902 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from SCHEDULED to DEPLOYING.
08:08:22.903 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #7) with attempt id 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1) with allocation id 4c78869737ef27e21dadfe7d1a23010d
08:08:22.903 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#7 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_7), deploy into slot with allocation id 2f9a5ebd231a465571d2109e36591407.
08:08:22.904 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 3 to checkpoint 65 for source Source: KuduSource to checkpoint.
08:08:22.910 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 4c78869737ef27e21dadfe7d1a23010d.
08:08:22.912 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#7 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_7), deploy into slot with allocation id 4c78869737ef27e21dadfe7d1a23010d.
08:08:22.913 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#7 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from CREATED to DEPLOYING.
08:08:22.913 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#7 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_7) [DEPLOYING].
08:08:22.914 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@76bcfd3b
08:08:22.914 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:22.914 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit1738461414297871817/checkpoints")
08:08:22.914 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#7 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from DEPLOYING to INITIALIZING.
08:08:22.919 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#7 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from CREATED to DEPLOYING.
08:08:22.919 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#7 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_7) [DEPLOYING].
08:08:22.919 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from DEPLOYING to INITIALIZING.
08:08:22.920 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5a396225
08:08:22.920 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:22.920 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit1738461414297871817/checkpoints")
08:08:22.920 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#7 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from DEPLOYING to INITIALIZING.
08:08:22.920 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from DEPLOYING to INITIALIZING.
08:08:22.923 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7b898a9e
08:08:22.925 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3bffb93
08:08:22.927 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:22.928 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:22.929 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:22.929 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:22.930 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:22.930 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:22.930 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:22.930 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:22.931 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:22.931 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:22.931 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:22.932 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:22.932 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:22.932 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:22.932 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:22.932 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:22.936 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:22.936 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:22.936 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:22.936 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:22.936 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:22.937 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:22.937 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:22.937 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:22.942 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:22.942 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:22.942 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:22.942 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:22.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:22.949 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:22.950 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:22.951 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:22.951 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:22.951 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:22.951 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:22.952 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:22.952 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:22.952 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:22.952 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:22.952 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:22.952 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:22.953 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:22.953 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:22.953 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:22.953 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:22.954 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:22.954 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:22.954 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:22.955 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:22.955 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:22.955 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:22.953 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:22.963 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:22.963 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:22.963 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:22.969 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:22.971 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:22.973 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:22.986 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:22.986 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:22.987 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:22.987 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:22.988 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:22.988 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:22.988 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:22.988 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:22.989 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:22.989 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:22.989 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:22.989 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:22.989 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:22.990 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:22.990 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:22.990 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:22.991 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:22.991 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:22.991 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:22.991 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:22.991 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:22.991 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:22.991 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:22.993 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:22.993 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:22.993 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:22.993 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:22.993 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:22.993 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:22.994 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:22.994 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:22.994 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:22.994 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:22.994 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:22.994 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:22.994 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:23.005 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:23.005 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:23.005 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:23.005 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:23.006 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:23.006 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:23.006 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:23.006 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:23.006 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:23.006 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:23.006 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:23.006 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:23.006 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:23.009 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:23.009 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:23.009 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.010 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:23.010 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.010 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.010 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.010 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.010 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.010 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.010 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.010 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.010 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:23.012 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:23.012 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:23.012 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:23.013 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.013 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.013 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.013 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.013 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.013 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.013 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.013 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.013 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.013 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:23.020 [DEBUG - pool-288-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30012), Traces: [0ms] sending RPC to server master-127.31.46.252:40541, [4ms] received response from server master-127.31.46.252:40541: OK, deferred=null) with no deferred attached!
08:08:23.029 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:23.029 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:23.030 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:23.030 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.030 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.030 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.030 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.030 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.030 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.030 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.030 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.031 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.031 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:23.033 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:23.033 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:23.033 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:23.034 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.034 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.034 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.034 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.034 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.034 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.034 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.034 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.034 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.034 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:23.048 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:23.049 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:23.049 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:23.049 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.049 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.050 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.050 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.050 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.050 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.050 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.050 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.051 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.051 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:23.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:23.073 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:23.073 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:23.074 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:23.074 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.074 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.074 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.074 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.074 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.074 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.075 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.075 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.075 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.075 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:23.088 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:23.089 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:23.089 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:23.090 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.090 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.090 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.093 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.093 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.093 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.094 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.094 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.094 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.094 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:23.150 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091703149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:23.164 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
08:08:23.165 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
08:08:23.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:21.281381  2429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:23.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:22.688926  2427 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 2422
08:08:23.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:23.199272  2422 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.918s	user 0.598s	sys 1.233s
08:08:23.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:23.201387  2431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:23.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:23.201587  2422 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.921s	user 0.598s	sys 1.233s
08:08:23.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:23.200671  2430 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1919 milliseconds
08:08:23.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.201938  2422 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:08:23.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.207540  2422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:08:23.209 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:23.209 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:23.210 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:23.210 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.210 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.210 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.210 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.210 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.210 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.210 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.211 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.211 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.211 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:23.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.211879  2422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:08:23.213 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:23.213 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:23.213 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:23.213 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.213 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.213 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.213 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.213 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.213 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.214 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.214 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.214 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.213600  2422 hybrid_clock.cc:648] HybridClock initialized: now 1779091703213542 us; error 32 us; skew 500 ppm
08:08:23.214 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:23.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.214840  2422 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:08:23.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.224396  2422 webserver.cc:533] Webserver started at http://127.2.90.190:37553/ using document root <none> and password file <none>
08:08:23.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.225821  2422 fs_manager.cc:362] Metadata directory not provided
08:08:23.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.226114  2422 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:08:23.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.226760  2422 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:08:23.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.234225  2422 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-0/data/instance:
08:08:23.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f8c639184e474686ba6ce9a8bd838d4c"
08:08:23.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:23 on dist-test-slave-1jss"
08:08:23.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.235813  2422 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-0/wal/instance:
08:08:23.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f8c639184e474686ba6ce9a8bd838d4c"
08:08:23.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:23 on dist-test-slave-1jss"
08:08:23.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.246362  2422 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.005s	sys 0.006s
08:08:23.249 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:23.250 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:23.250 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:23.250 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.250 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.250 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.251 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.251 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.251 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.252 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.252 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.252 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.252 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:23.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.256525  2461 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:08:23.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.258117  2422 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.005s	sys 0.000s
08:08:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.258596  2422 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-0/wal
08:08:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f8c639184e474686ba6ce9a8bd838d4c"
08:08:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:23 on dist-test-slave-1jss"
08:08:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.259080  2422 fs_report.cc:389] FS layout report
08:08:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:08:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-0/wal
08:08:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-0/wal
08:08:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-0/data/data
08:08:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:08:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:08:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:08:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:08:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:08:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:08:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:08:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:08:23.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:08:23.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:08:23.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:08:23.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:23.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.337077  2422 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:08:23.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.339495  2422 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:08:23.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.340148  2422 kserver.cc:163] Server-wide thread pool size limit: 3276
08:08:23.348 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:23.349 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:23.349 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:23.349 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:23.349 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:23.349 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:23.349 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:23.349 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:23.349 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:23.350 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:23.350 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:23.350 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:23.350 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:23.373 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:23.374 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:23.374 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:23.374 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.375 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.375 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.375 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.375 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.375 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.376 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.376 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.376 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.376 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:23.392 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:23.393 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:23.393 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:23.394 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.394 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.394 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.395 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.395 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.395 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.395 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.395 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.395 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.396 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:23.405 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:23.406 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:23.406 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:23.407 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:23.407 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:23.407 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:23.407 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:23.407 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:23.408 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:23.408 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:23.408 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:23.408 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:23.408 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:23.429 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:23.430 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:23.430 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:23.430 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.430 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.431 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.431 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.431 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.431 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.431 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.431 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.431 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.432 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:23.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:23.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.467113  2422 rpc_server.cc:307] RPC server started. Bound to: 127.2.90.190:42265
08:08:23.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.467247  2512 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.90.190:42265 every 8 connection(s)
08:08:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.471534  2422 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-0/data/info.pb
08:08:23.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.479422  2410 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 2422
08:08:23.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.480041  2410 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-0/wal/instance
08:08:23.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.480301  2513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:23.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.486338  2410 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:08:23.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:08:23.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-1/wal
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-1/data
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-1/logs
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-1/data/info.pb
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.90.189:41065
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.90.189
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.90.148:36029
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.90.190:42265,127.2.90.189:41065,127.2.90.188:42457
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:08:23.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35589/jwks.json with env {}
08:08:23.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.499311  2513 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.90.190" port: 42265 } has no permanent_uuid. Determining permanent_uuid...
08:08:23.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.542984  2513 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } has no permanent_uuid. Determining permanent_uuid...
08:08:23.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:23.546247  2464 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.90.189:41065: connect: Connection refused (error 111)
08:08:23.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:23.552204  2513 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.90.189:41065: Network error: Client connection negotiation failed: client connection to 127.2.90.189:41065: connect: Connection refused (error 111)
08:08:23.558 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:23.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.601972  2513 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } attempt: 1
08:08:23.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:23.613410  2513 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.90.189:41065: Network error: Client connection negotiation failed: client connection to 127.2.90.189:41065: connect: Connection refused (error 111)
08:08:23.657 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091703649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:23.670 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
08:08:23.671 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
08:08:23.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.682034  2513 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } attempt: 2
08:08:23.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:23.687932  2513 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.90.189:41065: Network error: Client connection negotiation failed: client connection to 127.2.90.189:41065: connect: Connection refused (error 111)
08:08:23.738 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:23.738 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:23.738 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:23.739 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:23.739 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:23.739 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:23.739 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:23.739 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:23.739 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:23.740 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:23.740 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:23.740 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:23.740 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:23.748 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:23.749 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:23.749 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:23.749 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.749 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.749 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:23.749 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.749 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.749 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:23.749 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.749 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.749 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:23.750 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:23.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.779465  2513 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } attempt: 3
08:08:23.783 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:23.784 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:23.784 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:23.785 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:23.785 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:23.785 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:23.786 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:23.786 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:23.786 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:23.786 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:23.786 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:23.787 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:23.787 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:23.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:23.790373  2513 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.90.189:41065: Network error: Client connection negotiation failed: client connection to 127.2.90.189:41065: connect: Connection refused (error 111)
08:08:23.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:23.848 [DEBUG - pool-291-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30011), Traces: [0ms] sending RPC to server master-127.31.233.252:36101, [8ms] received response from server master-127.31.233.252:36101: OK, deferred=null) with no deferred attached!
08:08:23.848 [DEBUG - pool-291-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30011), Traces: [0ms] sending RPC to server master-127.31.233.252:36101, [5ms] received response from server master-127.31.233.252:36101: OK, deferred=null) with no deferred attached!
08:08:23.848 [DEBUG - pool-291-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30010), Traces: [0ms] sending RPC to server master-127.31.233.252:36101, [7ms] received response from server master-127.31.233.252:36101: OK, deferred=null) with no deferred attached!
08:08:23.848 [DEBUG - pool-291-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30010), Traces: [0ms] sending RPC to server master-127.31.233.252:36101, [8ms] received response from server master-127.31.233.252:36101: OK, deferred=null) with no deferred attached!
08:08:23.848 [DEBUG - pool-291-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30009), Traces: [0ms] sending RPC to server master-127.31.233.252:36101, [10ms] received response from server master-127.31.233.252:36101: OK, deferred=null) with no deferred attached!
08:08:23.908 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:23.908 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:23.909 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:23.909 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:23.909 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:23.909 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:23.909 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:23.909 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:23.909 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:23.910 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:23.910 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:23.910 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:23.910 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:23.910 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29066), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [56ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [108ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [117ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [118ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [139ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [173ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [179ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [179ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [254ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [259ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [260ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [261ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [261ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [282ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [282ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [283ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [283ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [300ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [304ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [304ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [343ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [344ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [344ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [344ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [382ms] refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [383ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [384ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [384ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [385ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [460ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [462ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [463ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [463ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [464ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [563ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [564ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [564ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [565ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [903ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [904ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [904ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [904ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1441ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1444ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1444ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2261ms] refreshing cache from master, [2261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2262ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [2262ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2262ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2263ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [5801ms] refreshing cache from master, [5801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [5802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [5802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [5802ms] too many traces: truncated at 100 traces, deferred=Deferred@2096632658(state=PENDING, result=null, callback=(continuation of Deferred@292890594 after retry RPC after error@153531143) -> (continuation of Deferred@1662579964 after retry RPC after error@1598425422) -> (continuation of Deferred@1731489651 after retry RPC after error@1538672153) -> (continuation of Deferred@2133718663 after retry RPC after error@281975893) -> (continuation of Deferred@1422206664 after retry RPC after error@1026172103) -> (continuation of Deferred@757298219 after retry RPC after error@1231780334) -> (continuation of Deferred@887485805 after retry RPC after error@1485173546) -> (continuation of Deferred@1857111613 after retry RPC after error@2089281036) -> (continuation of Deferred@1733438060 after retry RPC after error@280598799) -> (continuation of Deferred@1960682891 after retry RPC after error@933862042) -> (continuation of Deferred@1096730441 after retry RPC after error@494100364) -> (continuation of Deferred@68898900 after retry RPC after error@2141026055) -> (continuation of Deferred@1213109042 after retry RPC after error@1330002568) -> (continuation of Deferred@293690052 after retry RPC after error@87044796) -> (continuation of Deferred@962328107 after retry RPC after error@1203182066) -> (continuation of Deferred@1559968954 after retry RPC after error@1482309707) -> (continuation of Deferred@1045827525 after retry RPC after error@1104275828) -> (continuation of Deferred@1145705240 after retry RPC after error@1318603714) -> (continuation of Deferred@1086213619 after retry RPC after error@250255065) -> (continuation of Deferred@447514319 after retry RPC after error@384178179) -> (continuation of Deferred@612699897 after retry RPC after error@2114128110) -> (continuation of Deferred@15168287 after retry RPC after error@644302080) -> (continuation of Deferred@714700275 after retry RPC after error@1278954550), errback=(continuation of Deferred@292890594 after retry RPC after error@153531143) -> (continuation of Deferred@1662579964 after retry RPC after error@1598425422) -> (continuation of Deferred@1731489651 after retry RPC after error@1538672153) -> (continuation of Deferred@2133718663 after retry RPC after error@281975893) -> (continuation of Deferred@1422206664 after retry RPC after error@1026172103) -> (continuation of Deferred@757298219 after retry RPC after error@1231780334) -> (continuation of Deferred@887485805 after retry RPC after error@1485173546) -> (continuation of Deferred@1857111613 after retry RPC after error@2089281036) -> (continuation of Deferred@1733438060 after retry RPC after error@280598799) -> (continuation of Deferred@1960682891 after retry RPC after error@933862042) -> (continuation of Deferred@1096730441 after retry RPC after error@494100364) -> (continuation of Deferred@68898900 after retry RPC after error@2141026055) -> (continuation of Deferred@1213109042 after retry RPC after error@1330002568) -> (continuation of Deferred@293690052 after retry RPC after error@87044796) -> (continuation of Deferred@962328107 after retry RPC after error@1203182066) -> (continuation of Deferred@1559968954 after retry RPC after error@1482309707) -> (continuation of Deferred@1045827525 after retry RPC after error@1104275828) -> (continuation of Deferred@1145705240 after retry RPC after error@1318603714) -> (continuation of Deferred@1086213619 after retry RPC after error@250255065) -> (continuation of Deferred@447514319 after retry RPC after error@384178179) -> (continuation of Deferred@612699897 after retry RPC after error@2114128110) -> (continuation of Deferred@15168287 after retry RPC after error@644302080) -> (continuation of Deferred@714700275 after retry RPC after error@1278954550)))
08:08:23.913 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
08:08:23.913 [WARN - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#5 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29066), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [56ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [108ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [117ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [118ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [139ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [173ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [179ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [179ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [254ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [259ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [260ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [261ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [261ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [282ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [282ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [283ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [283ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [300ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [304ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [304ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [343ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [344ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [344ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [344ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [382ms] refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [383ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [384ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [384ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [385ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [460ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [462ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [463ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [463ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [464ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [563ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [564ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [564ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [565ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [903ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [904ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [904ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [904ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1441ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1444ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1444ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2261ms] refreshing cache from master, [2261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2262ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [2262ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2262ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2263ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [5801ms] refreshing cache from master, [5801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [5802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [5802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [5802ms] too many traces: truncated at 100 traces, deferred=Deferred@2096632658(state=PENDING, result=null, callback=(continuation of Deferred@292890594 after retry RPC after error@153531143) -> (continuation of Deferred@1662579964 after retry RPC after error@1598425422) -> (continuation of Deferred@1731489651 after retry RPC after error@1538672153) -> (continuation of Deferred@2133718663 after retry RPC after error@281975893) -> (continuation of Deferred@1422206664 after retry RPC after error@1026172103) -> (continuation of Deferred@757298219 after retry RPC after error@1231780334) -> (continuation of Deferred@887485805 after retry RPC after error@1485173546) -> (continuation of Deferred@1857111613 after retry RPC after error@2089281036) -> (continuation of Deferred@1733438060 after retry RPC after error@280598799) -> (continuation of Deferred@1960682891 after retry RPC after error@933862042) -> (continuation of Deferred@1096730441 after retry RPC after error@494100364) -> (continuation of Deferred@68898900 after retry RPC after error@2141026055) -> (continuation of Deferred@1213109042 after retry RPC after error@1330002568) -> (continuation of Deferred@293690052 after retry RPC after error@87044796) -> (continuation of Deferred@962328107 after retry RPC after error@1203182066) -> (continuation of Deferred@1559968954 after retry RPC after error@1482309707) -> (continuation of Deferred@1045827525 after retry RPC after error@1104275828) -> (continuation of Deferred@1145705240 after retry RPC after error@1318603714) -> (continuation of Deferred@1086213619 after retry RPC after error@250255065) -> (continuation of Deferred@447514319 after retry RPC after error@384178179) -> (continuation of Deferred@612699897 after retry RPC after error@2114128110) -> (continuation of Deferred@15168287 after retry RPC after error@644302080) -> (continuation of Deferred@714700275 after retry RPC after error@1278954550), errback=(continuation of Deferred@292890594 after retry RPC after error@153531143) -> (continuation of Deferred@1662579964 after retry RPC after error@1598425422) -> (continuation of Deferred@1731489651 after retry RPC after error@1538672153) -> (continuation of Deferred@2133718663 after retry RPC after error@281975893) -> (continuation of Deferred@1422206664 after retry RPC after error@1026172103) -> (continuation of Deferred@757298219 after retry RPC after error@1231780334) -> (continuation of Deferred@887485805 after retry RPC after error@1485173546) -> (continuation of Deferred@1857111613 after retry RPC after error@2089281036) -> (continuation of Deferred@1733438060 after retry RPC after error@280598799) -> (continuation of Deferred@1960682891 after retry RPC after error@933862042) -> (continuation of Deferred@1096730441 after retry RPC after error@494100364) -> (continuation of Deferred@68898900 after retry RPC after error@2141026055) -> (continuation of Deferred@1213109042 after retry RPC after error@1330002568) -> (continuation of Deferred@293690052 after retry RPC after error@87044796) -> (continuation of Deferred@962328107 after retry RPC after error@1203182066) -> (continuation of Deferred@1559968954 after retry RPC after error@1482309707) -> (continuation of Deferred@1045827525 after retry RPC after error@1104275828) -> (continuation of Deferred@1145705240 after retry RPC after error@1318603714) -> (continuation of Deferred@1086213619 after retry RPC after error@250255065) -> (continuation of Deferred@447514319 after retry RPC after error@384178179) -> (continuation of Deferred@612699897 after retry RPC after error@2114128110) -> (continuation of Deferred@15168287 after retry RPC after error@644302080) -> (continuation of Deferred@714700275 after retry RPC after error@1278954550)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.189:46677
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:23.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:23.917894  2515 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:08:23.918 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#5 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_5).
08:08:23.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:23.918864  2515 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:08:23.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:23.919759  2515 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:08:23.920 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#5 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_5.
08:08:23.922 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from INITIALIZING to FAILED on 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29066), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [56ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [108ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [117ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [118ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [139ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [173ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [179ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [179ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [254ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [259ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [260ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [261ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [261ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [282ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [282ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [283ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [283ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [300ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [303ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [304ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [304ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [343ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [344ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [344ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [344ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [382ms] refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [383ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [384ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [384ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [385ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [460ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [462ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [463ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [463ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [464ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [563ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [564ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [564ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [565ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [903ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [904ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [904ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [904ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1441ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1444ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1444ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2261ms] refreshing cache from master, [2261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2262ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [2262ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2262ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2263ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [5801ms] refreshing cache from master, [5801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [5802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [5802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [5802ms] too many traces: truncated at 100 traces, deferred=Deferred@2096632658(state=PENDING, result=null, callback=(continuation of Deferred@292890594 after retry RPC after error@153531143) -> (continuation of Deferred@1662579964 after retry RPC after error@1598425422) -> (continuation of Deferred@1731489651 after retry RPC after error@1538672153) -> (continuation of Deferred@2133718663 after retry RPC after error@281975893) -> (continuation of Deferred@1422206664 after retry RPC after error@1026172103) -> (continuation of Deferred@757298219 after retry RPC after error@1231780334) -> (continuation of Deferred@887485805 after retry RPC after error@1485173546) -> (continuation of Deferred@1857111613 after retry RPC after error@2089281036) -> (continuation of Deferred@1733438060 after retry RPC after error@280598799) -> (continuation of Deferred@1960682891 after retry RPC after error@933862042) -> (continuation of Deferred@1096730441 after retry RPC after error@494100364) -> (continuation of Deferred@68898900 after retry RPC after error@2141026055) -> (continuation of Deferred@1213109042 after retry RPC after error@1330002568) -> (continuation of Deferred@293690052 after retry RPC after error@87044796) -> (continuation of Deferred@962328107 after retry RPC after error@1203182066) -> (continuation of Deferred@1559968954 after retry RPC after error@1482309707) -> (continuation of Deferred@1045827525 after retry RPC after error@1104275828) -> (continuation of Deferred@1145705240 after retry RPC after error@1318603714) -> (continuation of Deferred@1086213619 after retry RPC after error@250255065) -> (continuation of Deferred@447514319 after retry RPC after error@384178179) -> (continuation of Deferred@612699897 after retry RPC after error@2114128110) -> (continuation of Deferred@15168287 after retry RPC after error@644302080) -> (continuation of Deferred@714700275 after retry RPC after error@1278954550), errback=(continuation of Deferred@292890594 after retry RPC after error@153531143) -> (continuation of Deferred@1662579964 after retry RPC after error@1598425422) -> (continuation of Deferred@1731489651 after retry RPC after error@1538672153) -> (continuation of Deferred@2133718663 after retry RPC after error@281975893) -> (continuation of Deferred@1422206664 after retry RPC after error@1026172103) -> (continuation of Deferred@757298219 after retry RPC after error@1231780334) -> (continuation of Deferred@887485805 after retry RPC after error@1485173546) -> (continuation of Deferred@1857111613 after retry RPC after error@2089281036) -> (continuation of Deferred@1733438060 after retry RPC after error@280598799) -> (continuation of Deferred@1960682891 after retry RPC after error@933862042) -> (continuation of Deferred@1096730441 after retry RPC after error@494100364) -> (continuation of Deferred@68898900 after retry RPC after error@2141026055) -> (continuation of Deferred@1213109042 after retry RPC after error@1330002568) -> (continuation of Deferred@293690052 after retry RPC after error@87044796) -> (continuation of Deferred@962328107 after retry RPC after error@1203182066) -> (continuation of Deferred@1559968954 after retry RPC after error@1482309707) -> (continuation of Deferred@1045827525 after retry RPC after error@1104275828) -> (continuation of Deferred@1145705240 after retry RPC after error@1318603714) -> (continuation of Deferred@1086213619 after retry RPC after error@250255065) -> (continuation of Deferred@447514319 after retry RPC after error@384178179) -> (continuation of Deferred@612699897 after retry RPC after error@2114128110) -> (continuation of Deferred@15168287 after retry RPC after error@644302080) -> (continuation of Deferred@714700275 after retry RPC after error@1278954550)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.189:46677
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:23.929 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:08:23.929 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#5) of source Source: KuduSource.
08:08:23.930 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_5.
08:08:23.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:23.933931  2513 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } attempt: 4
08:08:23.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:23.940565  2513 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.90.189:41065: Network error: Client connection negotiation failed: client connection to 127.2.90.189:41065: connect: Connection refused (error 111)
08:08:23.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:23.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:23.981303  2515 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:08:23.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:23.981782  2515 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:08:23.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:23.982177  2515 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:08:23.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:23.982542  2515 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:08:23.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:23.982970  2515 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:08:23.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:23.983304  2515 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:35589/jwks.json
08:08:24.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:24.035777  2515 master_runner.cc:387] Master server non-default flags:
08:08:24.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:24.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.90.148:36029
08:08:24.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:24.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:24.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-1/data
08:08:24.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-1/wal
08:08:24.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:08:24.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.90.190:42265,127.2.90.189:41065,127.2.90.188:42457
08:08:24.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:24.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:24.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:08:24.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.90.189:41065
08:08:24.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:08:24.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:08:24.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:08:24.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35589/jwks.json
08:08:24.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:24.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:24.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-1/data/info.pb
08:08:24.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.90.189
08:08:24.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:24.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:08:24.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:24.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:08:24.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:08:24.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:24.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-1/logs
08:08:24.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:24.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:08:24.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:08:24.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:08:24.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:08:24.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:08:24.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:08:24.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:08:24.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:08:24.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:08:24.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:24.037631  2515 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:08:24.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:24.039691  2515 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:08:24.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:24.054435  2524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:24.058 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:24.133 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:24.133 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:24.133 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:24.135 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:24.135 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:24.135 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:24.134 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:24.136 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:24.136 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:24.134 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:24.136 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:24.136 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:24.136 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:24.152 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091704151 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:24.161 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
08:08:24.162 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
08:08:24.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:24.240095  2513 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } attempt: 5
08:08:24.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:24.254347  2513 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.90.189:41065: Network error: Client connection negotiation failed: client connection to 127.2.90.189:41065: connect: Connection refused (error 111)
08:08:24.331 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:24.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:24.513 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:24.514 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:24.514 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:24.514 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:24.514 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:24.515 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:24.515 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:24.515 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:24.516 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:24.516 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:24.516 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:24.516 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:24.516 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:24.529 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:24.529 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:24.529 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:24.529 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:24.529 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:24.530 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:24.530 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:24.531 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:24.531 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:24.531 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:24.531 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:24.531 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:24.532 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:24.558 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:24.650 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091704649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:24.661 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:08:24.662 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
08:08:24.708 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:24.709 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:24.709 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:24.709 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:24.709 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:24.709 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:24.710 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:24.710 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:24.710 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:24.710 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:24.710 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:24.710 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:24.710 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:24.778 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:24.779 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:24.779 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:24.780 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:24.780 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:24.780 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:24.781 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:24.781 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:24.781 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:24.781 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:24.782 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:24.782 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:24.782 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:24.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:24.801992  2513 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } attempt: 6
08:08:24.831 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:24.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:24.840266  2513 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.90.189:41065: Network error: Client connection negotiation failed: client connection to 127.2.90.189:41065: connect: Connection refused (error 111)
08:08:24.865 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:24.865 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:24.865 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:24.866 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:24.866 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:24.867 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:24.867 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:24.867 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:24.867 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:24.868 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:24.868 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:24.868 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:24.868 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:24.923 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:24.923 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:24.924 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:24.924 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:24.924 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:24.925 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:24.925 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:24.925 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:24.925 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:24.925 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:24.925 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:24.926 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:24.926 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:24.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:25.058 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:25.060 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:25.060 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:25.060 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:25.061 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:25.061 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:25.061 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:25.061 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:25.062 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:25.062 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:25.061 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:25.064 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:25.064 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:25.064 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:25.150 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091705149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:25.161 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
08:08:25.162 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
08:08:25.183 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:25.184 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:25.184 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:25.185 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:25.185 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:25.185 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:25.186 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:25.190 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:25.190 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:25.186 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:25.190 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:25.190 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:25.190 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:25.279 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:25.279 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:25.279 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:25.280 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:25.280 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:25.281 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:25.282 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:25.282 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:25.282 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:25.282 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:25.282 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:25.282 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:25.283 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:25.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:25.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:25.557 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:25.568 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:25.569 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:25.569 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:25.570 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:25.570 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:25.570 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:25.571 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:25.571 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:25.571 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:25.571 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:25.571 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:25.571 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:25.571 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:25.651 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091705650 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:25.669 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
08:08:25.671 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
08:08:25.836 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:25.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:25.900949  2513 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } attempt: 7
08:08:25.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:25.941222  2513 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.90.189:41065: Network error: Client connection negotiation failed: client connection to 127.2.90.189:41065: connect: Connection refused (error 111)
08:08:25.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:25.984 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:25.984 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:25.984 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:25.985 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:25.985 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:25.985 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:25.985 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:25.985 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:25.986 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:25.986 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:25.986 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:25.986 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:25.986 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:26.058 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:26.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:25.464777  2523 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 2515
08:08:26.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:24.055670  2525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:26.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:26.079849  2515 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.025s	user 0.737s	sys 1.110s
08:08:26.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:26.081440  2515 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.027s	user 0.737s	sys 1.110s
08:08:26.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:26.083006  2527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:26.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:26.087170  2526 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2019 milliseconds
08:08:26.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.087250  2515 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:08:26.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.088742  2515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:08:26.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.091953  2515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:08:26.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.093386  2515 hybrid_clock.cc:648] HybridClock initialized: now 1779091706093317 us; error 61 us; skew 500 ppm
08:08:26.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.094556  2515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:08:26.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.102309  2515 webserver.cc:533] Webserver started at http://127.2.90.189:35841/ using document root <none> and password file <none>
08:08:26.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.103669  2515 fs_manager.cc:362] Metadata directory not provided
08:08:26.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.103951  2515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:08:26.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.104712  2515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:08:26.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.111759  2515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-1/data/instance:
08:08:26.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "49bfb1f1e5e040d0869d8e6fdab4c9bb"
08:08:26.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:26 on dist-test-slave-1jss"
08:08:26.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.113368  2515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-1/wal/instance:
08:08:26.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "49bfb1f1e5e040d0869d8e6fdab4c9bb"
08:08:26.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:26 on dist-test-slave-1jss"
08:08:26.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.122016  2515 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.002s
08:08:26.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.129078  2540 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:08:26.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.130381  2515 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.007s	sys 0.000s
08:08:26.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.130761  2515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-1/wal
08:08:26.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "49bfb1f1e5e040d0869d8e6fdab4c9bb"
08:08:26.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:26 on dist-test-slave-1jss"
08:08:26.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.131151  2515 fs_report.cc:389] FS layout report
08:08:26.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:08:26.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-1/wal
08:08:26.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-1/wal
08:08:26.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-1/data/data
08:08:26.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:08:26.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:08:26.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:08:26.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:08:26.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:08:26.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:08:26.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:08:26.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:08:26.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:08:26.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:08:26.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:08:26.149 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 66 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091706149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:26.158 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 66 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
08:08:26.158 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 66 as completed for source Source: KuduSource.
08:08:26.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.206907  2515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:08:26.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.208880  2515 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:08:26.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.209429  2515 kserver.cc:163] Server-wide thread pool size limit: 3276
08:08:26.298 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:26.299 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:26.299 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:26.300 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:26.300 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:26.300 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:26.300 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:26.300 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:26.300 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:26.300 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:26.301 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:26.301 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:26.301 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:26.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.304395  2515 rpc_server.cc:307] RPC server started. Bound to: 127.2.90.189:41065
08:08:26.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.304556  2591 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.90.189:41065 every 8 connection(s)
08:08:26.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.308297  2515 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-1/data/info.pb
08:08:26.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.316730  2410 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 2515
08:08:26.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.317322  2410 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-1/wal/instance
08:08:26.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.318293  2592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:26.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.320436  2410 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:08:26.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:08:26.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-2/wal
08:08:26.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-2/data
08:08:26.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:08:26.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:08:26.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:08:26.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:26.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:26.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:26.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-2/logs
08:08:26.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-2/data/info.pb
08:08:26.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:26.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:08:26.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:08:26.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:08:26.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:08:26.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:26.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:26.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:26.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:08:26.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:08:26.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:08:26.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:08:26.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.90.188:42457
08:08:26.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.90.188
08:08:26.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:26.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.90.148:36029
08:08:26.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:26.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:26.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:26.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:08:26.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.90.190:42265,127.2.90.189:41065,127.2.90.188:42457
08:08:26.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:08:26.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35589/jwks.json with env {}
08:08:26.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:26.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.335160  2592 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.90.190" port: 42265 } has no permanent_uuid. Determining permanent_uuid...
08:08:26.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.365759  2592 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } has no permanent_uuid. Determining permanent_uuid...
08:08:26.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.384541  2592 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } has no permanent_uuid. Determining permanent_uuid...
08:08:26.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:26.387749  2544 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.90.188:42457: connect: Connection refused (error 111)
08:08:26.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:26.393505  2592 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.90.188:42457: Network error: Client connection negotiation failed: client connection to 127.2.90.188:42457: connect: Connection refused (error 111)
08:08:26.417 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:26.417 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:26.417 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:26.417 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:26.417 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:26.418 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:26.418 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:26.418 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:26.418 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:26.418 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:26.418 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:26.418 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:26.418 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:26.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.443188  2592 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } attempt: 1
08:08:26.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:26.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:26.448753  2592 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.90.188:42457: Network error: Client connection negotiation failed: client connection to 127.2.90.188:42457: connect: Connection refused (error 111)
08:08:26.463 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:26.464 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:26.464 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:26.464 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:26.464 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:26.464 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:26.466 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:26.466 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:26.466 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:26.466 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:26.466 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:26.466 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:26.467 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:26.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.517302  2592 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } attempt: 2
08:08:26.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:26.522763  2592 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.90.188:42457: Network error: Client connection negotiation failed: client connection to 127.2.90.188:42457: connect: Connection refused (error 111)
08:08:26.557 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:26.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.614238  2592 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } attempt: 3
08:08:26.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:26.619271  2592 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.90.188:42457: Network error: Client connection negotiation failed: client connection to 127.2.90.188:42457: connect: Connection refused (error 111)
08:08:26.628 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:26.629 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:26.629 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:26.629 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:26.629 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:26.629 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:26.629 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:26.629 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:26.629 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:26.629 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:26.629 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:26.629 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:26.630 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:26.640 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:26.640 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:26.640 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:26.640 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:26.640 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:26.641 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:26.641 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:26.640 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:26.641 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:26.641 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:26.641 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:26.641 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:26.641 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:26.649 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 67 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091706649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:26.657 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 67 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
08:08:26.658 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 67 as completed for source Source: KuduSource.
08:08:26.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:26.719859  2594 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:08:26.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:26.720739  2594 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:08:26.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:26.721360  2594 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:08:26.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.762737  2592 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } attempt: 4
08:08:26.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:26.772701  2592 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.90.188:42457: Network error: Client connection negotiation failed: client connection to 127.2.90.188:42457: connect: Connection refused (error 111)
08:08:26.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:26.778828  2594 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:08:26.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:26.779139  2594 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:08:26.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:26.779431  2594 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:08:26.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:26.779728  2594 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:08:26.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:26.780051  2594 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:08:26.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:26.780280  2594 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:35589/jwks.json
08:08:26.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.828022  2594 master_runner.cc:387] Master server non-default flags:
08:08:26.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:26.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.90.148:36029
08:08:26.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:26.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:26.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-2/data
08:08:26.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-2/wal
08:08:26.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:08:26.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.90.190:42265,127.2.90.189:41065,127.2.90.188:42457
08:08:26.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:26.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:26.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.90.188:42457
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35589/jwks.json
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-2/data/info.pb
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.90.188
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-2/logs
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:08:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:08:26.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.830099  2594 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:08:26.831 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:26.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:26.832195  2594 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:08:26.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:26.846575  2604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:26.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:26.952 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:26.952 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:26.952 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:26.953 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:26.953 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:26.953 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:26.953 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:26.953 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:26.954 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:26.954 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:26.953 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:26.955 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:26.955 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:27.058 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:27.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:27.072216  2592 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } attempt: 5
08:08:27.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:27.080857  2592 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.90.188:42457: Network error: Client connection negotiation failed: client connection to 127.2.90.188:42457: connect: Connection refused (error 111)
08:08:27.143 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:27.143 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:27.144 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:27.144 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:27.144 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:27.144 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:27.144 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:27.144 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:27.145 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:27.145 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:27.145 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:27.145 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:27.145 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:27.150 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 68 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091707149 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:27.163 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 68 for job da74ffd3de6ba1563e412fcb34de5c51 (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
08:08:27.165 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 68 as completed for source Source: KuduSource.
08:08:27.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:27.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:27.453 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:27.453 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:27.454 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:27.454 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:27.454 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:27.455 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:27.455 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:27.455 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:27.456 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:27.456 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:27.456 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:27.456 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:27.457 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:27.493 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:27.494 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:27.494 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:27.495 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:27.495 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:27.495 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:27.496 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:27.496 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:27.496 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:27.496 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:27.497 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:27.497 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:27.497 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:27.558 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:27.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:27.628623  2592 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } attempt: 6
08:08:27.640 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:27.640 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:27.640 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:27.641 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.642 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.642 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.642 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.642 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.642 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.643 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.643 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.643 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.644 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:27.645 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=27011), Traces: [0ms] sending RPC to server master-127.31.46.252:40541, [2ms] received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [7ms] refreshing cache from master, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [9ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [9ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [10ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [10ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [27ms] refreshing cache from master, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [29ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [29ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [29ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [29ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [47ms] refreshing cache from master, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [48ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [48ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [48ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [49ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [67ms] refreshing cache from master, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [68ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [68ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [69ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [69ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [87ms] refreshing cache from master, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [88ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [89ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [89ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [89ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [167ms] refreshing cache from master, [167ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [167ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [168ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [168ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [168ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [169ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [307ms] refreshing cache from master, [307ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [307ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [308ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [308ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [308ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [308ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [308ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [387ms] refreshing cache from master, [387ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [388ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [388ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [389ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [389ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [389ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [389ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [427ms] refreshing cache from master, [428ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [428ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [428ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [429ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [429ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [429ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [429ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1068ms] refreshing cache from master, [1068ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1069ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [1069ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [1069ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [1069ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1069ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1070ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [2629ms] refreshing cache from master, [2629ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [2630ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [2630ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [2631ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [2631ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [2632ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [2632ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [3007ms] refreshing cache from master, [3008ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [3009ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [3009ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [3010ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [3011ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [3011ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [3011ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [3187ms] refreshing cache from master, [3187ms] too many traces: truncated at 100 traces, deferred=Deferred@1401927713(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$232/0x00007f7544330000@7bb6a77a -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2075085686 after retry RPC after error@386261282) -> (continuation of Deferred@971312467 after retry RPC after error@1999040610) -> (continuation of Deferred@1993601291 after retry RPC after error@1315373570) -> (continuation of Deferred@1610154248 after retry RPC after error@521953141) -> (continuation of Deferred@1991163444 after retry RPC after error@3134961) -> (continuation of Deferred@399078845 after retry RPC after error@1783855046) -> (continuation of Deferred@1762601894 after retry RPC after error@393341739) -> (continuation of Deferred@1271468261 after retry RPC after error@978690845) -> (continuation of Deferred@714604010 after retry RPC after error@841442080) -> (continuation of Deferred@837419961 after retry RPC after error@649069522) -> (continuation of Deferred@861786691 after retry RPC after error@988453227) -> (continuation of Deferred@1534894660 after retry RPC after error@2104792170) -> (continuation of Deferred@551980621 after retry RPC after error@1319729915) -> (continuation of Deferred@1887014888 after retry RPC after error@704090697) -> (continuation of Deferred@1039656412 after retry RPC after error@940322363) -> (continuation of Deferred@79093789 after retry RPC after error@289820440) -> (continuation of Deferred@329093609 after retry RPC after error@1253644375) -> (continuation of Deferred@2034020117 after retry RPC after error@1512116645) -> (continuation of Deferred@634180049 after retry RPC after error@657792671) -> (continuation of Deferred@1005410667 after retry RPC after error@1762909066) -> (continuation of Deferred@714267936 after retry RPC after error@635240203) -> (continuation of Deferred@1949027546 after retry RPC after error@59999838), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2075085686 after retry RPC after error@386261282) -> (continuation of Deferred@971312467 after retry RPC after error@1999040610) -> (continuation of Deferred@1993601291 after retry RPC after error@1315373570) -> (continuation of Deferred@1610154248 after retry RPC after error@521953141) -> (continuation of Deferred@1991163444 after retry RPC after error@3134961) -> (continuation of Deferred@399078845 after retry RPC after error@1783855046) -> (continuation of Deferred@1762601894 after retry RPC after error@393341739) -> (continuation of Deferred@1271468261 after retry RPC after error@978690845) -> (continuation of Deferred@714604010 after retry RPC after error@841442080) -> (continuation of Deferred@837419961 after retry RPC after error@649069522) -> (continuation of Deferred@861786691 after retry RPC after error@988453227) -> (continuation of Deferred@1534894660 after retry RPC after error@2104792170) -> (continuation of Deferred@551980621 after retry RPC after error@1319729915) -> (continuation of Deferred@1887014888 after retry RPC after error@704090697) -> (continuation of Deferred@1039656412 after retry RPC after error@940322363) -> (continuation of Deferred@79093789 after retry RPC after error@289820440) -> (continuation of Deferred@329093609 after retry RPC after error@1253644375) -> (continuation of Deferred@2034020117 after retry RPC after error@1512116645) -> (continuation of Deferred@634180049 after retry RPC after error@657792671) -> (continuation of Deferred@1005410667 after retry RPC after error@1762909066) -> (continuation of Deferred@714267936 after retry RPC after error@635240203) -> (continuation of Deferred@1949027546 after retry RPC after error@59999838)))
08:08:27.648 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:27.649 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:27.649 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:27.649 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.650 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=27011), Traces: [0ms] sending RPC to server master-127.31.46.252:40541, [2ms] received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [7ms] refreshing cache from master, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [9ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [9ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [10ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [10ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [27ms] refreshing cache from master, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [29ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [29ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [29ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [29ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [47ms] refreshing cache from master, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [48ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [48ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [48ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [49ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [67ms] refreshing cache from master, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [68ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [68ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [69ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [69ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [87ms] refreshing cache from master, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [88ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [89ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [89ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [89ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [167ms] refreshing cache from master, [167ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [167ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [168ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [168ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [168ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [169ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [307ms] refreshing cache from master, [307ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [307ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [308ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [308ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [308ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [308ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [308ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [387ms] refreshing cache from master, [387ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [388ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [388ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [389ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [389ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [389ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [389ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [427ms] refreshing cache from master, [428ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [428ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [428ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [429ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [429ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [429ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [429ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1068ms] refreshing cache from master, [1068ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1069ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [1069ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [1069ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [1069ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1069ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1070ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [2629ms] refreshing cache from master, [2629ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [2630ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [2630ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [2631ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [2631ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [2632ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [2632ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [3007ms] refreshing cache from master, [3008ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [3009ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [3009ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [3010ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [3011ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [3011ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [3011ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [3187ms] refreshing cache from master, [3187ms] too many traces: truncated at 100 traces, deferred=Deferred@1401927713(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$232/0x00007f7544330000@7bb6a77a -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2075085686 after retry RPC after error@386261282) -> (continuation of Deferred@971312467 after retry RPC after error@1999040610) -> (continuation of Deferred@1993601291 after retry RPC after error@1315373570) -> (continuation of Deferred@1610154248 after retry RPC after error@521953141) -> (continuation of Deferred@1991163444 after retry RPC after error@3134961) -> (continuation of Deferred@399078845 after retry RPC after error@1783855046) -> (continuation of Deferred@1762601894 after retry RPC after error@393341739) -> (continuation of Deferred@1271468261 after retry RPC after error@978690845) -> (continuation of Deferred@714604010 after retry RPC after error@841442080) -> (continuation of Deferred@837419961 after retry RPC after error@649069522) -> (continuation of Deferred@861786691 after retry RPC after error@988453227) -> (continuation of Deferred@1534894660 after retry RPC after error@2104792170) -> (continuation of Deferred@551980621 after retry RPC after error@1319729915) -> (continuation of Deferred@1887014888 after retry RPC after error@704090697) -> (continuation of Deferred@1039656412 after retry RPC after error@940322363) -> (continuation of Deferred@79093789 after retry RPC after error@289820440) -> (continuation of Deferred@329093609 after retry RPC after error@1253644375) -> (continuation of Deferred@2034020117 after retry RPC after error@1512116645) -> (continuation of Deferred@634180049 after retry RPC after error@657792671) -> (continuation of Deferred@1005410667 after retry RPC after error@1762909066) -> (continuation of Deferred@714267936 after retry RPC after error@635240203) -> (continuation of Deferred@1949027546 after retry RPC after error@59999838), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2075085686 after retry RPC after error@386261282) -> (continuation of Deferred@971312467 after retry RPC after error@1999040610) -> (continuation of Deferred@1993601291 after retry RPC after error@1315373570) -> (continuation of Deferred@1610154248 after retry RPC after error@521953141) -> (continuation of Deferred@1991163444 after retry RPC after error@3134961) -> (continuation of Deferred@399078845 after retry RPC after error@1783855046) -> (continuation of Deferred@1762601894 after retry RPC after error@393341739) -> (continuation of Deferred@1271468261 after retry RPC after error@978690845) -> (continuation of Deferred@714604010 after retry RPC after error@841442080) -> (continuation of Deferred@837419961 after retry RPC after error@649069522) -> (continuation of Deferred@861786691 after retry RPC after error@988453227) -> (continuation of Deferred@1534894660 after retry RPC after error@2104792170) -> (continuation of Deferred@551980621 after retry RPC after error@1319729915) -> (continuation of Deferred@1887014888 after retry RPC after error@704090697) -> (continuation of Deferred@1039656412 after retry RPC after error@940322363) -> (continuation of Deferred@79093789 after retry RPC after error@289820440) -> (continuation of Deferred@329093609 after retry RPC after error@1253644375) -> (continuation of Deferred@2034020117 after retry RPC after error@1512116645) -> (continuation of Deferred@634180049 after retry RPC after error@657792671) -> (continuation of Deferred@1005410667 after retry RPC after error@1762909066) -> (continuation of Deferred@714267936 after retry RPC after error@635240203) -> (continuation of Deferred@1949027546 after retry RPC after error@59999838)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=27011), Traces: [0ms] sending RPC to server master-127.31.46.252:40541, [2ms] received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [7ms] refreshing cache from master, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [9ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [9ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [10ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [10ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [27ms] refreshing cache from master, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [29ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [29ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [29ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [29ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [47ms] refreshing cache from master, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [48ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [48ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [48ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [49ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [67ms] refreshing cache from master, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [68ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [68ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [69ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [69ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [87ms] refreshing cache from master, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [88ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [89ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [89ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [89ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [167ms] refreshing cache from master, [167ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [167ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [168ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [168ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [168ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [169ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [307ms] refreshing cache from master, [307ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [307ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [308ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [308ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [308ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [308ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [308ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [387ms] refreshing cache from master, [387ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [388ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [388ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [389ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [389ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [389ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [389ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [427ms] refreshing cache from master, [428ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [428ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [428ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [429ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [429ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [429ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [429ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1068ms] refreshing cache from master, [1068ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1069ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [1069ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [1069ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [1069ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1069ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1070ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [2629ms] refreshing cache from master, [2629ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [2630ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [2630ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [2631ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [2631ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [2632ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [2632ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [3007ms] refreshing cache from master, [3008ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [3009ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [3009ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [3010ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [3011ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [3011ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [3011ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [3187ms] refreshing cache from master, [3187ms] too many traces: truncated at 100 traces, deferred=Deferred@1401927713(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$232/0x00007f7544330000@7bb6a77a -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2075085686 after retry RPC after error@386261282) -> (continuation of Deferred@971312467 after retry RPC after error@1999040610) -> (continuation of Deferred@1993601291 after retry RPC after error@1315373570) -> (continuation of Deferred@1610154248 after retry RPC after error@521953141) -> (continuation of Deferred@1991163444 after retry RPC after error@3134961) -> (continuation of Deferred@399078845 after retry RPC after error@1783855046) -> (continuation of Deferred@1762601894 after retry RPC after error@393341739) -> (continuation of Deferred@1271468261 after retry RPC after error@978690845) -> (continuation of Deferred@714604010 after retry RPC after error@841442080) -> (continuation of Deferred@837419961 after retry RPC after error@649069522) -> (continuation of Deferred@861786691 after retry RPC after error@988453227) -> (continuation of Deferred@1534894660 after retry RPC after error@2104792170) -> (continuation of Deferred@551980621 after retry RPC after error@1319729915) -> (continuation of Deferred@1887014888 after retry RPC after error@704090697) -> (continuation of Deferred@1039656412 after retry RPC after error@940322363) -> (continuation of Deferred@79093789 after retry RPC after error@289820440) -> (continuation of Deferred@329093609 after retry RPC after error@1253644375) -> (continuation of Deferred@2034020117 after retry RPC after error@1512116645) -> (continuation of Deferred@634180049 after retry RPC after error@657792671) -> (continuation of Deferred@1005410667 after retry RPC after error@1762909066) -> (continuation of Deferred@714267936 after retry RPC after error@635240203) -> (continuation of Deferred@1949027546 after retry RPC after error@59999838), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2075085686 after retry RPC after error@386261282) -> (continuation of Deferred@971312467 after retry RPC after error@1999040610) -> (continuation of Deferred@1993601291 after retry RPC after error@1315373570) -> (continuation of Deferred@1610154248 after retry RPC after error@521953141) -> (continuation of Deferred@1991163444 after retry RPC after error@3134961) -> (continuation of Deferred@399078845 after retry RPC after error@1783855046) -> (continuation of Deferred@1762601894 after retry RPC after error@393341739) -> (continuation of Deferred@1271468261 after retry RPC after error@978690845) -> (continuation of Deferred@714604010 after retry RPC after error@841442080) -> (continuation of Deferred@837419961 after retry RPC after error@649069522) -> (continuation of Deferred@861786691 after retry RPC after error@988453227) -> (continuation of Deferred@1534894660 after retry RPC after error@2104792170) -> (continuation of Deferred@551980621 after retry RPC after error@1319729915) -> (continuation of Deferred@1887014888 after retry RPC after error@704090697) -> (continuation of Deferred@1039656412 after retry RPC after error@940322363) -> (continuation of Deferred@79093789 after retry RPC after error@289820440) -> (continuation of Deferred@329093609 after retry RPC after error@1253644375) -> (continuation of Deferred@2034020117 after retry RPC after error@1512116645) -> (continuation of Deferred@634180049 after retry RPC after error@657792671) -> (continuation of Deferred@1005410667 after retry RPC after error@1762909066) -> (continuation of Deferred@714267936 after retry RPC after error@635240203) -> (continuation of Deferred@1949027546 after retry RPC after error@59999838)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.31.46.252:40541
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:27.654 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.655 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.655 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 69 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091707649 for job da74ffd3de6ba1563e412fcb34de5c51.
08:08:27.666 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.666 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.667 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.667 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.668 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.668 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.668 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:27.672 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=27011), Traces: [0ms] sending RPC to server master-127.31.46.252:40541, [2ms] received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [7ms] refreshing cache from master, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [9ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [9ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [10ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [10ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [27ms] refreshing cache from master, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [29ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [29ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [29ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [29ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [47ms] refreshing cache from master, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [48ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [48ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [48ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [49ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [67ms] refreshing cache from master, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [68ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [68ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [69ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [69ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [87ms] refreshing cache from master, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [88ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [89ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [89ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [89ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [167ms] refreshing cache from master, [167ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [167ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [168ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [168ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [168ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [169ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [307ms] refreshing cache from master, [307ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [307ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [308ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [308ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [308ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [308ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [308ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [387ms] refreshing cache from master, [387ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [388ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [388ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [389ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [389ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [389ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [389ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [427ms] refreshing cache from master, [428ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [428ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [428ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [429ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [429ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [429ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [429ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1068ms] refreshing cache from master, [1068ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1069ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [1069ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [1069ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [1069ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1069ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1070ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [2629ms] refreshing cache from master, [2629ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [2630ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [2630ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [2631ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [2631ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [2632ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [2632ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [3007ms] refreshing cache from master, [3008ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [3009ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [3009ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [3010ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [3011ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [3011ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [3011ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [3187ms] refreshing cache from master, [3187ms] too many traces: truncated at 100 traces, deferred=Deferred@1401927713(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$232/0x00007f7544330000@7bb6a77a -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2075085686 after retry RPC after error@386261282) -> (continuation of Deferred@971312467 after retry RPC after error@1999040610) -> (continuation of Deferred@1993601291 after retry RPC after error@1315373570) -> (continuation of Deferred@1610154248 after retry RPC after error@521953141) -> (continuation of Deferred@1991163444 after retry RPC after error@3134961) -> (continuation of Deferred@399078845 after retry RPC after error@1783855046) -> (continuation of Deferred@1762601894 after retry RPC after error@393341739) -> (continuation of Deferred@1271468261 after retry RPC after error@978690845) -> (continuation of Deferred@714604010 after retry RPC after error@841442080) -> (continuation of Deferred@837419961 after retry RPC after error@649069522) -> (continuation of Deferred@861786691 after retry RPC after error@988453227) -> (continuation of Deferred@1534894660 after retry RPC after error@2104792170) -> (continuation of Deferred@551980621 after retry RPC after error@1319729915) -> (continuation of Deferred@1887014888 after retry RPC after error@704090697) -> (continuation of Deferred@1039656412 after retry RPC after error@940322363) -> (continuation of Deferred@79093789 after retry RPC after error@289820440) -> (continuation of Deferred@329093609 after retry RPC after error@1253644375) -> (continuation of Deferred@2034020117 after retry RPC after error@1512116645) -> (continuation of Deferred@634180049 after retry RPC after error@657792671) -> (continuation of Deferred@1005410667 after retry RPC after error@1762909066) -> (continuation of Deferred@714267936 after retry RPC after error@635240203) -> (continuation of Deferred@1949027546 after retry RPC after error@59999838), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2075085686 after retry RPC after error@386261282) -> (continuation of Deferred@971312467 after retry RPC after error@1999040610) -> (continuation of Deferred@1993601291 after retry RPC after error@1315373570) -> (continuation of Deferred@1610154248 after retry RPC after error@521953141) -> (continuation of Deferred@1991163444 after retry RPC after error@3134961) -> (continuation of Deferred@399078845 after retry RPC after error@1783855046) -> (continuation of Deferred@1762601894 after retry RPC after error@393341739) -> (continuation of Deferred@1271468261 after retry RPC after error@978690845) -> (continuation of Deferred@714604010 after retry RPC after error@841442080) -> (continuation of Deferred@837419961 after retry RPC after error@649069522) -> (continuation of Deferred@861786691 after retry RPC after error@988453227) -> (continuation of Deferred@1534894660 after retry RPC after error@2104792170) -> (continuation of Deferred@551980621 after retry RPC after error@1319729915) -> (continuation of Deferred@1887014888 after retry RPC after error@704090697) -> (continuation of Deferred@1039656412 after retry RPC after error@940322363) -> (continuation of Deferred@79093789 after retry RPC after error@289820440) -> (continuation of Deferred@329093609 after retry RPC after error@1253644375) -> (continuation of Deferred@2034020117 after retry RPC after error@1512116645) -> (continuation of Deferred@634180049 after retry RPC after error@657792671) -> (continuation of Deferred@1005410667 after retry RPC after error@1762909066) -> (continuation of Deferred@714267936 after retry RPC after error@635240203) -> (continuation of Deferred@1949027546 after retry RPC after error@59999838)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=27011), Traces: [0ms] sending RPC to server master-127.31.46.252:40541, [2ms] received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [7ms] refreshing cache from master, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [9ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [9ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [10ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [10ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [27ms] refreshing cache from master, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [29ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [29ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [29ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [29ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [47ms] refreshing cache from master, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [48ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [48ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [48ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [49ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [67ms] refreshing cache from master, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [68ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [68ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [69ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [69ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [87ms] refreshing cache from master, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [88ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [89ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [89ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [89ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [167ms] refreshing cache from master, [167ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [167ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [168ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [168ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [168ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [169ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [307ms] refreshing cache from master, [307ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [307ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [308ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [308ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [308ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [308ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [308ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [387ms] refreshing cache from master, [387ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [388ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [388ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [389ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [389ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [389ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [389ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [427ms] refreshing cache from master, [428ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [428ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [428ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [429ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [429ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [429ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [429ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1068ms] refreshing cache from master, [1068ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1069ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [1069ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [1069ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [1069ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1069ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1070ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [2629ms] refreshing cache from master, [2629ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [2630ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [2630ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [2631ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [2631ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [2632ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [2632ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [3007ms] refreshing cache from master, [3008ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [3009ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [3009ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [3010ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [3011ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [3011ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [3011ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [3187ms] refreshing cache from master, [3187ms] too many traces: truncated at 100 traces, deferred=Deferred@1401927713(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$232/0x00007f7544330000@7bb6a77a -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2075085686 after retry RPC after error@386261282) -> (continuation of Deferred@971312467 after retry RPC after error@1999040610) -> (continuation of Deferred@1993601291 after retry RPC after error@1315373570) -> (continuation of Deferred@1610154248 after retry RPC after error@521953141) -> (continuation of Deferred@1991163444 after retry RPC after error@3134961) -> (continuation of Deferred@399078845 after retry RPC after error@1783855046) -> (continuation of Deferred@1762601894 after retry RPC after error@393341739) -> (continuation of Deferred@1271468261 after retry RPC after error@978690845) -> (continuation of Deferred@714604010 after retry RPC after error@841442080) -> (continuation of Deferred@837419961 after retry RPC after error@649069522) -> (continuation of Deferred@861786691 after retry RPC after error@988453227) -> (continuation of Deferred@1534894660 after retry RPC after error@2104792170) -> (continuation of Deferred@551980621 after retry RPC after error@1319729915) -> (continuation of Deferred@1887014888 after retry RPC after error@704090697) -> (continuation of Deferred@1039656412 after retry RPC after error@940322363) -> (continuation of Deferred@79093789 after retry RPC after error@289820440) -> (continuation of Deferred@329093609 after retry RPC after error@1253644375) -> (continuation of Deferred@2034020117 after retry RPC after error@1512116645) -> (continuation of Deferred@634180049 after retry RPC after error@657792671) -> (continuation of Deferred@1005410667 after retry RPC after error@1762909066) -> (continuation of Deferred@714267936 after retry RPC after error@635240203) -> (continuation of Deferred@1949027546 after retry RPC after error@59999838), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2075085686 after retry RPC after error@386261282) -> (continuation of Deferred@971312467 after retry RPC after error@1999040610) -> (continuation of Deferred@1993601291 after retry RPC after error@1315373570) -> (continuation of Deferred@1610154248 after retry RPC after error@521953141) -> (continuation of Deferred@1991163444 after retry RPC after error@3134961) -> (continuation of Deferred@399078845 after retry RPC after error@1783855046) -> (continuation of Deferred@1762601894 after retry RPC after error@393341739) -> (continuation of Deferred@1271468261 after retry RPC after error@978690845) -> (continuation of Deferred@714604010 after retry RPC after error@841442080) -> (continuation of Deferred@837419961 after retry RPC after error@649069522) -> (continuation of Deferred@861786691 after retry RPC after error@988453227) -> (continuation of Deferred@1534894660 after retry RPC after error@2104792170) -> (continuation of Deferred@551980621 after retry RPC after error@1319729915) -> (continuation of Deferred@1887014888 after retry RPC after error@704090697) -> (continuation of Deferred@1039656412 after retry RPC after error@940322363) -> (continuation of Deferred@79093789 after retry RPC after error@289820440) -> (continuation of Deferred@329093609 after retry RPC after error@1253644375) -> (continuation of Deferred@2034020117 after retry RPC after error@1512116645) -> (continuation of Deferred@634180049 after retry RPC after error@657792671) -> (continuation of Deferred@1005410667 after retry RPC after error@1762909066) -> (continuation of Deferred@714267936 after retry RPC after error@635240203) -> (continuation of Deferred@1949027546 after retry RPC after error@59999838)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.31.46.252:40541
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:27.679 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:27.680 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:27.680 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.684 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.684 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.684 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
08:08:27.684 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:27.685 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (da74ffd3de6ba1563e412fcb34de5c51) switched from state RUNNING to RESTARTING.
08:08:27.685 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.685 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.685 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.685 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.686 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.686 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.686 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:27.698 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:27.698 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:27.699 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:27.699 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:27.699 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:27.699 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:27.699 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:27.699 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:27.699 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:27.700 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:27.700 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:27.700 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:27.700 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.700 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.700 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:27.701 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:27.701 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.701 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:27.701 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:27.701 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.701 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.701 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.702 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.702 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.702 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.702 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:27.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:27.710557  2592 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.90.188:42457: Network error: Client connection negotiation failed: client connection to 127.2.90.188:42457: connect: Connection refused (error 111)
08:08:27.713 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:27.713 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:27.713 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:27.713 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:27.713 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:27.714 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:27.714 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:27.714 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:27.714 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:27.713 [WARN - flink-pekko.actor.default-dispatcher-9] (CheckpointFailureManager.java:114) Failed to trigger or complete checkpoint 69 for job da74ffd3de6ba1563e412fcb34de5c51. (0 consecutive failed attempts so far)
org.apache.flink.runtime.checkpoint.CheckpointException: Checkpoint Coordinator is suspending.
	at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.stopCheckpointScheduler(CheckpointCoordinator.java:2056)
	at org.apache.flink.runtime.checkpoint.CheckpointCoordinatorDeActivator.jobStatusChanges(CheckpointCoordinatorDeActivator.java:46)
	at org.apache.flink.runtime.executiongraph.DefaultExecutionGraph.notifyJobStatusChange(DefaultExecutionGraph.java:1580)
	at org.apache.flink.runtime.executiongraph.DefaultExecutionGraph.transitionState(DefaultExecutionGraph.java:1146)
	at org.apache.flink.runtime.executiongraph.DefaultExecutionGraph.transitionState(DefaultExecutionGraph.java:1118)
	at org.apache.flink.runtime.scheduler.SchedulerBase.transitionExecutionGraphState(SchedulerBase.java:600)
	at org.apache.flink.runtime.scheduler.DefaultScheduler.addVerticesToRestartPending(DefaultScheduler.java:382)
	at org.apache.flink.runtime.scheduler.DefaultScheduler.restartTasksWithDelay(DefaultScheduler.java:358)
	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeRestartTasks(DefaultScheduler.java:326)
	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleGlobalFailure(DefaultScheduler.java:321)
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.lambda$failJob$0(OperatorCoordinatorHolder.java:669)
	at org.apache.flink.runtime.rpc.pekko.PekkoRpcActor.lambda$handleRunAsync$4(PekkoRpcActor.java:451)
	at org.apache.flink.runtime.concurrent.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68)
	at org.apache.flink.runtime.rpc.pekko.PekkoRpcActor.handleRunAsync(PekkoRpcActor.java:451)
	at org.apache.flink.runtime.rpc.pekko.PekkoRpcActor.handleRpcMessage(PekkoRpcActor.java:218)
	at org.apache.flink.runtime.rpc.pekko.FencedPekkoRpcActor.handleRpcMessage(FencedPekkoRpcActor.java:85)
	at org.apache.flink.runtime.rpc.pekko.PekkoRpcActor.handleMessage(PekkoRpcActor.java:168)
	at org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33)
	at org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29)
	at scala.PartialFunction.applyOrElse(PartialFunction.scala:127)
	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:126)
	at org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29)
	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:175)
	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:176)
	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:176)
	at org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547)
	at org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545)
	at org.apache.pekko.actor.AbstractActor.aroundReceive(AbstractActor.scala:229)
	at org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590)
	at org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557)
	at org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:272)
	at org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:233)
	at org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:245)
	at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373)
	at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182)
	at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655)
	at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622)
	at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165)
08:08:27.715 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:27.716 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:27.716 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:27.716 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:27.720 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:27.720 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:27.720 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:27.721 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.721 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.721 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.722 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.722 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.722 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.723 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.723 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.723 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.723 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:27.740 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:27.740 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:27.740 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:27.741 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.741 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.741 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.741 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.741 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.741 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.742 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.742 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.742 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.742 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:27.745 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:27.746 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
08:08:27.746 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:27.746 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:27.746 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:27.747 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#0) of source Source: KuduSource.
08:08:27.748 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
08:08:27.748 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#0) of source Source: KuduSource.
08:08:27.748 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:27.749 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:27.750 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:27.750 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:27.750 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:27.751 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:27.751 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
08:08:27.751 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:27.751 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:27.751 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:27.751 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
08:08:27.753 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
08:08:27.753 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
08:08:27.753 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
08:08:27.753 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
08:08:27.753 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
08:08:27.760 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:27.760 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:27.760 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:27.761 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.761 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.761 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.761 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.761 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.761 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.761 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.762 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.762 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.762 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:27.767 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:426) Marking checkpoint 69 as aborted for source Source: KuduSource.
08:08:27.770 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.31.233.252:36101(127.31.233.252:36101)] disconnecting while in state TERMINATED
08:08:27.770 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.31.233.254:35197(127.31.233.254:35197)] disconnecting while in state TERMINATED
08:08:27.770 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.31.233.253:33393(127.31.233.253:33393)] disconnecting while in state TERMINATED
08:08:27.771 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:27.772 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:08:27.772 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-2
08:08:27.795 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
08:08:27.795 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
08:08:27.795 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
08:08:27.802 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.31.233.252:36101(127.31.233.252:36101)] disconnecting while in state TERMINATED
08:08:27.802 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.31.233.254:35197(127.31.233.254:35197)] disconnecting while in state TERMINATED
08:08:27.802 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.31.233.253:33393(127.31.233.253:33393)] disconnecting while in state TERMINATED
08:08:27.802 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:27.803 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
08:08:27.804 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-2
08:08:27.804 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
08:08:27.804 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
08:08:27.804 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
08:08:27.807 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.31.233.252:36101(127.31.233.252:36101)] disconnecting while in state TERMINATED
08:08:27.807 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer ff0efe9052574a8fb425700eee4efb00(127.31.233.195:40161)] disconnecting while in state TERMINATED
08:08:27.807 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.31.233.254:35197(127.31.233.254:35197)] disconnecting while in state TERMINATED
08:08:27.807 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.31.233.253:33393(127.31.233.253:33393)] disconnecting while in state TERMINATED
08:08:27.808 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:27.809 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-3
08:08:27.810 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:08:27.811 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-2
08:08:27.820 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:27.820 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:27.820 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:27.821 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.821 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.821 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.821 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.822 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.822 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.822 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.822 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.822 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.822 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:27.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:27.844 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
08:08:27.844 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
08:08:27.845 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
08:08:27.845 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
08:08:27.856 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
08:08:27.856 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
08:08:27.857 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
08:08:27.857 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
08:08:27.859 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-1
08:08:27.859 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
08:08:27.860 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
08:08:27.860 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
08:08:27.861 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
08:08:27.861 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
08:08:27.861 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
08:08:27.868 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.31.233.252:36101(127.31.233.252:36101)] disconnecting while in state TERMINATED
08:08:27.869 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.31.233.254:35197(127.31.233.254:35197)] disconnecting while in state TERMINATED
08:08:27.869 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.31.233.253:33393(127.31.233.253:33393)] disconnecting while in state TERMINATED
08:08:27.869 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:27.871 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:08:27.872 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-2
08:08:27.881 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#0 baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
08:08:27.882 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
08:08:27.882 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#0 baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_0.
08:08:27.883 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
08:08:27.887 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job da74ffd3de6ba1563e412fcb34de5c51: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:08:27.888 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
08:08:27.889 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job da74ffd3de6ba1563e412fcb34de5c51: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:08:27.891 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
08:08:27.898 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job da74ffd3de6ba1563e412fcb34de5c51: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:08:27.899 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:27.899 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:27.899 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:27.900 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.900 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.900 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.900 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.901 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.901 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.901 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.901 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.901 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.901 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:27.907 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
08:08:27.908 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
08:08:27.912 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
08:08:27.912 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
08:08:27.913 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
08:08:27.915 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
08:08:27.916 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:318) Clearing resource requirements of job da74ffd3de6ba1563e412fcb34de5c51
08:08:27.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:27.959 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:27.960 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:27.960 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:27.961 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.961 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.961 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:27.962 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.962 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.962 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:27.963 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.963 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.963 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:27.963 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:28.000 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:28.000 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:28.000 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:28.001 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:28.001 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:28.001 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:28.001 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:28.001 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:28.001 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:28.001 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:28.001 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:28.001 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:28.001 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:28.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.031844  2513 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } attempt: 8
08:08:28.058 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:28.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.082346  2513 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } has no permanent_uuid. Determining permanent_uuid...
08:08:28.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:28.092554  2513 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.90.188:42457: Network error: Client connection negotiation failed: client connection to 127.2.90.188:42457: connect: Connection refused (error 111)
08:08:28.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.165233  2513 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } attempt: 1
08:08:28.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:28.176187  2513 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.90.188:42457: Network error: Client connection negotiation failed: client connection to 127.2.90.188:42457: connect: Connection refused (error 111)
08:08:28.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.229712  2513 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } attempt: 2
08:08:28.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:28.249497  2513 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.90.188:42457: Network error: Client connection negotiation failed: client connection to 127.2.90.188:42457: connect: Connection refused (error 111)
08:08:28.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.326025  2513 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } attempt: 3
08:08:28.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:28.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:28.334389  2513 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.90.188:42457: Network error: Client connection negotiation failed: client connection to 127.2.90.188:42457: connect: Connection refused (error 111)
08:08:28.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:28.249687  2603 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 2594
08:08:28.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:28.407516  2594 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.563s	user 0.535s	sys 1.015s
08:08:28.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:28.407898  2594 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.563s	user 0.535s	sys 1.015s
08:08:28.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:26.847581  2605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:28.409 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:28.409 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:28.409 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:28.410 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:28.410 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:28.410 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:28.410 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:28.410 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:28.410 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:28.411 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:28.411 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:28.411 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:28.411 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:28.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:28.421021  2637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:28.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.421111  2594 server_base.cc:1061] running on GCE node
08:08:28.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.422580  2594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:08:28.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.425594  2594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:08:28.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.427045  2594 hybrid_clock.cc:648] HybridClock initialized: now 1779091708426986 us; error 44 us; skew 500 ppm
08:08:28.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.428107  2594 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:08:28.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.435467  2594 webserver.cc:533] Webserver started at http://127.2.90.188:37531/ using document root <none> and password file <none>
08:08:28.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.436522  2594 fs_manager.cc:362] Metadata directory not provided
08:08:28.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.436779  2594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:08:28.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.437505  2594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:08:28.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.443528  2594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-2/data/instance:
08:08:28.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f53cc5e7046643509bdbfd90a8351029"
08:08:28.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:28 on dist-test-slave-1jss"
08:08:28.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.444962  2594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-2/wal/instance:
08:08:28.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f53cc5e7046643509bdbfd90a8351029"
08:08:28.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:28 on dist-test-slave-1jss"
08:08:28.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:28.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.454342  2594 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.010s	sys 0.002s
08:08:28.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.462576  2643 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:08:28.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.464031  2594 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.002s
08:08:28.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.464423  2594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-2/wal
08:08:28.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f53cc5e7046643509bdbfd90a8351029"
08:08:28.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:28 on dist-test-slave-1jss"
08:08:28.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.464890  2594 fs_report.cc:389] FS layout report
08:08:28.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:08:28.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-2/wal
08:08:28.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-2/wal
08:08:28.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-2/data/data
08:08:28.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:08:28.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:08:28.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:08:28.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:08:28.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:08:28.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:08:28.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:08:28.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:08:28.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:08:28.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:08:28.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:08:28.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.489923  2513 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } attempt: 4
08:08:28.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:28.494663  2513 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.90.188:42457: Network error: Client connection negotiation failed: client connection to 127.2.90.188:42457: connect: Connection refused (error 111)
08:08:28.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.536631  2594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:08:28.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.538682  2594 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:08:28.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.539134  2594 kserver.cc:163] Server-wide thread pool size limit: 3276
08:08:28.558 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:28.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.631130  2594 rpc_server.cc:307] RPC server started. Bound to: 127.2.90.188:42457
08:08:28.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.631313  2694 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.90.188:42457 every 8 connection(s)
08:08:28.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.634828  2594 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-2/data/info.pb
08:08:28.638 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:28.638 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:28.639 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:28.639 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:28.639 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:28.639 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:28.639 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:28.639 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:28.639 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:28.639 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:28.639 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:28.639 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:28.639 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:28.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.642292  2410 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 2594
08:08:28.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.642819  2410 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/master-2/wal/instance
08:08:28.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.642978  2695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:28.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.662500  2695 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.90.190" port: 42265 } has no permanent_uuid. Determining permanent_uuid...
08:08:28.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.697240  2695 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } has no permanent_uuid. Determining permanent_uuid...
08:08:28.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.710175  2695 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } has no permanent_uuid. Determining permanent_uuid...
08:08:28.719 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:28.720 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:28.720 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:28.720 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:28.720 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:28.720 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:28.720 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:28.720 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:28.720 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:28.721 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:28.721 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:28.721 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:28.721 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:28.723 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:28.723 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:28.724 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:28.724 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:28.724 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:28.724 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:28.724 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:28.724 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:28.724 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:28.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.731818  2695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029: Bootstrap starting.
08:08:28.732 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:28.732 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:28.732 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:28.732 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:28.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.744127  2695 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029: Neither blocks nor log segments found. Creating new log.
08:08:28.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.746562  2695 log.cc:826] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029: Log is configured to *not* fsync() on all Append() calls
08:08:28.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.752998  2695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029: No bootstrap required, opened a new log
08:08:28.757 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (da74ffd3de6ba1563e412fcb34de5c51) switched from state RESTARTING to RUNNING.
08:08:28.758 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:28.758 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job da74ffd3de6ba1563e412fcb34de5c51 from Checkpoint 68 @ 1779091707149 for da74ffd3de6ba1563e412fcb34de5c51 located at file:/tmp/junit5660276855152915670/checkpoints/da74ffd3de6ba1563e412fcb34de5c51/chk-68.
08:08:28.758 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:28.758 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:28.758 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:28.759 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:28.759 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:28.759 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
08:08:28.759 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:28.759 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:28.759 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:28.759 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:28.759 [INFO - flink-pekko.actor.default-dispatcher-8] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
08:08:28.759 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:28.759 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:28.759 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:28.760 [INFO - Thread-48] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
08:08:28.760 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to SCHEDULED.
08:08:28.760 [DEBUG - Thread-48] (Connection.java:575) [peer master-127.31.46.252:40541(127.31.46.252:40541)] disconnecting while in state TERMINATED
08:08:28.760 [DEBUG - Thread-48] (Connection.java:575) [peer master-127.31.46.253:46697(127.31.46.253:46697)] disconnecting while in state TERMINATED
08:08:28.760 [DEBUG - Thread-48] (Connection.java:575) [peer master-127.31.46.254:45015(127.31.46.254:45015)] disconnecting while in state TERMINATED
08:08:28.760 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:28.761 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:08:28.761 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-2
08:08:28.762 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
08:08:28.763 [INFO - Thread-48] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
08:08:28.763 [INFO - Thread-48] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
08:08:28.763 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job da74ffd3de6ba1563e412fcb34de5c51: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:08:28.764 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING.
08:08:28.764 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #1) with attempt id baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to c1befdc5-4ac6-48c0-985f-201fc5cdc5a6 @ 127.0.0.1 (dataPort=-1) with allocation id 9b941a5fbbbdb04dacdc14d5e09c626f
08:08:28.764 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
08:08:28.765 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 9b941a5fbbbdb04dacdc14d5e09c626f.
08:08:28.765 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job da74ffd3de6ba1563e412fcb34de5c51: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:08:28.765 [DEBUG - Thread-48] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:28.765 [INFO - Thread-48] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
08:08:28.766 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id 9b941a5fbbbdb04dacdc14d5e09c626f.
08:08:28.767 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
08:08:28.767 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to c1befdc5-4ac6-48c0-985f-201fc5cdc5a6 @ 127.0.0.1 (dataPort=-1) with allocation id a7a5d41ebc10c1cb065f8992e3a1fcb8
08:08:28.767 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to SCHEDULED.
08:08:28.768 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job da74ffd3de6ba1563e412fcb34de5c51: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:08:28.768 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from SCHEDULED to DEPLOYING.
08:08:28.768 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #1) with attempt id baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to c1befdc5-4ac6-48c0-985f-201fc5cdc5a6 @ 127.0.0.1 (dataPort=-1) with allocation id fc644b3daf65704dd575ddb1e126a17f
08:08:28.768 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to SCHEDULED.
08:08:28.769 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job da74ffd3de6ba1563e412fcb34de5c51: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:08:28.769 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from SCHEDULED to DEPLOYING.
08:08:28.770 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #1) with attempt id baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to c1befdc5-4ac6-48c0-985f-201fc5cdc5a6 @ 127.0.0.1 (dataPort=-1) with allocation id e0ded49cc18cf9d68a3f4d967ddb5165
08:08:28.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.771353  2592 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } attempt: 7
08:08:28.772 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot a7a5d41ebc10c1cb065f8992e3a1fcb8.
08:08:28.774 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id a7a5d41ebc10c1cb065f8992e3a1fcb8.
08:08:28.774 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
08:08:28.774 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
08:08:28.775 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@b0b800d
08:08:28.775 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:28.776 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5660276855152915670/checkpoints")
08:08:28.777 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
08:08:28.777 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
08:08:28.781 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@58190741
08:08:28.783 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:28.780 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:08:28.785 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:08:28.785 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:08:28.785 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:08:28.786 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot fc644b3daf65704dd575ddb1e126a17f.
08:08:28.787 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_1), deploy into slot with allocation id fc644b3daf65704dd575ddb1e126a17f.
08:08:28.787 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
08:08:28.788 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
08:08:28.788 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:28.788 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@326e71ed
08:08:28.788 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:28.789 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5660276855152915670/checkpoints")
08:08:28.789 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
08:08:28.789 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
08:08:28.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.791088  2513 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } attempt: 5
08:08:28.808 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6f893746
08:08:28.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.812847  2592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49bfb1f1e5e040d0869d8e6fdab4c9bb: Bootstrap starting.
08:08:28.815 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:28.816 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot e0ded49cc18cf9d68a3f4d967ddb5165.
08:08:28.817 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_1), deploy into slot with allocation id e0ded49cc18cf9d68a3f4d967ddb5165.
08:08:28.818 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to DEPLOYING.
08:08:28.818 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_1) [DEPLOYING].
08:08:28.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.817847  2695 raft_consensus.cc:359] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c639184e474686ba6ce9a8bd838d4c" member_type: VOTER last_known_addr { host: "127.2.90.190" port: 42265 } } peers { permanent_uuid: "49bfb1f1e5e040d0869d8e6fdab4c9bb" member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } } peers { permanent_uuid: "f53cc5e7046643509bdbfd90a8351029" member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } }
08:08:28.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.818843  2695 raft_consensus.cc:385] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:28.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.819146  2695 raft_consensus.cc:740] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f53cc5e7046643509bdbfd90a8351029, State: Initialized, Role: FOLLOWER
08:08:28.820 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@37620b0e
08:08:28.820 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:28.820 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5660276855152915670/checkpoints")
08:08:28.820 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
08:08:28.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.820166  2695 consensus_queue.cc:260] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c639184e474686ba6ce9a8bd838d4c" member_type: VOTER last_known_addr { host: "127.2.90.190" port: 42265 } } peers { permanent_uuid: "49bfb1f1e5e040d0869d8e6fdab4c9bb" member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } } peers { permanent_uuid: "f53cc5e7046643509bdbfd90a8351029" member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } }
08:08:28.823 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:28.824 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
08:08:28.824 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.824 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.824 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.825342  2592 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 49bfb1f1e5e040d0869d8e6fdab4c9bb: Neither blocks nor log segments found. Creating new log.
08:08:28.828 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:28.829 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1ebaebf8
08:08:28.829 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.829 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.830 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.830634  2592 log.cc:826] T 00000000000000000000000000000000 P 49bfb1f1e5e040d0869d8e6fdab4c9bb: Log is configured to *not* fsync() on all Append() calls
08:08:28.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:28.832 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:28.832 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:28.833 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:28.833 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:28.833 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:28.833 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:28.834 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:28.834 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:28.834 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:28.834 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:28.834 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:28.835 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:28.835 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:28.835 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:28.837 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:28.838 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to DEPLOYING.
08:08:28.838 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_1) [DEPLOYING].
08:08:28.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.839051  2513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8c639184e474686ba6ce9a8bd838d4c: Bootstrap starting.
08:08:28.839 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:28.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.842835  2592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49bfb1f1e5e040d0869d8e6fdab4c9bb: No bootstrap required, opened a new log
08:08:28.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.842752  2714 sys_catalog.cc:455] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c639184e474686ba6ce9a8bd838d4c" member_type: VOTER last_known_addr { host: "127.2.90.190" port: 42265 } } peers { permanent_uuid: "49bfb1f1e5e040d0869d8e6fdab4c9bb" member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } } peers { permanent_uuid: "f53cc5e7046643509bdbfd90a8351029" member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } } }
08:08:28.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.843786  2714 sys_catalog.cc:458] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [sys.catalog]: This master's current role is: FOLLOWER
08:08:28.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.847576  2695 sys_catalog.cc:565] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [sys.catalog]: configured and running, proceeding with master startup.
08:08:28.850 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5980f800
08:08:28.850 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:28.851 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5660276855152915670/checkpoints")
08:08:28.851 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
08:08:28.851 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
08:08:28.855 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.856 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.856 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.856 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:28.862 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:28.864 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:28.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.864503  2513 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8c639184e474686ba6ce9a8bd838d4c: Neither blocks nor log segments found. Creating new log.
08:08:28.865 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.865 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.865 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.866 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:28.866 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.867 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.867 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.867 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.867 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.868 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.868 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:28.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.868448  2513 log.cc:826] T 00000000000000000000000000000000 P f8c639184e474686ba6ce9a8bd838d4c: Log is configured to *not* fsync() on all Append() calls
08:08:28.869 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:28.869 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:28.870 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.870 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.870 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.870 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:28.871 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.871 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.871 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.872 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.872 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.872 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.872 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:28.876 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:28.878 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:28.879 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.880 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.880 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.880 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@cd291a2
08:08:28.883 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:28.884 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:28.885 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:28.885 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:28.886 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:28.886 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:28.886 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:28.887 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:28.886 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.887 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.887 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.887 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:28.887 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:28.887 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:28.888 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:28.888 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:28.888 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:28.888 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:28.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.890305  2513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8c639184e474686ba6ce9a8bd838d4c: No bootstrap required, opened a new log
08:08:28.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.896198  2592 raft_consensus.cc:359] T 00000000000000000000000000000000 P 49bfb1f1e5e040d0869d8e6fdab4c9bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c639184e474686ba6ce9a8bd838d4c" member_type: VOTER last_known_addr { host: "127.2.90.190" port: 42265 } } peers { permanent_uuid: "49bfb1f1e5e040d0869d8e6fdab4c9bb" member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } } peers { permanent_uuid: "f53cc5e7046643509bdbfd90a8351029" member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } }
08:08:28.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.898093  2592 raft_consensus.cc:385] T 00000000000000000000000000000000 P 49bfb1f1e5e040d0869d8e6fdab4c9bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:28.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.898592  2592 raft_consensus.cc:740] T 00000000000000000000000000000000 P 49bfb1f1e5e040d0869d8e6fdab4c9bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bfb1f1e5e040d0869d8e6fdab4c9bb, State: Initialized, Role: FOLLOWER
08:08:28.900 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:28.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.899896  2592 consensus_queue.cc:260] T 00000000000000000000000000000000 P 49bfb1f1e5e040d0869d8e6fdab4c9bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c639184e474686ba6ce9a8bd838d4c" member_type: VOTER last_known_addr { host: "127.2.90.190" port: 42265 } } peers { permanent_uuid: "49bfb1f1e5e040d0869d8e6fdab4c9bb" member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } } peers { permanent_uuid: "f53cc5e7046643509bdbfd90a8351029" member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } }
08:08:28.907 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:28.909 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.909 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.909 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.909 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:28.910 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:28.911 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.911 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.911 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.912 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:28.913 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.913 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.913 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.914 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.914 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.914 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.914 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:28.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.915176  2740 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49bfb1f1e5e040d0869d8e6fdab4c9bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c639184e474686ba6ce9a8bd838d4c" member_type: VOTER last_known_addr { host: "127.2.90.190" port: 42265 } } peers { permanent_uuid: "49bfb1f1e5e040d0869d8e6fdab4c9bb" member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } } peers { permanent_uuid: "f53cc5e7046643509bdbfd90a8351029" member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } } }
08:08:28.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.916003  2740 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49bfb1f1e5e040d0869d8e6fdab4c9bb [sys.catalog]: This master's current role is: FOLLOWER
08:08:28.918 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:28.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.917834  2592 sys_catalog.cc:565] T 00000000000000000000000000000000 P 49bfb1f1e5e040d0869d8e6fdab4c9bb [sys.catalog]: configured and running, proceeding with master startup.
08:08:28.919 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:28.920 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.920 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.920 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.926 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:28.927 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.927 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.927 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.928124  2513 raft_consensus.cc:359] T 00000000000000000000000000000000 P f8c639184e474686ba6ce9a8bd838d4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c639184e474686ba6ce9a8bd838d4c" member_type: VOTER last_known_addr { host: "127.2.90.190" port: 42265 } } peers { permanent_uuid: "49bfb1f1e5e040d0869d8e6fdab4c9bb" member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } } peers { permanent_uuid: "f53cc5e7046643509bdbfd90a8351029" member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } }
08:08:28.929 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:28.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.929131  2513 raft_consensus.cc:385] T 00000000000000000000000000000000 P f8c639184e474686ba6ce9a8bd838d4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:28.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.929556  2513 raft_consensus.cc:740] T 00000000000000000000000000000000 P f8c639184e474686ba6ce9a8bd838d4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8c639184e474686ba6ce9a8bd838d4c, State: Initialized, Role: FOLLOWER
08:08:28.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.930887  2513 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8c639184e474686ba6ce9a8bd838d4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c639184e474686ba6ce9a8bd838d4c" member_type: VOTER last_known_addr { host: "127.2.90.190" port: 42265 } } peers { permanent_uuid: "49bfb1f1e5e040d0869d8e6fdab4c9bb" member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } } peers { permanent_uuid: "f53cc5e7046643509bdbfd90a8351029" member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } }
08:08:28.932 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.932 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.932 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.937 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:28.938 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:28.939 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.939 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.939 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.938804  2756 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8c639184e474686ba6ce9a8bd838d4c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c639184e474686ba6ce9a8bd838d4c" member_type: VOTER last_known_addr { host: "127.2.90.190" port: 42265 } } peers { permanent_uuid: "49bfb1f1e5e040d0869d8e6fdab4c9bb" member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } } peers { permanent_uuid: "f53cc5e7046643509bdbfd90a8351029" member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } } }
08:08:28.947 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:28.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:28.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.951656  2513 sys_catalog.cc:565] T 00000000000000000000000000000000 P f8c639184e474686ba6ce9a8bd838d4c [sys.catalog]: configured and running, proceeding with master startup.
08:08:28.955 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:28.956 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.956 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.956 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.957 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.957 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.957 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.957 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:28.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.939955  2756 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8c639184e474686ba6ce9a8bd838d4c [sys.catalog]: This master's current role is: FOLLOWER
08:08:28.963 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:28.969 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:28.969 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:28.969 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:28.970 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.970 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.970 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:28.969939  2546 tablet.cc:2404] T 00000000000000000000000000000000 P 49bfb1f1e5e040d0869d8e6fdab4c9bb: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:08:28.970 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.970 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.970 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.970 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.970 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.971 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.971 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:28.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.962302  2759 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
08:08:28.988 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:28.988 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:28.988 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:28.988 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:28.989 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:28.989 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:28.989 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.989 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.989 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:28.989 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.989 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.990 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:28.990 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.990 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.990 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:28.990 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:28.995 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:28.996 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:28.996 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:28.996 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.002 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.003 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.003 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.003 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.004 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.005 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.005 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.007 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.012 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.012 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.012 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.012 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.011929  2714 raft_consensus.cc:493] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:29.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.012727  2714 raft_consensus.cc:515] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c639184e474686ba6ce9a8bd838d4c" member_type: VOTER last_known_addr { host: "127.2.90.190" port: 42265 } } peers { permanent_uuid: "49bfb1f1e5e040d0869d8e6fdab4c9bb" member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } } peers { permanent_uuid: "f53cc5e7046643509bdbfd90a8351029" member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } }
08:08:29.020 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.020 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.020 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.020 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:29.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.017557  2486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f53cc5e7046643509bdbfd90a8351029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8c639184e474686ba6ce9a8bd838d4c" is_pre_election: true
08:08:29.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.018710  2486 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f8c639184e474686ba6ce9a8bd838d4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f53cc5e7046643509bdbfd90a8351029 in term 0.
08:08:29.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.018822  2567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f53cc5e7046643509bdbfd90a8351029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bfb1f1e5e040d0869d8e6fdab4c9bb" is_pre_election: true
08:08:29.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.019977  2567 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 49bfb1f1e5e040d0869d8e6fdab4c9bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f53cc5e7046643509bdbfd90a8351029 in term 0.
08:08:29.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.020440  2645 leader_election.cc:304] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f53cc5e7046643509bdbfd90a8351029, f8c639184e474686ba6ce9a8bd838d4c; no voters: 
08:08:29.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.021883  2714 leader_election.cc:290] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8c639184e474686ba6ce9a8bd838d4c (127.2.90.190:42265), 49bfb1f1e5e040d0869d8e6fdab4c9bb (127.2.90.189:41065)
08:08:29.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.022498  2714 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:08:29.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.023073  2714 raft_consensus.cc:493] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:08:29.023 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.023581  2714 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [term 0 FOLLOWER]: Advancing to term 1
08:08:29.028 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.029 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.029 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.029 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.029 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.030 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.030 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.030 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.030 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.031 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.031 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.031 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.031 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.031 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.031 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.032 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.032 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.034 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.036 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.036 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.039 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.035815  2714 raft_consensus.cc:515] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c639184e474686ba6ce9a8bd838d4c" member_type: VOTER last_known_addr { host: "127.2.90.190" port: 42265 } } peers { permanent_uuid: "49bfb1f1e5e040d0869d8e6fdab4c9bb" member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } } peers { permanent_uuid: "f53cc5e7046643509bdbfd90a8351029" member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } }
08:08:29.040 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:29.042 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.042 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.042 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.043 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.043 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.043 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.043 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.043 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.044601  2486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f53cc5e7046643509bdbfd90a8351029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8c639184e474686ba6ce9a8bd838d4c"
08:08:29.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.045320  2486 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f8c639184e474686ba6ce9a8bd838d4c [term 0 FOLLOWER]: Advancing to term 1
08:08:29.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.045495  2567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f53cc5e7046643509bdbfd90a8351029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bfb1f1e5e040d0869d8e6fdab4c9bb"
08:08:29.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:29.045786  2649 tablet.cc:2404] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:08:29.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.046306  2567 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 49bfb1f1e5e040d0869d8e6fdab4c9bb [term 0 FOLLOWER]: Advancing to term 1
08:08:29.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.054512  2486 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f8c639184e474686ba6ce9a8bd838d4c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f53cc5e7046643509bdbfd90a8351029 in term 1.
08:08:29.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.056605  2714 leader_election.cc:290] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [CANDIDATE]: Term 1 election: Requested vote from peers f8c639184e474686ba6ce9a8bd838d4c (127.2.90.190:42265), 49bfb1f1e5e040d0869d8e6fdab4c9bb (127.2.90.189:41065)
08:08:29.058 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:29.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.059146  2567 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 49bfb1f1e5e040d0869d8e6fdab4c9bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f53cc5e7046643509bdbfd90a8351029 in term 1.
08:08:29.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.059659  2645 leader_election.cc:304] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f53cc5e7046643509bdbfd90a8351029, f8c639184e474686ba6ce9a8bd838d4c; no voters: 
08:08:29.060 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.060664  2714 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [term 1 FOLLOWER]: Leader election won for term 1
08:08:29.061 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.061316  2714 raft_consensus.cc:697] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [term 1 LEADER]: Becoming Leader. State: Replica: f53cc5e7046643509bdbfd90a8351029, State: Running, Role: LEADER
08:08:29.061 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.061 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.062636  2714 consensus_queue.cc:237] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c639184e474686ba6ce9a8bd838d4c" member_type: VOTER last_known_addr { host: "127.2.90.190" port: 42265 } } peers { permanent_uuid: "49bfb1f1e5e040d0869d8e6fdab4c9bb" member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } } peers { permanent_uuid: "f53cc5e7046643509bdbfd90a8351029" member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } }
08:08:29.066 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.066 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.066 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.066 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.067 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:29.068 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.068 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.068 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.069 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.069 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:29.069 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.070 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.070 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.071 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.071 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.072 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.072 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:29.073 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.074 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.074 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.074 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.075 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.075 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.075 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.075 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.076 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.076 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.077 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.077 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.077 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.077 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.078 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.078 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.078 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.078 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.078 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.078 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.078 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.079 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.079 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.079 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.079 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.080 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.080 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.080 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.080 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:29.081 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:29.081 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:29.081 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.081 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.081 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.081 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.082 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.082 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.082 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.082 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.082 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.082 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:29.095 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.095649  2798 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
08:08:29.097 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.097 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.097 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.098 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.098 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.098 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.098 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.098 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.098 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.099 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.099220  2777 sys_catalog.cc:455] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f53cc5e7046643509bdbfd90a8351029. Latest consensus state: current_term: 1 leader_uuid: "f53cc5e7046643509bdbfd90a8351029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c639184e474686ba6ce9a8bd838d4c" member_type: VOTER last_known_addr { host: "127.2.90.190" port: 42265 } } peers { permanent_uuid: "49bfb1f1e5e040d0869d8e6fdab4c9bb" member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } } peers { permanent_uuid: "f53cc5e7046643509bdbfd90a8351029" member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } } }
08:08:29.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.100395  2777 sys_catalog.cc:458] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [sys.catalog]: This master's current role is: LEADER
08:08:29.101 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:29.101 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:29.102 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:29.102 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.102 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.102 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.102 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.102 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.103 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.103 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.103 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.103 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.103 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.103 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.103 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.103 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:29.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:29.108014  2793 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 49bfb1f1e5e040d0869d8e6fdab4c9bb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:08:29.108 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.108 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.109 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.109 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.109 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.109 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.110 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.110 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.110 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.110 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.110 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.110 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.110 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.109 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.117 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.117 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.117 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.117 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.117 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.118 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.118 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.118 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:29.109674  2467 tablet.cc:2404] T 00000000000000000000000000000000 P f8c639184e474686ba6ce9a8bd838d4c: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:08:29.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:29.108345  2793 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:08:29.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.112598  2799 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
08:08:29.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:28.968393  2594 master_runner.cc:187] Error getting master registration for 127.2.90.190:42265: OK, instance_id { permanent_uuid: "f8c639184e474686ba6ce9a8bd838d4c" instance_seqno: 1779091703427769 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:08:29.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.113893  2594 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:08:29.122 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:29.122 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.122 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.122 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.122 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.128 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.128 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.128 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.129 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.129 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.129 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.129 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.129 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.129 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.130 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.130 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.130 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.130 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.138 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.138 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.138 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.138 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.138 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.139 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.139 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.139 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.139 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.140 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.140 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.140 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.140 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.140 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:29.140 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:29.141 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:29.141 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.141 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.141 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.141 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.141 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.142 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.142 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.142 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.142 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.142 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:29.148 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.148 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.148 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.149 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.149 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.149 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.149 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.149 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.149 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.150 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.150 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.150 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.150 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.162 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.162 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.162 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.162 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.163 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.163 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.163 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.163 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.174474  2799 catalog_manager.cc:1519] Initializing Kudu cluster ID...
08:08:29.178 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.178 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.178 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.179 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.179 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.179 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.179 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.179 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.179 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.179 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.180 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.180 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.180 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.182 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.182 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.183 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.183 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.183 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.183 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.183 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.183 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.183 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.183 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.183 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.183 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.184 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.206 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.207 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.207 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.208 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.208 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.208 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.208 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.209 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.209 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.209 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.209 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.209 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.209 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.210 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.210 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.210 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.211 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.211 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.211 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.211 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.211 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.211 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.212 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.212 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.212 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.212 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.220 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:29.220 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:29.221 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:29.221 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.221 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.221 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.222 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.222 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.222 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.222 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.222 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.222 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.222 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:29.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.227372  2567 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 49bfb1f1e5e040d0869d8e6fdab4c9bb [term 1 FOLLOWER]: Refusing update from remote peer f53cc5e7046643509bdbfd90a8351029: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:08:29.229 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.229 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.229 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.229 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.229 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.230 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.230 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.230 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.230 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.230 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.230 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.230 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.230 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.231457  2777 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bfb1f1e5e040d0869d8e6fdab4c9bb" member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:08:29.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.086205  2515 master_runner.cc:187] Error getting master registration for 127.2.90.190:42265: OK, instance_id { permanent_uuid: "f8c639184e474686ba6ce9a8bd838d4c" instance_seqno: 1779091703427769 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:08:29.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.235852  2515 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:08:29.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.237367  2486 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f8c639184e474686ba6ce9a8bd838d4c [term 1 FOLLOWER]: Refusing update from remote peer f53cc5e7046643509bdbfd90a8351029: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:08:29.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.239276  2777 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8c639184e474686ba6ce9a8bd838d4c" member_type: VOTER last_known_addr { host: "127.2.90.190" port: 42265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:08:29.244 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.245 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.245 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.245 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.246 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.246 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.246 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.246 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.246 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.247 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.247 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.247 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.247 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.258 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.258 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.258 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.259 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.259 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.259 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.259 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.260 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.260 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.260 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.260 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.260 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.260 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.264 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.264 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.265 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.265 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.265 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.266 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.266 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.266 [INFO - pool-352-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.266 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.267 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.267 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.267 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.267 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.268 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.268 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.268 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.268 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.268 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.269 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.269 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.269 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.269 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.270 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.270 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.270 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.270 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.278 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:29.278 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:29.278 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:29.278 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:29.278 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:29.279 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:29.279 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:29.279 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:29.279 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:29.279 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:29.279 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:29.279 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:29.279 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:29.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:29.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.331419  2740 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49bfb1f1e5e040d0869d8e6fdab4c9bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader f53cc5e7046643509bdbfd90a8351029. Latest consensus state: current_term: 1 leader_uuid: "f53cc5e7046643509bdbfd90a8351029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c639184e474686ba6ce9a8bd838d4c" member_type: VOTER last_known_addr { host: "127.2.90.190" port: 42265 } } peers { permanent_uuid: "49bfb1f1e5e040d0869d8e6fdab4c9bb" member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } } peers { permanent_uuid: "f53cc5e7046643509bdbfd90a8351029" member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } } }
08:08:29.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.333295  2740 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49bfb1f1e5e040d0869d8e6fdab4c9bb [sys.catalog]: This master's current role is: FOLLOWER
08:08:29.340 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:29.341 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:29.341 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:29.342 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.342 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.342 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.342 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.343 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.343 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.343 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.343 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.343 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.343 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:29.349 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:29.349 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:29.350 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:29.350 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:29.350 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:29.350 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:29.350 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:29.350 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:29.350 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:29.350 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:29.351 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:29.351 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:29.351 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:29.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.351459  2756 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8c639184e474686ba6ce9a8bd838d4c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f53cc5e7046643509bdbfd90a8351029. Latest consensus state: current_term: 1 leader_uuid: "f53cc5e7046643509bdbfd90a8351029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c639184e474686ba6ce9a8bd838d4c" member_type: VOTER last_known_addr { host: "127.2.90.190" port: 42265 } } peers { permanent_uuid: "49bfb1f1e5e040d0869d8e6fdab4c9bb" member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } } peers { permanent_uuid: "f53cc5e7046643509bdbfd90a8351029" member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } } }
08:08:29.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.352707  2756 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8c639184e474686ba6ce9a8bd838d4c [sys.catalog]: This master's current role is: FOLLOWER
08:08:29.360 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:29.360 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:29.360 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:29.361 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.361 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.361 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.362 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.362 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.362 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.362 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.363 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.363 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.363 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:29.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.369333  2740 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49bfb1f1e5e040d0869d8e6fdab4c9bb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f53cc5e7046643509bdbfd90a8351029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c639184e474686ba6ce9a8bd838d4c" member_type: VOTER last_known_addr { host: "127.2.90.190" port: 42265 } } peers { permanent_uuid: "49bfb1f1e5e040d0869d8e6fdab4c9bb" member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } } peers { permanent_uuid: "f53cc5e7046643509bdbfd90a8351029" member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } } }
08:08:29.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.370450  2740 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49bfb1f1e5e040d0869d8e6fdab4c9bb [sys.catalog]: This master's current role is: FOLLOWER
08:08:29.383 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.384 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.384 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.385 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.385 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.385 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.386 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.386 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.386 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.387 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.387 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.387 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.387 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.390517  2756 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8c639184e474686ba6ce9a8bd838d4c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f53cc5e7046643509bdbfd90a8351029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c639184e474686ba6ce9a8bd838d4c" member_type: VOTER last_known_addr { host: "127.2.90.190" port: 42265 } } peers { permanent_uuid: "49bfb1f1e5e040d0869d8e6fdab4c9bb" member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } } peers { permanent_uuid: "f53cc5e7046643509bdbfd90a8351029" member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } } }
08:08:29.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.391820  2756 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8c639184e474686ba6ce9a8bd838d4c [sys.catalog]: This master's current role is: FOLLOWER
08:08:29.408 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.409 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.409 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.410 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.410 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.410 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.411 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.411 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.411 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.411 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.412 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.412 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.412 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.427 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.428 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.428 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.429 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.429 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.429 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.429 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.430 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.430 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.430 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.428841  2777 sys_catalog.cc:455] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f53cc5e7046643509bdbfd90a8351029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c639184e474686ba6ce9a8bd838d4c" member_type: VOTER last_known_addr { host: "127.2.90.190" port: 42265 } } peers { permanent_uuid: "49bfb1f1e5e040d0869d8e6fdab4c9bb" member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } } peers { permanent_uuid: "f53cc5e7046643509bdbfd90a8351029" member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } } }
08:08:29.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.429667  2777 sys_catalog.cc:458] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [sys.catalog]: This master's current role is: LEADER
08:08:29.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.430389  2777 sys_catalog.cc:455] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f53cc5e7046643509bdbfd90a8351029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8c639184e474686ba6ce9a8bd838d4c" member_type: VOTER last_known_addr { host: "127.2.90.190" port: 42265 } } peers { permanent_uuid: "49bfb1f1e5e040d0869d8e6fdab4c9bb" member_type: VOTER last_known_addr { host: "127.2.90.189" port: 41065 } } peers { permanent_uuid: "f53cc5e7046643509bdbfd90a8351029" member_type: VOTER last_known_addr { host: "127.2.90.188" port: 42457 } } }
08:08:29.431 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.431 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.431 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.431088  2777 sys_catalog.cc:458] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 [sys.catalog]: This master's current role is: LEADER
08:08:29.438 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:29.439 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:29.439 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:29.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.439611  2799 catalog_manager.cc:1382] Generated new cluster ID: fe48ee1290e64b238c3afb118ff6298d
08:08:29.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.439962  2799 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
08:08:29.440 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:29.440 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:29.440 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:29.441 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:29.441 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:29.441 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:29.442 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:29.442 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:29.442 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:29.442 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:29.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:29.463 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.463 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.464 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.464 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.464 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.464 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.465 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.465 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.465 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.465 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.465 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.466 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.466 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.478 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.478 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.478 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.479 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.479 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.479 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.480 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.480 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.480 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.480 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.480 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.480 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.480 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.497897  2799 catalog_manager.cc:1405] Generated new certificate authority record
08:08:29.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.500275  2799 catalog_manager.cc:1539] Loading token signing keys...
08:08:29.504 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:29.504 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:29.505 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:29.505 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:29.505 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:29.505 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:29.505 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:29.505 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:29.505 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:29.505 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:29.505 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:29.506 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:29.506 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:29.523 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:29.524 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:29.524 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:29.525 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:29.525 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:29.525 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:29.525 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:29.525 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:29.525 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:29.525 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:29.526 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:29.525 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:29.526 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:29.548 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:29.549 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:29.549 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:29.550 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:29.550 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:29.550 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:29.550 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:29.550 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:29.550 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:29.551 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:29.551 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:29.551 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:29.551 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:29.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.556119  2799 catalog_manager.cc:6069] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029: Generated new TSK 0
08:08:29.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.557538  2799 catalog_manager.cc:1549] Initializing in-progress tserver states...
08:08:29.562 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:29.568 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.568 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.568 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.569 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.569 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.569 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.569 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.570 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.570 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.570 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.570 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.570 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.570 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.593 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job e26b904229418d0e047d5d94c5b9f905 from Checkpoint 76 @ 1779091546865 for e26b904229418d0e047d5d94c5b9f905 located at file:/tmp/junit16937918701930502306/checkpoints/e26b904229418d0e047d5d94c5b9f905/chk-76.
08:08:29.594 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
08:08:29.594 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 2 to checkpoint 76 for source Source: KuduSource to checkpoint.
08:08:29.594 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from CREATED to SCHEDULED.
08:08:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:29.594672  2410 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:08:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:08:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-0/wal
08:08:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-0/data
08:08:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:08:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:08:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:08:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:29.595 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from SCHEDULED to DEPLOYING.
08:08:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-0/logs
08:08:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-0/data/info.pb
08:08:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:08:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:08:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:08:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:08:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:29.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:08:29.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:08:29.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.90.129:0
08:08:29.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.90.129
08:08:29.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.90.129
08:08:29.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:29.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.90.190:42265,127.2.90.189:41065,127.2.90.188:42457
08:08:29.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.90.148:36029
08:08:29.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:29.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:29.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:08:29.596 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #6) with attempt id 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1) with allocation id 0f1066b174fb1f271b9fbb4939140659
08:08:29.597 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 0f1066b174fb1f271b9fbb4939140659.
08:08:29.598 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:08:29.598 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#6 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_6), deploy into slot with allocation id 0f1066b174fb1f271b9fbb4939140659.
08:08:29.599 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (e26b904229418d0e047d5d94c5b9f905) switched from state RESTARTING to RUNNING.
08:08:29.599 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job e26b904229418d0e047d5d94c5b9f905 from Checkpoint 76 @ 1779091546865 for e26b904229418d0e047d5d94c5b9f905 located at file:/tmp/junit16937918701930502306/checkpoints/e26b904229418d0e047d5d94c5b9f905/chk-76.
08:08:29.600 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
08:08:29.600 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 76 for source Source: KuduSource to checkpoint.
08:08:29.600 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CREATED to SCHEDULED.
08:08:29.602 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#6 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from CREATED to DEPLOYING.
08:08:29.602 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#6 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_6) [DEPLOYING].
08:08:29.603 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:08:29.604 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from SCHEDULED to DEPLOYING.
08:08:29.604 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #6) with attempt id 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1) with allocation id bc35714883422bae5e4de5056d4b8678
08:08:29.605 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot bc35714883422bae5e4de5056d4b8678.
08:08:29.606 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#6 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_6), deploy into slot with allocation id bc35714883422bae5e4de5056d4b8678.
08:08:29.607 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3fd38d20
08:08:29.607 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:29.607 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16937918701930502306/checkpoints")
08:08:29.608 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#6 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from DEPLOYING to INITIALIZING.
08:08:29.609 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from DEPLOYING to INITIALIZING.
08:08:29.611 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@cfdb4cc
08:08:29.619 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:29.620 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:29.620 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CREATED to DEPLOYING.
08:08:29.621 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#6 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_6) [DEPLOYING].
08:08:29.622 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@37a24b0c
08:08:29.622 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:29.623 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16937918701930502306/checkpoints")
08:08:29.623 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from DEPLOYING to INITIALIZING.
08:08:29.623 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from DEPLOYING to INITIALIZING.
08:08:29.639 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@18088f4
08:08:29.641 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:29.645 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:29.657 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.658 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.658 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.658 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:29.658 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.658 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.658 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.659 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.659 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.659 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.659 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.659 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.660 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.660 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.668 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:29.669 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:29.669 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:29.670 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:29.670 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:29.670 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:29.670 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:29.671 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:29.671 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:29.671 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:29.671 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.671 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.671 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.671 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:29.671 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:29.672 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:29.672 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:29.683 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:29.685 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.685 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.685 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.690 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:29.691 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.692 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.692 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.696 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:29.696 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:29.697 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:29.697 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:29.697 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:29.697 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:29.698 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:29.698 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:29.698 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:29.698 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:29.698 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:29.698 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:29.698 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:29.702 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:29.705 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.705 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.705 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.710 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.711 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.711 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.711 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:29.719 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.719 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.719 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.719 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:29.723 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.723 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.723 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.724 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.724 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.724 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.724 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.725 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.725 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.725 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:29.725 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.725 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.725 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.725 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.737 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:29.739 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.739 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.739 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:29.741 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.749 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:29.751 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.751 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.751 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.754 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:29.755 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.755 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.755 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.762 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:29.763 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.763 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.763 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.768 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.768 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.768 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.768 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:29.779 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:29.788 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.788 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.788 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.788 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:29.800 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:29.803 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.803 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.803 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.805 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:29.806 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:29.806 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.807 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.807 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.810 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.810 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.813 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.814 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:29.818 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:29.818 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:29.819 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:29.819 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:29.819 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.819 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.819 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.820 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.820 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.820 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.820 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.820 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.821 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.821 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:29.821 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.821 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.822 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.830 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:29.831 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.831 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.831 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:29.833 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.833 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.833 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.833 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:29.839 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:29.839 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:29.840 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:29.840 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.840 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.840 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.840 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:29.840 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.840 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:29.840 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.840 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.840 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:29.840 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.840 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.840 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.841 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:29.841 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.841 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.841 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.841 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.841 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.841 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.841 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.841 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.842 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.842 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:29.845 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:29.845 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:29.845 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:29.845 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.845 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.845 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.845 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.845 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.845 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.845 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.845 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.846 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.846 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:29.860 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:29.860 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:29.860 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:29.861 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.861 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.861 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:29.861 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.861 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.861 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:29.862 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.862 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.862 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:29.862 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:29.865 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:29.865 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:29.866 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.866 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:29.866 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.866 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.866 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.866 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.866 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.866 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.866 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.866 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.866 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:29.879 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:29.879 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:29.880 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:29.880 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.880 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.880 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.881 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.881 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.881 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.881 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.881 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.881 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.882 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:29.885 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:29.885 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:29.885 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:29.886 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.886 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.886 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.886 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.886 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.886 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.886 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.886 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.886 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.886 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:29.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:29.910 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:29.910 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:29.911 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:29.912 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.912 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.912 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:29.912 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.912 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.913 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:29.913 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.913 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.913 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:29.913 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:29.926 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:29.926 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:29.926 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:29.927 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.927 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.927 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.927 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.927 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.927 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.928 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.928 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.928 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.928 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:29.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:29.964 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:29.965 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:29.965 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:29.966 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.966 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.966 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:29.966 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.966 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.966 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:29.967 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.967 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.968 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:29.968 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:30.026 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:30.026 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:30.026 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:30.028 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:30.028 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:30.028 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:30.029 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:30.029 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:30.029 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:30.029 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:30.029 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:30.029 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:30.029 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:30.058 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:30.079 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:30.079 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:30.079 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:30.079 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:30.080 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:30.080 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:30.080 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:30.080 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:30.080 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:30.080 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:30.080 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:30.081 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:30.081 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:30.085 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:30.085 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:30.085 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:30.085 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:30.086 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:30.086 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:30.086 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:30.086 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:30.087 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:30.087 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:30.087 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:30.087 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:30.087 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:30.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:30.117687  2793 catalog_manager.cc:1294] Loaded cluster ID: fe48ee1290e64b238c3afb118ff6298d
08:08:30.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:30.118067  2793 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 49bfb1f1e5e040d0869d8e6fdab4c9bb: loading cluster ID for follower catalog manager: success
08:08:30.119 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:30.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:30.138593  2798 catalog_manager.cc:1294] Loaded cluster ID: fe48ee1290e64b238c3afb118ff6298d
08:08:30.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:30.139485  2793 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 49bfb1f1e5e040d0869d8e6fdab4c9bb: acquiring CA information for follower catalog manager: success
08:08:30.142 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:30.143 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:30.143 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:30.143 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:30.143 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:30.144 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:30.144 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:30.144 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:30.144 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:30.144 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:30.145 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:30.145 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:30.145 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:30.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:30.145924  2798 catalog_manager.cc:1587] T 00000000000000000000000000000000 P f8c639184e474686ba6ce9a8bd838d4c: loading cluster ID for follower catalog manager: success
08:08:30.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:30.145709  2793 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 49bfb1f1e5e040d0869d8e6fdab4c9bb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:08:30.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:30.157891  2798 catalog_manager.cc:1609] T 00000000000000000000000000000000 P f8c639184e474686ba6ce9a8bd838d4c: acquiring CA information for follower catalog manager: success
08:08:30.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:30.167335  2798 catalog_manager.cc:1637] T 00000000000000000000000000000000 P f8c639184e474686ba6ce9a8bd838d4c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:08:30.179 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:30.180 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:30.180 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:30.181 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:30.181 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:30.181 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:30.181 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:30.181 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:30.181 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:30.182 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:30.182 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:30.182 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:30.182 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:30.208 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:30.209 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:30.209 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:30.210 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:30.210 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:30.210 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:30.210 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:30.211 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:30.211 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:30.211 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:30.211 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:30.211 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:30.211 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:30.225 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:30.225 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:30.225 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:30.226 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:30.226 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:30.226 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:30.226 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:30.227 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:30.227 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:30.227 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:30.227 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:30.227 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:30.227 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:30.238 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:30.239 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:30.239 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:30.240 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:30.240 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:30.240 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:30.240 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:30.240 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:30.240 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:30.240 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:30.240 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:30.240 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:30.241 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:30.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:30.313181  2812 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:08:30.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:30.314013  2812 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:08:30.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:30.314815  2812 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:08:30.328 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:30.328 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:30.329 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:30.329 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:30.329 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:30.329 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:30.329 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:30.329 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:30.329 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:30.330 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:30.330 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:30.330 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:30.330 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:30.331 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:30.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:30.380803  2812 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:08:30.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:30.382380  2812 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.90.129
08:08:30.402 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:30.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:30.449 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:30.449 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:30.449 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:30.450 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:30.450 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:30.450 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:30.450 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:30.450 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:30.450 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:30.451 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:30.451 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:30.451 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:30.451 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:30.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:30.458506  2812 tablet_server_runner.cc:78] Tablet server non-default flags:
08:08:30.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:30.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.90.148:36029
08:08:30.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:30.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:30.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-0/data
08:08:30.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-0/wal
08:08:30.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:30.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:30.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.90.129:0
08:08:30.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:08:30.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:30.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:30.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-0/data/info.pb
08:08:30.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.90.129
08:08:30.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:30.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.90.190:42265,127.2.90.189:41065,127.2.90.188:42457
08:08:30.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:08:30.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:30.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:08:30.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:08:30.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:30.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.90.129
08:08:30.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-0/logs
08:08:30.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:30.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:08:30.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:08:30.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:08:30.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:08:30.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:08:30.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:08:30.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:08:30.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:08:30.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:08:30.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:30.460646  2812 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:08:30.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:30.463178  2812 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:08:30.478 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:30.479 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:30.479 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:30.480 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:30.480 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:30.480 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:30.480 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:30.480 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:30.480 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:30.481 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:30.481 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:30.481 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:30.481 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:30.496 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:30.496 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:30.496 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:30.497 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:30.497 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:30.497 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:30.497 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:30.497 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:30.497 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:30.498 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:30.498 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:30.498 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:30.498 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:30.502 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:30.503 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:30.503 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:30.503 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:30.503 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:30.503 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:30.504 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:30.504 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:30.504 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:30.504 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:30.504 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:30.504 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:30.504 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:30.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:30.505825  2839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:30.537 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:30.538 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:30.538 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:30.539 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:30.539 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:30.539 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:30.539 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:30.539 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:30.539 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:30.539 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:30.539 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:30.540 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:30.540 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:30.543 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:30.543 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:30.543 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:30.544 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:30.544 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:30.544 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:30.544 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:30.544 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:30.544 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:30.545 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:30.545 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:30.545 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:30.545 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:30.558 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:30.600 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:30.600 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:30.601 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:30.601 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:30.601 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:30.601 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:30.602 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:30.602 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:30.602 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:30.602 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:30.602 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:30.602 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:30.602 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:30.620 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:30.725 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:30.725 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:30.726 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:30.726 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:30.726 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:30.726 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:30.727 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:30.727 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:30.727 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:30.728 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:30.728 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:30.728 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:30.728 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:30.733 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:30.733 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:30.733 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:30.734 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:30.734 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:30.734 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:30.734 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:30.734 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:30.734 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:30.735 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:30.735 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:30.735 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:30.735 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:30.743 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:30.743 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:30.743 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:30.744 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:30.744 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:30.744 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:30.744 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:30.745 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:30.745 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:30.745 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:30.745 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:30.745 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:30.745 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:30.831 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:30.838 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:30.839 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:30.839 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:30.840 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:30.840 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:30.840 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:30.840 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:30.840 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:30.840 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:30.841 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:30.841 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:30.841 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:30.841 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:30.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:30.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:31.059 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:31.085 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:31.085 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:31.085 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:31.086 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:31.087 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:31.087 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:31.087 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:31.087 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:31.087 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:31.088 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:31.088 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:31.088 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:31.088 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:31.120 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:31.203 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:31.203 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:31.204 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:31.204 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:31.205 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:31.205 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:31.205 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:31.205 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:31.205 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:31.206 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:31.206 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:31.206 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:31.206 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:31.245 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:31.245 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:31.245 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:31.246 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:31.246 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:31.247 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:31.247 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:31.247 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:31.247 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:31.247 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:31.248 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:31.248 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:31.248 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:31.299 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:31.300 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:31.300 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:31.301 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:31.301 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:31.301 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:31.301 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:31.301 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:31.301 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:31.302 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:31.302 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:31.302 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:31.302 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:31.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:31.401 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:31.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:31.561 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:31.589 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:31.589 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:31.589 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:31.590 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:31.590 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:31.590 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:31.591 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:31.591 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:31.591 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:31.591 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:31.591 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:31.591 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:31.591 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:31.616 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:31.617 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:31.617 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:31.618 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:31.618 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:31.618 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:31.618 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:31.618 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:31.618 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:31.619 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:31.619 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:31.619 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:31.619 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:31.620 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:31.638 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:31.638 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:31.638 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:31.639 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:31.639 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:31.639 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:31.639 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:31.639 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:31.639 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:31.639 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:31.639 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:31.639 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:31.640 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:31.669 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:31.669 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:31.670 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:31.670 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:31.670 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:31.670 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:31.670 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:31.670 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:31.670 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:31.671 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:31.671 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:31.671 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:31.671 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:31.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:31.847 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:31.848 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:31.848 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:31.849 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:31.849 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:31.849 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:31.851 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:31.851 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:31.852 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:31.851 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:31.852 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:31.852 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:31.852 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:31.878 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:31.878 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:31.879 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:31.880 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:31.880 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:31.880 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:31.880 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:31.880 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:31.881 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:31.881 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:31.881 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:31.881 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:31.881 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:31.897 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:31.898 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:31.898 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:31.898 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:31.899 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:31.899 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:31.899 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:31.899 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:31.899 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:31.900 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:31.900 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:31.900 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:31.900 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:31.900 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:31.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:31.969 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:31.969 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:31.969 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:31.970 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:31.970 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:31.971 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:31.971 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:31.971 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:31.971 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:31.972 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:31.972 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:31.972 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:31.972 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:32.058 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:32.120 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:32.196 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:32.197 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:32.197 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:32.198 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:32.198 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:32.198 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:32.198 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:32.198 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:32.198 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:32.199 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:32.199 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:32.199 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:32.199 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:32.326 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:32.327 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:32.327 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:32.327 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:32.328 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:32.328 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:32.328 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:32.328 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:32.328 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:32.330 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:32.330 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:32.330 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:32.330 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:32.348 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:32.398 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:32.398 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:32.399 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:32.399 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:32.400 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:32.400 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:32.400 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:32.400 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:32.400 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:32.400 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:32.400 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:32.401 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:32.401 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:32.401 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:32.405 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:32.406 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:32.406 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:32.406 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:32.406 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:32.407 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:32.407 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:32.407 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:32.407 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:32.407 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:32.407 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:32.407 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:32.408 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:32.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:32.558 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:32.619 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:32.623 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:32.624 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:32.624 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:32.624 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:32.625 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:32.625 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:32.625 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:32.625 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:32.625 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:32.624 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:32.625 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:32.625 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:32.626 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:32.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:32.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:32.954 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:33.003 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:33.004 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:33.004 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:33.005 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:33.005 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:33.005 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:33.006 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:33.006 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:33.006 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:33.006 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:33.006 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:33.006 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:33.006 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:33.058 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:33.119 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:33.224 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:33.224 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:33.224 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:33.225 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:33.225 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:33.225 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:33.226 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:33.226 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:33.226 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:33.226 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:33.226 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:33.226 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:33.226 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:33.308 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:33.309 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:33.309 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:33.310 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:33.310 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:33.310 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:33.311 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:33.311 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:33.311 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:33.311 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:33.311 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:33.311 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:33.311 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:33.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:33.347 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:33.348 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:33.348 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:33.349 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:33.349 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:33.349 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:33.349 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:33.349 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:33.349 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:33.350 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:33.350 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:33.350 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:33.350 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:33.401 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:33.408 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:33.408 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:33.409 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:33.409 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:33.409 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:33.409 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:33.409 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:33.409 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:33.409 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:33.410 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:33.410 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:33.410 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:33.410 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:33.412 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:33.413 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:33.413 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:33.413 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:33.413 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:33.413 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:33.413 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:33.414 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:33.414 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:33.413 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:33.414 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:33.414 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:33.414 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:33.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:33.558 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:33.619 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:33.643 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:33.644 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:33.644 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:33.644 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:33.645 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:33.645 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:33.645 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:33.645 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:33.646 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:33.646 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:33.646 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:33.646 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:33.646 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:33.709 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:33.709 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:33.710 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:33.710 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:33.711 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:33.711 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:33.711 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:33.712 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:33.712 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:33.712 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:33.712 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:33.712 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:33.712 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:33.823 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:33.823 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:33.823 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:33.825 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:33.825 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:33.826 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:33.826 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:33.826 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:33.826 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:33.826 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:33.826 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:33.828 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:33.828 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:33.831 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:33.860 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:33.860 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:33.860 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:33.861 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:33.861 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:33.861 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:33.862 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:33.862 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:33.862 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:33.862 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:33.862 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:33.862 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:33.863 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:33.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:33.943 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:33.944 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:33.944 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:33.944 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:33.944 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:33.945 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:33.945 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:33.945 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:33.945 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:33.946 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:33.946 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:33.946 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:33.946 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:33.956 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:34.009 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:34.009 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:34.010 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:34.010 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:34.010 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:34.011 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:34.011 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:34.011 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:34.011 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:34.012 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:34.012 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:34.012 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:34.012 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:34.017 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:34.018 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:34.018 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:34.018 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:34.018 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:34.019 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:34.019 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:34.019 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:34.019 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:34.019 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:34.019 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:34.019 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:34.020 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:34.058 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:34.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:31.902979  2838 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 2812
08:08:34.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:30.511746  2840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:34.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:34.107620  2812 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 3.599s	user 1.118s	sys 1.896s
08:08:34.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:34.109628  2812 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 3.601s	user 1.118s	sys 1.896s
08:08:34.119 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:34.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.139333  2812 server_base.cc:1061] running on GCE node
08:08:34.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:34.140463  2850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:34.142 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:34.143 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:34.143 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:34.144 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:34.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.144032  2812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:08:34.144 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:34.144 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:34.144 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:34.144 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:34.145 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:34.145 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:34.145 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:34.145 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:34.145 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:34.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.150020  2812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:08:34.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.154016  2812 hybrid_clock.cc:648] HybridClock initialized: now 1779091714153135 us; error 853 us; skew 500 ppm
08:08:34.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.155298  2812 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:08:34.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.178045  2812 webserver.cc:533] Webserver started at http://127.2.90.129:35735/ using document root <none> and password file <none>
08:08:34.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.179500  2812 fs_manager.cc:362] Metadata directory not provided
08:08:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.179913  2812 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:08:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.180549  2812 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:08:34.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.186451  2812 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-0/data/instance:
08:08:34.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0eddb522ea89403b931e52e7ea0a535b"
08:08:34.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:34 on dist-test-slave-1jss"
08:08:34.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.187964  2812 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-0/wal/instance:
08:08:34.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0eddb522ea89403b931e52e7ea0a535b"
08:08:34.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:34 on dist-test-slave-1jss"
08:08:34.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.198983  2812 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.009s	sys 0.002s
08:08:34.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.207525  2855 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:08:34.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.209122  2812 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.001s	sys 0.004s
08:08:34.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.209704  2812 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-0/wal
08:08:34.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0eddb522ea89403b931e52e7ea0a535b"
08:08:34.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:34 on dist-test-slave-1jss"
08:08:34.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.210254  2812 fs_report.cc:389] FS layout report
08:08:34.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:08:34.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-0/wal
08:08:34.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-0/wal
08:08:34.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-0/data/data
08:08:34.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:08:34.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:08:34.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:08:34.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:08:34.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:08:34.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:08:34.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:08:34.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:08:34.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:08:34.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:08:34.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:08:34.249 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:34.249 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:34.250 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:34.250 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:34.250 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:34.251 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:34.251 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:34.251 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:34.251 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:34.252 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:34.252 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:34.252 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:34.252 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:34.283 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:34.283 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:34.283 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:34.284 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:34.284 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:34.284 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:34.284 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:34.284 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:34.284 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:34.285 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:34.285 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:34.285 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:34.285 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:34.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.289678  2812 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:08:34.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.291890  2812 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:08:34.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.292451  2812 kserver.cc:163] Server-wide thread pool size limit: 3276
08:08:34.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.296739  2812 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:08:34.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.304193  2812 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:08:34.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.304462  2812 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:08:34.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.304811  2812 ts_tablet_manager.cc:616] Registered 0 tablets
08:08:34.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.305009  2812 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:08:34.331 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:34.401 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:34.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:34.459 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:34.460 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:34.460 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:34.460 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:34.460 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:34.460 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:34.460 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:34.460 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:34.460 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:34.461 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:34.461 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:34.461 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:34.461 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:34.537 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:34.537 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:34.537 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:34.537 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:34.538 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:34.538 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:34.538 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:34.538 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:34.538 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:34.538 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:34.539 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:34.539 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:34.539 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:34.558 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:34.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.614303  2812 rpc_server.cc:307] RPC server started. Bound to: 127.2.90.129:37135
08:08:34.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.614421  2967 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.90.129:37135 every 8 connection(s)
08:08:34.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.618517  2812 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-0/data/info.pb
08:08:34.620 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:34.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.627180  2410 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 2812
08:08:34.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.628104  2410 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-0/wal/instance
08:08:34.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.662140  2410 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:08:34.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:08:34.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-1/wal
08:08:34.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-1/data
08:08:34.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:08:34.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:08:34.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:08:34.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:34.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:34.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:34.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-1/logs
08:08:34.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-1/data/info.pb
08:08:34.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:34.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:08:34.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:08:34.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:08:34.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:08:34.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:34.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:34.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:34.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:08:34.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:08:34.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.90.130:0
08:08:34.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.90.130
08:08:34.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.90.130
08:08:34.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:34.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.90.190:42265,127.2.90.189:41065,127.2.90.188:42457
08:08:34.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.90.148:36029
08:08:34.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:34.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:34.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:08:34.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.709654  2968 heartbeater.cc:344] Connected to a master server at 127.2.90.188:42457
08:08:34.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.710387  2968 heartbeater.cc:461] Registering TS with master...
08:08:34.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.711925  2968 heartbeater.cc:507] Master 127.2.90.188:42457 requested a full tablet report, sending...
08:08:34.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.715962  2660 ts_manager.cc:194] Registered new tserver with Master: 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135)
08:08:34.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.719515  2660 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.2.90.129:52585
08:08:34.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.721115  2970 heartbeater.cc:344] Connected to a master server at 127.2.90.190:42265
08:08:34.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.721493  2970 heartbeater.cc:461] Registering TS with master...
08:08:34.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.722536  2970 heartbeater.cc:507] Master 127.2.90.190:42265 requested a full tablet report, sending...
08:08:34.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.724750  2969 heartbeater.cc:344] Connected to a master server at 127.2.90.189:41065
08:08:34.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.725114  2969 heartbeater.cc:461] Registering TS with master...
08:08:34.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.726115  2969 heartbeater.cc:507] Master 127.2.90.189:41065 requested a full tablet report, sending...
08:08:34.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.731654  2478 ts_manager.cc:194] Registered new tserver with Master: 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135)
08:08:34.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:34.733896  2557 ts_manager.cc:194] Registered new tserver with Master: 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135)
08:08:34.832 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:34.859 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:34.859 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:34.859 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:34.860 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:34.860 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:34.860 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:34.860 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:34.860 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:34.860 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:34.861 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:34.861 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:34.861 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:34.861 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:34.866 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:34.866 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:34.866 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:34.866 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:34.866 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:34.866 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:34.866 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:34.867 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:34.867 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:34.867 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:34.867 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:34.867 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:34.867 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:34.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:34.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:35.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:35.120 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:35.125 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:35.125 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:35.126 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:35.126 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:35.126 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:35.126 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:35.126 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:35.127 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:35.127 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:35.127 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:35.127 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:35.127 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:35.127 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:35.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:35.135811  2978 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:08:35.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:35.136927  2978 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:08:35.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:35.137521  2978 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:08:35.169 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:35.169 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:35.169 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:35.169 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:35.169 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:35.170 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:35.170 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:35.170 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:35.170 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:35.170 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:35.170 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:35.170 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:35.170 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:35.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:35.188640  2978 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:08:35.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:35.190025  2978 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.90.130
08:08:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:35.239776  2978 tablet_server_runner.cc:78] Tablet server non-default flags:
08:08:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.90.148:36029
08:08:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-1/data
08:08:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-1/wal
08:08:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.90.130:0
08:08:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:08:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-1/data/info.pb
08:08:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.90.130
08:08:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.90.190:42265,127.2.90.189:41065,127.2.90.188:42457
08:08:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:08:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:08:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:08:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.90.130
08:08:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-1/logs
08:08:35.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:35.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:08:35.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:08:35.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:08:35.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:08:35.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:08:35.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:08:35.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:08:35.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:08:35.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:08:35.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:35.241858  2978 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:08:35.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:35.243892  2978 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:08:35.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:35.261694  2984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:35.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:35.382 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:35.382 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:35.383 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:35.384 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:35.384 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:35.384 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:35.384 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:35.385 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:35.385 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:35.385 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:35.385 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:35.385 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:35.385 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:35.398 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:35.398 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:35.399 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:35.399 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.399 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.399 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.400 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.400 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.400 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.400 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.400 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.400 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.400 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:35.401 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27467), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [50ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [55ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [73ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [73ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [90ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [98ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [98ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [109ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [110ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [111ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [111ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [112ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [112ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [124ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [124ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [124ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [143ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [163ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [164ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [169ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [169ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [202ms] refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [205ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [205ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [206ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [206ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [305ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [305ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [342ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [344ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [351ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [352ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [352ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [642ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [644ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [644ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [645ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1065ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [1066ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [1066ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [1067ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [1067ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1068ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2301ms] refreshing cache from master, [2301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [2302ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [2302ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [2303ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2303ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2881ms] refreshing cache from master, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [2882ms] too many traces: truncated at 100 traces, deferred=Deferred@1525968178(state=PENDING, result=null, callback=(continuation of Deferred@59807386 after retry RPC after error@1087281380) -> (continuation of Deferred@1383852360 after retry RPC after error@731878344) -> (continuation of Deferred@742188135 after retry RPC after error@411127996) -> (continuation of Deferred@364763981 after retry RPC after error@1122704353) -> (continuation of Deferred@155172871 after retry RPC after error@464090412) -> (continuation of Deferred@1622520487 after retry RPC after error@2048624963) -> (continuation of Deferred@231948799 after retry RPC after error@1560495484) -> (continuation of Deferred@275703025 after retry RPC after error@916006446) -> (continuation of Deferred@559044027 after retry RPC after error@1715326024) -> (continuation of Deferred@18085138 after retry RPC after error@2126781256) -> (continuation of Deferred@1292400294 after retry RPC after error@1163902147) -> (continuation of Deferred@1543141919 after retry RPC after error@87696499) -> (continuation of Deferred@185196340 after retry RPC after error@864604978) -> (continuation of Deferred@1001024990 after retry RPC after error@1869078372) -> (continuation of Deferred@710041027 after retry RPC after error@1605769976) -> (continuation of Deferred@932857933 after retry RPC after error@1716993317) -> (continuation of Deferred@1590941801 after retry RPC after error@828209297) -> (continuation of Deferred@1424000727 after retry RPC after error@184625019) -> (continuation of Deferred@1263642338 after retry RPC after error@286443241) -> (continuation of Deferred@1100233762 after retry RPC after error@1135403412) -> (continuation of Deferred@84683189 after retry RPC after error@36602483) -> (continuation of Deferred@1648089912 after retry RPC after error@1178547882) -> (continuation of Deferred@572190297 after retry RPC after error@1414651251), errback=(continuation of Deferred@59807386 after retry RPC after error@1087281380) -> (continuation of Deferred@1383852360 after retry RPC after error@731878344) -> (continuation of Deferred@742188135 after retry RPC after error@411127996) -> (continuation of Deferred@364763981 after retry RPC after error@1122704353) -> (continuation of Deferred@155172871 after retry RPC after error@464090412) -> (continuation of Deferred@1622520487 after retry RPC after error@2048624963) -> (continuation of Deferred@231948799 after retry RPC after error@1560495484) -> (continuation of Deferred@275703025 after retry RPC after error@916006446) -> (continuation of Deferred@559044027 after retry RPC after error@1715326024) -> (continuation of Deferred@18085138 after retry RPC after error@2126781256) -> (continuation of Deferred@1292400294 after retry RPC after error@1163902147) -> (continuation of Deferred@1543141919 after retry RPC after error@87696499) -> (continuation of Deferred@185196340 after retry RPC after error@864604978) -> (continuation of Deferred@1001024990 after retry RPC after error@1869078372) -> (continuation of Deferred@710041027 after retry RPC after error@1605769976) -> (continuation of Deferred@932857933 after retry RPC after error@1716993317) -> (continuation of Deferred@1590941801 after retry RPC after error@828209297) -> (continuation of Deferred@1424000727 after retry RPC after error@184625019) -> (continuation of Deferred@1263642338 after retry RPC after error@286443241) -> (continuation of Deferred@1100233762 after retry RPC after error@1135403412) -> (continuation of Deferred@84683189 after retry RPC after error@36602483) -> (continuation of Deferred@1648089912 after retry RPC after error@1178547882) -> (continuation of Deferred@572190297 after retry RPC after error@1414651251)))
08:08:35.404 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:35.404 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:35.404 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:35.405 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:35.405 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.405 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.405 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.405 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.405 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.405 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.405 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27467), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [50ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [55ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [73ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [73ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [90ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [98ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [98ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [109ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [110ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [111ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [111ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [112ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [112ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [124ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [124ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [124ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [143ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [163ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [164ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [169ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [169ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [202ms] refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [205ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [205ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [206ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [206ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [305ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [305ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [342ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [344ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [351ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [352ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [352ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [642ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [644ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [644ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [645ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1065ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [1066ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [1066ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [1067ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [1067ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1068ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2301ms] refreshing cache from master, [2301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [2302ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [2302ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [2303ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2303ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2881ms] refreshing cache from master, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [2882ms] too many traces: truncated at 100 traces, deferred=Deferred@1525968178(state=PENDING, result=null, callback=(continuation of Deferred@59807386 after retry RPC after error@1087281380) -> (continuation of Deferred@1383852360 after retry RPC after error@731878344) -> (continuation of Deferred@742188135 after retry RPC after error@411127996) -> (continuation of Deferred@364763981 after retry RPC after error@1122704353) -> (continuation of Deferred@155172871 after retry RPC after error@464090412) -> (continuation of Deferred@1622520487 after retry RPC after error@2048624963) -> (continuation of Deferred@231948799 after retry RPC after error@1560495484) -> (continuation of Deferred@275703025 after retry RPC after error@916006446) -> (continuation of Deferred@559044027 after retry RPC after error@1715326024) -> (continuation of Deferred@18085138 after retry RPC after error@2126781256) -> (continuation of Deferred@1292400294 after retry RPC after error@1163902147) -> (continuation of Deferred@1543141919 after retry RPC after error@87696499) -> (continuation of Deferred@185196340 after retry RPC after error@864604978) -> (continuation of Deferred@1001024990 after retry RPC after error@1869078372) -> (continuation of Deferred@710041027 after retry RPC after error@1605769976) -> (continuation of Deferred@932857933 after retry RPC after error@1716993317) -> (continuation of Deferred@1590941801 after retry RPC after error@828209297) -> (continuation of Deferred@1424000727 after retry RPC after error@184625019) -> (continuation of Deferred@1263642338 after retry RPC after error@286443241) -> (continuation of Deferred@1100233762 after retry RPC after error@1135403412) -> (continuation of Deferred@84683189 after retry RPC after error@36602483) -> (continuation of Deferred@1648089912 after retry RPC after error@1178547882) -> (continuation of Deferred@572190297 after retry RPC after error@1414651251), errback=(continuation of Deferred@59807386 after retry RPC after error@1087281380) -> (continuation of Deferred@1383852360 after retry RPC after error@731878344) -> (continuation of Deferred@742188135 after retry RPC after error@411127996) -> (continuation of Deferred@364763981 after retry RPC after error@1122704353) -> (continuation of Deferred@155172871 after retry RPC after error@464090412) -> (continuation of Deferred@1622520487 after retry RPC after error@2048624963) -> (continuation of Deferred@231948799 after retry RPC after error@1560495484) -> (continuation of Deferred@275703025 after retry RPC after error@916006446) -> (continuation of Deferred@559044027 after retry RPC after error@1715326024) -> (continuation of Deferred@18085138 after retry RPC after error@2126781256) -> (continuation of Deferred@1292400294 after retry RPC after error@1163902147) -> (continuation of Deferred@1543141919 after retry RPC after error@87696499) -> (continuation of Deferred@185196340 after retry RPC after error@864604978) -> (continuation of Deferred@1001024990 after retry RPC after error@1869078372) -> (continuation of Deferred@710041027 after retry RPC after error@1605769976) -> (continuation of Deferred@932857933 after retry RPC after error@1716993317) -> (continuation of Deferred@1590941801 after retry RPC after error@828209297) -> (continuation of Deferred@1424000727 after retry RPC after error@184625019) -> (continuation of Deferred@1263642338 after retry RPC after error@286443241) -> (continuation of Deferred@1100233762 after retry RPC after error@1135403412) -> (continuation of Deferred@84683189 after retry RPC after error@36602483) -> (continuation of Deferred@1648089912 after retry RPC after error@1178547882) -> (continuation of Deferred@572190297 after retry RPC after error@1414651251)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27467), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [50ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [55ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [73ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [73ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [90ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [98ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [98ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [109ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [110ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [111ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [111ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [112ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [112ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [124ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [124ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [124ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [143ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [163ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [164ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [169ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [169ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [202ms] refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [205ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [205ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [206ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [206ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [305ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [305ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [342ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [344ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [351ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [352ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [352ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [642ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [644ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [644ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [645ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1065ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [1066ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [1066ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [1067ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [1067ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1068ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2301ms] refreshing cache from master, [2301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [2302ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [2302ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [2303ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2303ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2881ms] refreshing cache from master, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [2882ms] too many traces: truncated at 100 traces, deferred=Deferred@1525968178(state=PENDING, result=null, callback=(continuation of Deferred@59807386 after retry RPC after error@1087281380) -> (continuation of Deferred@1383852360 after retry RPC after error@731878344) -> (continuation of Deferred@742188135 after retry RPC after error@411127996) -> (continuation of Deferred@364763981 after retry RPC after error@1122704353) -> (continuation of Deferred@155172871 after retry RPC after error@464090412) -> (continuation of Deferred@1622520487 after retry RPC after error@2048624963) -> (continuation of Deferred@231948799 after retry RPC after error@1560495484) -> (continuation of Deferred@275703025 after retry RPC after error@916006446) -> (continuation of Deferred@559044027 after retry RPC after error@1715326024) -> (continuation of Deferred@18085138 after retry RPC after error@2126781256) -> (continuation of Deferred@1292400294 after retry RPC after error@1163902147) -> (continuation of Deferred@1543141919 after retry RPC after error@87696499) -> (continuation of Deferred@185196340 after retry RPC after error@864604978) -> (continuation of Deferred@1001024990 after retry RPC after error@1869078372) -> (continuation of Deferred@710041027 after retry RPC after error@1605769976) -> (continuation of Deferred@932857933 after retry RPC after error@1716993317) -> (continuation of Deferred@1590941801 after retry RPC after error@828209297) -> (continuation of Deferred@1424000727 after retry RPC after error@184625019) -> (continuation of Deferred@1263642338 after retry RPC after error@286443241) -> (continuation of Deferred@1100233762 after retry RPC after error@1135403412) -> (continuation of Deferred@84683189 after retry RPC after error@36602483) -> (continuation of Deferred@1648089912 after retry RPC after error@1178547882) -> (continuation of Deferred@572190297 after retry RPC after error@1414651251), errback=(continuation of Deferred@59807386 after retry RPC after error@1087281380) -> (continuation of Deferred@1383852360 after retry RPC after error@731878344) -> (continuation of Deferred@742188135 after retry RPC after error@411127996) -> (continuation of Deferred@364763981 after retry RPC after error@1122704353) -> (continuation of Deferred@155172871 after retry RPC after error@464090412) -> (continuation of Deferred@1622520487 after retry RPC after error@2048624963) -> (continuation of Deferred@231948799 after retry RPC after error@1560495484) -> (continuation of Deferred@275703025 after retry RPC after error@916006446) -> (continuation of Deferred@559044027 after retry RPC after error@1715326024) -> (continuation of Deferred@18085138 after retry RPC after error@2126781256) -> (continuation of Deferred@1292400294 after retry RPC after error@1163902147) -> (continuation of Deferred@1543141919 after retry RPC after error@87696499) -> (continuation of Deferred@185196340 after retry RPC after error@864604978) -> (continuation of Deferred@1001024990 after retry RPC after error@1869078372) -> (continuation of Deferred@710041027 after retry RPC after error@1605769976) -> (continuation of Deferred@932857933 after retry RPC after error@1716993317) -> (continuation of Deferred@1590941801 after retry RPC after error@828209297) -> (continuation of Deferred@1424000727 after retry RPC after error@184625019) -> (continuation of Deferred@1263642338 after retry RPC after error@286443241) -> (continuation of Deferred@1100233762 after retry RPC after error@1135403412) -> (continuation of Deferred@84683189 after retry RPC after error@36602483) -> (continuation of Deferred@1648089912 after retry RPC after error@1178547882) -> (continuation of Deferred@572190297 after retry RPC after error@1414651251)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.220.252:33543
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:35.447 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.447 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:35.449 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.449 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:35.458 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:35.459 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:35.459 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:35.460 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.460 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.460 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.465 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.466 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.466 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.466 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.466 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.466 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.466 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:35.478 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:35.479 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:35.479 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:35.480 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.480 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.480 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27467), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [50ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [55ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [73ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [73ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [90ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [98ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [98ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [109ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [110ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [111ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [111ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [112ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [112ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [124ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [124ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [124ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [143ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [163ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [164ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [169ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [169ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [202ms] refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [205ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [205ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [206ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [206ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [305ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [305ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [342ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [344ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [351ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [352ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [352ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [642ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [644ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [644ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [645ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1065ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [1066ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [1066ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [1067ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [1067ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1068ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2301ms] refreshing cache from master, [2301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [2302ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [2302ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [2303ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2303ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2881ms] refreshing cache from master, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [2882ms] too many traces: truncated at 100 traces, deferred=Deferred@1525968178(state=PENDING, result=null, callback=(continuation of Deferred@59807386 after retry RPC after error@1087281380) -> (continuation of Deferred@1383852360 after retry RPC after error@731878344) -> (continuation of Deferred@742188135 after retry RPC after error@411127996) -> (continuation of Deferred@364763981 after retry RPC after error@1122704353) -> (continuation of Deferred@155172871 after retry RPC after error@464090412) -> (continuation of Deferred@1622520487 after retry RPC after error@2048624963) -> (continuation of Deferred@231948799 after retry RPC after error@1560495484) -> (continuation of Deferred@275703025 after retry RPC after error@916006446) -> (continuation of Deferred@559044027 after retry RPC after error@1715326024) -> (continuation of Deferred@18085138 after retry RPC after error@2126781256) -> (continuation of Deferred@1292400294 after retry RPC after error@1163902147) -> (continuation of Deferred@1543141919 after retry RPC after error@87696499) -> (continuation of Deferred@185196340 after retry RPC after error@864604978) -> (continuation of Deferred@1001024990 after retry RPC after error@1869078372) -> (continuation of Deferred@710041027 after retry RPC after error@1605769976) -> (continuation of Deferred@932857933 after retry RPC after error@1716993317) -> (continuation of Deferred@1590941801 after retry RPC after error@828209297) -> (continuation of Deferred@1424000727 after retry RPC after error@184625019) -> (continuation of Deferred@1263642338 after retry RPC after error@286443241) -> (continuation of Deferred@1100233762 after retry RPC after error@1135403412) -> (continuation of Deferred@84683189 after retry RPC after error@36602483) -> (continuation of Deferred@1648089912 after retry RPC after error@1178547882) -> (continuation of Deferred@572190297 after retry RPC after error@1414651251), errback=(continuation of Deferred@59807386 after retry RPC after error@1087281380) -> (continuation of Deferred@1383852360 after retry RPC after error@731878344) -> (continuation of Deferred@742188135 after retry RPC after error@411127996) -> (continuation of Deferred@364763981 after retry RPC after error@1122704353) -> (continuation of Deferred@155172871 after retry RPC after error@464090412) -> (continuation of Deferred@1622520487 after retry RPC after error@2048624963) -> (continuation of Deferred@231948799 after retry RPC after error@1560495484) -> (continuation of Deferred@275703025 after retry RPC after error@916006446) -> (continuation of Deferred@559044027 after retry RPC after error@1715326024) -> (continuation of Deferred@18085138 after retry RPC after error@2126781256) -> (continuation of Deferred@1292400294 after retry RPC after error@1163902147) -> (continuation of Deferred@1543141919 after retry RPC after error@87696499) -> (continuation of Deferred@185196340 after retry RPC after error@864604978) -> (continuation of Deferred@1001024990 after retry RPC after error@1869078372) -> (continuation of Deferred@710041027 after retry RPC after error@1605769976) -> (continuation of Deferred@932857933 after retry RPC after error@1716993317) -> (continuation of Deferred@1590941801 after retry RPC after error@828209297) -> (continuation of Deferred@1424000727 after retry RPC after error@184625019) -> (continuation of Deferred@1263642338 after retry RPC after error@286443241) -> (continuation of Deferred@1100233762 after retry RPC after error@1135403412) -> (continuation of Deferred@84683189 after retry RPC after error@36602483) -> (continuation of Deferred@1648089912 after retry RPC after error@1178547882) -> (continuation of Deferred@572190297 after retry RPC after error@1414651251)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27467), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [50ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [55ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [73ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [73ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [90ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [98ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [98ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [109ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [110ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [111ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [111ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [112ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [112ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [124ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [124ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [124ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [143ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [163ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [164ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [169ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [169ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [202ms] refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [205ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [205ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [206ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [206ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [305ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [305ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [342ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [344ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [351ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [352ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [352ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [642ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [644ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [644ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [645ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1065ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [1066ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [1066ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [1067ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [1067ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1068ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2301ms] refreshing cache from master, [2301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [2302ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [2302ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [2303ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2303ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2881ms] refreshing cache from master, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [2882ms] too many traces: truncated at 100 traces, deferred=Deferred@1525968178(state=PENDING, result=null, callback=(continuation of Deferred@59807386 after retry RPC after error@1087281380) -> (continuation of Deferred@1383852360 after retry RPC after error@731878344) -> (continuation of Deferred@742188135 after retry RPC after error@411127996) -> (continuation of Deferred@364763981 after retry RPC after error@1122704353) -> (continuation of Deferred@155172871 after retry RPC after error@464090412) -> (continuation of Deferred@1622520487 after retry RPC after error@2048624963) -> (continuation of Deferred@231948799 after retry RPC after error@1560495484) -> (continuation of Deferred@275703025 after retry RPC after error@916006446) -> (continuation of Deferred@559044027 after retry RPC after error@1715326024) -> (continuation of Deferred@18085138 after retry RPC after error@2126781256) -> (continuation of Deferred@1292400294 after retry RPC after error@1163902147) -> (continuation of Deferred@1543141919 after retry RPC after error@87696499) -> (continuation of Deferred@185196340 after retry RPC after error@864604978) -> (continuation of Deferred@1001024990 after retry RPC after error@1869078372) -> (continuation of Deferred@710041027 after retry RPC after error@1605769976) -> (continuation of Deferred@932857933 after retry RPC after error@1716993317) -> (continuation of Deferred@1590941801 after retry RPC after error@828209297) -> (continuation of Deferred@1424000727 after retry RPC after error@184625019) -> (continuation of Deferred@1263642338 after retry RPC after error@286443241) -> (continuation of Deferred@1100233762 after retry RPC after error@1135403412) -> (continuation of Deferred@84683189 after retry RPC after error@36602483) -> (continuation of Deferred@1648089912 after retry RPC after error@1178547882) -> (continuation of Deferred@572190297 after retry RPC after error@1414651251), errback=(continuation of Deferred@59807386 after retry RPC after error@1087281380) -> (continuation of Deferred@1383852360 after retry RPC after error@731878344) -> (continuation of Deferred@742188135 after retry RPC after error@411127996) -> (continuation of Deferred@364763981 after retry RPC after error@1122704353) -> (continuation of Deferred@155172871 after retry RPC after error@464090412) -> (continuation of Deferred@1622520487 after retry RPC after error@2048624963) -> (continuation of Deferred@231948799 after retry RPC after error@1560495484) -> (continuation of Deferred@275703025 after retry RPC after error@916006446) -> (continuation of Deferred@559044027 after retry RPC after error@1715326024) -> (continuation of Deferred@18085138 after retry RPC after error@2126781256) -> (continuation of Deferred@1292400294 after retry RPC after error@1163902147) -> (continuation of Deferred@1543141919 after retry RPC after error@87696499) -> (continuation of Deferred@185196340 after retry RPC after error@864604978) -> (continuation of Deferred@1001024990 after retry RPC after error@1869078372) -> (continuation of Deferred@710041027 after retry RPC after error@1605769976) -> (continuation of Deferred@932857933 after retry RPC after error@1716993317) -> (continuation of Deferred@1590941801 after retry RPC after error@828209297) -> (continuation of Deferred@1424000727 after retry RPC after error@184625019) -> (continuation of Deferred@1263642338 after retry RPC after error@286443241) -> (continuation of Deferred@1100233762 after retry RPC after error@1135403412) -> (continuation of Deferred@84683189 after retry RPC after error@36602483) -> (continuation of Deferred@1648089912 after retry RPC after error@1178547882) -> (continuation of Deferred@572190297 after retry RPC after error@1414651251)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.220.252:33543
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:35.481 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.481 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.481 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.481 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.480 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.482 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.482 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.482 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:35.492 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
08:08:35.492 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (a72e6b48022ef36361b5eef11ee7c683) switched from state RUNNING to RESTARTING.
08:08:35.493 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#2) of source Source: KuduSource.
08:08:35.498 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:35.498 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to CANCELING.
08:08:35.498 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:35.498 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:35.499 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
08:08:35.499 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to CANCELING.
08:08:35.499 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
08:08:35.502 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to CANCELING.
08:08:35.502 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#2) of source Source: KuduSource.
08:08:35.502 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.502 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.502 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.502 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#2) of source Source: KuduSource.
08:08:35.502 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to CANCELING.
08:08:35.503 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.503 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.503 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#2) of source Source: KuduSource.
08:08:35.503 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.503 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to CANCELING.
08:08:35.503 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.504 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.504 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.505 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:35.510 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
08:08:35.510 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CANCELING to CANCELED.
08:08:35.511 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
08:08:35.525 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:35.526 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:35.526 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:35.527 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:35.527 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:35.527 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:35.528 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:35.528 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:35.528 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:35.528 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:35.529 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:35.529 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:35.529 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:35.531 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
08:08:35.531 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to CANCELING.
08:08:35.531 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
08:08:35.538 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:35.538 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:35.539 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:35.539 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
08:08:35.539 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.539 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.539 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CANCELING to CANCELED.
08:08:35.539 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.539 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
08:08:35.540 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.540 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.540 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.540 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.540 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.541 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.541 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:35.542 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:35.542 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:35.542 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:35.543 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:35.543 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:35.543 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:35.543 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:35.543 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:35.543 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:35.544 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:35.544 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:35.544 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:35.544 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:35.555 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
08:08:35.555 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to CANCELING.
08:08:35.555 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
08:08:35.558 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:35.558 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:35.559 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:35.559 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.559 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.559 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.560 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.560 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.560 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.560 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.561 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.561 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.561 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:35.564 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
08:08:35.564 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CANCELING to CANCELED.
08:08:35.564 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
08:08:35.568 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
08:08:35.568 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to CANCELING.
08:08:35.568 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
08:08:35.584 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:35.584 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:35.585 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:35.585 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
08:08:35.585 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CANCELING to CANCELED.
08:08:35.586 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:35.586 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:35.586 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#2 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
08:08:35.586 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:35.586 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:35.586 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:35.586 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:35.591 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:35.591 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:35.591 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:35.592 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:35.603 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#2 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_2.
08:08:35.604 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#2 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_2.
08:08:35.604 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#2 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
08:08:35.604 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#2 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_2.
08:08:35.605 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CANCELING to CANCELED.
08:08:35.607 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:08:35.608 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CANCELING to CANCELED.
08:08:35.620 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:35.623 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:08:35.625 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CANCELING to CANCELED.
08:08:35.626 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:08:35.627 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CANCELING to CANCELED.
08:08:35.628 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:318) Clearing resource requirements of job a72e6b48022ef36361b5eef11ee7c683
08:08:35.638 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:35.639 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:35.639 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:35.640 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.640 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.640 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.641 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.641 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.641 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.641 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.642 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.642 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.643 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:35.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:35.731383  2968 heartbeater.cc:499] Master 127.2.90.188:42457 was elected leader, sending a full tablet report...
08:08:35.777 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:35.778 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:35.778 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:35.782 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.782 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.782 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.782 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.782 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.783 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.783 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.783 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.783 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.783 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:35.788 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:35.788 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:35.788 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:35.789 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:35.789 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:35.789 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:35.789 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:35.789 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:35.789 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:35.790 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:35.790 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:35.790 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:35.790 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:35.818 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:35.819 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:35.819 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:35.820 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.820 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.820 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.820 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:35.820 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.820 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.820 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.820 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:35.820 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:35.822 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:35.835 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:35.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:35.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:35.964 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:35.964 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:35.964 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:35.965 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:35.965 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:35.965 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:35.965 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:35.965 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:35.965 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:35.966 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:35.966 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:35.966 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:35.966 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:36.120 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:36.124 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:36.124 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:36.124 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:36.125 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:36.125 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:36.125 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:36.125 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:36.126 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:36.126 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:36.126 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:36.125 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:36.127 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:36.127 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:36.128 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28205), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [45ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [47ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [48ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [48ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [94ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [99ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [112ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [112ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [129ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [129ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [144ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [144ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [145ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [161ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [161ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [162ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [162ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [181ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [182ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [182ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [182ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [202ms] refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [209ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [209ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [209ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [210ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [210ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [211ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [221ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [222ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [222ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [222ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [363ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [462ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [463ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [463ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [463ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [521ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [522ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [523ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [523ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1540ms] refreshing cache from master, [1540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1543ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1543ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1543ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2800ms] refreshing cache from master, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2801ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [2801ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [2802ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2802ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [5740ms] refreshing cache from master, [5740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [5741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [5741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [5742ms] too many traces: truncated at 100 traces, deferred=Deferred@1320690309(state=PENDING, result=null, callback=(continuation of Deferred@1684146053 after retry RPC after error@801218843) -> (continuation of Deferred@235366903 after retry RPC after error@27578040) -> (continuation of Deferred@1972289318 after retry RPC after error@1466237429) -> (continuation of Deferred@1645777471 after retry RPC after error@1173242314) -> (continuation of Deferred@1167700446 after retry RPC after error@982284849) -> (continuation of Deferred@480484917 after retry RPC after error@729054330) -> (continuation of Deferred@602619787 after retry RPC after error@2062521397) -> (continuation of Deferred@2050883435 after retry RPC after error@1923275770) -> (continuation of Deferred@147830082 after retry RPC after error@243783250) -> (continuation of Deferred@458532430 after retry RPC after error@2144191445) -> (continuation of Deferred@173870283 after retry RPC after error@987262612) -> (continuation of Deferred@75553111 after retry RPC after error@356671865) -> (continuation of Deferred@1998261326 after retry RPC after error@240017655) -> (continuation of Deferred@201742856 after retry RPC after error@172600152) -> (continuation of Deferred@631226147 after retry RPC after error@1479223999) -> (continuation of Deferred@1715731880 after retry RPC after error@563579219) -> (continuation of Deferred@2032753893 after retry RPC after error@2027356077) -> (continuation of Deferred@16905122 after retry RPC after error@482422720) -> (continuation of Deferred@792495817 after retry RPC after error@1616391956) -> (continuation of Deferred@1850362974 after retry RPC after error@2069942648) -> (continuation of Deferred@807471635 after retry RPC after error@287355788) -> (continuation of Deferred@758396234 after retry RPC after error@1344461445) -> (continuation of Deferred@1760244480 after retry RPC after error@2093171010) -> (continuation of Deferred@1884403189 after retry RPC after error@920764296), errback=(continuation of Deferred@1684146053 after retry RPC after error@801218843) -> (continuation of Deferred@235366903 after retry RPC after error@27578040) -> (continuation of Deferred@1972289318 after retry RPC after error@1466237429) -> (continuation of Deferred@1645777471 after retry RPC after error@1173242314) -> (continuation of Deferred@1167700446 after retry RPC after error@982284849) -> (continuation of Deferred@480484917 after retry RPC after error@729054330) -> (continuation of Deferred@602619787 after retry RPC after error@2062521397) -> (continuation of Deferred@2050883435 after retry RPC after error@1923275770) -> (continuation of Deferred@147830082 after retry RPC after error@243783250) -> (continuation of Deferred@458532430 after retry RPC after error@2144191445) -> (continuation of Deferred@173870283 after retry RPC after error@987262612) -> (continuation of Deferred@75553111 after retry RPC after error@356671865) -> (continuation of Deferred@1998261326 after retry RPC after error@240017655) -> (continuation of Deferred@201742856 after retry RPC after error@172600152) -> (continuation of Deferred@631226147 after retry RPC after error@1479223999) -> (continuation of Deferred@1715731880 after retry RPC after error@563579219) -> (continuation of Deferred@2032753893 after retry RPC after error@2027356077) -> (continuation of Deferred@16905122 after retry RPC after error@482422720) -> (continuation of Deferred@792495817 after retry RPC after error@1616391956) -> (continuation of Deferred@1850362974 after retry RPC after error@2069942648) -> (continuation of Deferred@807471635 after retry RPC after error@287355788) -> (continuation of Deferred@758396234 after retry RPC after error@1344461445) -> (continuation of Deferred@1760244480 after retry RPC after error@2093171010) -> (continuation of Deferred@1884403189 after retry RPC after error@920764296)))
08:08:36.138 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:36.139 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:36.139 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:36.140 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:36.140 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:36.140 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:36.140 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:36.140 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:36.141 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:36.141 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:36.141 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:36.141 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:36.141 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:36.143 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28293), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [32ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [67ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [127ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [128ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [174ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [174ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [175ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [175ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [182ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [182ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [207ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [208ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [214ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [215ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [215ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [223ms] refreshing cache from master, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [227ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [227ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [227ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [228ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [242ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [242ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [242ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [243ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [260ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [262ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [263ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [264ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [264ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [322ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [323ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [323ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [324ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [362ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [522ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [523ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [524ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [524ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [783ms] refreshing cache from master, [783ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [783ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [783ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [784ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [784ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [785ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [785ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1244ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2621ms] refreshing cache from master, [2621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [2622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2623ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [2623ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2623ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [2623ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [3201ms] refreshing cache from master, [3201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [3201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [3202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [3202ms] too many traces: truncated at 100 traces, deferred=Deferred@933173282(state=PENDING, result=null, callback=(continuation of Deferred@1554639145 after retry RPC after error@426645814) -> (continuation of Deferred@799274426 after retry RPC after error@1622324836) -> (continuation of Deferred@1933700090 after retry RPC after error@445643533) -> (continuation of Deferred@707904451 after retry RPC after error@1598378359) -> (continuation of Deferred@598179678 after retry RPC after error@1175826356) -> (continuation of Deferred@1654543214 after retry RPC after error@388327587) -> (continuation of Deferred@266381462 after retry RPC after error@1684262609) -> (continuation of Deferred@1953952784 after retry RPC after error@1219164749) -> (continuation of Deferred@1107578838 after retry RPC after error@954930177) -> (continuation of Deferred@2071896440 after retry RPC after error@1679381704) -> (continuation of Deferred@67358050 after retry RPC after error@1688767231) -> (continuation of Deferred@1792250483 after retry RPC after error@1145189621) -> (continuation of Deferred@1588627906 after retry RPC after error@2121211801) -> (continuation of Deferred@148458029 after retry RPC after error@1567175263) -> (continuation of Deferred@130899625 after retry RPC after error@30939678) -> (continuation of Deferred@1133682730 after retry RPC after error@1467849165) -> (continuation of Deferred@975748509 after retry RPC after error@2069977132) -> (continuation of Deferred@757347482 after retry RPC after error@372007682) -> (continuation of Deferred@1771565071 after retry RPC after error@407266601) -> (continuation of Deferred@340394591 after retry RPC after error@1628133287) -> (continuation of Deferred@936039425 after retry RPC after error@479105276), errback=(continuation of Deferred@1554639145 after retry RPC after error@426645814) -> (continuation of Deferred@799274426 after retry RPC after error@1622324836) -> (continuation of Deferred@1933700090 after retry RPC after error@445643533) -> (continuation of Deferred@707904451 after retry RPC after error@1598378359) -> (continuation of Deferred@598179678 after retry RPC after error@1175826356) -> (continuation of Deferred@1654543214 after retry RPC after error@388327587) -> (continuation of Deferred@266381462 after retry RPC after error@1684262609) -> (continuation of Deferred@1953952784 after retry RPC after error@1219164749) -> (continuation of Deferred@1107578838 after retry RPC after error@954930177) -> (continuation of Deferred@2071896440 after retry RPC after error@1679381704) -> (continuation of Deferred@67358050 after retry RPC after error@1688767231) -> (continuation of Deferred@1792250483 after retry RPC after error@1145189621) -> (continuation of Deferred@1588627906 after retry RPC after error@2121211801) -> (continuation of Deferred@148458029 after retry RPC after error@1567175263) -> (continuation of Deferred@130899625 after retry RPC after error@30939678) -> (continuation of Deferred@1133682730 after retry RPC after error@1467849165) -> (continuation of Deferred@975748509 after retry RPC after error@2069977132) -> (continuation of Deferred@757347482 after retry RPC after error@372007682) -> (continuation of Deferred@1771565071 after retry RPC after error@407266601) -> (continuation of Deferred@340394591 after retry RPC after error@1628133287) -> (continuation of Deferred@936039425 after retry RPC after error@479105276)))
08:08:36.238 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:36.238 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:36.238 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:36.239 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:36.239 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:36.242 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:36.242 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:36.242 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:36.239 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:36.243 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:36.243 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:36.243 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:36.243 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:36.298 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:36.299 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:36.299 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:36.299 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:36.299 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:36.300 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:36.300 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:36.300 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:36.300 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:36.300 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:36.301 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:36.301 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:36.301 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:36.302 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28442), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [42ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [90ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [94ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [94ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [129ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [131ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [133ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [133ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [133ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [148ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [149ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [162ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [163ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [163ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [185ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [185ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [186ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [186ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [203ms] refreshing cache from master, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [204ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [204ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [204ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [204ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [243ms] refreshing cache from master, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [244ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [246ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [250ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [250ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [263ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [263ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [264ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [264ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [362ms] refreshing cache from master, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [363ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [363ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [364ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [364ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [442ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [443ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [443ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [444ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [703ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [705ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [705ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [705ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1121ms] refreshing cache from master, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1124ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1124ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1125ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2521ms] refreshing cache from master, [2521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [2522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2523ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [2523ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2524ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [2524ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [3961ms] refreshing cache from master, [3961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [3961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [3962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [3962ms] too many traces: truncated at 100 traces, deferred=Deferred@1128086430(state=PENDING, result=null, callback=(continuation of Deferred@770224344 after retry RPC after error@790247885) -> (continuation of Deferred@132132600 after retry RPC after error@766182481) -> (continuation of Deferred@1168969548 after retry RPC after error@998740581) -> (continuation of Deferred@1024912387 after retry RPC after error@1214967420) -> (continuation of Deferred@1695567698 after retry RPC after error@1644424495) -> (continuation of Deferred@1761567640 after retry RPC after error@2004445685) -> (continuation of Deferred@284480151 after retry RPC after error@1843609395) -> (continuation of Deferred@2115199668 after retry RPC after error@1117358658) -> (continuation of Deferred@1959758060 after retry RPC after error@2178017) -> (continuation of Deferred@1698885523 after retry RPC after error@1795662563) -> (continuation of Deferred@1669844871 after retry RPC after error@1794117157) -> (continuation of Deferred@406608543 after retry RPC after error@1316680641) -> (continuation of Deferred@333248126 after retry RPC after error@2033668870) -> (continuation of Deferred@52762141 after retry RPC after error@441981251) -> (continuation of Deferred@1858302832 after retry RPC after error@766485197) -> (continuation of Deferred@110218395 after retry RPC after error@1557745419) -> (continuation of Deferred@695529235 after retry RPC after error@2040367418) -> (continuation of Deferred@1902147462 after retry RPC after error@1733812150) -> (continuation of Deferred@1767221304 after retry RPC after error@2090084465) -> (continuation of Deferred@247118882 after retry RPC after error@1472817196) -> (continuation of Deferred@320413317 after retry RPC after error@1309899575) -> (continuation of Deferred@353600891 after retry RPC after error@159844349), errback=(continuation of Deferred@770224344 after retry RPC after error@790247885) -> (continuation of Deferred@132132600 after retry RPC after error@766182481) -> (continuation of Deferred@1168969548 after retry RPC after error@998740581) -> (continuation of Deferred@1024912387 after retry RPC after error@1214967420) -> (continuation of Deferred@1695567698 after retry RPC after error@1644424495) -> (continuation of Deferred@1761567640 after retry RPC after error@2004445685) -> (continuation of Deferred@284480151 after retry RPC after error@1843609395) -> (continuation of Deferred@2115199668 after retry RPC after error@1117358658) -> (continuation of Deferred@1959758060 after retry RPC after error@2178017) -> (continuation of Deferred@1698885523 after retry RPC after error@1795662563) -> (continuation of Deferred@1669844871 after retry RPC after error@1794117157) -> (continuation of Deferred@406608543 after retry RPC after error@1316680641) -> (continuation of Deferred@333248126 after retry RPC after error@2033668870) -> (continuation of Deferred@52762141 after retry RPC after error@441981251) -> (continuation of Deferred@1858302832 after retry RPC after error@766485197) -> (continuation of Deferred@110218395 after retry RPC after error@1557745419) -> (continuation of Deferred@695529235 after retry RPC after error@2040367418) -> (continuation of Deferred@1902147462 after retry RPC after error@1733812150) -> (continuation of Deferred@1767221304 after retry RPC after error@2090084465) -> (continuation of Deferred@247118882 after retry RPC after error@1472817196) -> (continuation of Deferred@320413317 after retry RPC after error@1309899575) -> (continuation of Deferred@353600891 after retry RPC after error@159844349)))
08:08:36.332 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:36.368 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:36.369 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:36.369 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:36.369 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:36.369 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:36.369 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:36.370 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:36.370 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:36.370 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:36.370 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:36.371 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:36.371 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:36.371 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:36.393 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:36.393 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:36.393 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:36.393 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:36.393 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:36.394 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:36.394 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:36.394 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:36.394 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:36.394 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:36.394 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:36.394 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:36.394 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:36.400 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:36.408 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:36.408 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:36.409 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:36.409 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:36.409 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:36.409 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:36.410 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:36.410 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:36.410 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:36.409 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:36.410 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:36.410 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:36.410 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:36.412 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=28501), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [56ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [58ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [102ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [106ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [106ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [128ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [128ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [134ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [134ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [161ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [162ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [163ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [163ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [181ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [181ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [182ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [182ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [200ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [201ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [201ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [201ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [223ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [223ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [223ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [223ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [281ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [281ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [282ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [282ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [422ms] refreshing cache from master, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [422ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [423ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [423ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [424ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [660ms] refreshing cache from master, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [661ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [662ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [663ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [663ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1001ms] refreshing cache from master, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1004ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1005ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1005ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1880ms] refreshing cache from master, [1880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1881ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1881ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1882ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1882ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2680ms] refreshing cache from master, [2680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2682ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [2682ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [2682ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2682ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [4040ms] refreshing cache from master, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [4042ms] too many traces: truncated at 100 traces, deferred=Deferred@2092592083(state=PENDING, result=null, callback=(continuation of Deferred@1900837731 after retry RPC after error@832806990) -> (continuation of Deferred@1992351025 after retry RPC after error@1493947593) -> (continuation of Deferred@1259224040 after retry RPC after error@1736655639) -> (continuation of Deferred@391787395 after retry RPC after error@275779645) -> (continuation of Deferred@714848416 after retry RPC after error@1467866399) -> (continuation of Deferred@301808216 after retry RPC after error@27013538) -> (continuation of Deferred@1983235977 after retry RPC after error@1327069557) -> (continuation of Deferred@936293684 after retry RPC after error@1472168782) -> (continuation of Deferred@258871231 after retry RPC after error@196615670) -> (continuation of Deferred@1235058336 after retry RPC after error@1653813550) -> (continuation of Deferred@494917940 after retry RPC after error@1449341120) -> (continuation of Deferred@1948859602 after retry RPC after error@264796472) -> (continuation of Deferred@1813886860 after retry RPC after error@590835711) -> (continuation of Deferred@507844839 after retry RPC after error@1376297902) -> (continuation of Deferred@1395187636 after retry RPC after error@1266162361) -> (continuation of Deferred@2110562577 after retry RPC after error@1791916245) -> (continuation of Deferred@2140065607 after retry RPC after error@1948827613) -> (continuation of Deferred@1819565152 after retry RPC after error@1977981419) -> (continuation of Deferred@2081985767 after retry RPC after error@1308564206) -> (continuation of Deferred@52877421 after retry RPC after error@1515533091) -> (continuation of Deferred@1649552162 after retry RPC after error@1473213932) -> (continuation of Deferred@1646209736 after retry RPC after error@287359363) -> (continuation of Deferred@1649992638 after retry RPC after error@1309968908) -> (continuation of Deferred@1439084652 after retry RPC after error@1115508622) -> (continuation of Deferred@1729954156 after retry RPC after error@221492073) -> (continuation of Deferred@1830172531 after retry RPC after error@1161761888) -> (continuation of Deferred@1244036042 after retry RPC after error@1520316700) -> (continuation of Deferred@107948179 after retry RPC after error@1003401258), errback=(continuation of Deferred@1900837731 after retry RPC after error@832806990) -> (continuation of Deferred@1992351025 after retry RPC after error@1493947593) -> (continuation of Deferred@1259224040 after retry RPC after error@1736655639) -> (continuation of Deferred@391787395 after retry RPC after error@275779645) -> (continuation of Deferred@714848416 after retry RPC after error@1467866399) -> (continuation of Deferred@301808216 after retry RPC after error@27013538) -> (continuation of Deferred@1983235977 after retry RPC after error@1327069557) -> (continuation of Deferred@936293684 after retry RPC after error@1472168782) -> (continuation of Deferred@258871231 after retry RPC after error@196615670) -> (continuation of Deferred@1235058336 after retry RPC after error@1653813550) -> (continuation of Deferred@494917940 after retry RPC after error@1449341120) -> (continuation of Deferred@1948859602 after retry RPC after error@264796472) -> (continuation of Deferred@1813886860 after retry RPC after error@590835711) -> (continuation of Deferred@507844839 after retry RPC after error@1376297902) -> (continuation of Deferred@1395187636 after retry RPC after error@1266162361) -> (continuation of Deferred@2110562577 after retry RPC after error@1791916245) -> (continuation of Deferred@2140065607 after retry RPC after error@1948827613) -> (continuation of Deferred@1819565152 after retry RPC after error@1977981419) -> (continuation of Deferred@2081985767 after retry RPC after error@1308564206) -> (continuation of Deferred@52877421 after retry RPC after error@1515533091) -> (continuation of Deferred@1649552162 after retry RPC after error@1473213932) -> (continuation of Deferred@1646209736 after retry RPC after error@287359363) -> (continuation of Deferred@1649992638 after retry RPC after error@1309968908) -> (continuation of Deferred@1439084652 after retry RPC after error@1115508622) -> (continuation of Deferred@1729954156 after retry RPC after error@221492073) -> (continuation of Deferred@1830172531 after retry RPC after error@1161761888) -> (continuation of Deferred@1244036042 after retry RPC after error@1520316700) -> (continuation of Deferred@107948179 after retry RPC after error@1003401258)))
08:08:36.447 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:36.621 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:36.749 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:36.749 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:36.750 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:36.750 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:36.750 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:36.751 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:36.751 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:36.751 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:36.751 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:36.751 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:36.751 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:36.751 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:36.751 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:36.752 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28511), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [30ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [37ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [37ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [78ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [79ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [80ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [81ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [186ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [191ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [192ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [193ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [193ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [202ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [202ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [203ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [203ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [221ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [222ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [224ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [225ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [242ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [244ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [245ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [245ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [245ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [283ms] refreshing cache from master, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [284ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [285ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [285ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [285ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [324ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [324ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [422ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [422ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [423ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [423ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [940ms] refreshing cache from master, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [942ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [942ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [943ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [943ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1000ms] refreshing cache from master, [1000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1003ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1600ms] refreshing cache from master, [1600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1603ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1603ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1880ms] refreshing cache from master, [1880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1881ms] too many traces: truncated at 100 traces, deferred=Deferred@1846499344(state=PENDING, result=null, callback=(continuation of Deferred@93601739 after retry RPC after error@1896322429) -> (continuation of Deferred@571826196 after retry RPC after error@911106974) -> (continuation of Deferred@310405371 after retry RPC after error@1608625067) -> (continuation of Deferred@1459451267 after retry RPC after error@334151249) -> (continuation of Deferred@45927271 after retry RPC after error@1347589224) -> (continuation of Deferred@1841214092 after retry RPC after error@736137564) -> (continuation of Deferred@1331921076 after retry RPC after error@198618340) -> (continuation of Deferred@325342656 after retry RPC after error@1008819329) -> (continuation of Deferred@1863585169 after retry RPC after error@1360735515) -> (continuation of Deferred@1616951469 after retry RPC after error@1444099444) -> (continuation of Deferred@421839522 after retry RPC after error@299845480) -> (continuation of Deferred@1956585518 after retry RPC after error@1005060956) -> (continuation of Deferred@82245457 after retry RPC after error@1869153442) -> (continuation of Deferred@1652217649 after retry RPC after error@427018945) -> (continuation of Deferred@714930881 after retry RPC after error@225945380) -> (continuation of Deferred@956312292 after retry RPC after error@1042467527) -> (continuation of Deferred@1940223280 after retry RPC after error@1138467559) -> (continuation of Deferred@2075453298 after retry RPC after error@1407745585) -> (continuation of Deferred@188521865 after retry RPC after error@367970963) -> (continuation of Deferred@1228746795 after retry RPC after error@1505023691) -> (continuation of Deferred@915130529 after retry RPC after error@1431447217) -> (continuation of Deferred@1968109656 after retry RPC after error@171141812), errback=(continuation of Deferred@93601739 after retry RPC after error@1896322429) -> (continuation of Deferred@571826196 after retry RPC after error@911106974) -> (continuation of Deferred@310405371 after retry RPC after error@1608625067) -> (continuation of Deferred@1459451267 after retry RPC after error@334151249) -> (continuation of Deferred@45927271 after retry RPC after error@1347589224) -> (continuation of Deferred@1841214092 after retry RPC after error@736137564) -> (continuation of Deferred@1331921076 after retry RPC after error@198618340) -> (continuation of Deferred@325342656 after retry RPC after error@1008819329) -> (continuation of Deferred@1863585169 after retry RPC after error@1360735515) -> (continuation of Deferred@1616951469 after retry RPC after error@1444099444) -> (continuation of Deferred@421839522 after retry RPC after error@299845480) -> (continuation of Deferred@1956585518 after retry RPC after error@1005060956) -> (continuation of Deferred@82245457 after retry RPC after error@1869153442) -> (continuation of Deferred@1652217649 after retry RPC after error@427018945) -> (continuation of Deferred@714930881 after retry RPC after error@225945380) -> (continuation of Deferred@956312292 after retry RPC after error@1042467527) -> (continuation of Deferred@1940223280 after retry RPC after error@1138467559) -> (continuation of Deferred@2075453298 after retry RPC after error@1407745585) -> (continuation of Deferred@188521865 after retry RPC after error@367970963) -> (continuation of Deferred@1228746795 after retry RPC after error@1505023691) -> (continuation of Deferred@915130529 after retry RPC after error@1431447217) -> (continuation of Deferred@1968109656 after retry RPC after error@171141812)))
08:08:36.755 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
08:08:36.755 [WARN - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28511), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [30ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [37ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [37ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [78ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [79ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [80ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [81ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [186ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [191ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [192ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [193ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [193ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [202ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [202ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [203ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [203ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [221ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [222ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [224ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [225ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [242ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [244ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [245ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [245ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [245ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [283ms] refreshing cache from master, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [284ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [285ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [285ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [285ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [324ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [324ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [422ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [422ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [423ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [423ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [940ms] refreshing cache from master, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [942ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [942ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [943ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [943ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1000ms] refreshing cache from master, [1000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1003ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1600ms] refreshing cache from master, [1600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1603ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1603ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1880ms] refreshing cache from master, [1880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1881ms] too many traces: truncated at 100 traces, deferred=Deferred@1846499344(state=PENDING, result=null, callback=(continuation of Deferred@93601739 after retry RPC after error@1896322429) -> (continuation of Deferred@571826196 after retry RPC after error@911106974) -> (continuation of Deferred@310405371 after retry RPC after error@1608625067) -> (continuation of Deferred@1459451267 after retry RPC after error@334151249) -> (continuation of Deferred@45927271 after retry RPC after error@1347589224) -> (continuation of Deferred@1841214092 after retry RPC after error@736137564) -> (continuation of Deferred@1331921076 after retry RPC after error@198618340) -> (continuation of Deferred@325342656 after retry RPC after error@1008819329) -> (continuation of Deferred@1863585169 after retry RPC after error@1360735515) -> (continuation of Deferred@1616951469 after retry RPC after error@1444099444) -> (continuation of Deferred@421839522 after retry RPC after error@299845480) -> (continuation of Deferred@1956585518 after retry RPC after error@1005060956) -> (continuation of Deferred@82245457 after retry RPC after error@1869153442) -> (continuation of Deferred@1652217649 after retry RPC after error@427018945) -> (continuation of Deferred@714930881 after retry RPC after error@225945380) -> (continuation of Deferred@956312292 after retry RPC after error@1042467527) -> (continuation of Deferred@1940223280 after retry RPC after error@1138467559) -> (continuation of Deferred@2075453298 after retry RPC after error@1407745585) -> (continuation of Deferred@188521865 after retry RPC after error@367970963) -> (continuation of Deferred@1228746795 after retry RPC after error@1505023691) -> (continuation of Deferred@915130529 after retry RPC after error@1431447217) -> (continuation of Deferred@1968109656 after retry RPC after error@171141812), errback=(continuation of Deferred@93601739 after retry RPC after error@1896322429) -> (continuation of Deferred@571826196 after retry RPC after error@911106974) -> (continuation of Deferred@310405371 after retry RPC after error@1608625067) -> (continuation of Deferred@1459451267 after retry RPC after error@334151249) -> (continuation of Deferred@45927271 after retry RPC after error@1347589224) -> (continuation of Deferred@1841214092 after retry RPC after error@736137564) -> (continuation of Deferred@1331921076 after retry RPC after error@198618340) -> (continuation of Deferred@325342656 after retry RPC after error@1008819329) -> (continuation of Deferred@1863585169 after retry RPC after error@1360735515) -> (continuation of Deferred@1616951469 after retry RPC after error@1444099444) -> (continuation of Deferred@421839522 after retry RPC after error@299845480) -> (continuation of Deferred@1956585518 after retry RPC after error@1005060956) -> (continuation of Deferred@82245457 after retry RPC after error@1869153442) -> (continuation of Deferred@1652217649 after retry RPC after error@427018945) -> (continuation of Deferred@714930881 after retry RPC after error@225945380) -> (continuation of Deferred@956312292 after retry RPC after error@1042467527) -> (continuation of Deferred@1940223280 after retry RPC after error@1138467559) -> (continuation of Deferred@2075453298 after retry RPC after error@1407745585) -> (continuation of Deferred@188521865 after retry RPC after error@367970963) -> (continuation of Deferred@1228746795 after retry RPC after error@1505023691) -> (continuation of Deferred@915130529 after retry RPC after error@1431447217) -> (continuation of Deferred@1968109656 after retry RPC after error@171141812)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.200.124:34439
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:36.762 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_4).
08:08:36.765 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#4 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_4.
08:08:36.768 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to FAILED on 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28511), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [30ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [37ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [37ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [78ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [79ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [80ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [81ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [186ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [191ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [192ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [193ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [193ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [202ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [202ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [203ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [203ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [221ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [222ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [224ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [225ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [242ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [244ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [245ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [245ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [245ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [283ms] refreshing cache from master, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [284ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [285ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [285ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [285ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [324ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [324ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [422ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [422ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [423ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [423ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [940ms] refreshing cache from master, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [942ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [942ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [943ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [943ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1000ms] refreshing cache from master, [1000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1003ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1600ms] refreshing cache from master, [1600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1603ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1603ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1880ms] refreshing cache from master, [1880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1881ms] too many traces: truncated at 100 traces, deferred=Deferred@1846499344(state=PENDING, result=null, callback=(continuation of Deferred@93601739 after retry RPC after error@1896322429) -> (continuation of Deferred@571826196 after retry RPC after error@911106974) -> (continuation of Deferred@310405371 after retry RPC after error@1608625067) -> (continuation of Deferred@1459451267 after retry RPC after error@334151249) -> (continuation of Deferred@45927271 after retry RPC after error@1347589224) -> (continuation of Deferred@1841214092 after retry RPC after error@736137564) -> (continuation of Deferred@1331921076 after retry RPC after error@198618340) -> (continuation of Deferred@325342656 after retry RPC after error@1008819329) -> (continuation of Deferred@1863585169 after retry RPC after error@1360735515) -> (continuation of Deferred@1616951469 after retry RPC after error@1444099444) -> (continuation of Deferred@421839522 after retry RPC after error@299845480) -> (continuation of Deferred@1956585518 after retry RPC after error@1005060956) -> (continuation of Deferred@82245457 after retry RPC after error@1869153442) -> (continuation of Deferred@1652217649 after retry RPC after error@427018945) -> (continuation of Deferred@714930881 after retry RPC after error@225945380) -> (continuation of Deferred@956312292 after retry RPC after error@1042467527) -> (continuation of Deferred@1940223280 after retry RPC after error@1138467559) -> (continuation of Deferred@2075453298 after retry RPC after error@1407745585) -> (continuation of Deferred@188521865 after retry RPC after error@367970963) -> (continuation of Deferred@1228746795 after retry RPC after error@1505023691) -> (continuation of Deferred@915130529 after retry RPC after error@1431447217) -> (continuation of Deferred@1968109656 after retry RPC after error@171141812), errback=(continuation of Deferred@93601739 after retry RPC after error@1896322429) -> (continuation of Deferred@571826196 after retry RPC after error@911106974) -> (continuation of Deferred@310405371 after retry RPC after error@1608625067) -> (continuation of Deferred@1459451267 after retry RPC after error@334151249) -> (continuation of Deferred@45927271 after retry RPC after error@1347589224) -> (continuation of Deferred@1841214092 after retry RPC after error@736137564) -> (continuation of Deferred@1331921076 after retry RPC after error@198618340) -> (continuation of Deferred@325342656 after retry RPC after error@1008819329) -> (continuation of Deferred@1863585169 after retry RPC after error@1360735515) -> (continuation of Deferred@1616951469 after retry RPC after error@1444099444) -> (continuation of Deferred@421839522 after retry RPC after error@299845480) -> (continuation of Deferred@1956585518 after retry RPC after error@1005060956) -> (continuation of Deferred@82245457 after retry RPC after error@1869153442) -> (continuation of Deferred@1652217649 after retry RPC after error@427018945) -> (continuation of Deferred@714930881 after retry RPC after error@225945380) -> (continuation of Deferred@956312292 after retry RPC after error@1042467527) -> (continuation of Deferred@1940223280 after retry RPC after error@1138467559) -> (continuation of Deferred@2075453298 after retry RPC after error@1407745585) -> (continuation of Deferred@188521865 after retry RPC after error@367970963) -> (continuation of Deferred@1228746795 after retry RPC after error@1505023691) -> (continuation of Deferred@915130529 after retry RPC after error@1431447217) -> (continuation of Deferred@1968109656 after retry RPC after error@171141812)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.200.124:34439
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:36.776 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:08:36.776 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#4) of source Source: KuduSource.
08:08:36.778 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_4.
08:08:36.778 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (0d2ddb76420639a9ec06ca05e894cb50) switched from state RUNNING to RESTARTING.
08:08:36.798 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:36.798 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:36.798 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:36.798 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:36.799 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:36.799 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:36.799 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:36.799 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:36.799 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:36.799 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:36.799 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:36.799 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:36.799 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:36.799 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:36.799 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:36.799 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:36.799 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:36.800 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:36.800 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:36.800 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:36.800 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:36.800 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:36.800 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:36.800 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:36.800 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:36.800 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:36.900 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:36.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:36.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:35.282492  2987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:36.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:35.263247  2985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:36.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:36.970120  2986 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1700 milliseconds
08:08:36.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:36.970247  2978 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:08:36.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:36.972108  2978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:08:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:36.976820  2978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:08:36.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:36.978283  2978 hybrid_clock.cc:648] HybridClock initialized: now 1779091716978236 us; error 53 us; skew 500 ppm
08:08:36.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:36.979436  2978 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:08:36.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:36.990665  2978 webserver.cc:533] Webserver started at http://127.2.90.130:39997/ using document root <none> and password file <none>
08:08:36.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:36.992224  2978 fs_manager.cc:362] Metadata directory not provided
08:08:36.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:36.992519  2978 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:08:36.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:36.993158  2978 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:08:37.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.000524  2978 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-1/data/instance:
08:08:37.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5e3589ebfaf94fe5849b6322dc8e0be0"
08:08:37.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:36 on dist-test-slave-1jss"
08:08:37.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.002285  2978 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-1/wal/instance:
08:08:37.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5e3589ebfaf94fe5849b6322dc8e0be0"
08:08:37.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:36 on dist-test-slave-1jss"
08:08:37.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.013406  2978 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.004s	sys 0.004s
08:08:37.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.021157  3010 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:08:37.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.023608  2978 fs_manager.cc:730] Time spent opening block manager: real 0.007s	user 0.005s	sys 0.001s
08:08:37.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.023983  2978 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-1/wal
08:08:37.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5e3589ebfaf94fe5849b6322dc8e0be0"
08:08:37.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:36 on dist-test-slave-1jss"
08:08:37.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.024324  2978 fs_report.cc:389] FS layout report
08:08:37.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:08:37.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-1/wal
08:08:37.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-1/wal
08:08:37.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-1/data/data
08:08:37.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:08:37.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:08:37.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:08:37.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:08:37.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:08:37.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:08:37.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:08:37.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:08:37.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:08:37.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:08:37.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:08:37.036 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:37.036 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:37.036 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:37.036 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.036 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.037 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.037 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.037 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.037 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.038 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.038 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.038 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.038 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:37.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.092514  2978 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:08:37.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.094405  2978 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:08:37.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.094869  2978 kserver.cc:163] Server-wide thread pool size limit: 3276
08:08:37.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.099009  2978 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:08:37.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.104404  2978 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:08:37.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.104635  2978 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:08:37.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.104853  2978 ts_tablet_manager.cc:616] Registered 0 tablets
08:08:37.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.104990  2978 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:08:37.119 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:37.284 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:37.285 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:37.285 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:37.285 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:37.285 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:37.285 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:37.285 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:37.286 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:37.286 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:37.286 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:37.286 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:37.286 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:37.287 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:37.288 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29007), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [17ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [19ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [20ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [20ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [78ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [80ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [120ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [121ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [146ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [147ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [149ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [150ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [151ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [151ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [163ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [164ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [165ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [165ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [182ms] refreshing cache from master, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [183ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [184ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [185ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [185ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [202ms] refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [203ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [208ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [211ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [211ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [282ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [282ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [283ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [283ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [344ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [344ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [345ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [345ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [483ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [484ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [484ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [484ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [762ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [762ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [763ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1000ms] refreshing cache from master, [1000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1004ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1004ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1360ms] refreshing cache from master, [1360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1362ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2540ms] refreshing cache from master, [2540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2542ms] too many traces: truncated at 100 traces, [2542ms] too many traces: truncated at 100 traces, deferred=Deferred@1060151549(state=PENDING, result=null, callback=(continuation of Deferred@990439810 after retry RPC after error@1721338696) -> (continuation of Deferred@1759648094 after retry RPC after error@1383037943) -> (continuation of Deferred@777505985 after retry RPC after error@79610248) -> (continuation of Deferred@2087583912 after retry RPC after error@1442278417) -> (continuation of Deferred@1163297706 after retry RPC after error@924235785) -> (continuation of Deferred@1005683971 after retry RPC after error@1426649480) -> (continuation of Deferred@615670608 after retry RPC after error@644239679) -> (continuation of Deferred@285737325 after retry RPC after error@60700277) -> (continuation of Deferred@872512949 after retry RPC after error@544882083) -> (continuation of Deferred@1898464168 after retry RPC after error@66580070) -> (continuation of Deferred@1009047416 after retry RPC after error@1304584826) -> (continuation of Deferred@2118409577 after retry RPC after error@1115428889) -> (continuation of Deferred@1492752441 after retry RPC after error@108458222) -> (continuation of Deferred@1510296156 after retry RPC after error@2015051221) -> (continuation of Deferred@1823955647 after retry RPC after error@1576482375) -> (continuation of Deferred@760266767 after retry RPC after error@201635301) -> (continuation of Deferred@1513124984 after retry RPC after error@1049703543) -> (continuation of Deferred@367708946 after retry RPC after error@1013510103) -> (continuation of Deferred@1696784278 after retry RPC after error@1378315721) -> (continuation of Deferred@290885316 after retry RPC after error@1790696814) -> (continuation of Deferred@420897216 after retry RPC after error@1882590734) -> (continuation of Deferred@1429442146 after retry RPC after error@1641511175) -> (continuation of Deferred@1264917660 after retry RPC after error@199437696) -> (continuation of Deferred@1114300928 after retry RPC after error@405779467) -> (continuation of Deferred@2077084270 after retry RPC after error@1775265722), errback=(continuation of Deferred@990439810 after retry RPC after error@1721338696) -> (continuation of Deferred@1759648094 after retry RPC after error@1383037943) -> (continuation of Deferred@777505985 after retry RPC after error@79610248) -> (continuation of Deferred@2087583912 after retry RPC after error@1442278417) -> (continuation of Deferred@1163297706 after retry RPC after error@924235785) -> (continuation of Deferred@1005683971 after retry RPC after error@1426649480) -> (continuation of Deferred@615670608 after retry RPC after error@644239679) -> (continuation of Deferred@285737325 after retry RPC after error@60700277) -> (continuation of Deferred@872512949 after retry RPC after error@544882083) -> (continuation of Deferred@1898464168 after retry RPC after error@66580070) -> (continuation of Deferred@1009047416 after retry RPC after error@1304584826) -> (continuation of Deferred@2118409577 after retry RPC after error@1115428889) -> (continuation of Deferred@1492752441 after retry RPC after error@108458222) -> (continuation of Deferred@1510296156 after retry RPC after error@2015051221) -> (continuation of Deferred@1823955647 after retry RPC after error@1576482375) -> (continuation of Deferred@760266767 after retry RPC after error@201635301) -> (continuation of Deferred@1513124984 after retry RPC after error@1049703543) -> (continuation of Deferred@367708946 after retry RPC after error@1013510103) -> (continuation of Deferred@1696784278 after retry RPC after error@1378315721) -> (continuation of Deferred@290885316 after retry RPC after error@1790696814) -> (continuation of Deferred@420897216 after retry RPC after error@1882590734) -> (continuation of Deferred@1429442146 after retry RPC after error@1641511175) -> (continuation of Deferred@1264917660 after retry RPC after error@199437696) -> (continuation of Deferred@1114300928 after retry RPC after error@405779467) -> (continuation of Deferred@2077084270 after retry RPC after error@1775265722)))
08:08:37.291 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
08:08:37.292 [WARN - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29007), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [17ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [19ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [20ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [20ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [78ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [80ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [120ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [121ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [146ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [147ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [149ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [150ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [151ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [151ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [163ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [164ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [165ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [165ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [182ms] refreshing cache from master, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [183ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [184ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [185ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [185ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [202ms] refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [203ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [208ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [211ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [211ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [282ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [282ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [283ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [283ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [344ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [344ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [345ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [345ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [483ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [484ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [484ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [484ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [762ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [762ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [763ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1000ms] refreshing cache from master, [1000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1004ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1004ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1360ms] refreshing cache from master, [1360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1362ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2540ms] refreshing cache from master, [2540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2542ms] too many traces: truncated at 100 traces, [2542ms] too many traces: truncated at 100 traces, deferred=Deferred@1060151549(state=PENDING, result=null, callback=(continuation of Deferred@990439810 after retry RPC after error@1721338696) -> (continuation of Deferred@1759648094 after retry RPC after error@1383037943) -> (continuation of Deferred@777505985 after retry RPC after error@79610248) -> (continuation of Deferred@2087583912 after retry RPC after error@1442278417) -> (continuation of Deferred@1163297706 after retry RPC after error@924235785) -> (continuation of Deferred@1005683971 after retry RPC after error@1426649480) -> (continuation of Deferred@615670608 after retry RPC after error@644239679) -> (continuation of Deferred@285737325 after retry RPC after error@60700277) -> (continuation of Deferred@872512949 after retry RPC after error@544882083) -> (continuation of Deferred@1898464168 after retry RPC after error@66580070) -> (continuation of Deferred@1009047416 after retry RPC after error@1304584826) -> (continuation of Deferred@2118409577 after retry RPC after error@1115428889) -> (continuation of Deferred@1492752441 after retry RPC after error@108458222) -> (continuation of Deferred@1510296156 after retry RPC after error@2015051221) -> (continuation of Deferred@1823955647 after retry RPC after error@1576482375) -> (continuation of Deferred@760266767 after retry RPC after error@201635301) -> (continuation of Deferred@1513124984 after retry RPC after error@1049703543) -> (continuation of Deferred@367708946 after retry RPC after error@1013510103) -> (continuation of Deferred@1696784278 after retry RPC after error@1378315721) -> (continuation of Deferred@290885316 after retry RPC after error@1790696814) -> (continuation of Deferred@420897216 after retry RPC after error@1882590734) -> (continuation of Deferred@1429442146 after retry RPC after error@1641511175) -> (continuation of Deferred@1264917660 after retry RPC after error@199437696) -> (continuation of Deferred@1114300928 after retry RPC after error@405779467) -> (continuation of Deferred@2077084270 after retry RPC after error@1775265722), errback=(continuation of Deferred@990439810 after retry RPC after error@1721338696) -> (continuation of Deferred@1759648094 after retry RPC after error@1383037943) -> (continuation of Deferred@777505985 after retry RPC after error@79610248) -> (continuation of Deferred@2087583912 after retry RPC after error@1442278417) -> (continuation of Deferred@1163297706 after retry RPC after error@924235785) -> (continuation of Deferred@1005683971 after retry RPC after error@1426649480) -> (continuation of Deferred@615670608 after retry RPC after error@644239679) -> (continuation of Deferred@285737325 after retry RPC after error@60700277) -> (continuation of Deferred@872512949 after retry RPC after error@544882083) -> (continuation of Deferred@1898464168 after retry RPC after error@66580070) -> (continuation of Deferred@1009047416 after retry RPC after error@1304584826) -> (continuation of Deferred@2118409577 after retry RPC after error@1115428889) -> (continuation of Deferred@1492752441 after retry RPC after error@108458222) -> (continuation of Deferred@1510296156 after retry RPC after error@2015051221) -> (continuation of Deferred@1823955647 after retry RPC after error@1576482375) -> (continuation of Deferred@760266767 after retry RPC after error@201635301) -> (continuation of Deferred@1513124984 after retry RPC after error@1049703543) -> (continuation of Deferred@367708946 after retry RPC after error@1013510103) -> (continuation of Deferred@1696784278 after retry RPC after error@1378315721) -> (continuation of Deferred@290885316 after retry RPC after error@1790696814) -> (continuation of Deferred@420897216 after retry RPC after error@1882590734) -> (continuation of Deferred@1429442146 after retry RPC after error@1641511175) -> (continuation of Deferred@1264917660 after retry RPC after error@199437696) -> (continuation of Deferred@1114300928 after retry RPC after error@405779467) -> (continuation of Deferred@2077084270 after retry RPC after error@1775265722)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.200.125:46459
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:37.297 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_4).
08:08:37.300 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#4 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_4.
08:08:37.304 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to FAILED on 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29007), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [17ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [19ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [20ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [20ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [78ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [80ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [120ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [121ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [146ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [147ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [149ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [150ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [151ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [151ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [163ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [164ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [165ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [165ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [182ms] refreshing cache from master, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [183ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [184ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [185ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [185ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [202ms] refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [203ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [208ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [211ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [211ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [282ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [282ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [283ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [283ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [344ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [344ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [345ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [345ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [483ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [484ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [484ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [484ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [762ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [762ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [763ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [763ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1000ms] refreshing cache from master, [1000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1004ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1004ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1360ms] refreshing cache from master, [1360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1362ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2540ms] refreshing cache from master, [2540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2542ms] too many traces: truncated at 100 traces, [2542ms] too many traces: truncated at 100 traces, deferred=Deferred@1060151549(state=PENDING, result=null, callback=(continuation of Deferred@990439810 after retry RPC after error@1721338696) -> (continuation of Deferred@1759648094 after retry RPC after error@1383037943) -> (continuation of Deferred@777505985 after retry RPC after error@79610248) -> (continuation of Deferred@2087583912 after retry RPC after error@1442278417) -> (continuation of Deferred@1163297706 after retry RPC after error@924235785) -> (continuation of Deferred@1005683971 after retry RPC after error@1426649480) -> (continuation of Deferred@615670608 after retry RPC after error@644239679) -> (continuation of Deferred@285737325 after retry RPC after error@60700277) -> (continuation of Deferred@872512949 after retry RPC after error@544882083) -> (continuation of Deferred@1898464168 after retry RPC after error@66580070) -> (continuation of Deferred@1009047416 after retry RPC after error@1304584826) -> (continuation of Deferred@2118409577 after retry RPC after error@1115428889) -> (continuation of Deferred@1492752441 after retry RPC after error@108458222) -> (continuation of Deferred@1510296156 after retry RPC after error@2015051221) -> (continuation of Deferred@1823955647 after retry RPC after error@1576482375) -> (continuation of Deferred@760266767 after retry RPC after error@201635301) -> (continuation of Deferred@1513124984 after retry RPC after error@1049703543) -> (continuation of Deferred@367708946 after retry RPC after error@1013510103) -> (continuation of Deferred@1696784278 after retry RPC after error@1378315721) -> (continuation of Deferred@290885316 after retry RPC after error@1790696814) -> (continuation of Deferred@420897216 after retry RPC after error@1882590734) -> (continuation of Deferred@1429442146 after retry RPC after error@1641511175) -> (continuation of Deferred@1264917660 after retry RPC after error@199437696) -> (continuation of Deferred@1114300928 after retry RPC after error@405779467) -> (continuation of Deferred@2077084270 after retry RPC after error@1775265722), errback=(continuation of Deferred@990439810 after retry RPC after error@1721338696) -> (continuation of Deferred@1759648094 after retry RPC after error@1383037943) -> (continuation of Deferred@777505985 after retry RPC after error@79610248) -> (continuation of Deferred@2087583912 after retry RPC after error@1442278417) -> (continuation of Deferred@1163297706 after retry RPC after error@924235785) -> (continuation of Deferred@1005683971 after retry RPC after error@1426649480) -> (continuation of Deferred@615670608 after retry RPC after error@644239679) -> (continuation of Deferred@285737325 after retry RPC after error@60700277) -> (continuation of Deferred@872512949 after retry RPC after error@544882083) -> (continuation of Deferred@1898464168 after retry RPC after error@66580070) -> (continuation of Deferred@1009047416 after retry RPC after error@1304584826) -> (continuation of Deferred@2118409577 after retry RPC after error@1115428889) -> (continuation of Deferred@1492752441 after retry RPC after error@108458222) -> (continuation of Deferred@1510296156 after retry RPC after error@2015051221) -> (continuation of Deferred@1823955647 after retry RPC after error@1576482375) -> (continuation of Deferred@760266767 after retry RPC after error@201635301) -> (continuation of Deferred@1513124984 after retry RPC after error@1049703543) -> (continuation of Deferred@367708946 after retry RPC after error@1013510103) -> (continuation of Deferred@1696784278 after retry RPC after error@1378315721) -> (continuation of Deferred@290885316 after retry RPC after error@1790696814) -> (continuation of Deferred@420897216 after retry RPC after error@1882590734) -> (continuation of Deferred@1429442146 after retry RPC after error@1641511175) -> (continuation of Deferred@1264917660 after retry RPC after error@199437696) -> (continuation of Deferred@1114300928 after retry RPC after error@405779467) -> (continuation of Deferred@2077084270 after retry RPC after error@1775265722)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.200.125:46459
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:37.312 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:08:37.312 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#4) of source Source: KuduSource.
08:08:37.312 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_4.
08:08:37.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.317287  2978 rpc_server.cc:307] RPC server started. Bound to: 127.2.90.130:34617
08:08:37.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.317502  3122 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.90.130:34617 every 8 connection(s)
08:08:37.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.321573  2978 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-1/data/info.pb
08:08:37.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.333101  2410 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 2978
08:08:37.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.333863  2410 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-1/wal/instance
08:08:37.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.394217  2410 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:08:37.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:08:37.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-2/wal
08:08:37.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-2/data
08:08:37.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:08:37.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:08:37.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:08:37.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:37.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:37.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:37.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-2/logs
08:08:37.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-2/data/info.pb
08:08:37.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:37.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:08:37.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:08:37.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:08:37.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:08:37.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:37.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:37.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:37.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:08:37.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:08:37.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.90.131:0
08:08:37.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.90.131
08:08:37.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.90.131
08:08:37.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:37.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.90.190:42265,127.2.90.189:41065,127.2.90.188:42457
08:08:37.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.90.148:36029
08:08:37.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:37.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:37.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:08:37.400 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:37.445 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:37.445 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:37.446 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:37.446 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:37.447 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:37.447 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:37.447 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:37.447 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:37.447 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:37.446 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:37.447 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:37.447 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:37.447 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:37.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:37.448 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29167), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [11ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [13ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [15ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [15ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [73ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [90ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [90ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [128ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [129ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [130ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [131ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [131ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [142ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [143ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [144ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [144ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [165ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [168ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [168ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [168ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [202ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [206ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [206ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [206ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [242ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [243ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [243ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [243ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [363ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [363ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [364ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [365ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [584ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [584ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [584ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [900ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [902ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [903ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [904ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [904ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1541ms] refreshing cache from master, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1541ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1543ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2841ms] refreshing cache from master, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2843ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2843ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [4501ms] refreshing cache from master, [4501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [4501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [4502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [4502ms] too many traces: truncated at 100 traces, deferred=Deferred@1452467799(state=PENDING, result=null, callback=(continuation of Deferred@1880675522 after retry RPC after error@477676884) -> (continuation of Deferred@1551501245 after retry RPC after error@488366651) -> (continuation of Deferred@722705310 after retry RPC after error@1906031053) -> (continuation of Deferred@2110791596 after retry RPC after error@1058545687) -> (continuation of Deferred@148935425 after retry RPC after error@605619713) -> (continuation of Deferred@1506365521 after retry RPC after error@665832423) -> (continuation of Deferred@727399560 after retry RPC after error@1201544940) -> (continuation of Deferred@1413911958 after retry RPC after error@225418250) -> (continuation of Deferred@2132954707 after retry RPC after error@1216108069) -> (continuation of Deferred@687247513 after retry RPC after error@1502139969) -> (continuation of Deferred@884296693 after retry RPC after error@517140024) -> (continuation of Deferred@37537571 after retry RPC after error@496579579) -> (continuation of Deferred@57489758 after retry RPC after error@172471333) -> (continuation of Deferred@1848016785 after retry RPC after error@989105989) -> (continuation of Deferred@1345971852 after retry RPC after error@1734907442) -> (continuation of Deferred@980395961 after retry RPC after error@612337942) -> (continuation of Deferred@1005393555 after retry RPC after error@412602074) -> (continuation of Deferred@1602412574 after retry RPC after error@133035457) -> (continuation of Deferred@1424437793 after retry RPC after error@1914754937) -> (continuation of Deferred@980048691 after retry RPC after error@1388438082) -> (continuation of Deferred@1062908929 after retry RPC after error@1261778828) -> (continuation of Deferred@602824218 after retry RPC after error@2128636887) -> (continuation of Deferred@351281846 after retry RPC after error@1981542131) -> (continuation of Deferred@668229796 after retry RPC after error@1511459162) -> (continuation of Deferred@1340568892 after retry RPC after error@1721919045), errback=(continuation of Deferred@1880675522 after retry RPC after error@477676884) -> (continuation of Deferred@1551501245 after retry RPC after error@488366651) -> (continuation of Deferred@722705310 after retry RPC after error@1906031053) -> (continuation of Deferred@2110791596 after retry RPC after error@1058545687) -> (continuation of Deferred@148935425 after retry RPC after error@605619713) -> (continuation of Deferred@1506365521 after retry RPC after error@665832423) -> (continuation of Deferred@727399560 after retry RPC after error@1201544940) -> (continuation of Deferred@1413911958 after retry RPC after error@225418250) -> (continuation of Deferred@2132954707 after retry RPC after error@1216108069) -> (continuation of Deferred@687247513 after retry RPC after error@1502139969) -> (continuation of Deferred@884296693 after retry RPC after error@517140024) -> (continuation of Deferred@37537571 after retry RPC after error@496579579) -> (continuation of Deferred@57489758 after retry RPC after error@172471333) -> (continuation of Deferred@1848016785 after retry RPC after error@989105989) -> (continuation of Deferred@1345971852 after retry RPC after error@1734907442) -> (continuation of Deferred@980395961 after retry RPC after error@612337942) -> (continuation of Deferred@1005393555 after retry RPC after error@412602074) -> (continuation of Deferred@1602412574 after retry RPC after error@133035457) -> (continuation of Deferred@1424437793 after retry RPC after error@1914754937) -> (continuation of Deferred@980048691 after retry RPC after error@1388438082) -> (continuation of Deferred@1062908929 after retry RPC after error@1261778828) -> (continuation of Deferred@602824218 after retry RPC after error@2128636887) -> (continuation of Deferred@351281846 after retry RPC after error@1981542131) -> (continuation of Deferred@668229796 after retry RPC after error@1511459162) -> (continuation of Deferred@1340568892 after retry RPC after error@1721919045)))
08:08:37.451 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
08:08:37.451 [WARN - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29167), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [11ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [13ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [15ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [15ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [73ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [90ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [90ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [128ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [129ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [130ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [131ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [131ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [142ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [143ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [144ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [144ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [165ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [168ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [168ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [168ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [202ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [206ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [206ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [206ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [242ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [243ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [243ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [243ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [363ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [363ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [364ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [365ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [584ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [584ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [584ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [900ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [902ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [903ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [904ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [904ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1541ms] refreshing cache from master, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1541ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1543ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2841ms] refreshing cache from master, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2843ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2843ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [4501ms] refreshing cache from master, [4501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [4501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [4502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [4502ms] too many traces: truncated at 100 traces, deferred=Deferred@1452467799(state=PENDING, result=null, callback=(continuation of Deferred@1880675522 after retry RPC after error@477676884) -> (continuation of Deferred@1551501245 after retry RPC after error@488366651) -> (continuation of Deferred@722705310 after retry RPC after error@1906031053) -> (continuation of Deferred@2110791596 after retry RPC after error@1058545687) -> (continuation of Deferred@148935425 after retry RPC after error@605619713) -> (continuation of Deferred@1506365521 after retry RPC after error@665832423) -> (continuation of Deferred@727399560 after retry RPC after error@1201544940) -> (continuation of Deferred@1413911958 after retry RPC after error@225418250) -> (continuation of Deferred@2132954707 after retry RPC after error@1216108069) -> (continuation of Deferred@687247513 after retry RPC after error@1502139969) -> (continuation of Deferred@884296693 after retry RPC after error@517140024) -> (continuation of Deferred@37537571 after retry RPC after error@496579579) -> (continuation of Deferred@57489758 after retry RPC after error@172471333) -> (continuation of Deferred@1848016785 after retry RPC after error@989105989) -> (continuation of Deferred@1345971852 after retry RPC after error@1734907442) -> (continuation of Deferred@980395961 after retry RPC after error@612337942) -> (continuation of Deferred@1005393555 after retry RPC after error@412602074) -> (continuation of Deferred@1602412574 after retry RPC after error@133035457) -> (continuation of Deferred@1424437793 after retry RPC after error@1914754937) -> (continuation of Deferred@980048691 after retry RPC after error@1388438082) -> (continuation of Deferred@1062908929 after retry RPC after error@1261778828) -> (continuation of Deferred@602824218 after retry RPC after error@2128636887) -> (continuation of Deferred@351281846 after retry RPC after error@1981542131) -> (continuation of Deferred@668229796 after retry RPC after error@1511459162) -> (continuation of Deferred@1340568892 after retry RPC after error@1721919045), errback=(continuation of Deferred@1880675522 after retry RPC after error@477676884) -> (continuation of Deferred@1551501245 after retry RPC after error@488366651) -> (continuation of Deferred@722705310 after retry RPC after error@1906031053) -> (continuation of Deferred@2110791596 after retry RPC after error@1058545687) -> (continuation of Deferred@148935425 after retry RPC after error@605619713) -> (continuation of Deferred@1506365521 after retry RPC after error@665832423) -> (continuation of Deferred@727399560 after retry RPC after error@1201544940) -> (continuation of Deferred@1413911958 after retry RPC after error@225418250) -> (continuation of Deferred@2132954707 after retry RPC after error@1216108069) -> (continuation of Deferred@687247513 after retry RPC after error@1502139969) -> (continuation of Deferred@884296693 after retry RPC after error@517140024) -> (continuation of Deferred@37537571 after retry RPC after error@496579579) -> (continuation of Deferred@57489758 after retry RPC after error@172471333) -> (continuation of Deferred@1848016785 after retry RPC after error@989105989) -> (continuation of Deferred@1345971852 after retry RPC after error@1734907442) -> (continuation of Deferred@980395961 after retry RPC after error@612337942) -> (continuation of Deferred@1005393555 after retry RPC after error@412602074) -> (continuation of Deferred@1602412574 after retry RPC after error@133035457) -> (continuation of Deferred@1424437793 after retry RPC after error@1914754937) -> (continuation of Deferred@980048691 after retry RPC after error@1388438082) -> (continuation of Deferred@1062908929 after retry RPC after error@1261778828) -> (continuation of Deferred@602824218 after retry RPC after error@2128636887) -> (continuation of Deferred@351281846 after retry RPC after error@1981542131) -> (continuation of Deferred@668229796 after retry RPC after error@1511459162) -> (continuation of Deferred@1340568892 after retry RPC after error@1721919045)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.200.126:43511
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:37.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.451392  3123 heartbeater.cc:344] Connected to a master server at 127.2.90.188:42457
08:08:37.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.452034  3123 heartbeater.cc:461] Registering TS with master...
08:08:37.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.453783  3123 heartbeater.cc:507] Master 127.2.90.188:42457 requested a full tablet report, sending...
08:08:37.457 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_4).
08:08:37.459 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#4 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_4.
08:08:37.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.457926  2660 ts_manager.cc:194] Registered new tserver with Master: 5e3589ebfaf94fe5849b6322dc8e0be0 (127.2.90.130:34617)
08:08:37.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.460408  2660 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.2.90.130:46907
08:08:37.463 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to FAILED on 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29167), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [11ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [13ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [15ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [15ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [73ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [90ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [90ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [128ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [129ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [130ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [131ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [131ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [142ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [143ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [144ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [144ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [165ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [168ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [168ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [168ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [202ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [206ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [206ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [206ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [242ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [243ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [243ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [243ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [363ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [363ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [364ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [365ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [584ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [584ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [584ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [900ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [902ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [903ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [904ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [904ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1541ms] refreshing cache from master, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1541ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1543ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2841ms] refreshing cache from master, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2843ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2843ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [4501ms] refreshing cache from master, [4501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [4501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [4502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [4502ms] too many traces: truncated at 100 traces, deferred=Deferred@1452467799(state=PENDING, result=null, callback=(continuation of Deferred@1880675522 after retry RPC after error@477676884) -> (continuation of Deferred@1551501245 after retry RPC after error@488366651) -> (continuation of Deferred@722705310 after retry RPC after error@1906031053) -> (continuation of Deferred@2110791596 after retry RPC after error@1058545687) -> (continuation of Deferred@148935425 after retry RPC after error@605619713) -> (continuation of Deferred@1506365521 after retry RPC after error@665832423) -> (continuation of Deferred@727399560 after retry RPC after error@1201544940) -> (continuation of Deferred@1413911958 after retry RPC after error@225418250) -> (continuation of Deferred@2132954707 after retry RPC after error@1216108069) -> (continuation of Deferred@687247513 after retry RPC after error@1502139969) -> (continuation of Deferred@884296693 after retry RPC after error@517140024) -> (continuation of Deferred@37537571 after retry RPC after error@496579579) -> (continuation of Deferred@57489758 after retry RPC after error@172471333) -> (continuation of Deferred@1848016785 after retry RPC after error@989105989) -> (continuation of Deferred@1345971852 after retry RPC after error@1734907442) -> (continuation of Deferred@980395961 after retry RPC after error@612337942) -> (continuation of Deferred@1005393555 after retry RPC after error@412602074) -> (continuation of Deferred@1602412574 after retry RPC after error@133035457) -> (continuation of Deferred@1424437793 after retry RPC after error@1914754937) -> (continuation of Deferred@980048691 after retry RPC after error@1388438082) -> (continuation of Deferred@1062908929 after retry RPC after error@1261778828) -> (continuation of Deferred@602824218 after retry RPC after error@2128636887) -> (continuation of Deferred@351281846 after retry RPC after error@1981542131) -> (continuation of Deferred@668229796 after retry RPC after error@1511459162) -> (continuation of Deferred@1340568892 after retry RPC after error@1721919045), errback=(continuation of Deferred@1880675522 after retry RPC after error@477676884) -> (continuation of Deferred@1551501245 after retry RPC after error@488366651) -> (continuation of Deferred@722705310 after retry RPC after error@1906031053) -> (continuation of Deferred@2110791596 after retry RPC after error@1058545687) -> (continuation of Deferred@148935425 after retry RPC after error@605619713) -> (continuation of Deferred@1506365521 after retry RPC after error@665832423) -> (continuation of Deferred@727399560 after retry RPC after error@1201544940) -> (continuation of Deferred@1413911958 after retry RPC after error@225418250) -> (continuation of Deferred@2132954707 after retry RPC after error@1216108069) -> (continuation of Deferred@687247513 after retry RPC after error@1502139969) -> (continuation of Deferred@884296693 after retry RPC after error@517140024) -> (continuation of Deferred@37537571 after retry RPC after error@496579579) -> (continuation of Deferred@57489758 after retry RPC after error@172471333) -> (continuation of Deferred@1848016785 after retry RPC after error@989105989) -> (continuation of Deferred@1345971852 after retry RPC after error@1734907442) -> (continuation of Deferred@980395961 after retry RPC after error@612337942) -> (continuation of Deferred@1005393555 after retry RPC after error@412602074) -> (continuation of Deferred@1602412574 after retry RPC after error@133035457) -> (continuation of Deferred@1424437793 after retry RPC after error@1914754937) -> (continuation of Deferred@980048691 after retry RPC after error@1388438082) -> (continuation of Deferred@1062908929 after retry RPC after error@1261778828) -> (continuation of Deferred@602824218 after retry RPC after error@2128636887) -> (continuation of Deferred@351281846 after retry RPC after error@1981542131) -> (continuation of Deferred@668229796 after retry RPC after error@1511459162) -> (continuation of Deferred@1340568892 after retry RPC after error@1721919045)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.200.126:43511
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:37.476 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#4) of source Source: KuduSource.
08:08:37.477 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_4.
08:08:37.477 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:08:37.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.481068  3124 heartbeater.cc:344] Connected to a master server at 127.2.90.189:41065
08:08:37.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.481518  3124 heartbeater.cc:461] Registering TS with master...
08:08:37.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.482318  3124 heartbeater.cc:507] Master 127.2.90.189:41065 requested a full tablet report, sending...
08:08:37.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.485548  2557 ts_manager.cc:194] Registered new tserver with Master: 5e3589ebfaf94fe5849b6322dc8e0be0 (127.2.90.130:34617)
08:08:37.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.486443  3125 heartbeater.cc:344] Connected to a master server at 127.2.90.190:42265
08:08:37.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.486799  3125 heartbeater.cc:461] Registering TS with master...
08:08:37.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.487495  3125 heartbeater.cc:507] Master 127.2.90.190:42265 requested a full tablet report, sending...
08:08:37.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:37.490568  2478 ts_manager.cc:194] Registered new tserver with Master: 5e3589ebfaf94fe5849b6322dc8e0be0 (127.2.90.130:34617)
08:08:37.523 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:37.523 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:37.523 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:37.524 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:37.524 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:37.524 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:37.524 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:37.524 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:37.524 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:37.524 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:37.524 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:37.524 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:37.524 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:37.576 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:37.576 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:37.576 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:37.577 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.577 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.577 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.577 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.577 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.577 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.577 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.577 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.578 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.578 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:37.579 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29296), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [29ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [31ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [142ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [142ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [164ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [165ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [166ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [166ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [194ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [197ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [198ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [200ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [222ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [225ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [225ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [225ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [243ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [244ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [253ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [253ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [263ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [263ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [264ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [264ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [324ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [324ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [463ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [464ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [464ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [464ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [602ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [603ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [604ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [604ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1121ms] refreshing cache from master, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1124ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1125ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1125ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1601ms] refreshing cache from master, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1602ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2521ms] refreshing cache from master, [2521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2522ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2523ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2523ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2523ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [6400ms] refreshing cache from master, [6400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [6401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [6401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [6402ms] too many traces: truncated at 100 traces, deferred=Deferred@154107210(state=PENDING, result=null, callback=(continuation of Deferred@1985931590 after retry RPC after error@369840062) -> (continuation of Deferred@138342696 after retry RPC after error@2055805000) -> (continuation of Deferred@2065488518 after retry RPC after error@925240548) -> (continuation of Deferred@1215175833 after retry RPC after error@2048329348) -> (continuation of Deferred@1740778410 after retry RPC after error@1610893978) -> (continuation of Deferred@1488324823 after retry RPC after error@441914979) -> (continuation of Deferred@1824453112 after retry RPC after error@774649455) -> (continuation of Deferred@1186227149 after retry RPC after error@1693618550) -> (continuation of Deferred@2136513825 after retry RPC after error@805852139) -> (continuation of Deferred@1439167532 after retry RPC after error@625911491) -> (continuation of Deferred@516200158 after retry RPC after error@1814108646) -> (continuation of Deferred@103675610 after retry RPC after error@1451565154) -> (continuation of Deferred@1817001482 after retry RPC after error@138929228) -> (continuation of Deferred@1630886072 after retry RPC after error@516747980) -> (continuation of Deferred@468988529 after retry RPC after error@749129927) -> (continuation of Deferred@1730002291 after retry RPC after error@515799502) -> (continuation of Deferred@610514898 after retry RPC after error@1046051697) -> (continuation of Deferred@874885100 after retry RPC after error@1496891567) -> (continuation of Deferred@1625039229 after retry RPC after error@363547876) -> (continuation of Deferred@208198514 after retry RPC after error@323637224) -> (continuation of Deferred@312230709 after retry RPC after error@1562374638) -> (continuation of Deferred@392565364 after retry RPC after error@1452419711) -> (continuation of Deferred@644308595 after retry RPC after error@81091536) -> (continuation of Deferred@587664524 after retry RPC after error@1686178625), errback=(continuation of Deferred@1985931590 after retry RPC after error@369840062) -> (continuation of Deferred@138342696 after retry RPC after error@2055805000) -> (continuation of Deferred@2065488518 after retry RPC after error@925240548) -> (continuation of Deferred@1215175833 after retry RPC after error@2048329348) -> (continuation of Deferred@1740778410 after retry RPC after error@1610893978) -> (continuation of Deferred@1488324823 after retry RPC after error@441914979) -> (continuation of Deferred@1824453112 after retry RPC after error@774649455) -> (continuation of Deferred@1186227149 after retry RPC after error@1693618550) -> (continuation of Deferred@2136513825 after retry RPC after error@805852139) -> (continuation of Deferred@1439167532 after retry RPC after error@625911491) -> (continuation of Deferred@516200158 after retry RPC after error@1814108646) -> (continuation of Deferred@103675610 after retry RPC after error@1451565154) -> (continuation of Deferred@1817001482 after retry RPC after error@138929228) -> (continuation of Deferred@1630886072 after retry RPC after error@516747980) -> (continuation of Deferred@468988529 after retry RPC after error@749129927) -> (continuation of Deferred@1730002291 after retry RPC after error@515799502) -> (continuation of Deferred@610514898 after retry RPC after error@1046051697) -> (continuation of Deferred@874885100 after retry RPC after error@1496891567) -> (continuation of Deferred@1625039229 after retry RPC after error@363547876) -> (continuation of Deferred@208198514 after retry RPC after error@323637224) -> (continuation of Deferred@312230709 after retry RPC after error@1562374638) -> (continuation of Deferred@392565364 after retry RPC after error@1452419711) -> (continuation of Deferred@644308595 after retry RPC after error@81091536) -> (continuation of Deferred@587664524 after retry RPC after error@1686178625)))
08:08:37.581 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:37.582 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:37.582 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:37.582 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29296), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [29ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [31ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [142ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [142ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [164ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [165ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [166ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [166ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [194ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [197ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [198ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [200ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [222ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [225ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [225ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [225ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [243ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [244ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [253ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [253ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [263ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [263ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [264ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [264ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [324ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [324ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [463ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [464ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [464ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [464ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [602ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [603ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [604ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [604ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1121ms] refreshing cache from master, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1124ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1125ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1125ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1601ms] refreshing cache from master, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1602ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2521ms] refreshing cache from master, [2521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2522ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2523ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2523ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2523ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [6400ms] refreshing cache from master, [6400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [6401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [6401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [6402ms] too many traces: truncated at 100 traces, deferred=Deferred@154107210(state=PENDING, result=null, callback=(continuation of Deferred@1985931590 after retry RPC after error@369840062) -> (continuation of Deferred@138342696 after retry RPC after error@2055805000) -> (continuation of Deferred@2065488518 after retry RPC after error@925240548) -> (continuation of Deferred@1215175833 after retry RPC after error@2048329348) -> (continuation of Deferred@1740778410 after retry RPC after error@1610893978) -> (continuation of Deferred@1488324823 after retry RPC after error@441914979) -> (continuation of Deferred@1824453112 after retry RPC after error@774649455) -> (continuation of Deferred@1186227149 after retry RPC after error@1693618550) -> (continuation of Deferred@2136513825 after retry RPC after error@805852139) -> (continuation of Deferred@1439167532 after retry RPC after error@625911491) -> (continuation of Deferred@516200158 after retry RPC after error@1814108646) -> (continuation of Deferred@103675610 after retry RPC after error@1451565154) -> (continuation of Deferred@1817001482 after retry RPC after error@138929228) -> (continuation of Deferred@1630886072 after retry RPC after error@516747980) -> (continuation of Deferred@468988529 after retry RPC after error@749129927) -> (continuation of Deferred@1730002291 after retry RPC after error@515799502) -> (continuation of Deferred@610514898 after retry RPC after error@1046051697) -> (continuation of Deferred@874885100 after retry RPC after error@1496891567) -> (continuation of Deferred@1625039229 after retry RPC after error@363547876) -> (continuation of Deferred@208198514 after retry RPC after error@323637224) -> (continuation of Deferred@312230709 after retry RPC after error@1562374638) -> (continuation of Deferred@392565364 after retry RPC after error@1452419711) -> (continuation of Deferred@644308595 after retry RPC after error@81091536) -> (continuation of Deferred@587664524 after retry RPC after error@1686178625), errback=(continuation of Deferred@1985931590 after retry RPC after error@369840062) -> (continuation of Deferred@138342696 after retry RPC after error@2055805000) -> (continuation of Deferred@2065488518 after retry RPC after error@925240548) -> (continuation of Deferred@1215175833 after retry RPC after error@2048329348) -> (continuation of Deferred@1740778410 after retry RPC after error@1610893978) -> (continuation of Deferred@1488324823 after retry RPC after error@441914979) -> (continuation of Deferred@1824453112 after retry RPC after error@774649455) -> (continuation of Deferred@1186227149 after retry RPC after error@1693618550) -> (continuation of Deferred@2136513825 after retry RPC after error@805852139) -> (continuation of Deferred@1439167532 after retry RPC after error@625911491) -> (continuation of Deferred@516200158 after retry RPC after error@1814108646) -> (continuation of Deferred@103675610 after retry RPC after error@1451565154) -> (continuation of Deferred@1817001482 after retry RPC after error@138929228) -> (continuation of Deferred@1630886072 after retry RPC after error@516747980) -> (continuation of Deferred@468988529 after retry RPC after error@749129927) -> (continuation of Deferred@1730002291 after retry RPC after error@515799502) -> (continuation of Deferred@610514898 after retry RPC after error@1046051697) -> (continuation of Deferred@874885100 after retry RPC after error@1496891567) -> (continuation of Deferred@1625039229 after retry RPC after error@363547876) -> (continuation of Deferred@208198514 after retry RPC after error@323637224) -> (continuation of Deferred@312230709 after retry RPC after error@1562374638) -> (continuation of Deferred@392565364 after retry RPC after error@1452419711) -> (continuation of Deferred@644308595 after retry RPC after error@81091536) -> (continuation of Deferred@587664524 after retry RPC after error@1686178625)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29296), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [29ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [31ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [142ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [142ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [164ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [165ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [166ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [166ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [194ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [197ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [198ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [200ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [222ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [225ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [225ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [225ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [243ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [244ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [253ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [253ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [263ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [263ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [264ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [264ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [324ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [324ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [463ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [464ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [464ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [464ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [602ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [603ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [604ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [604ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1121ms] refreshing cache from master, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1124ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1125ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1125ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1601ms] refreshing cache from master, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1602ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2521ms] refreshing cache from master, [2521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2522ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2523ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2523ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2523ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [6400ms] refreshing cache from master, [6400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [6401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [6401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [6402ms] too many traces: truncated at 100 traces, deferred=Deferred@154107210(state=PENDING, result=null, callback=(continuation of Deferred@1985931590 after retry RPC after error@369840062) -> (continuation of Deferred@138342696 after retry RPC after error@2055805000) -> (continuation of Deferred@2065488518 after retry RPC after error@925240548) -> (continuation of Deferred@1215175833 after retry RPC after error@2048329348) -> (continuation of Deferred@1740778410 after retry RPC after error@1610893978) -> (continuation of Deferred@1488324823 after retry RPC after error@441914979) -> (continuation of Deferred@1824453112 after retry RPC after error@774649455) -> (continuation of Deferred@1186227149 after retry RPC after error@1693618550) -> (continuation of Deferred@2136513825 after retry RPC after error@805852139) -> (continuation of Deferred@1439167532 after retry RPC after error@625911491) -> (continuation of Deferred@516200158 after retry RPC after error@1814108646) -> (continuation of Deferred@103675610 after retry RPC after error@1451565154) -> (continuation of Deferred@1817001482 after retry RPC after error@138929228) -> (continuation of Deferred@1630886072 after retry RPC after error@516747980) -> (continuation of Deferred@468988529 after retry RPC after error@749129927) -> (continuation of Deferred@1730002291 after retry RPC after error@515799502) -> (continuation of Deferred@610514898 after retry RPC after error@1046051697) -> (continuation of Deferred@874885100 after retry RPC after error@1496891567) -> (continuation of Deferred@1625039229 after retry RPC after error@363547876) -> (continuation of Deferred@208198514 after retry RPC after error@323637224) -> (continuation of Deferred@312230709 after retry RPC after error@1562374638) -> (continuation of Deferred@392565364 after retry RPC after error@1452419711) -> (continuation of Deferred@644308595 after retry RPC after error@81091536) -> (continuation of Deferred@587664524 after retry RPC after error@1686178625), errback=(continuation of Deferred@1985931590 after retry RPC after error@369840062) -> (continuation of Deferred@138342696 after retry RPC after error@2055805000) -> (continuation of Deferred@2065488518 after retry RPC after error@925240548) -> (continuation of Deferred@1215175833 after retry RPC after error@2048329348) -> (continuation of Deferred@1740778410 after retry RPC after error@1610893978) -> (continuation of Deferred@1488324823 after retry RPC after error@441914979) -> (continuation of Deferred@1824453112 after retry RPC after error@774649455) -> (continuation of Deferred@1186227149 after retry RPC after error@1693618550) -> (continuation of Deferred@2136513825 after retry RPC after error@805852139) -> (continuation of Deferred@1439167532 after retry RPC after error@625911491) -> (continuation of Deferred@516200158 after retry RPC after error@1814108646) -> (continuation of Deferred@103675610 after retry RPC after error@1451565154) -> (continuation of Deferred@1817001482 after retry RPC after error@138929228) -> (continuation of Deferred@1630886072 after retry RPC after error@516747980) -> (continuation of Deferred@468988529 after retry RPC after error@749129927) -> (continuation of Deferred@1730002291 after retry RPC after error@515799502) -> (continuation of Deferred@610514898 after retry RPC after error@1046051697) -> (continuation of Deferred@874885100 after retry RPC after error@1496891567) -> (continuation of Deferred@1625039229 after retry RPC after error@363547876) -> (continuation of Deferred@208198514 after retry RPC after error@323637224) -> (continuation of Deferred@312230709 after retry RPC after error@1562374638) -> (continuation of Deferred@392565364 after retry RPC after error@1452419711) -> (continuation of Deferred@644308595 after retry RPC after error@81091536) -> (continuation of Deferred@587664524 after retry RPC after error@1686178625)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.17.253:37621
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:37.583 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.583 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.583 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.583 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.584 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.584 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.586 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.586 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.586 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.586 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:37.595 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29296), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [29ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [31ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [142ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [142ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [164ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [165ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [166ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [166ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [194ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [197ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [198ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [200ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [222ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [225ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [225ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [225ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [243ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [244ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [253ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [253ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [263ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [263ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [264ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [264ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [324ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [324ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [463ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [464ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [464ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [464ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [602ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [603ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [604ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [604ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1121ms] refreshing cache from master, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1124ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1125ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1125ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1601ms] refreshing cache from master, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1602ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2521ms] refreshing cache from master, [2521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2522ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2523ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2523ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2523ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [6400ms] refreshing cache from master, [6400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [6401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [6401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [6402ms] too many traces: truncated at 100 traces, deferred=Deferred@154107210(state=PENDING, result=null, callback=(continuation of Deferred@1985931590 after retry RPC after error@369840062) -> (continuation of Deferred@138342696 after retry RPC after error@2055805000) -> (continuation of Deferred@2065488518 after retry RPC after error@925240548) -> (continuation of Deferred@1215175833 after retry RPC after error@2048329348) -> (continuation of Deferred@1740778410 after retry RPC after error@1610893978) -> (continuation of Deferred@1488324823 after retry RPC after error@441914979) -> (continuation of Deferred@1824453112 after retry RPC after error@774649455) -> (continuation of Deferred@1186227149 after retry RPC after error@1693618550) -> (continuation of Deferred@2136513825 after retry RPC after error@805852139) -> (continuation of Deferred@1439167532 after retry RPC after error@625911491) -> (continuation of Deferred@516200158 after retry RPC after error@1814108646) -> (continuation of Deferred@103675610 after retry RPC after error@1451565154) -> (continuation of Deferred@1817001482 after retry RPC after error@138929228) -> (continuation of Deferred@1630886072 after retry RPC after error@516747980) -> (continuation of Deferred@468988529 after retry RPC after error@749129927) -> (continuation of Deferred@1730002291 after retry RPC after error@515799502) -> (continuation of Deferred@610514898 after retry RPC after error@1046051697) -> (continuation of Deferred@874885100 after retry RPC after error@1496891567) -> (continuation of Deferred@1625039229 after retry RPC after error@363547876) -> (continuation of Deferred@208198514 after retry RPC after error@323637224) -> (continuation of Deferred@312230709 after retry RPC after error@1562374638) -> (continuation of Deferred@392565364 after retry RPC after error@1452419711) -> (continuation of Deferred@644308595 after retry RPC after error@81091536) -> (continuation of Deferred@587664524 after retry RPC after error@1686178625), errback=(continuation of Deferred@1985931590 after retry RPC after error@369840062) -> (continuation of Deferred@138342696 after retry RPC after error@2055805000) -> (continuation of Deferred@2065488518 after retry RPC after error@925240548) -> (continuation of Deferred@1215175833 after retry RPC after error@2048329348) -> (continuation of Deferred@1740778410 after retry RPC after error@1610893978) -> (continuation of Deferred@1488324823 after retry RPC after error@441914979) -> (continuation of Deferred@1824453112 after retry RPC after error@774649455) -> (continuation of Deferred@1186227149 after retry RPC after error@1693618550) -> (continuation of Deferred@2136513825 after retry RPC after error@805852139) -> (continuation of Deferred@1439167532 after retry RPC after error@625911491) -> (continuation of Deferred@516200158 after retry RPC after error@1814108646) -> (continuation of Deferred@103675610 after retry RPC after error@1451565154) -> (continuation of Deferred@1817001482 after retry RPC after error@138929228) -> (continuation of Deferred@1630886072 after retry RPC after error@516747980) -> (continuation of Deferred@468988529 after retry RPC after error@749129927) -> (continuation of Deferred@1730002291 after retry RPC after error@515799502) -> (continuation of Deferred@610514898 after retry RPC after error@1046051697) -> (continuation of Deferred@874885100 after retry RPC after error@1496891567) -> (continuation of Deferred@1625039229 after retry RPC after error@363547876) -> (continuation of Deferred@208198514 after retry RPC after error@323637224) -> (continuation of Deferred@312230709 after retry RPC after error@1562374638) -> (continuation of Deferred@392565364 after retry RPC after error@1452419711) -> (continuation of Deferred@644308595 after retry RPC after error@81091536) -> (continuation of Deferred@587664524 after retry RPC after error@1686178625)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29296), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [29ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [31ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [142ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [142ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [164ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [165ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [166ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [166ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [194ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [197ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [198ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [200ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [222ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [225ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [225ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [225ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [243ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [244ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [253ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [253ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [263ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [263ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [264ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [264ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [324ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [324ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [463ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [464ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [464ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [464ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [602ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [603ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [604ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [604ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1121ms] refreshing cache from master, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1124ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1125ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1125ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1601ms] refreshing cache from master, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1602ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2521ms] refreshing cache from master, [2521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2522ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2523ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2523ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2523ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [6400ms] refreshing cache from master, [6400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [6401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [6401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [6402ms] too many traces: truncated at 100 traces, deferred=Deferred@154107210(state=PENDING, result=null, callback=(continuation of Deferred@1985931590 after retry RPC after error@369840062) -> (continuation of Deferred@138342696 after retry RPC after error@2055805000) -> (continuation of Deferred@2065488518 after retry RPC after error@925240548) -> (continuation of Deferred@1215175833 after retry RPC after error@2048329348) -> (continuation of Deferred@1740778410 after retry RPC after error@1610893978) -> (continuation of Deferred@1488324823 after retry RPC after error@441914979) -> (continuation of Deferred@1824453112 after retry RPC after error@774649455) -> (continuation of Deferred@1186227149 after retry RPC after error@1693618550) -> (continuation of Deferred@2136513825 after retry RPC after error@805852139) -> (continuation of Deferred@1439167532 after retry RPC after error@625911491) -> (continuation of Deferred@516200158 after retry RPC after error@1814108646) -> (continuation of Deferred@103675610 after retry RPC after error@1451565154) -> (continuation of Deferred@1817001482 after retry RPC after error@138929228) -> (continuation of Deferred@1630886072 after retry RPC after error@516747980) -> (continuation of Deferred@468988529 after retry RPC after error@749129927) -> (continuation of Deferred@1730002291 after retry RPC after error@515799502) -> (continuation of Deferred@610514898 after retry RPC after error@1046051697) -> (continuation of Deferred@874885100 after retry RPC after error@1496891567) -> (continuation of Deferred@1625039229 after retry RPC after error@363547876) -> (continuation of Deferred@208198514 after retry RPC after error@323637224) -> (continuation of Deferred@312230709 after retry RPC after error@1562374638) -> (continuation of Deferred@392565364 after retry RPC after error@1452419711) -> (continuation of Deferred@644308595 after retry RPC after error@81091536) -> (continuation of Deferred@587664524 after retry RPC after error@1686178625), errback=(continuation of Deferred@1985931590 after retry RPC after error@369840062) -> (continuation of Deferred@138342696 after retry RPC after error@2055805000) -> (continuation of Deferred@2065488518 after retry RPC after error@925240548) -> (continuation of Deferred@1215175833 after retry RPC after error@2048329348) -> (continuation of Deferred@1740778410 after retry RPC after error@1610893978) -> (continuation of Deferred@1488324823 after retry RPC after error@441914979) -> (continuation of Deferred@1824453112 after retry RPC after error@774649455) -> (continuation of Deferred@1186227149 after retry RPC after error@1693618550) -> (continuation of Deferred@2136513825 after retry RPC after error@805852139) -> (continuation of Deferred@1439167532 after retry RPC after error@625911491) -> (continuation of Deferred@516200158 after retry RPC after error@1814108646) -> (continuation of Deferred@103675610 after retry RPC after error@1451565154) -> (continuation of Deferred@1817001482 after retry RPC after error@138929228) -> (continuation of Deferred@1630886072 after retry RPC after error@516747980) -> (continuation of Deferred@468988529 after retry RPC after error@749129927) -> (continuation of Deferred@1730002291 after retry RPC after error@515799502) -> (continuation of Deferred@610514898 after retry RPC after error@1046051697) -> (continuation of Deferred@874885100 after retry RPC after error@1496891567) -> (continuation of Deferred@1625039229 after retry RPC after error@363547876) -> (continuation of Deferred@208198514 after retry RPC after error@323637224) -> (continuation of Deferred@312230709 after retry RPC after error@1562374638) -> (continuation of Deferred@392565364 after retry RPC after error@1452419711) -> (continuation of Deferred@644308595 after retry RPC after error@81091536) -> (continuation of Deferred@587664524 after retry RPC after error@1686178625)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.17.253:37621
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:37.596 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:37.597 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:37.597 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:37.598 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.598 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.598 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.598 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.598 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.598 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.598 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.599 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.599 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.599 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:37.604 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
08:08:37.604 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to CANCELING.
08:08:37.604 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#4) of source Source: KuduSource.
08:08:37.605 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
08:08:37.605 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to CANCELING.
08:08:37.605 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
08:08:37.606 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
08:08:37.606 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CANCELING to CANCELED.
08:08:37.606 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#4 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
08:08:37.608 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#4 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_4.
08:08:37.609 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CANCELING to CANCELED.
08:08:37.610 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 0d2ddb76420639a9ec06ca05e894cb50
08:08:37.616 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:37.616 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:37.616 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:37.616 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.617 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.617 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.617 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.617 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.617 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.617 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.618 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.617 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.618 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:37.619 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:37.636 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:37.636 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:37.636 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:37.637 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.637 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.637 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.637 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.637 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.637 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.637 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.637 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.637 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.638 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:37.656 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:37.656 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:37.656 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:37.657 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.657 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.657 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.657 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.657 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.657 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.657 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.657 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.657 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.658 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:37.676 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:37.676 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (a72e6b48022ef36361b5eef11ee7c683) switched from state RESTARTING to RUNNING.
08:08:37.677 [INFO - flink-pekko.actor.default-dispatcher-6] (CheckpointCoordinator.java:1805) Restoring job a72e6b48022ef36361b5eef11ee7c683 from Checkpoint 78 @ 1779091656118 for a72e6b48022ef36361b5eef11ee7c683 located at file:/tmp/junit13140095929423248446/checkpoints/a72e6b48022ef36361b5eef11ee7c683/chk-78.
08:08:37.677 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:37.677 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:37.677 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.677 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.678 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.678 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.678 [INFO - flink-pekko.actor.default-dispatcher-6] (MasterHooks.java:201) No master state to restore
08:08:37.678 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.678 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.679 [INFO - flink-pekko.actor.default-dispatcher-6] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
08:08:37.679 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.679 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.679 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.679 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:37.680 [INFO - Thread-49] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
08:08:37.680 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to SCHEDULED.
08:08:37.680 [DEBUG - Thread-49] (Connection.java:575) [peer master-127.28.220.253:45079(127.28.220.253:45079)] disconnecting while in state TERMINATED
08:08:37.680 [DEBUG - Thread-49] (Connection.java:575) [peer master-127.28.220.254:37365(127.28.220.254:37365)] disconnecting while in state TERMINATED
08:08:37.681 [DEBUG - Thread-49] (Connection.java:575) [peer master-127.28.220.252:33543(127.28.220.252:33543)] disconnecting while in state TERMINATED
08:08:37.681 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:37.681 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:08:37.681 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from SCHEDULED to DEPLOYING.
08:08:37.682 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #3) with attempt id 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1) with allocation id 68aed56532af9c33564af146c662175d
08:08:37.682 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to SCHEDULED.
08:08:37.682 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 68aed56532af9c33564af146c662175d.
08:08:37.683 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from SCHEDULED to DEPLOYING.
08:08:37.683 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #3) with attempt id 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1) with allocation id 99f4948912648970d945ee4b7d180287
08:08:37.683 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to SCHEDULED.
08:08:37.683 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:08:37.683 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:08:37.683 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from SCHEDULED to DEPLOYING.
08:08:37.683 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #3) with attempt id 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1) with allocation id 4d91c4a4289e885e1ccd40283ee9eec0
08:08:37.684 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to SCHEDULED.
08:08:37.684 [INFO - Thread-49] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
08:08:37.684 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:08:37.684 [INFO - Thread-49] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
08:08:37.684 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from SCHEDULED to DEPLOYING.
08:08:37.685 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #3) with attempt id 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1) with allocation id 0a17552dd40f187ff1067ce2b4829466
08:08:37.685 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_3), deploy into slot with allocation id 68aed56532af9c33564af146c662175d.
08:08:37.686 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 99f4948912648970d945ee4b7d180287.
08:08:37.686 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to DEPLOYING.
08:08:37.686 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_3) [DEPLOYING].
08:08:37.687 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7437f8fa
08:08:37.687 [DEBUG - Thread-49] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:37.687 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_3), deploy into slot with allocation id 99f4948912648970d945ee4b7d180287.
08:08:37.688 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:37.688 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 4d91c4a4289e885e1ccd40283ee9eec0.
08:08:37.688 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13140095929423248446/checkpoints")
08:08:37.688 [INFO - Thread-49] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
08:08:37.688 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
08:08:37.689 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
08:08:37.689 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to DEPLOYING.
08:08:37.689 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_3) [DEPLOYING].
08:08:37.689 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_3), deploy into slot with allocation id 4d91c4a4289e885e1ccd40283ee9eec0.
08:08:37.689 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@272dccbd
08:08:37.690 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:37.690 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13140095929423248446/checkpoints")
08:08:37.690 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
08:08:37.690 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
08:08:37.691 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:08:37.691 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:08:37.692 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:08:37.692 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:08:37.692 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 0a17552dd40f187ff1067ce2b4829466.
08:08:37.692 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3b423fd6
08:08:37.693 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_3), deploy into slot with allocation id 0a17552dd40f187ff1067ce2b4829466.
08:08:37.693 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to DEPLOYING.
08:08:37.693 [ERROR - Source: KuduSource -> Sink: Writer (1/4)#3] (HashedWheelTimer.java:470) You are creating too many HashedWheelTimer instances. HashedWheelTimer is a shared resource that must be reused across the JVM, so that only a few instances are created.
08:08:37.693 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_3) [DEPLOYING].
08:08:37.694 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4f9ed6a2
08:08:37.694 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:37.694 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13140095929423248446/checkpoints")
08:08:37.694 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
08:08:37.695 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
08:08:37.696 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:37.697 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:37.697 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.697 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:37.698 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.698 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:37.698 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:37.698 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.698 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.698 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:37.699 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:37.699 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.699 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.699 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:37.699 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:37.699 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:37.699 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.700 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.700 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:37.700 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.700 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.700 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.700 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:37.700 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.700 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:37.700 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:37.701 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.702 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:37.703 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:37.703 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:37.703 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:37.703 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:37.703 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:37.703 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:37.703 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:37.703 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:37.704 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:37.704 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:37.704 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:37.704 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:37.704 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:37.704 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:37.704 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:37.704 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:37.704 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@12227294
08:08:37.704 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:37.705 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:37.705 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:37.705 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:37.707 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:37.703 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:37.708 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:37.708 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:37.708 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:37.708 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.708 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:37.708 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.709 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.709 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.709 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29468), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [69ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [70ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [70ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [86ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [133ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [134ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [136ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [136ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [185ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [186ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [186ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [187ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [187ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [201ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [201ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [202ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [202ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [222ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [222ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [223ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [223ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [241ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [242ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [243ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [243ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [262ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [262ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [263ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [263ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [402ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [402ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [403ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [404ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [622ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [622ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [623ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [623ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1100ms] refreshing cache from master, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1102ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1103ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1104ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1104ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1900ms] refreshing cache from master, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1903ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1903ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3960ms] refreshing cache from master, [3960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [3960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [3961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [3961ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [3962ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [3962ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3963ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [5580ms] refreshing cache from master, [5580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [5581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [5581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [5582ms] too many traces: truncated at 100 traces, deferred=Deferred@1534721818(state=PENDING, result=null, callback=(continuation of Deferred@376860156 after retry RPC after error@580197013) -> (continuation of Deferred@2122449569 after retry RPC after error@1779934020) -> (continuation of Deferred@1328233079 after retry RPC after error@1163968693) -> (continuation of Deferred@731469234 after retry RPC after error@2084822534) -> (continuation of Deferred@1789770619 after retry RPC after error@697019379) -> (continuation of Deferred@1214140341 after retry RPC after error@705633110) -> (continuation of Deferred@771627791 after retry RPC after error@1507785072) -> (continuation of Deferred@1665607193 after retry RPC after error@826299532) -> (continuation of Deferred@1824196552 after retry RPC after error@1115711062) -> (continuation of Deferred@414054385 after retry RPC after error@737813596) -> (continuation of Deferred@533459884 after retry RPC after error@1580766421) -> (continuation of Deferred@694022812 after retry RPC after error@1409280815) -> (continuation of Deferred@334046319 after retry RPC after error@166561019) -> (continuation of Deferred@1340231240 after retry RPC after error@1676177928) -> (continuation of Deferred@964229190 after retry RPC after error@1549236686) -> (continuation of Deferred@26930178 after retry RPC after error@558016011) -> (continuation of Deferred@1602666669 after retry RPC after error@955796378) -> (continuation of Deferred@1859406459 after retry RPC after error@1511185236) -> (continuation of Deferred@863566611 after retry RPC after error@1227281021) -> (continuation of Deferred@99471024 after retry RPC after error@1240038690) -> (continuation of Deferred@1027450735 after retry RPC after error@1123499919) -> (continuation of Deferred@688189743 after retry RPC after error@730237248) -> (continuation of Deferred@2077250944 after retry RPC after error@10491442) -> (continuation of Deferred@245568128 after retry RPC after error@292570781) -> (continuation of Deferred@1760918886 after retry RPC after error@1759832012), errback=(continuation of Deferred@376860156 after retry RPC after error@580197013) -> (continuation of Deferred@2122449569 after retry RPC after error@1779934020) -> (continuation of Deferred@1328233079 after retry RPC after error@1163968693) -> (continuation of Deferred@731469234 after retry RPC after error@2084822534) -> (continuation of Deferred@1789770619 after retry RPC after error@697019379) -> (continuation of Deferred@1214140341 after retry RPC after error@705633110) -> (continuation of Deferred@771627791 after retry RPC after error@1507785072) -> (continuation of Deferred@1665607193 after retry RPC after error@826299532) -> (continuation of Deferred@1824196552 after retry RPC after error@1115711062) -> (continuation of Deferred@414054385 after retry RPC after error@737813596) -> (continuation of Deferred@533459884 after retry RPC after error@1580766421) -> (continuation of Deferred@694022812 after retry RPC after error@1409280815) -> (continuation of Deferred@334046319 after retry RPC after error@166561019) -> (continuation of Deferred@1340231240 after retry RPC after error@1676177928) -> (continuation of Deferred@964229190 after retry RPC after error@1549236686) -> (continuation of Deferred@26930178 after retry RPC after error@558016011) -> (continuation of Deferred@1602666669 after retry RPC after error@955796378) -> (continuation of Deferred@1859406459 after retry RPC after error@1511185236) -> (continuation of Deferred@863566611 after retry RPC after error@1227281021) -> (continuation of Deferred@99471024 after retry RPC after error@1240038690) -> (continuation of Deferred@1027450735 after retry RPC after error@1123499919) -> (continuation of Deferred@688189743 after retry RPC after error@730237248) -> (continuation of Deferred@2077250944 after retry RPC after error@10491442) -> (continuation of Deferred@245568128 after retry RPC after error@292570781) -> (continuation of Deferred@1760918886 after retry RPC after error@1759832012)))
08:08:37.709 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.713 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@49e78883
08:08:37.714 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.714 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to DEPLOYING.
08:08:37.714 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_3) [DEPLOYING].
08:08:37.714 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.714 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.714 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.715 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.715 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.715 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@141a897c
08:08:37.715 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.715 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:37.715 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.715 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13140095929423248446/checkpoints")
08:08:37.716 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
08:08:37.716 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
08:08:37.717 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.718 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.718 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.718 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.718 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.718 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.719 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.719 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.719 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.719 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.719 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.720 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.720 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.720 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:37.721 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7fd40263
08:08:37.722 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:37.723 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:37.723 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.723 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:37.723 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:37.723 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:37.725 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:37.726 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:37.726 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:37.726 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:37.727 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:37.728 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.734 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.734 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.734 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.735 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.735 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.736 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:37.736 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:37.736 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:37.736 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:37.738 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.738 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.738 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.738 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.738 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.742 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.742 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.742 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.742 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.742 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:37.743 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.743 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.744 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.744 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.744 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.744 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.744 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.745 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.746 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.757 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:37.757 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.757 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:37.757 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.758 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.758 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.758 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.759 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.759 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.760 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.760 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.760 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.760 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.760 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.761 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.758 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:37.762 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.762 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.762 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.762 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:37.763 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:37.763 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.764 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:37.764 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:37.764 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:37.764 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:37.764 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:37.764 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:37.764 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:37.765 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:37.765 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:37.765 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:37.765 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:37.765 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.766 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.766 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.766 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.770 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.770 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.770 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.770 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.776 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.779 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.780 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.780 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.780 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.781 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.781 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.781 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.781 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.781 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.782 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.782 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.782 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.782 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:37.782 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:37.782 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:37.782 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.782 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.782 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.783 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.783 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:37.783 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:37.783 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:37.783 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:37.783 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:37.783 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:37.784 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:37.784 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:37.784 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:37.784 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:37.786 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.786 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.786 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.786 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.787 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.787 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.787 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.787 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.788 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.788 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.788 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.788 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.788 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.789 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.789 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.789 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.789 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.789 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.789 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.789 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.790 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.790 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.790 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.791 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.791 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.791 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.792 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.792 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.792 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.793 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.793 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.793 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.793 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.796 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.797 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.797 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.797 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.798 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.798 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.798 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.798 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.798 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.798 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.798 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.798 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.798 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.798 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.799 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.799 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.799 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.799 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.799 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.799 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.799 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.799 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.800 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.800 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.800 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.800 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.803 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:37.803 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:37.803 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.803 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:37.803 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:37.803 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:37.803 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:37.803 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:37.803 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:37.804 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:37.804 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:37.804 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:37.803 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:37.804 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:37.806 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.806 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.806 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.806 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.808 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.808 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.808 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.809 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.809 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.809 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.809 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.809 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.808 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.810 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.810 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.810 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.810 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.816 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.817 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.817 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.817 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.817 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.817 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.817 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.817 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.817 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.818 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.818 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.818 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.818 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.818 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.818 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.818 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.818 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.818 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.819 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.819 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.819 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.819 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.819 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.819 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.819 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.819 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.822 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.822 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.822 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.823 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.823 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.823 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.823 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.823 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.828 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.828 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.828 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.828 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.828 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.829 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.829 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.829 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.829 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.829 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.829 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.829 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.829 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.832 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:37.832 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:37.832 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:37.833 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:37.833 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:37.833 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:37.833 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:37.833 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:37.833 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:37.833 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:37.833 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:37.833 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:37.833 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:37.836 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.837 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.837 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.837 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.837 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.837 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.837 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.837 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.837 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.837 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.837 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.838 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.837 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.838 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.838 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.838 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.838 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.838 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.838 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.838 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.839 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.839 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.839 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.839 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.839 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.839 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.842 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:37.842 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:37.842 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:37.842 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:37.842 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:37.842 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:37.843 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:37.843 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:37.843 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:37.843 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:37.843 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:37.843 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:37.843 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:37.843 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.844 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.844 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.844 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.844 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.844 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.844 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.844 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.844 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.844 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.844 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.844 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.844 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.849 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.849 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.849 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.849 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.849 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.849 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.849 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.849 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.849 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.850 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.850 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.850 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.850 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.863 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:37.863 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:37.863 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.863 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:37.863 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.864 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:37.864 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.864 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:37.864 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.864 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.864 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.864 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.864 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.864 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.864 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.864 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.864 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:37.864 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:37.864 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:37.864 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:37.864 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.865 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.865 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:37.865 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:37.865 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:37.865 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:37.876 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:37.876 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:37.876 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:37.877 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.877 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.877 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.877 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.877 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.877 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.877 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.877 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.877 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.877 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.877 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.878 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.878 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.878 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.878 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.878 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.878 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.878 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.878 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.879 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.879 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.879 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.882 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:37.898 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.898 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.899 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.899 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.899 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.899 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.899 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.899 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.899 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.899 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.899 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.900 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.900 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.900 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:37.903 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:37.903 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:37.903 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:37.904 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:37.904 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:37.904 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:37.904 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:37.904 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:37.904 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:37.903 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.904 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:37.905 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:37.905 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:37.905 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.905 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:37.905 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.906 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.906 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.906 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.906 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.906 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.906 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.906 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.906 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.906 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.906 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.916 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:37.916 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:37.916 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:37.917 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.917 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.917 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:37.917 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.917 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.917 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:37.917 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.917 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.917 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:37.917 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:37.928 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.928 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.928 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.929 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.929 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.929 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.929 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.929 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.929 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.929 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.930 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.929 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.930 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.936 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.937 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.937 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.937 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.937 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.937 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.937 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.938 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.938 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.938 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.938 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.938 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.938 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:37.939582  3134 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:08:37.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:37.940387  3134 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:08:37.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:37.941200  3134 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:08:37.950 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:37.958 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.958 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.958 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.959 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.959 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.959 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.959 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.959 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.960 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.960 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.960 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.960 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.960 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.964 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.964 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.964 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.964 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.964 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.964 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.965 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.965 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.965 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.965 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.965 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.966 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.966 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.989 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.989 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.990 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.990 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.990 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.990 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.991 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.991 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.991 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.991 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.991 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.991 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.992 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.995 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:37.996 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:37.996 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:37.996 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.996 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.996 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:37.996 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.996 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.996 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:37.996 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.996 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.996 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:37.997 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:37.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:37.997563  3134 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:08:37.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:37.998524  3134 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.90.131
08:08:38.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:38.045343  3134 tablet_server_runner.cc:78] Tablet server non-default flags:
08:08:38.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:38.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.90.148:36029
08:08:38.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:38.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:38.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-2/data
08:08:38.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-2/wal
08:08:38.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:38.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:38.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.90.131:0
08:08:38.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:08:38.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:38.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:38.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-2/data/info.pb
08:08:38.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.90.131
08:08:38.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:38.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.90.190:42265,127.2.90.189:41065,127.2.90.188:42457
08:08:38.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:08:38.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:38.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:08:38.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:08:38.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:38.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.90.131
08:08:38.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-2/logs
08:08:38.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:38.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:08:38.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:08:38.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:08:38.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:08:38.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:08:38.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:08:38.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:08:38.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:08:38.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:08:38.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:38.047468  3134 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:08:38.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:38.049644  3134 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:08:38.056 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:38.057 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:38.057 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:38.057 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.057 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.057 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.057 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.057 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.058 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.058 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.058 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.058 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.058 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:38.061 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:38.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:38.067174  3196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:38.077 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:38.078 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:38.078 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:38.079 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.079 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.079 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.079 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.079 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.079 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.079 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.079 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.080 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.080 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:38.083 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:38.083 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:38.083 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:38.084 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.084 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.084 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.084 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.084 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.084 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.084 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.085 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.085 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.085 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:38.096 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:38.096 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:38.096 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:38.097 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.097 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.097 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.098 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.098 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.098 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.098 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.098 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.098 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.098 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:38.098 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:38.099 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:38.099 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:38.099 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:38.099 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:38.099 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:38.102 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:38.102 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:38.103 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:38.103 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:38.103 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:38.103 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:38.103 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:38.120 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:38.123 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:38.123 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:38.123 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:38.124 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:38.124 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:38.124 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:38.125 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:38.125 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:38.125 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:38.126 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:38.127 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:38.127 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:38.127 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:38.128 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:38.129 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:38.129 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:38.129 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:38.129 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:38.130 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:38.130 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:38.130 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:38.129 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:38.130 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:38.130 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:38.130 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:38.130 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:38.190 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:38.190 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:38.190 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:38.191 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.192 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.192 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.192 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.192 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.192 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.194 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.194 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.195 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.195 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:38.228 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:38.229 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:38.229 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:38.230 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.230 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.230 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.231 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.231 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.231 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.232 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.232 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.232 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.233 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:38.248 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:38.249 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:38.249 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:38.249 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:38.250 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:38.250 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:38.250 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:38.250 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:38.250 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:38.251 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:38.251 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:38.251 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:38.251 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:38.296 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:38.296 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:38.296 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:38.296 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:38.297 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.297 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.297 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.298 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:38.298 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:38.298 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:38.298 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.298 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.299 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.301 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.301 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.296 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:38.302 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:38.302 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:38.302 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:38.302 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:38.302 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:38.302 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:38.302 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:38.302 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:38.303 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.303 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:38.303 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:38.303 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:38.303 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:38.303 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.303 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.303 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.304 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.304 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.304 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.304 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.304 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.304 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.304 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:38.322 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:38.323 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:38.323 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:38.323 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:38.323 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:38.324 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:38.324 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:38.324 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:38.324 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:38.324 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:38.324 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:38.324 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:38.324 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:38.349 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:38.349 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:38.350 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:38.350 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.350 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.350 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.351 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.351 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.351 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.352 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.352 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.352 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.352 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:38.376 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:38.377 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:38.377 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:38.378 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:38.378 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:38.378 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:38.379 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:38.379 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:38.379 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:38.379 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:38.379 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:38.379 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:38.379 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:38.398 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:38.398 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:38.398 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:38.401 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.401 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.401 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.401 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.401 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.401 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.402 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.402 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.402 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.402 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:38.404 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:38.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:38.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:38.465855  3123 heartbeater.cc:499] Master 127.2.90.188:42457 was elected leader, sending a full tablet report...
08:08:38.542 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:38.543 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:38.543 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:38.544 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:38.544 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:38.545 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:38.545 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:38.546 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:38.546 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:38.546 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:38.549 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:38.550 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:38.550 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:38.561 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:38.620 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:38.677 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:38.678 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:38.678 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:38.678 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.678 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.679 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.679 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.679 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.679 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.681 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.681 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.681 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.681 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:38.824 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:38.824 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:38.824 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:38.825 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.826 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.826 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:38.826 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.826 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.826 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:38.827 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.827 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.827 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:38.828 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:38.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:38.926 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:38.926 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:38.927 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:38.927 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:38.927 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:38.927 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:38.927 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:38.928 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:38.928 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:38.929 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:38.929 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:38.929 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:38.929 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:38.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:39.004 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:39.004 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:39.005 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:39.005 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:39.005 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:39.005 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:39.005 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:39.005 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:39.006 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:39.006 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:39.007 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:39.007 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:39.007 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:39.062 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:39.120 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:39.160 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:39.160 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:39.160 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:39.161 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:39.162 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:39.162 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:39.162 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:39.162 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:39.162 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:39.163 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:39.163 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:39.163 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:39.163 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:39.209 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:39.209 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:39.209 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:39.211 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:39.211 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:39.211 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:39.212 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:39.212 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:39.212 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:39.214 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:39.214 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:39.214 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:39.214 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:39.218 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:39.218 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:39.218 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:39.219 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:39.219 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:39.219 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:39.219 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:39.219 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:39.219 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:39.220 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:39.220 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:39.220 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:39.220 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:39.389 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:39.390 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:39.390 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:39.390 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:39.390 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:39.390 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:39.391 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:39.391 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:39.391 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:39.391 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:39.392 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:39.392 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:39.392 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:39.401 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:39.447 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:39.562 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:39.620 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:39.676 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:39.676 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:39.677 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:39.677 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:39.677 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:39.677 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:39.678 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:39.678 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:39.678 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:39.678 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:39.678 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:39.678 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:39.678 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:39.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:39.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:40.062 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:40.076 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:40.077 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:40.077 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:40.078 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:40.078 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:40.078 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:40.079 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:40.079 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:40.079 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:40.079 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:40.079 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:40.079 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:40.080 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:40.098 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:40.098 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:40.098 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:40.098 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:40.098 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:40.099 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:40.099 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:40.099 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:40.098 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:40.099 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:40.099 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:40.099 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:40.099 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:40.118 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:40.119 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:40.119 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:40.119 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:40.119 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:40.119 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:40.119 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:40.119 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:40.119 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:40.119 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:40.119 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:40.119 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:40.119 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:40.120 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:40.168 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:40.168 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:40.168 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:40.169 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:40.169 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:40.169 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:40.170 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:40.171 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:40.171 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:40.171 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:40.171 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:40.171 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:40.171 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:40.289 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:40.289 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:40.289 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:40.290 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:40.290 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:40.290 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:40.291 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:40.291 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:40.291 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:40.292 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:40.292 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:40.292 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:40.292 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:40.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:39.471729  3195 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 3134
08:08:40.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:38.068763  3197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:40.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:40.333775  3195 kernel_stack_watchdog.cc:198] Thread 3134 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 401ms:
08:08:40.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:08:40.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:08:40.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:08:40.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:08:40.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:40.334852  3134 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.268s	user 0.693s	sys 1.393s
08:08:40.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:40.335287  3134 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.268s	user 0.693s	sys 1.393s
08:08:40.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:40.336755  3199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:40.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:40.340649  3198 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 2272 milliseconds
08:08:40.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.340662  3134 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:08:40.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.342499  3134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:08:40.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.354115  3134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:08:40.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.361934  3134 hybrid_clock.cc:648] HybridClock initialized: now 1779091720361869 us; error 78 us; skew 500 ppm
08:08:40.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.363118  3134 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:08:40.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.388279  3134 webserver.cc:533] Webserver started at http://127.2.90.131:34907/ using document root <none> and password file <none>
08:08:40.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.389561  3134 fs_manager.cc:362] Metadata directory not provided
08:08:40.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.389880  3134 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:08:40.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.390472  3134 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:08:40.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.396086  3134 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-2/data/instance:
08:08:40.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fecbf6c21a40400fac9aa6a557be405c"
08:08:40.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:40 on dist-test-slave-1jss"
08:08:40.401 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:40.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.397722  3134 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-2/wal/instance:
08:08:40.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fecbf6c21a40400fac9aa6a557be405c"
08:08:40.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:40 on dist-test-slave-1jss"
08:08:40.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.408906  3134 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.008s	sys 0.001s
08:08:40.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.417366  3210 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:08:40.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.418990  3134 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.007s	sys 0.000s
08:08:40.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.419371  3134 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-2/wal
08:08:40.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fecbf6c21a40400fac9aa6a557be405c"
08:08:40.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:08:40 on dist-test-slave-1jss"
08:08:40.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.419898  3134 fs_report.cc:389] FS layout report
08:08:40.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:08:40.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-2/wal
08:08:40.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-2/wal
08:08:40.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-2/data/data
08:08:40.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:08:40.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:08:40.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:08:40.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:08:40.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:08:40.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:08:40.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:08:40.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:08:40.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:08:40.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:08:40.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:08:40.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:40.457 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:40.458 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:40.458 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:40.459 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:40.459 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:40.459 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:40.459 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:40.459 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:40.459 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:40.460 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:40.460 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:40.460 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:40.460 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:40.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.504990  3134 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:08:40.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.507336  3134 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:08:40.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.508055  3134 kserver.cc:163] Server-wide thread pool size limit: 3276
08:08:40.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.511981  3134 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:08:40.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.517513  3134 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:08:40.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.517719  3134 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:08:40.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.518007  3134 ts_tablet_manager.cc:616] Registered 0 tablets
08:08:40.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.518162  3134 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:08:40.522 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:40.523 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:40.523 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:40.523 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:40.523 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:40.523 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:40.523 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:40.523 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:40.523 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:40.523 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:40.524 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:40.524 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:40.524 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:40.544 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:40.544 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:40.544 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:40.544 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:40.545 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:40.545 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:40.545 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:40.545 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:40.545 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:40.545 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:40.545 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:40.545 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:40.545 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:40.562 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:40.583 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:40.583 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:40.584 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:40.584 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:40.584 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:40.584 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:40.586 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:40.586 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:40.586 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:40.588 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:40.588 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:40.588 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:40.588 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:40.620 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:40.648 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:40.648 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:40.648 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:40.649 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:40.649 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:40.649 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:40.649 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:40.650 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:40.650 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:40.650 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:40.651 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:40.649 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:40.651 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:40.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.733278  3134 rpc_server.cc:307] RPC server started. Bound to: 127.2.90.131:33107
08:08:40.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.733364  3323 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.90.131:33107 every 8 connection(s)
08:08:40.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.737212  3134 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-2/data/info.pb
08:08:40.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.739010  2410 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 3134
08:08:40.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.739862  2410 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster7312192873312287029/ts-2/wal/instance
08:08:40.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.807461  3324 heartbeater.cc:344] Connected to a master server at 127.2.90.188:42457
08:08:40.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.808184  3324 heartbeater.cc:461] Registering TS with master...
08:08:40.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.810647  3324 heartbeater.cc:507] Master 127.2.90.188:42457 requested a full tablet report, sending...
08:08:40.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.814607  2660 ts_manager.cc:194] Registered new tserver with Master: fecbf6c21a40400fac9aa6a557be405c (127.2.90.131:33107)
08:08:40.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.822618  2660 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.2.90.131:41055
08:08:40.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.840045  3325 heartbeater.cc:344] Connected to a master server at 127.2.90.189:41065
08:08:40.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.840457  3325 heartbeater.cc:461] Registering TS with master...
08:08:40.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.841226  3325 heartbeater.cc:507] Master 127.2.90.189:41065 requested a full tablet report, sending...
08:08:40.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.844357  2556 ts_manager.cc:194] Registered new tserver with Master: fecbf6c21a40400fac9aa6a557be405c (127.2.90.131:33107)
08:08:40.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.851774  3328 heartbeater.cc:344] Connected to a master server at 127.2.90.190:42265
08:08:40.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.852177  3328 heartbeater.cc:461] Registering TS with master...
08:08:40.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.852888  3328 heartbeater.cc:507] Master 127.2.90.190:42265 requested a full tablet report, sending...
08:08:40.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.855371  2477 ts_manager.cc:194] Registered new tserver with Master: fecbf6c21a40400fac9aa6a557be405c (127.2.90.131:33107)
08:08:40.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.863543  2410 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
08:08:40.878 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:08:40.878 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

08:08:40.879 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.2.90.190"
      port: 42265
    }
    bound_http_address {
      host: "127.2.90.190"
      port: 37553
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.2.90.189"
      port: 41065
    }
    bound_http_address {
      host: "127.2.90.189"
      port: 35841
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.2.90.188"
      port: 42457
    }
    bound_http_address {
      host: "127.2.90.188"
      port: 37531
    }
  }
}

08:08:40.880 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

08:08:40.881 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.2.90.129"
      port: 37135
    }
    bound_http_address {
      host: "127.2.90.129"
      port: 35735
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.2.90.130"
      port: 34617
    }
    bound_http_address {
      host: "127.2.90.130"
      port: 39997
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.2.90.131"
      port: 33107
    }
    bound_http_address {
      host: "127.2.90.131"
      port: 34907
    }
  }
}

08:08:40.881 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
08:08:40.882 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:40.884 [DEBUG - main] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:08:40.885 [DEBUG - main] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:08:40.885 [DEBUG - main] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:08:40.885 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.1.134.254:38449(127.1.134.254:38449)] Successfully connected to peer
08:08:40.886 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.1.134.253:41425(127.1.134.253:41425)] Successfully connected to peer
08:08:40.891 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.253
08:08:40.892 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.1.134.252:42093(127.1.134.252:42093)] Successfully connected to peer
08:08:40.893 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.254
08:08:40.895 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.252
08:08:40.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:40.904 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:40.904 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:40.908 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:40.909 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x9480a731, L:/127.0.0.1:34188 - R:/127.1.134.252:42093] using SASL/PLAIN
08:08:40.910 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x2d6dffb6, L:/127.0.0.1:39364 - R:/127.1.134.254:38449] using SASL/PLAIN
08:08:40.913 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:08:40.913 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=29), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [28ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: OK, deferred=null) after lookup
08:08:40.914 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xb73d3692, L:/127.0.0.1:59100 - R:/127.1.134.253:41425] using SASL/PLAIN
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:40.915664  1885 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34188:
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:08:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:08:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:08:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:08:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:08:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
08:08:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:08:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:08:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:08:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:08:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:08:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:08:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:08:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:08:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
08:08:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
08:08:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
08:08:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
08:08:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:08:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 3
08:08:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
08:08:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:08:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
08:08:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
08:08:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key2"
08:08:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:08:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
08:08:40.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key3"
08:08:40.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:08:40.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
08:08:40.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 42
08:08:40.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:08:40.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
08:08:40.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:08:40.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:08:40.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:40.920706  1885 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
08:08:40.937 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:40.938 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:40.938 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:40.938 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:40.938 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:40.939 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:40.939 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:40.939 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:40.939 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:40.939 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:40.939 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:40.940 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:40.940 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:40.948 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:40.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:40.948 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:40.948 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:40.948 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:40.948 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:40.948 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:40.949 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:40.949 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:40.949 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:40.949 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:40.949 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:40.949 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:40.949 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:40.989 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:40.989 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:40.989 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:40.990 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:40.990 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:40.990 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:40.990 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:40.990 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:40.990 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:40.991 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:40.991 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:40.991 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:40.991 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:41.012 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 2a489752354241eebd5d00f80d2b9347
08:08:41.063 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:41.121 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:41.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.131326  2190 tablet_service.cc:1511] Processing CreateTablet for tablet 72ad21258ea34269bce6ae4c80b8e589 (DEFAULT_TABLE table=replication_test_table [id=2a489752354241eebd5d00f80d2b9347]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
08:08:41.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.133639  2190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72ad21258ea34269bce6ae4c80b8e589. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:41.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.134353  2192 tablet_service.cc:1511] Processing CreateTablet for tablet 57ec20d798834ab1a9d6bad82e7002fe (DEFAULT_TABLE table=replication_test_table [id=2a489752354241eebd5d00f80d2b9347]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
08:08:41.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.135489  2192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57ec20d798834ab1a9d6bad82e7002fe. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:41.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.137933  2191 tablet_service.cc:1511] Processing CreateTablet for tablet 76d8c41bbf134c32947c73f9414f7aab (DEFAULT_TABLE table=replication_test_table [id=2a489752354241eebd5d00f80d2b9347]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
08:08:41.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.139365  2191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76d8c41bbf134c32947c73f9414f7aab. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:41.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.141752  2193 tablet_service.cc:1511] Processing CreateTablet for tablet 5b322ee1784745bfbf45b3b4ff0b9eee (DEFAULT_TABLE table=replication_test_table [id=2a489752354241eebd5d00f80d2b9347]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
08:08:41.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.142307  2051 tablet_service.cc:1511] Processing CreateTablet for tablet 5b322ee1784745bfbf45b3b4ff0b9eee (DEFAULT_TABLE table=replication_test_table [id=2a489752354241eebd5d00f80d2b9347]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
08:08:41.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.143947  2194 tablet_service.cc:1511] Processing CreateTablet for tablet aa8885af14cf410093b0fc307e337db3 (DEFAULT_TABLE table=replication_test_table [id=2a489752354241eebd5d00f80d2b9347]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
08:08:41.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.144390  2048 tablet_service.cc:1511] Processing CreateTablet for tablet 72ad21258ea34269bce6ae4c80b8e589 (DEFAULT_TABLE table=replication_test_table [id=2a489752354241eebd5d00f80d2b9347]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
08:08:41.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.142925  2193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b322ee1784745bfbf45b3b4ff0b9eee. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:41.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.146029  2194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa8885af14cf410093b0fc307e337db3. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:41.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.146915  2052 tablet_service.cc:1511] Processing CreateTablet for tablet aa8885af14cf410093b0fc307e337db3 (DEFAULT_TABLE table=replication_test_table [id=2a489752354241eebd5d00f80d2b9347]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
08:08:41.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.149051  2049 tablet_service.cc:1511] Processing CreateTablet for tablet 76d8c41bbf134c32947c73f9414f7aab (DEFAULT_TABLE table=replication_test_table [id=2a489752354241eebd5d00f80d2b9347]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
08:08:41.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.151028  2050 tablet_service.cc:1511] Processing CreateTablet for tablet 57ec20d798834ab1a9d6bad82e7002fe (DEFAULT_TABLE table=replication_test_table [id=2a489752354241eebd5d00f80d2b9347]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
08:08:41.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.152801  2048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72ad21258ea34269bce6ae4c80b8e589. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:41.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.154398  2049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76d8c41bbf134c32947c73f9414f7aab. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:41.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.155273  2052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa8885af14cf410093b0fc307e337db3. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:41.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.156493  2050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57ec20d798834ab1a9d6bad82e7002fe. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:41.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.158299  2331 tablet_service.cc:1511] Processing CreateTablet for tablet 76d8c41bbf134c32947c73f9414f7aab (DEFAULT_TABLE table=replication_test_table [id=2a489752354241eebd5d00f80d2b9347]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
08:08:41.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.160205  2331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76d8c41bbf134c32947c73f9414f7aab. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:41.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.160020  2051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b322ee1784745bfbf45b3b4ff0b9eee. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:41.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.152032  2195 tablet_service.cc:1511] Processing CreateTablet for tablet 0127c24cdb254b3b9444ea5f96a1b0ab (DEFAULT_TABLE table=replication_test_table [id=2a489752354241eebd5d00f80d2b9347]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
08:08:41.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.162673  2330 tablet_service.cc:1511] Processing CreateTablet for tablet 72ad21258ea34269bce6ae4c80b8e589 (DEFAULT_TABLE table=replication_test_table [id=2a489752354241eebd5d00f80d2b9347]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
08:08:41.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.163898  2330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72ad21258ea34269bce6ae4c80b8e589. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:41.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.165313  2195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0127c24cdb254b3b9444ea5f96a1b0ab. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:41.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.166903  2053 tablet_service.cc:1511] Processing CreateTablet for tablet 0127c24cdb254b3b9444ea5f96a1b0ab (DEFAULT_TABLE table=replication_test_table [id=2a489752354241eebd5d00f80d2b9347]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
08:08:41.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.167601  2334 tablet_service.cc:1511] Processing CreateTablet for tablet aa8885af14cf410093b0fc307e337db3 (DEFAULT_TABLE table=replication_test_table [id=2a489752354241eebd5d00f80d2b9347]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
08:08:41.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.168787  2334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa8885af14cf410093b0fc307e337db3. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:41.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.170253  2333 tablet_service.cc:1511] Processing CreateTablet for tablet 5b322ee1784745bfbf45b3b4ff0b9eee (DEFAULT_TABLE table=replication_test_table [id=2a489752354241eebd5d00f80d2b9347]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
08:08:41.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.170760  2053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0127c24cdb254b3b9444ea5f96a1b0ab. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:41.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.171404  2333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b322ee1784745bfbf45b3b4ff0b9eee. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:41.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.150476  2332 tablet_service.cc:1511] Processing CreateTablet for tablet 57ec20d798834ab1a9d6bad82e7002fe (DEFAULT_TABLE table=replication_test_table [id=2a489752354241eebd5d00f80d2b9347]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
08:08:41.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.178824  2332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57ec20d798834ab1a9d6bad82e7002fe. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:41.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.184262  2335 tablet_service.cc:1511] Processing CreateTablet for tablet 0127c24cdb254b3b9444ea5f96a1b0ab (DEFAULT_TABLE table=replication_test_table [id=2a489752354241eebd5d00f80d2b9347]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
08:08:41.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.186985  2335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0127c24cdb254b3b9444ea5f96a1b0ab. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:41.209 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:41.209 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:41.210 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:41.210 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:41.210 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:41.210 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:41.210 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:41.211 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:41.211 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:41.211 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:41.211 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:41.211 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:41.211 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:41.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.238588  3358 tablet_bootstrap.cc:492] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2: Bootstrap starting.
08:08:41.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.262197  3358 tablet_bootstrap.cc:654] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2: Neither blocks nor log segments found. Creating new log.
08:08:41.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.264074  3359 tablet_bootstrap.cc:492] T 72ad21258ea34269bce6ae4c80b8e589 P ad1db063d05747e7970018aed83fc0b5: Bootstrap starting.
08:08:41.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.270612  3358 log.cc:826] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2: Log is configured to *not* fsync() on all Append() calls
08:08:41.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.286918  3358 tablet_bootstrap.cc:492] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2: No bootstrap required, opened a new log
08:08:41.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.287613  3358 ts_tablet_manager.cc:1403] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.012s
08:08:41.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.288126  3359 tablet_bootstrap.cc:654] T 72ad21258ea34269bce6ae4c80b8e589 P ad1db063d05747e7970018aed83fc0b5: Neither blocks nor log segments found. Creating new log.
08:08:41.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.291483  3359 log.cc:826] T 72ad21258ea34269bce6ae4c80b8e589 P ad1db063d05747e7970018aed83fc0b5: Log is configured to *not* fsync() on all Append() calls
08:08:41.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.309365  3359 tablet_bootstrap.cc:492] T 72ad21258ea34269bce6ae4c80b8e589 P ad1db063d05747e7970018aed83fc0b5: No bootstrap required, opened a new log
08:08:41.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.310099  3359 ts_tablet_manager.cc:1403] T 72ad21258ea34269bce6ae4c80b8e589 P ad1db063d05747e7970018aed83fc0b5: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.024s
08:08:41.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.345068  3362 tablet_bootstrap.cc:492] T aa8885af14cf410093b0fc307e337db3 P a8c1971e3b584658ab4174f8d0ac12de: Bootstrap starting.
08:08:41.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.363353  3358 raft_consensus.cc:359] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.364643  3358 raft_consensus.cc:385] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:41.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.366346  3358 raft_consensus.cc:740] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c9c5ea12af94143abc1d9b757f8a3c2, State: Initialized, Role: FOLLOWER
08:08:41.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.367595  3359 raft_consensus.cc:359] T 72ad21258ea34269bce6ae4c80b8e589 P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.368690  3359 raft_consensus.cc:385] T 72ad21258ea34269bce6ae4c80b8e589 P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:41.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.369149  3359 raft_consensus.cc:740] T 72ad21258ea34269bce6ae4c80b8e589 P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad1db063d05747e7970018aed83fc0b5, State: Initialized, Role: FOLLOWER
08:08:41.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.368631  3358 consensus_queue.cc:260] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.372653  3359 consensus_queue.cc:260] T 72ad21258ea34269bce6ae4c80b8e589 P ad1db063d05747e7970018aed83fc0b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.384613  3359 ts_tablet_manager.cc:1434] T 72ad21258ea34269bce6ae4c80b8e589 P ad1db063d05747e7970018aed83fc0b5: Time spent starting tablet: real 0.074s	user 0.034s	sys 0.010s
08:08:41.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.385596  3358 ts_tablet_manager.cc:1434] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2: Time spent starting tablet: real 0.098s	user 0.042s	sys 0.002s
08:08:41.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.384647  3362 tablet_bootstrap.cc:654] T aa8885af14cf410093b0fc307e337db3 P a8c1971e3b584658ab4174f8d0ac12de: Neither blocks nor log segments found. Creating new log.
08:08:41.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.396306  3362 log.cc:826] T aa8885af14cf410093b0fc307e337db3 P a8c1971e3b584658ab4174f8d0ac12de: Log is configured to *not* fsync() on all Append() calls
08:08:41.401 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:41.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.399370  3359 tablet_bootstrap.cc:492] T 5b322ee1784745bfbf45b3b4ff0b9eee P ad1db063d05747e7970018aed83fc0b5: Bootstrap starting.
08:08:41.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.406714  3358 tablet_bootstrap.cc:492] T 76d8c41bbf134c32947c73f9414f7aab P 1c9c5ea12af94143abc1d9b757f8a3c2: Bootstrap starting.
08:08:41.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.416128  3363 raft_consensus.cc:493] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:41.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.416883  3363 raft_consensus.cc:515] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:41.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.448256  3359 tablet_bootstrap.cc:654] T 5b322ee1784745bfbf45b3b4ff0b9eee P ad1db063d05747e7970018aed83fc0b5: Neither blocks nor log segments found. Creating new log.
08:08:41.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.450366  3362 tablet_bootstrap.cc:492] T aa8885af14cf410093b0fc307e337db3 P a8c1971e3b584658ab4174f8d0ac12de: No bootstrap required, opened a new log
08:08:41.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.451064  3362 ts_tablet_manager.cc:1403] T aa8885af14cf410093b0fc307e337db3 P a8c1971e3b584658ab4174f8d0ac12de: Time spent bootstrapping tablet: real 0.107s	user 0.011s	sys 0.014s
08:08:41.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.456357  3359 tablet_bootstrap.cc:492] T 5b322ee1784745bfbf45b3b4ff0b9eee P ad1db063d05747e7970018aed83fc0b5: No bootstrap required, opened a new log
08:08:41.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.457096  3359 ts_tablet_manager.cc:1403] T 5b322ee1784745bfbf45b3b4ff0b9eee P ad1db063d05747e7970018aed83fc0b5: Time spent bootstrapping tablet: real 0.058s	user 0.004s	sys 0.011s
08:08:41.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.457201  3358 tablet_bootstrap.cc:654] T 76d8c41bbf134c32947c73f9414f7aab P 1c9c5ea12af94143abc1d9b757f8a3c2: Neither blocks nor log segments found. Creating new log.
08:08:41.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.458312  3363 leader_election.cc:290] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad1db063d05747e7970018aed83fc0b5 (127.1.134.193:41847), a8c1971e3b584658ab4174f8d0ac12de (127.1.134.195:39383)
08:08:41.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.460554  3359 raft_consensus.cc:359] T 5b322ee1784745bfbf45b3b4ff0b9eee P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.461436  3359 raft_consensus.cc:385] T 5b322ee1784745bfbf45b3b4ff0b9eee P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:41.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.461746  3359 raft_consensus.cc:740] T 5b322ee1784745bfbf45b3b4ff0b9eee P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad1db063d05747e7970018aed83fc0b5, State: Initialized, Role: FOLLOWER
08:08:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.462597  3359 consensus_queue.cc:260] T 5b322ee1784745bfbf45b3b4ff0b9eee P ad1db063d05747e7970018aed83fc0b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.466019  3359 ts_tablet_manager.cc:1434] T 5b322ee1784745bfbf45b3b4ff0b9eee P ad1db063d05747e7970018aed83fc0b5: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
08:08:41.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.471235  3359 tablet_bootstrap.cc:492] T 57ec20d798834ab1a9d6bad82e7002fe P ad1db063d05747e7970018aed83fc0b5: Bootstrap starting.
08:08:41.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.483321  3359 tablet_bootstrap.cc:654] T 57ec20d798834ab1a9d6bad82e7002fe P ad1db063d05747e7970018aed83fc0b5: Neither blocks nor log segments found. Creating new log.
08:08:41.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.499646  3358 tablet_bootstrap.cc:492] T 76d8c41bbf134c32947c73f9414f7aab P 1c9c5ea12af94143abc1d9b757f8a3c2: No bootstrap required, opened a new log
08:08:41.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.500185  3358 ts_tablet_manager.cc:1403] T 76d8c41bbf134c32947c73f9414f7aab P 1c9c5ea12af94143abc1d9b757f8a3c2: Time spent bootstrapping tablet: real 0.094s	user 0.008s	sys 0.004s
08:08:41.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.500447  3359 tablet_bootstrap.cc:492] T 57ec20d798834ab1a9d6bad82e7002fe P ad1db063d05747e7970018aed83fc0b5: No bootstrap required, opened a new log
08:08:41.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.500941  3359 ts_tablet_manager.cc:1403] T 57ec20d798834ab1a9d6bad82e7002fe P ad1db063d05747e7970018aed83fc0b5: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.001s
08:08:41.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.499819  3362 raft_consensus.cc:359] T aa8885af14cf410093b0fc307e337db3 P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.502074  3362 raft_consensus.cc:385] T aa8885af14cf410093b0fc307e337db3 P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:41.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.502704  3362 raft_consensus.cc:740] T aa8885af14cf410093b0fc307e337db3 P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1971e3b584658ab4174f8d0ac12de, State: Initialized, Role: FOLLOWER
08:08:41.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.504019  3362 consensus_queue.cc:260] T aa8885af14cf410093b0fc307e337db3 P a8c1971e3b584658ab4174f8d0ac12de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.504443  3359 raft_consensus.cc:359] T 57ec20d798834ab1a9d6bad82e7002fe P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.505187  3359 raft_consensus.cc:385] T 57ec20d798834ab1a9d6bad82e7002fe P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:41.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.505470  3359 raft_consensus.cc:740] T 57ec20d798834ab1a9d6bad82e7002fe P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad1db063d05747e7970018aed83fc0b5, State: Initialized, Role: FOLLOWER
08:08:41.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.506188  3359 consensus_queue.cc:260] T 57ec20d798834ab1a9d6bad82e7002fe P ad1db063d05747e7970018aed83fc0b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.507254  2355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa8885af14cf410093b0fc307e337db3" candidate_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1971e3b584658ab4174f8d0ac12de" is_pre_election: true
08:08:41.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.508301  2355 raft_consensus.cc:2468] T aa8885af14cf410093b0fc307e337db3 P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c9c5ea12af94143abc1d9b757f8a3c2 in term 0.
08:08:41.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.510804  2148 leader_election.cc:304] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c9c5ea12af94143abc1d9b757f8a3c2, a8c1971e3b584658ab4174f8d0ac12de; no voters: 
08:08:41.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.512215  3363 raft_consensus.cc:2804] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:08:41.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.512602  3363 raft_consensus.cc:493] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:08:41.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.512964  3363 raft_consensus.cc:3060] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Advancing to term 1
08:08:41.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.514883  3359 ts_tablet_manager.cc:1434] T 57ec20d798834ab1a9d6bad82e7002fe P ad1db063d05747e7970018aed83fc0b5: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
08:08:41.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.522028  3359 tablet_bootstrap.cc:492] T aa8885af14cf410093b0fc307e337db3 P ad1db063d05747e7970018aed83fc0b5: Bootstrap starting.
08:08:41.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.526456  2073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa8885af14cf410093b0fc307e337db3" candidate_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad1db063d05747e7970018aed83fc0b5" is_pre_election: true
08:08:41.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.523171  3363 raft_consensus.cc:515] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.529474  3359 tablet_bootstrap.cc:654] T aa8885af14cf410093b0fc307e337db3 P ad1db063d05747e7970018aed83fc0b5: Neither blocks nor log segments found. Creating new log.
08:08:41.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:41.535157  2150 leader_election.cc:343] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad1db063d05747e7970018aed83fc0b5 (127.1.134.193:41847): Illegal state: must be running to vote when last-logged opid is not known
08:08:41.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.537546  2355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa8885af14cf410093b0fc307e337db3" candidate_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1971e3b584658ab4174f8d0ac12de"
08:08:41.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.538211  2355 raft_consensus.cc:3060] T aa8885af14cf410093b0fc307e337db3 P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Advancing to term 1
08:08:41.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.541923  2073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa8885af14cf410093b0fc307e337db3" candidate_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad1db063d05747e7970018aed83fc0b5"
08:08:41.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:41.543735  2150 leader_election.cc:343] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ad1db063d05747e7970018aed83fc0b5 (127.1.134.193:41847): Illegal state: must be running to vote when last-logged opid is not known
08:08:41.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.532379  3358 raft_consensus.cc:359] T 76d8c41bbf134c32947c73f9414f7aab P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.547883  3358 raft_consensus.cc:385] T 76d8c41bbf134c32947c73f9414f7aab P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:41.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.548296  3358 raft_consensus.cc:740] T 76d8c41bbf134c32947c73f9414f7aab P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c9c5ea12af94143abc1d9b757f8a3c2, State: Initialized, Role: FOLLOWER
08:08:41.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.548861  3363 leader_election.cc:290] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2 [CANDIDATE]: Term 1 election: Requested vote from peers ad1db063d05747e7970018aed83fc0b5 (127.1.134.193:41847), a8c1971e3b584658ab4174f8d0ac12de (127.1.134.195:39383)
08:08:41.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.553223  3358 consensus_queue.cc:260] T 76d8c41bbf134c32947c73f9414f7aab P 1c9c5ea12af94143abc1d9b757f8a3c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.558120  2355 raft_consensus.cc:2468] T aa8885af14cf410093b0fc307e337db3 P a8c1971e3b584658ab4174f8d0ac12de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c9c5ea12af94143abc1d9b757f8a3c2 in term 1.
08:08:41.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:41.561014  2126 tablet.cc:2404] T 57ec20d798834ab1a9d6bad82e7002fe P ad1db063d05747e7970018aed83fc0b5: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:08:41.562 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:41.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.568017  3364 raft_consensus.cc:493] T 72ad21258ea34269bce6ae4c80b8e589 P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:41.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.568697  3364 raft_consensus.cc:515] T 72ad21258ea34269bce6ae4c80b8e589 P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.575357  3364 leader_election.cc:290] T 72ad21258ea34269bce6ae4c80b8e589 P ad1db063d05747e7970018aed83fc0b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c9c5ea12af94143abc1d9b757f8a3c2 (127.1.134.194:43489), a8c1971e3b584658ab4174f8d0ac12de (127.1.134.195:39383)
08:08:41.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.564584  3362 ts_tablet_manager.cc:1434] T aa8885af14cf410093b0fc307e337db3 P a8c1971e3b584658ab4174f8d0ac12de: Time spent starting tablet: real 0.113s	user 0.042s	sys 0.032s
08:08:41.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.579722  3362 tablet_bootstrap.cc:492] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de: Bootstrap starting.
08:08:41.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.579793  2148 leader_election.cc:304] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c9c5ea12af94143abc1d9b757f8a3c2, a8c1971e3b584658ab4174f8d0ac12de; no voters: ad1db063d05747e7970018aed83fc0b5
08:08:41.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.581265  3363 raft_consensus.cc:2804] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 1 FOLLOWER]: Leader election won for term 1
08:08:41.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.581988  3363 raft_consensus.cc:697] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 1 LEADER]: Becoming Leader. State: Replica: 1c9c5ea12af94143abc1d9b757f8a3c2, State: Running, Role: LEADER
08:08:41.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.589442  3362 tablet_bootstrap.cc:654] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de: Neither blocks nor log segments found. Creating new log.
08:08:41.593 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:41.593 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:41.593 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:41.594 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:41.594 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:41.594 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:41.594 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:41.594 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:41.594 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:41.594 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:41.594 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:41.594 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:41.595 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:41.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.591174  3359 tablet_bootstrap.cc:492] T aa8885af14cf410093b0fc307e337db3 P ad1db063d05747e7970018aed83fc0b5: No bootstrap required, opened a new log
08:08:41.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.601022  3359 ts_tablet_manager.cc:1403] T aa8885af14cf410093b0fc307e337db3 P ad1db063d05747e7970018aed83fc0b5: Time spent bootstrapping tablet: real 0.079s	user 0.017s	sys 0.021s
08:08:41.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.583819  3363 consensus_queue.cc:237] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.609887  3358 ts_tablet_manager.cc:1434] T 76d8c41bbf134c32947c73f9414f7aab P 1c9c5ea12af94143abc1d9b757f8a3c2: Time spent starting tablet: real 0.109s	user 0.005s	sys 0.003s
08:08:41.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.613590  3358 tablet_bootstrap.cc:492] T 57ec20d798834ab1a9d6bad82e7002fe P 1c9c5ea12af94143abc1d9b757f8a3c2: Bootstrap starting.
08:08:41.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.606317  3359 raft_consensus.cc:359] T aa8885af14cf410093b0fc307e337db3 P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.615306  3359 raft_consensus.cc:385] T aa8885af14cf410093b0fc307e337db3 P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:41.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.615617  3359 raft_consensus.cc:740] T aa8885af14cf410093b0fc307e337db3 P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad1db063d05747e7970018aed83fc0b5, State: Initialized, Role: FOLLOWER
08:08:41.620 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:41.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.616338  3359 consensus_queue.cc:260] T aa8885af14cf410093b0fc307e337db3 P ad1db063d05747e7970018aed83fc0b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:41.630262  2267 tablet.cc:2404] T 76d8c41bbf134c32947c73f9414f7aab P 1c9c5ea12af94143abc1d9b757f8a3c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:08:41.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.632021  3358 tablet_bootstrap.cc:654] T 57ec20d798834ab1a9d6bad82e7002fe P 1c9c5ea12af94143abc1d9b757f8a3c2: Neither blocks nor log segments found. Creating new log.
08:08:41.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.632599  3362 tablet_bootstrap.cc:492] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de: No bootstrap required, opened a new log
08:08:41.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.633080  3362 ts_tablet_manager.cc:1403] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de: Time spent bootstrapping tablet: real 0.054s	user 0.006s	sys 0.012s
08:08:41.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.641062  3364 raft_consensus.cc:493] T 5b322ee1784745bfbf45b3b4ff0b9eee P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:41.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.641595  3364 raft_consensus.cc:515] T 5b322ee1784745bfbf45b3b4ff0b9eee P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.643720  3364 leader_election.cc:290] T 5b322ee1784745bfbf45b3b4ff0b9eee P ad1db063d05747e7970018aed83fc0b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c9c5ea12af94143abc1d9b757f8a3c2 (127.1.134.194:43489), a8c1971e3b584658ab4174f8d0ac12de (127.1.134.195:39383)
08:08:41.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.626233  3359 ts_tablet_manager.cc:1434] T aa8885af14cf410093b0fc307e337db3 P ad1db063d05747e7970018aed83fc0b5: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.003s
08:08:41.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.641835  3362 raft_consensus.cc:359] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.647547  3362 raft_consensus.cc:385] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:41.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.647862  3362 raft_consensus.cc:740] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1971e3b584658ab4174f8d0ac12de, State: Initialized, Role: FOLLOWER
08:08:41.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.648710  3362 consensus_queue.cc:260] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.651415  1884 catalog_manager.cc:5696] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c9c5ea12af94143abc1d9b757f8a3c2 (127.1.134.194). New cstate: current_term: 1 leader_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } health_report { overall_health: UNKNOWN } } }
08:08:41.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.656850  3362 ts_tablet_manager.cc:1434] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
08:08:41.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.657891  3362 tablet_bootstrap.cc:492] T 0127c24cdb254b3b9444ea5f96a1b0ab P a8c1971e3b584658ab4174f8d0ac12de: Bootstrap starting.
08:08:41.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.670867  3359 tablet_bootstrap.cc:492] T 0127c24cdb254b3b9444ea5f96a1b0ab P ad1db063d05747e7970018aed83fc0b5: Bootstrap starting.
08:08:41.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.676926  3362 tablet_bootstrap.cc:654] T 0127c24cdb254b3b9444ea5f96a1b0ab P a8c1971e3b584658ab4174f8d0ac12de: Neither blocks nor log segments found. Creating new log.
08:08:41.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:41.721066  2403 tablet.cc:2404] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:08:41.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.734755  2355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ad21258ea34269bce6ae4c80b8e589" candidate_uuid: "ad1db063d05747e7970018aed83fc0b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1971e3b584658ab4174f8d0ac12de" is_pre_election: true
08:08:41.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.735064  2215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ad21258ea34269bce6ae4c80b8e589" candidate_uuid: "ad1db063d05747e7970018aed83fc0b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" is_pre_election: true
08:08:41.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.738421  2355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b322ee1784745bfbf45b3b4ff0b9eee" candidate_uuid: "ad1db063d05747e7970018aed83fc0b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1971e3b584658ab4174f8d0ac12de" is_pre_election: true
08:08:41.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.739135  2215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b322ee1784745bfbf45b3b4ff0b9eee" candidate_uuid: "ad1db063d05747e7970018aed83fc0b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" is_pre_election: true
08:08:41.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.741307  3372 raft_consensus.cc:493] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:41.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.742053  3359 tablet_bootstrap.cc:654] T 0127c24cdb254b3b9444ea5f96a1b0ab P ad1db063d05747e7970018aed83fc0b5: Neither blocks nor log segments found. Creating new log.
08:08:41.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.741914  3372 raft_consensus.cc:515] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:41.740409  2006 leader_election.cc:343] T 72ad21258ea34269bce6ae4c80b8e589 P ad1db063d05747e7970018aed83fc0b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c9c5ea12af94143abc1d9b757f8a3c2 (127.1.134.194:43489): Illegal state: must be running to vote when last-logged opid is not known
08:08:41.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:41.743918  2006 leader_election.cc:343] T 72ad21258ea34269bce6ae4c80b8e589 P ad1db063d05747e7970018aed83fc0b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c1971e3b584658ab4174f8d0ac12de (127.1.134.195:39383): Illegal state: must be running to vote when last-logged opid is not known
08:08:41.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.744438  2006 leader_election.cc:304] T 72ad21258ea34269bce6ae4c80b8e589 P ad1db063d05747e7970018aed83fc0b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad1db063d05747e7970018aed83fc0b5; no voters: 1c9c5ea12af94143abc1d9b757f8a3c2, a8c1971e3b584658ab4174f8d0ac12de
08:08:41.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.746152  3372 leader_election.cc:290] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad1db063d05747e7970018aed83fc0b5 (127.1.134.193:41847), 1c9c5ea12af94143abc1d9b757f8a3c2 (127.1.134.194:43489)
08:08:41.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.750591  3364 raft_consensus.cc:2749] T 72ad21258ea34269bce6ae4c80b8e589 P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
08:08:41.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:41.750926  2006 leader_election.cc:343] T 5b322ee1784745bfbf45b3b4ff0b9eee P ad1db063d05747e7970018aed83fc0b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c1971e3b584658ab4174f8d0ac12de (127.1.134.195:39383): Illegal state: must be running to vote when last-logged opid is not known
08:08:41.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.755638  3362 tablet_bootstrap.cc:492] T 0127c24cdb254b3b9444ea5f96a1b0ab P a8c1971e3b584658ab4174f8d0ac12de: No bootstrap required, opened a new log
08:08:41.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.756210  3362 ts_tablet_manager.cc:1403] T 0127c24cdb254b3b9444ea5f96a1b0ab P a8c1971e3b584658ab4174f8d0ac12de: Time spent bootstrapping tablet: real 0.099s	user 0.022s	sys 0.007s
08:08:41.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:41.760028  2006 leader_election.cc:343] T 5b322ee1784745bfbf45b3b4ff0b9eee P ad1db063d05747e7970018aed83fc0b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c9c5ea12af94143abc1d9b757f8a3c2 (127.1.134.194:43489): Illegal state: must be running to vote when last-logged opid is not known
08:08:41.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.760037  3362 raft_consensus.cc:359] T 0127c24cdb254b3b9444ea5f96a1b0ab P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.760793  3362 raft_consensus.cc:385] T 0127c24cdb254b3b9444ea5f96a1b0ab P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:41.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.761121  3362 raft_consensus.cc:740] T 0127c24cdb254b3b9444ea5f96a1b0ab P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1971e3b584658ab4174f8d0ac12de, State: Initialized, Role: FOLLOWER
08:08:41.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.761656  2006 leader_election.cc:304] T 5b322ee1784745bfbf45b3b4ff0b9eee P ad1db063d05747e7970018aed83fc0b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad1db063d05747e7970018aed83fc0b5; no voters: 1c9c5ea12af94143abc1d9b757f8a3c2, a8c1971e3b584658ab4174f8d0ac12de
08:08:41.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.761860  3362 consensus_queue.cc:260] T 0127c24cdb254b3b9444ea5f96a1b0ab P a8c1971e3b584658ab4174f8d0ac12de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.768743  3362 ts_tablet_manager.cc:1434] T 0127c24cdb254b3b9444ea5f96a1b0ab P a8c1971e3b584658ab4174f8d0ac12de: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
08:08:41.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.771008  3364 raft_consensus.cc:2749] T 5b322ee1784745bfbf45b3b4ff0b9eee P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
08:08:41.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.772534  3362 tablet_bootstrap.cc:492] T 57ec20d798834ab1a9d6bad82e7002fe P a8c1971e3b584658ab4174f8d0ac12de: Bootstrap starting.
08:08:41.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.785749  3362 tablet_bootstrap.cc:654] T 57ec20d798834ab1a9d6bad82e7002fe P a8c1971e3b584658ab4174f8d0ac12de: Neither blocks nor log segments found. Creating new log.
08:08:41.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.796389  3358 tablet_bootstrap.cc:492] T 57ec20d798834ab1a9d6bad82e7002fe P 1c9c5ea12af94143abc1d9b757f8a3c2: No bootstrap required, opened a new log
08:08:41.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.797811  3358 ts_tablet_manager.cc:1403] T 57ec20d798834ab1a9d6bad82e7002fe P 1c9c5ea12af94143abc1d9b757f8a3c2: Time spent bootstrapping tablet: real 0.184s	user 0.016s	sys 0.032s
08:08:41.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.808470  3358 raft_consensus.cc:359] T 57ec20d798834ab1a9d6bad82e7002fe P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.810487  3358 raft_consensus.cc:385] T 57ec20d798834ab1a9d6bad82e7002fe P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:41.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.811142  3358 raft_consensus.cc:740] T 57ec20d798834ab1a9d6bad82e7002fe P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c9c5ea12af94143abc1d9b757f8a3c2, State: Initialized, Role: FOLLOWER
08:08:41.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.817832  3358 consensus_queue.cc:260] T 57ec20d798834ab1a9d6bad82e7002fe P 1c9c5ea12af94143abc1d9b757f8a3c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.820098  3362 tablet_bootstrap.cc:492] T 57ec20d798834ab1a9d6bad82e7002fe P a8c1971e3b584658ab4174f8d0ac12de: No bootstrap required, opened a new log
08:08:41.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.820706  3362 ts_tablet_manager.cc:1403] T 57ec20d798834ab1a9d6bad82e7002fe P a8c1971e3b584658ab4174f8d0ac12de: Time spent bootstrapping tablet: real 0.048s	user 0.022s	sys 0.000s
08:08:41.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.823848  3362 raft_consensus.cc:359] T 57ec20d798834ab1a9d6bad82e7002fe P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.824561  3362 raft_consensus.cc:385] T 57ec20d798834ab1a9d6bad82e7002fe P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:41.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.824855  3362 raft_consensus.cc:740] T 57ec20d798834ab1a9d6bad82e7002fe P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1971e3b584658ab4174f8d0ac12de, State: Initialized, Role: FOLLOWER
08:08:41.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.824431  3358 ts_tablet_manager.cc:1434] T 57ec20d798834ab1a9d6bad82e7002fe P 1c9c5ea12af94143abc1d9b757f8a3c2: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
08:08:41.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.827394  3324 heartbeater.cc:499] Master 127.2.90.188:42457 was elected leader, sending a full tablet report...
08:08:41.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.828236  3358 tablet_bootstrap.cc:492] T 0127c24cdb254b3b9444ea5f96a1b0ab P 1c9c5ea12af94143abc1d9b757f8a3c2: Bootstrap starting.
08:08:41.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.828998  3362 consensus_queue.cc:260] T 57ec20d798834ab1a9d6bad82e7002fe P a8c1971e3b584658ab4174f8d0ac12de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.836650  3363 raft_consensus.cc:493] T 57ec20d798834ab1a9d6bad82e7002fe P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:41.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.836786  3362 ts_tablet_manager.cc:1434] T 57ec20d798834ab1a9d6bad82e7002fe P a8c1971e3b584658ab4174f8d0ac12de: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
08:08:41.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.837163  3363 raft_consensus.cc:515] T 57ec20d798834ab1a9d6bad82e7002fe P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.839540  3363 leader_election.cc:290] T 57ec20d798834ab1a9d6bad82e7002fe P 1c9c5ea12af94143abc1d9b757f8a3c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad1db063d05747e7970018aed83fc0b5 (127.1.134.193:41847), a8c1971e3b584658ab4174f8d0ac12de (127.1.134.195:39383)
08:08:41.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.839802  3362 tablet_bootstrap.cc:492] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de: Bootstrap starting.
08:08:41.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.840565  2073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ec20d798834ab1a9d6bad82e7002fe" candidate_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad1db063d05747e7970018aed83fc0b5" is_pre_election: true
08:08:41.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.841238  2073 raft_consensus.cc:2468] T 57ec20d798834ab1a9d6bad82e7002fe P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c9c5ea12af94143abc1d9b757f8a3c2 in term 0.
08:08:41.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.842597  2150 leader_election.cc:304] T 57ec20d798834ab1a9d6bad82e7002fe P 1c9c5ea12af94143abc1d9b757f8a3c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c9c5ea12af94143abc1d9b757f8a3c2, ad1db063d05747e7970018aed83fc0b5; no voters: 
08:08:41.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.843654  3363 raft_consensus.cc:2804] T 57ec20d798834ab1a9d6bad82e7002fe P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:08:41.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.843992  3363 raft_consensus.cc:493] T 57ec20d798834ab1a9d6bad82e7002fe P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:08:41.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.844329  3363 raft_consensus.cc:3060] T 57ec20d798834ab1a9d6bad82e7002fe P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Advancing to term 1
08:08:41.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.844599  2355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ec20d798834ab1a9d6bad82e7002fe" candidate_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1971e3b584658ab4174f8d0ac12de" is_pre_election: true
08:08:41.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.845257  2355 raft_consensus.cc:2468] T 57ec20d798834ab1a9d6bad82e7002fe P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c9c5ea12af94143abc1d9b757f8a3c2 in term 0.
08:08:41.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.853982  3359 tablet_bootstrap.cc:492] T 0127c24cdb254b3b9444ea5f96a1b0ab P ad1db063d05747e7970018aed83fc0b5: No bootstrap required, opened a new log
08:08:41.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.854640  3359 ts_tablet_manager.cc:1403] T 0127c24cdb254b3b9444ea5f96a1b0ab P ad1db063d05747e7970018aed83fc0b5: Time spent bootstrapping tablet: real 0.184s	user 0.013s	sys 0.003s
08:08:41.856 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:41.856 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:41.857 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:41.858 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:41.858 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:41.858 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:41.859 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:41.859 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:41.859 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:41.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.858554  3359 raft_consensus.cc:359] T 0127c24cdb254b3b9444ea5f96a1b0ab P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.859 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:41.859 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:41.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.859364  3359 raft_consensus.cc:385] T 0127c24cdb254b3b9444ea5f96a1b0ab P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:41.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.859670  3359 raft_consensus.cc:740] T 0127c24cdb254b3b9444ea5f96a1b0ab P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad1db063d05747e7970018aed83fc0b5, State: Initialized, Role: FOLLOWER
08:08:41.859 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:41.860 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:41.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.860428  3359 consensus_queue.cc:260] T 0127c24cdb254b3b9444ea5f96a1b0ab P ad1db063d05747e7970018aed83fc0b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.867053  3363 raft_consensus.cc:515] T 57ec20d798834ab1a9d6bad82e7002fe P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.871855  3363 leader_election.cc:290] T 57ec20d798834ab1a9d6bad82e7002fe P 1c9c5ea12af94143abc1d9b757f8a3c2 [CANDIDATE]: Term 1 election: Requested vote from peers ad1db063d05747e7970018aed83fc0b5 (127.1.134.193:41847), a8c1971e3b584658ab4174f8d0ac12de (127.1.134.195:39383)
08:08:41.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.872990  3358 tablet_bootstrap.cc:654] T 0127c24cdb254b3b9444ea5f96a1b0ab P 1c9c5ea12af94143abc1d9b757f8a3c2: Neither blocks nor log segments found. Creating new log.
08:08:41.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.873154  2073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ec20d798834ab1a9d6bad82e7002fe" candidate_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad1db063d05747e7970018aed83fc0b5"
08:08:41.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.873760  2073 raft_consensus.cc:3060] T 57ec20d798834ab1a9d6bad82e7002fe P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Advancing to term 1
08:08:41.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.869076  3362 tablet_bootstrap.cc:654] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de: Neither blocks nor log segments found. Creating new log.
08:08:41.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.878937  2355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ec20d798834ab1a9d6bad82e7002fe" candidate_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1971e3b584658ab4174f8d0ac12de"
08:08:41.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.879650  2355 raft_consensus.cc:3060] T 57ec20d798834ab1a9d6bad82e7002fe P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Advancing to term 1
08:08:41.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.893893  2355 raft_consensus.cc:2468] T 57ec20d798834ab1a9d6bad82e7002fe P a8c1971e3b584658ab4174f8d0ac12de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c9c5ea12af94143abc1d9b757f8a3c2 in term 1.
08:08:41.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:41.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.899942  2148 leader_election.cc:304] T 57ec20d798834ab1a9d6bad82e7002fe P 1c9c5ea12af94143abc1d9b757f8a3c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c9c5ea12af94143abc1d9b757f8a3c2, a8c1971e3b584658ab4174f8d0ac12de; no voters: 
08:08:41.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.900964  3363 raft_consensus.cc:2804] T 57ec20d798834ab1a9d6bad82e7002fe P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 1 FOLLOWER]: Leader election won for term 1
08:08:41.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.901471  3363 raft_consensus.cc:697] T 57ec20d798834ab1a9d6bad82e7002fe P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 1 LEADER]: Becoming Leader. State: Replica: 1c9c5ea12af94143abc1d9b757f8a3c2, State: Running, Role: LEADER
08:08:41.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.902199  2073 raft_consensus.cc:2468] T 57ec20d798834ab1a9d6bad82e7002fe P ad1db063d05747e7970018aed83fc0b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c9c5ea12af94143abc1d9b757f8a3c2 in term 1.
08:08:41.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.902590  3363 consensus_queue.cc:237] T 57ec20d798834ab1a9d6bad82e7002fe P 1c9c5ea12af94143abc1d9b757f8a3c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.905966  2072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d8c41bbf134c32947c73f9414f7aab" candidate_uuid: "a8c1971e3b584658ab4174f8d0ac12de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad1db063d05747e7970018aed83fc0b5" is_pre_election: true
08:08:41.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.915143  2215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d8c41bbf134c32947c73f9414f7aab" candidate_uuid: "a8c1971e3b584658ab4174f8d0ac12de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" is_pre_election: true
08:08:41.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.915879  2215 raft_consensus.cc:2468] T 76d8c41bbf134c32947c73f9414f7aab P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1971e3b584658ab4174f8d0ac12de in term 0.
08:08:41.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.917565  3359 ts_tablet_manager.cc:1434] T 0127c24cdb254b3b9444ea5f96a1b0ab P ad1db063d05747e7970018aed83fc0b5: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.001s
08:08:41.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.918272  2288 leader_election.cc:304] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c9c5ea12af94143abc1d9b757f8a3c2, a8c1971e3b584658ab4174f8d0ac12de; no voters: 
08:08:41.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.919514  3372 raft_consensus.cc:2804] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Leader pre-election won for term 1
08:08:41.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:41.919902  2290 leader_election.cc:343] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad1db063d05747e7970018aed83fc0b5 (127.1.134.193:41847): Illegal state: must be running to vote when last-logged opid is not known
08:08:41.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.919909  3372 raft_consensus.cc:493] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:08:41.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.920600  3372 raft_consensus.cc:3060] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Advancing to term 1
08:08:41.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.927112  3359 tablet_bootstrap.cc:492] T 76d8c41bbf134c32947c73f9414f7aab P ad1db063d05747e7970018aed83fc0b5: Bootstrap starting.
08:08:41.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.930809  3372 raft_consensus.cc:515] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.932895  3362 tablet_bootstrap.cc:492] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de: No bootstrap required, opened a new log
08:08:41.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.933377  3362 ts_tablet_manager.cc:1403] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de: Time spent bootstrapping tablet: real 0.094s	user 0.016s	sys 0.018s
08:08:41.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.934494  2073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d8c41bbf134c32947c73f9414f7aab" candidate_uuid: "a8c1971e3b584658ab4174f8d0ac12de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad1db063d05747e7970018aed83fc0b5"
08:08:41.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:41.936079  2290 leader_election.cc:343] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ad1db063d05747e7970018aed83fc0b5 (127.1.134.193:41847): Illegal state: must be running to vote when last-logged opid is not known
08:08:41.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.936650  3362 raft_consensus.cc:359] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.937464  3362 raft_consensus.cc:385] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:41.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.937911  3362 raft_consensus.cc:740] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1971e3b584658ab4174f8d0ac12de, State: Initialized, Role: FOLLOWER
08:08:41.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.938321  2215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d8c41bbf134c32947c73f9414f7aab" candidate_uuid: "a8c1971e3b584658ab4174f8d0ac12de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2"
08:08:41.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.938966  2215 raft_consensus.cc:3060] T 76d8c41bbf134c32947c73f9414f7aab P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Advancing to term 1
08:08:41.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.938659  3362 consensus_queue.cc:260] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.941282  3358 tablet_bootstrap.cc:492] T 0127c24cdb254b3b9444ea5f96a1b0ab P 1c9c5ea12af94143abc1d9b757f8a3c2: No bootstrap required, opened a new log
08:08:41.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.943341  3358 ts_tablet_manager.cc:1403] T 0127c24cdb254b3b9444ea5f96a1b0ab P 1c9c5ea12af94143abc1d9b757f8a3c2: Time spent bootstrapping tablet: real 0.115s	user 0.008s	sys 0.012s
08:08:41.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:41.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.947831  3358 raft_consensus.cc:359] T 0127c24cdb254b3b9444ea5f96a1b0ab P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.949589  3372 leader_election.cc:290] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de [CANDIDATE]: Term 1 election: Requested vote from peers ad1db063d05747e7970018aed83fc0b5 (127.1.134.193:41847), 1c9c5ea12af94143abc1d9b757f8a3c2 (127.1.134.194:43489)
08:08:41.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.952417  3358 raft_consensus.cc:385] T 0127c24cdb254b3b9444ea5f96a1b0ab P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:41.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.952759  3358 raft_consensus.cc:740] T 0127c24cdb254b3b9444ea5f96a1b0ab P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c9c5ea12af94143abc1d9b757f8a3c2, State: Initialized, Role: FOLLOWER
08:08:41.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.953550  3362 ts_tablet_manager.cc:1434] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de: Time spent starting tablet: real 0.020s	user 0.000s	sys 0.009s
08:08:41.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.954553  3362 tablet_bootstrap.cc:492] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de: Bootstrap starting.
08:08:41.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.962150  1884 catalog_manager.cc:5696] T 57ec20d798834ab1a9d6bad82e7002fe P 1c9c5ea12af94143abc1d9b757f8a3c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c9c5ea12af94143abc1d9b757f8a3c2 (127.1.134.194). New cstate: current_term: 1 leader_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } health_report { overall_health: UNKNOWN } } }
08:08:41.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.968127  3362 tablet_bootstrap.cc:654] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de: Neither blocks nor log segments found. Creating new log.
08:08:41.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.949314  2215 raft_consensus.cc:2468] T 76d8c41bbf134c32947c73f9414f7aab P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1971e3b584658ab4174f8d0ac12de in term 1.
08:08:41.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.972481  2288 leader_election.cc:304] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c9c5ea12af94143abc1d9b757f8a3c2, a8c1971e3b584658ab4174f8d0ac12de; no voters: ad1db063d05747e7970018aed83fc0b5
08:08:41.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.973660  3396 raft_consensus.cc:2804] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de [term 1 FOLLOWER]: Leader election won for term 1
08:08:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.976811  3364 raft_consensus.cc:493] T 0127c24cdb254b3b9444ea5f96a1b0ab P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.977342  3364 raft_consensus.cc:515] T 0127c24cdb254b3b9444ea5f96a1b0ab P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.977452  3358 consensus_queue.cc:260] T 0127c24cdb254b3b9444ea5f96a1b0ab P 1c9c5ea12af94143abc1d9b757f8a3c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.979390  3364 leader_election.cc:290] T 0127c24cdb254b3b9444ea5f96a1b0ab P ad1db063d05747e7970018aed83fc0b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c9c5ea12af94143abc1d9b757f8a3c2 (127.1.134.194:43489), a8c1971e3b584658ab4174f8d0ac12de (127.1.134.195:39383)
08:08:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.980659  2355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0127c24cdb254b3b9444ea5f96a1b0ab" candidate_uuid: "ad1db063d05747e7970018aed83fc0b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1971e3b584658ab4174f8d0ac12de" is_pre_election: true
08:08:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.981287  2355 raft_consensus.cc:2468] T 0127c24cdb254b3b9444ea5f96a1b0ab P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad1db063d05747e7970018aed83fc0b5 in term 0.
08:08:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.983342  2006 leader_election.cc:304] T 0127c24cdb254b3b9444ea5f96a1b0ab P ad1db063d05747e7970018aed83fc0b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8c1971e3b584658ab4174f8d0ac12de, ad1db063d05747e7970018aed83fc0b5; no voters: 
08:08:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.984171  3364 raft_consensus.cc:2804] T 0127c24cdb254b3b9444ea5f96a1b0ab P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:08:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.984510  3364 raft_consensus.cc:493] T 0127c24cdb254b3b9444ea5f96a1b0ab P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:08:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.984532  2215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0127c24cdb254b3b9444ea5f96a1b0ab" candidate_uuid: "ad1db063d05747e7970018aed83fc0b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" is_pre_election: true
08:08:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.984838  3364 raft_consensus.cc:3060] T 0127c24cdb254b3b9444ea5f96a1b0ab P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Advancing to term 1
08:08:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.985204  2215 raft_consensus.cc:2468] T 0127c24cdb254b3b9444ea5f96a1b0ab P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad1db063d05747e7970018aed83fc0b5 in term 0.
08:08:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.989195  3359 tablet_bootstrap.cc:654] T 76d8c41bbf134c32947c73f9414f7aab P ad1db063d05747e7970018aed83fc0b5: Neither blocks nor log segments found. Creating new log.
08:08:42.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.991431  3358 ts_tablet_manager.cc:1434] T 0127c24cdb254b3b9444ea5f96a1b0ab P 1c9c5ea12af94143abc1d9b757f8a3c2: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
08:08:42.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:41.996244  3358 tablet_bootstrap.cc:492] T 72ad21258ea34269bce6ae4c80b8e589 P 1c9c5ea12af94143abc1d9b757f8a3c2: Bootstrap starting.
08:08:42.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.016651  3358 tablet_bootstrap.cc:654] T 72ad21258ea34269bce6ae4c80b8e589 P 1c9c5ea12af94143abc1d9b757f8a3c2: Neither blocks nor log segments found. Creating new log.
08:08:42.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.035110  3396 raft_consensus.cc:697] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de [term 1 LEADER]: Becoming Leader. State: Replica: a8c1971e3b584658ab4174f8d0ac12de, State: Running, Role: LEADER
08:08:42.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.036495  3396 consensus_queue.cc:237] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:42.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.051527  3364 raft_consensus.cc:515] T 0127c24cdb254b3b9444ea5f96a1b0ab P ad1db063d05747e7970018aed83fc0b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:42.061 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:42.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.064828  3402 raft_consensus.cc:493] T aa8885af14cf410093b0fc307e337db3 P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:42.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.067665  3358 tablet_bootstrap.cc:492] T 72ad21258ea34269bce6ae4c80b8e589 P 1c9c5ea12af94143abc1d9b757f8a3c2: No bootstrap required, opened a new log
08:08:42.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.066747  3402 raft_consensus.cc:515] T aa8885af14cf410093b0fc307e337db3 P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:42.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.070587  3358 ts_tablet_manager.cc:1403] T 72ad21258ea34269bce6ae4c80b8e589 P 1c9c5ea12af94143abc1d9b757f8a3c2: Time spent bootstrapping tablet: real 0.075s	user 0.013s	sys 0.001s
08:08:42.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.068233  3362 tablet_bootstrap.cc:492] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de: No bootstrap required, opened a new log
08:08:42.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.074371  3362 ts_tablet_manager.cc:1403] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de: Time spent bootstrapping tablet: real 0.120s	user 0.018s	sys 0.004s
08:08:42.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.079221  2355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0127c24cdb254b3b9444ea5f96a1b0ab" candidate_uuid: "ad1db063d05747e7970018aed83fc0b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1971e3b584658ab4174f8d0ac12de"
08:08:42.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.079802  2355 raft_consensus.cc:3060] T 0127c24cdb254b3b9444ea5f96a1b0ab P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Advancing to term 1
08:08:42.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.079942  2215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0127c24cdb254b3b9444ea5f96a1b0ab" candidate_uuid: "ad1db063d05747e7970018aed83fc0b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2"
08:08:42.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.080549  2215 raft_consensus.cc:3060] T 0127c24cdb254b3b9444ea5f96a1b0ab P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Advancing to term 1
08:08:42.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.077634  3364 leader_election.cc:290] T 0127c24cdb254b3b9444ea5f96a1b0ab P ad1db063d05747e7970018aed83fc0b5 [CANDIDATE]: Term 1 election: Requested vote from peers 1c9c5ea12af94143abc1d9b757f8a3c2 (127.1.134.194:43489), a8c1971e3b584658ab4174f8d0ac12de (127.1.134.195:39383)
08:08:42.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.085130  2073 raft_consensus.cc:3060] T aa8885af14cf410093b0fc307e337db3 P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Advancing to term 1
08:08:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.091094  2355 raft_consensus.cc:2468] T 0127c24cdb254b3b9444ea5f96a1b0ab P a8c1971e3b584658ab4174f8d0ac12de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad1db063d05747e7970018aed83fc0b5 in term 1.
08:08:42.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.092546  2006 leader_election.cc:304] T 0127c24cdb254b3b9444ea5f96a1b0ab P ad1db063d05747e7970018aed83fc0b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8c1971e3b584658ab4174f8d0ac12de, ad1db063d05747e7970018aed83fc0b5; no voters: 
08:08:42.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.093366  3364 raft_consensus.cc:2804] T 0127c24cdb254b3b9444ea5f96a1b0ab P ad1db063d05747e7970018aed83fc0b5 [term 1 FOLLOWER]: Leader election won for term 1
08:08:42.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.104092  3359 tablet_bootstrap.cc:492] T 76d8c41bbf134c32947c73f9414f7aab P ad1db063d05747e7970018aed83fc0b5: No bootstrap required, opened a new log
08:08:42.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.104718  3359 ts_tablet_manager.cc:1403] T 76d8c41bbf134c32947c73f9414f7aab P ad1db063d05747e7970018aed83fc0b5: Time spent bootstrapping tablet: real 0.180s	user 0.012s	sys 0.012s
08:08:42.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.107757  3364 raft_consensus.cc:697] T 0127c24cdb254b3b9444ea5f96a1b0ab P ad1db063d05747e7970018aed83fc0b5 [term 1 LEADER]: Becoming Leader. State: Replica: ad1db063d05747e7970018aed83fc0b5, State: Running, Role: LEADER
08:08:42.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.109445  3364 consensus_queue.cc:237] T 0127c24cdb254b3b9444ea5f96a1b0ab P ad1db063d05747e7970018aed83fc0b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:42.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.115703  2215 raft_consensus.cc:2468] T 0127c24cdb254b3b9444ea5f96a1b0ab P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad1db063d05747e7970018aed83fc0b5 in term 1.
08:08:42.121 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:42.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.120636  3363 consensus_queue.cc:1048] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:08:42.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.119160  2214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa8885af14cf410093b0fc307e337db3" candidate_uuid: "ad1db063d05747e7970018aed83fc0b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" is_pre_election: true
08:08:42.124 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (0d2ddb76420639a9ec06ca05e894cb50) switched from state RESTARTING to RUNNING.
08:08:42.125 [INFO - flink-pekko.actor.default-dispatcher-4] (CheckpointCoordinator.java:1805) Restoring job 0d2ddb76420639a9ec06ca05e894cb50 from Checkpoint 69 @ 1779091595847 for 0d2ddb76420639a9ec06ca05e894cb50 located at file:/tmp/junit4405728108231754423/checkpoints/0d2ddb76420639a9ec06ca05e894cb50/chk-69.
08:08:42.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.125597  3402 leader_election.cc:290] T aa8885af14cf410093b0fc307e337db3 P ad1db063d05747e7970018aed83fc0b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c9c5ea12af94143abc1d9b757f8a3c2 (127.1.134.194:43489), a8c1971e3b584658ab4174f8d0ac12de (127.1.134.195:39383)
08:08:42.126 [INFO - flink-pekko.actor.default-dispatcher-4] (MasterHooks.java:201) No master state to restore
08:08:42.126 [INFO - flink-pekko.actor.default-dispatcher-4] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
08:08:42.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.099861  3358 raft_consensus.cc:359] T 72ad21258ea34269bce6ae4c80b8e589 P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:42.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.130880  3359 raft_consensus.cc:359] T 76d8c41bbf134c32947c73f9414f7aab P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:42.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.135151  2354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa8885af14cf410093b0fc307e337db3" candidate_uuid: "ad1db063d05747e7970018aed83fc0b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1971e3b584658ab4174f8d0ac12de" is_pre_election: true
08:08:42.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.136926  2354 raft_consensus.cc:2393] T aa8885af14cf410093b0fc307e337db3 P a8c1971e3b584658ab4174f8d0ac12de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad1db063d05747e7970018aed83fc0b5 in current term 1: Already voted for candidate 1c9c5ea12af94143abc1d9b757f8a3c2 in this term.
08:08:42.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.137843  3362 raft_consensus.cc:359] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:42.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.138600  3362 raft_consensus.cc:385] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:42.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.139084  3362 raft_consensus.cc:740] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1971e3b584658ab4174f8d0ac12de, State: Initialized, Role: FOLLOWER
08:08:42.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.139772  3362 consensus_queue.cc:260] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:42.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.144328  3362 ts_tablet_manager.cc:1434] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.000s
08:08:42.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.151134  1883 catalog_manager.cc:5696] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c1971e3b584658ab4174f8d0ac12de (127.1.134.195). New cstate: current_term: 1 leader_uuid: "a8c1971e3b584658ab4174f8d0ac12de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } health_report { overall_health: HEALTHY } } }
08:08:42.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.162555  3358 raft_consensus.cc:385] T 72ad21258ea34269bce6ae4c80b8e589 P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:42.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.164511  3358 raft_consensus.cc:740] T 72ad21258ea34269bce6ae4c80b8e589 P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c9c5ea12af94143abc1d9b757f8a3c2, State: Initialized, Role: FOLLOWER
08:08:42.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.158427  3363 consensus_queue.cc:1048] T aa8885af14cf410093b0fc307e337db3 P 1c9c5ea12af94143abc1d9b757f8a3c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:08:42.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.165848  3358 consensus_queue.cc:260] T 72ad21258ea34269bce6ae4c80b8e589 P 1c9c5ea12af94143abc1d9b757f8a3c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:42.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.179123  3358 ts_tablet_manager.cc:1434] T 72ad21258ea34269bce6ae4c80b8e589 P 1c9c5ea12af94143abc1d9b757f8a3c2: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.000s
08:08:42.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.141827  2006 leader_election.cc:304] T aa8885af14cf410093b0fc307e337db3 P ad1db063d05747e7970018aed83fc0b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad1db063d05747e7970018aed83fc0b5; no voters: 1c9c5ea12af94143abc1d9b757f8a3c2, a8c1971e3b584658ab4174f8d0ac12de
08:08:42.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.189832  3364 raft_consensus.cc:2749] T aa8885af14cf410093b0fc307e337db3 P ad1db063d05747e7970018aed83fc0b5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
08:08:42.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:42.190033  2006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.1.134.195:39383, user_credentials={real_user=slave}} blocked reactor thread for 48339.6us
08:08:42.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.193760  1884 catalog_manager.cc:5696] T 0127c24cdb254b3b9444ea5f96a1b0ab P ad1db063d05747e7970018aed83fc0b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad1db063d05747e7970018aed83fc0b5 (127.1.134.193). New cstate: current_term: 1 leader_uuid: "ad1db063d05747e7970018aed83fc0b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } health_report { overall_health: UNKNOWN } } }
08:08:42.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.199247  3358 tablet_bootstrap.cc:492] T 5b322ee1784745bfbf45b3b4ff0b9eee P 1c9c5ea12af94143abc1d9b757f8a3c2: Bootstrap starting.
08:08:42.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.209323  3359 raft_consensus.cc:385] T 76d8c41bbf134c32947c73f9414f7aab P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:42.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.210239  3359 raft_consensus.cc:740] T 76d8c41bbf134c32947c73f9414f7aab P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad1db063d05747e7970018aed83fc0b5, State: Initialized, Role: FOLLOWER
08:08:42.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.213380  3359 consensus_queue.cc:260] T 76d8c41bbf134c32947c73f9414f7aab P ad1db063d05747e7970018aed83fc0b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:42.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.241161  3359 ts_tablet_manager.cc:1434] T 76d8c41bbf134c32947c73f9414f7aab P ad1db063d05747e7970018aed83fc0b5: Time spent starting tablet: real 0.136s	user 0.003s	sys 0.003s
08:08:42.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.241624  3358 tablet_bootstrap.cc:654] T 5b322ee1784745bfbf45b3b4ff0b9eee P 1c9c5ea12af94143abc1d9b757f8a3c2: Neither blocks nor log segments found. Creating new log.
08:08:42.173 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CREATED to SCHEDULED.
08:08:42.250 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:08:42.250 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from SCHEDULED to DEPLOYING.
08:08:42.250 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #5) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id 562b84b71b659c92bf587d4c4d45167a
08:08:42.250 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to SCHEDULED.
08:08:42.251 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from SCHEDULED to DEPLOYING.
08:08:42.251 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #5) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id 23d75c1cae20f6d786d6e473edbc6825
08:08:42.252 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CREATED to SCHEDULED.
08:08:42.253 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 562b84b71b659c92bf587d4c4d45167a.
08:08:42.254 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:08:42.255 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_5), deploy into slot with allocation id 562b84b71b659c92bf587d4c4d45167a.
08:08:42.257 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:08:42.258 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from SCHEDULED to DEPLOYING.
08:08:42.258 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #5) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id 51ba13794eaa695dfcc17a66fc9521a4
08:08:42.262 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 23d75c1cae20f6d786d6e473edbc6825.
08:08:42.263 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CREATED to SCHEDULED.
08:08:42.264 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:08:42.264 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_5), deploy into slot with allocation id 23d75c1cae20f6d786d6e473edbc6825.
08:08:42.264 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CREATED to DEPLOYING.
08:08:42.265 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_5) [DEPLOYING].
08:08:42.265 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from SCHEDULED to DEPLOYING.
08:08:42.265 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #5) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id e7235da53f93c0af3219c2857bfb1cae
08:08:42.265 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6c9dff04
08:08:42.265 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:42.266 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:08:42.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.274035  3396 raft_consensus.cc:493] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:42.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.274557  3396 raft_consensus.cc:515] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:42.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.276502  3396 leader_election.cc:290] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad1db063d05747e7970018aed83fc0b5 (127.1.134.193:41847), 1c9c5ea12af94143abc1d9b757f8a3c2 (127.1.134.194:43489)
08:08:42.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.278060  2072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ad21258ea34269bce6ae4c80b8e589" candidate_uuid: "a8c1971e3b584658ab4174f8d0ac12de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad1db063d05747e7970018aed83fc0b5" is_pre_election: true
08:08:42.285 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 51ba13794eaa695dfcc17a66fc9521a4.
08:08:42.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.278270  2215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ad21258ea34269bce6ae4c80b8e589" candidate_uuid: "a8c1971e3b584658ab4174f8d0ac12de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" is_pre_election: true
08:08:42.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.278959  2215 raft_consensus.cc:2468] T 72ad21258ea34269bce6ae4c80b8e589 P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1971e3b584658ab4174f8d0ac12de in term 0.
08:08:42.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.278960  2072 raft_consensus.cc:2468] T 72ad21258ea34269bce6ae4c80b8e589 P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1971e3b584658ab4174f8d0ac12de in term 0.
08:08:42.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.280560  2290 leader_election.cc:304] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8c1971e3b584658ab4174f8d0ac12de, ad1db063d05747e7970018aed83fc0b5; no voters: 
08:08:42.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.281494  3396 raft_consensus.cc:2804] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Leader pre-election won for term 1
08:08:42.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.281842  3396 raft_consensus.cc:493] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:08:42.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.282135  3396 raft_consensus.cc:3060] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Advancing to term 1
08:08:42.290 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_5), deploy into slot with allocation id 51ba13794eaa695dfcc17a66fc9521a4.
08:08:42.297 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to DEPLOYING.
08:08:42.298 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_5) [DEPLOYING].
08:08:42.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.298782  3396 raft_consensus.cc:515] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:42.311 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from DEPLOYING to INITIALIZING.
08:08:42.312 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from DEPLOYING to INITIALIZING.
08:08:42.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.308190  2072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ad21258ea34269bce6ae4c80b8e589" candidate_uuid: "a8c1971e3b584658ab4174f8d0ac12de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad1db063d05747e7970018aed83fc0b5"
08:08:42.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.308892  2072 raft_consensus.cc:3060] T 72ad21258ea34269bce6ae4c80b8e589 P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Advancing to term 1
08:08:42.317 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@13a84f59
08:08:42.318 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:42.318 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:08:42.318 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
08:08:42.318 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
08:08:42.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.320130  2072 raft_consensus.cc:2468] T 72ad21258ea34269bce6ae4c80b8e589 P ad1db063d05747e7970018aed83fc0b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1971e3b584658ab4174f8d0ac12de in term 1.
08:08:42.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.321341  2290 leader_election.cc:304] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8c1971e3b584658ab4174f8d0ac12de, ad1db063d05747e7970018aed83fc0b5; no voters: 
08:08:42.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.323150  3397 raft_consensus.cc:2804] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de [term 1 FOLLOWER]: Leader election won for term 1
08:08:42.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.323711  3397 raft_consensus.cc:697] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de [term 1 LEADER]: Becoming Leader. State: Replica: a8c1971e3b584658ab4174f8d0ac12de, State: Running, Role: LEADER
08:08:42.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.323974  2215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ad21258ea34269bce6ae4c80b8e589" candidate_uuid: "a8c1971e3b584658ab4174f8d0ac12de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2"
08:08:42.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.324574  2215 raft_consensus.cc:3060] T 72ad21258ea34269bce6ae4c80b8e589 P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Advancing to term 1
08:08:42.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.324586  3397 consensus_queue.cc:237] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:42.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.333297  3396 leader_election.cc:290] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de [CANDIDATE]: Term 1 election: Requested vote from peers ad1db063d05747e7970018aed83fc0b5 (127.1.134.193:41847), 1c9c5ea12af94143abc1d9b757f8a3c2 (127.1.134.194:43489)
08:08:42.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.334129  2215 raft_consensus.cc:2468] T 72ad21258ea34269bce6ae4c80b8e589 P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1971e3b584658ab4174f8d0ac12de in term 1.
08:08:42.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.336850  3366 consensus_queue.cc:1048] T 57ec20d798834ab1a9d6bad82e7002fe P 1c9c5ea12af94143abc1d9b757f8a3c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:08:42.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.341277  3358 tablet_bootstrap.cc:492] T 5b322ee1784745bfbf45b3b4ff0b9eee P 1c9c5ea12af94143abc1d9b757f8a3c2: No bootstrap required, opened a new log
08:08:42.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.341845  3358 ts_tablet_manager.cc:1403] T 5b322ee1784745bfbf45b3b4ff0b9eee P 1c9c5ea12af94143abc1d9b757f8a3c2: Time spent bootstrapping tablet: real 0.143s	user 0.011s	sys 0.005s
08:08:42.346 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@46657d5a
08:08:42.357 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7a30bb9d
08:08:42.360 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:42.361 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:42.361 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:42.361 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:42.362 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:42.362 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:42.362 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:42.362 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:42.362 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:42.362 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:42.362 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:42.362 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:42.363 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:42.189 [INFO - Thread-50] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
08:08:42.184 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:42.367 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:42.367 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:42.368 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:42.368 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:42.368 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:42.368 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:42.368 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:42.368 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:42.368 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:42.369 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:42.369 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:42.369 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:42.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.360159  3358 raft_consensus.cc:359] T 5b322ee1784745bfbf45b3b4ff0b9eee P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:42.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.367460  3358 raft_consensus.cc:385] T 5b322ee1784745bfbf45b3b4ff0b9eee P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:42.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.367771  3358 raft_consensus.cc:740] T 5b322ee1784745bfbf45b3b4ff0b9eee P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c9c5ea12af94143abc1d9b757f8a3c2, State: Initialized, Role: FOLLOWER
08:08:42.374 [DEBUG - Thread-50] (Connection.java:575) [peer master-127.27.17.253:37621(127.27.17.253:37621)] disconnecting while in state TERMINATED
08:08:42.374 [DEBUG - Thread-50] (Connection.java:575) [peer master-127.27.17.252:43595(127.27.17.252:43595)] disconnecting while in state TERMINATED
08:08:42.375 [DEBUG - Thread-50] (Connection.java:575) [peer master-127.27.17.254:45447(127.27.17.254:45447)] disconnecting while in state TERMINATED
08:08:42.379 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:42.380 [DEBUG - Thread-50] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:42.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.381019  3358 consensus_queue.cc:260] T 5b322ee1784745bfbf45b3b4ff0b9eee P 1c9c5ea12af94143abc1d9b757f8a3c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:42.382 [INFO - Thread-50] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
08:08:42.382 [INFO - Thread-50] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
08:08:42.387 [DEBUG - Thread-50] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:42.387 [INFO - Thread-50] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
08:08:42.388 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot e7235da53f93c0af3219c2857bfb1cae.
08:08:42.390 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_5), deploy into slot with allocation id e7235da53f93c0af3219c2857bfb1cae.
08:08:42.391 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CREATED to DEPLOYING.
08:08:42.391 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_5) [DEPLOYING].
08:08:42.392 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4bb041e7
08:08:42.392 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:42.392 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.392 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:08:42.393 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CREATED to DEPLOYING.
08:08:42.393 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_5) [DEPLOYING].
08:08:42.393 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from DEPLOYING to INITIALIZING.
08:08:42.394 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1d94c943
08:08:42.394 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:42.394 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from DEPLOYING to INITIALIZING.
08:08:42.394 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:08:42.394 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from DEPLOYING to INITIALIZING.
08:08:42.394 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from DEPLOYING to INITIALIZING.
08:08:42.396 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.398 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.398 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.398 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.400 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:42.421 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:42.426 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2c87522e
08:08:42.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.435094  3417 consensus_queue.cc:1048] T 57ec20d798834ab1a9d6bad82e7002fe P 1c9c5ea12af94143abc1d9b757f8a3c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:08:42.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.441016  1884 catalog_manager.cc:5696] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c1971e3b584658ab4174f8d0ac12de (127.1.134.195). New cstate: current_term: 1 leader_uuid: "a8c1971e3b584658ab4174f8d0ac12de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } health_report { overall_health: HEALTHY } } }
08:08:42.442 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:42.446 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.447 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:42.455 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.455 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.455 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.467 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:08:42.467 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:08:42.467 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:08:42.468 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:08:42.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.472862  3358 ts_tablet_manager.cc:1434] T 5b322ee1784745bfbf45b3b4ff0b9eee P 1c9c5ea12af94143abc1d9b757f8a3c2: Time spent starting tablet: real 0.131s	user 0.006s	sys 0.007s
08:08:42.480 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@890d2ed
08:08:42.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.487794  3397 raft_consensus.cc:493] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:42.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.488374  3397 raft_consensus.cc:515] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:42.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.491281  3397 leader_election.cc:290] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad1db063d05747e7970018aed83fc0b5 (127.1.134.193:41847), 1c9c5ea12af94143abc1d9b757f8a3c2 (127.1.134.194:43489)
08:08:42.493 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:42.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.492875  2215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b322ee1784745bfbf45b3b4ff0b9eee" candidate_uuid: "a8c1971e3b584658ab4174f8d0ac12de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" is_pre_election: true
08:08:42.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.493546  2215 raft_consensus.cc:2468] T 5b322ee1784745bfbf45b3b4ff0b9eee P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1971e3b584658ab4174f8d0ac12de in term 0.
08:08:42.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.495664  2288 leader_election.cc:304] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c9c5ea12af94143abc1d9b757f8a3c2, a8c1971e3b584658ab4174f8d0ac12de; no voters: 
08:08:42.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.496752  3397 raft_consensus.cc:2804] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Leader pre-election won for term 1
08:08:42.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.497087  3397 raft_consensus.cc:493] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:08:42.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.497385  3397 raft_consensus.cc:3060] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de [term 0 FOLLOWER]: Advancing to term 1
08:08:42.505 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:42.505 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:42.505 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:42.505 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:42.506 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:42.506 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:42.506 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:42.506 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:42.506 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:42.507 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:42.507 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:42.507 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:42.507 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.505204  2071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b322ee1784745bfbf45b3b4ff0b9eee" candidate_uuid: "a8c1971e3b584658ab4174f8d0ac12de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad1db063d05747e7970018aed83fc0b5" is_pre_election: true
08:08:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.506141  3364 raft_consensus.cc:493] T 76d8c41bbf134c32947c73f9414f7aab P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.506599  3364 raft_consensus.cc:515] T 76d8c41bbf134c32947c73f9414f7aab P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.508648  3364 leader_election.cc:290] T 76d8c41bbf134c32947c73f9414f7aab P ad1db063d05747e7970018aed83fc0b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c9c5ea12af94143abc1d9b757f8a3c2 (127.1.134.194:43489), a8c1971e3b584658ab4174f8d0ac12de (127.1.134.195:39383)
08:08:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.509959  2215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d8c41bbf134c32947c73f9414f7aab" candidate_uuid: "ad1db063d05747e7970018aed83fc0b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" is_pre_election: true
08:08:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.510828  2215 raft_consensus.cc:2393] T 76d8c41bbf134c32947c73f9414f7aab P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad1db063d05747e7970018aed83fc0b5 in current term 1: Already voted for candidate a8c1971e3b584658ab4174f8d0ac12de in this term.
08:08:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.510764  2354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d8c41bbf134c32947c73f9414f7aab" candidate_uuid: "ad1db063d05747e7970018aed83fc0b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1971e3b584658ab4174f8d0ac12de" is_pre_election: true
08:08:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.512595  2071 raft_consensus.cc:2468] T 5b322ee1784745bfbf45b3b4ff0b9eee P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1971e3b584658ab4174f8d0ac12de in term 0.
08:08:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.512594  2006 leader_election.cc:304] T 76d8c41bbf134c32947c73f9414f7aab P ad1db063d05747e7970018aed83fc0b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad1db063d05747e7970018aed83fc0b5; no voters: 1c9c5ea12af94143abc1d9b757f8a3c2, a8c1971e3b584658ab4174f8d0ac12de
08:08:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.513514  3364 raft_consensus.cc:3060] T 76d8c41bbf134c32947c73f9414f7aab P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Advancing to term 1
08:08:42.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.519742  3364 raft_consensus.cc:2749] T 76d8c41bbf134c32947c73f9414f7aab P ad1db063d05747e7970018aed83fc0b5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
08:08:42.524 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.524144  3396 consensus_queue.cc:1048] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:08:42.533 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.541 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:42.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.543350  3397 raft_consensus.cc:515] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:42.547 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.547 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.547 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.547 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.553 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.552928  2073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b322ee1784745bfbf45b3b4ff0b9eee" candidate_uuid: "a8c1971e3b584658ab4174f8d0ac12de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad1db063d05747e7970018aed83fc0b5"
08:08:42.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.554196  2073 raft_consensus.cc:3060] T 5b322ee1784745bfbf45b3b4ff0b9eee P ad1db063d05747e7970018aed83fc0b5 [term 0 FOLLOWER]: Advancing to term 1
08:08:42.558 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:42.559 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:42.559 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:42.559 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:42.559 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:42.559 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:42.562 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:42.562 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:42.562 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:42.562 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:42.562 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:42.562 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:42.562 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:42.562 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:42.563 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:42.563 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:42.563 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:42.564 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:42.564 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:42.564 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:42.566 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:42.566 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:42.566 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:42.566 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:42.566 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:42.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.561746  2215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b322ee1784745bfbf45b3b4ff0b9eee" candidate_uuid: "a8c1971e3b584658ab4174f8d0ac12de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2"
08:08:42.566 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:42.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.562389  2215 raft_consensus.cc:3060] T 5b322ee1784745bfbf45b3b4ff0b9eee P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 0 FOLLOWER]: Advancing to term 1
08:08:42.567 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:42.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.571699  2215 raft_consensus.cc:2468] T 5b322ee1784745bfbf45b3b4ff0b9eee P 1c9c5ea12af94143abc1d9b757f8a3c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1971e3b584658ab4174f8d0ac12de in term 1.
08:08:42.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.573127  2288 leader_election.cc:304] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c9c5ea12af94143abc1d9b757f8a3c2, a8c1971e3b584658ab4174f8d0ac12de; no voters: 
08:08:42.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.574296  3396 raft_consensus.cc:2804] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de [term 1 FOLLOWER]: Leader election won for term 1
08:08:42.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.574760  3396 raft_consensus.cc:697] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de [term 1 LEADER]: Becoming Leader. State: Replica: a8c1971e3b584658ab4174f8d0ac12de, State: Running, Role: LEADER
08:08:42.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.575542  3396 consensus_queue.cc:237] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } }
08:08:42.598 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.599 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.598104  3372 consensus_queue.cc:1048] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:08:42.600 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.600 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.600 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.600 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.601 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.601 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.601 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.602 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.602 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.602 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.602 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.603 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:42.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.602092  1884 catalog_manager.cc:5696] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c1971e3b584658ab4174f8d0ac12de (127.1.134.195). New cstate: current_term: 1 leader_uuid: "a8c1971e3b584658ab4174f8d0ac12de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 } health_report { overall_health: HEALTHY } } }
08:08:42.604 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.604 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.604 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.605 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.605 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.605 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.606 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.606 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.606 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.606 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.607 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.607 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.607 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.607 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.608 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:42.608 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:42.608 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:42.609 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:42.609 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:42.609 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:42.611 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:42.611 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:42.611 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:42.611 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:42.611 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:42.612 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:42.612 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:42.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.613319  3364 consensus_queue.cc:1048] T 0127c24cdb254b3b9444ea5f96a1b0ab P ad1db063d05747e7970018aed83fc0b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:08:42.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.614334  3397 leader_election.cc:290] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de [CANDIDATE]: Term 1 election: Requested vote from peers ad1db063d05747e7970018aed83fc0b5 (127.1.134.193:41847), 1c9c5ea12af94143abc1d9b757f8a3c2 (127.1.134.194:43489)
08:08:42.630 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:42.649 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.650 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.650 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.651 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.651 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.652 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.652 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.660 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.660 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.660 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.661 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.663206  3364 consensus_queue.cc:1048] T 0127c24cdb254b3b9444ea5f96a1b0ab P ad1db063d05747e7970018aed83fc0b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1971e3b584658ab4174f8d0ac12de" member_type: VOTER last_known_addr { host: "127.1.134.195" port: 39383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:08:42.665 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.678 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.678519  2073 raft_consensus.cc:2468] T 5b322ee1784745bfbf45b3b4ff0b9eee P ad1db063d05747e7970018aed83fc0b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1971e3b584658ab4174f8d0ac12de in term 1.
08:08:42.686 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.688 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.688 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.688 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.689 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.692 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.709 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.709 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.709 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.710 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.710 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.710 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.718 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.719 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.719 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.719 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.726 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.727 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.727 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.727 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.728 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.729 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.729 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.729 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.743 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.745 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.745 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.745 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.746 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.746 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.746 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.746 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.747 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.747 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.747 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.747 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.747 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.748 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.765 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.765 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:42.765 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.765 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.765 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:42.765 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:42.765 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.765 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.766 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.766 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.765 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:42.766 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.766 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.766 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.766 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.766 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.766 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.770 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.772 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.772 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.772 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.784 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.785 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.785 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.785 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.786 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.786 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.786 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.786 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.787 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.787 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.787 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.787 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.787 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.787 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.787 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.788 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.788 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.788 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.788 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.788 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.788 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.788 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.789 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.789 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.789 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.789 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.789 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.789 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.789 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.790 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.790 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.790 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.790 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.791 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:42.791 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:42.791 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:42.791 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:42.792 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:42.792 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:42.792 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:42.792 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:42.792 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.793 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.793 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.793 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.793 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.794 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.794 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.794 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.794 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.795 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.795 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.795 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.795 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.795 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.796 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.796 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.796 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.797 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.797 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.797 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.797 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.797 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.797 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.797 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.797 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.798 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.803 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:42.806 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.806 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.806 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.806 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.813 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.813 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.813 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.813 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.814 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.814 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.814 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.814 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.814 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.814 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.814 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.814 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.814 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.814 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.817 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.817 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.817 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.817 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.818 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.818 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.818 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.819 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.822 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:42.823 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:42.823 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:42.823 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:42.823 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:42.824 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:42.824 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:42.824 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:42.824 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:42.824 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:42.824 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:42.824 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:42.824 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:42.825 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.825 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.825 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.825 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.826 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.826 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.826 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.826 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.826 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.826 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.826 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.826 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.826 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.830 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:42.832 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:42.832 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:42.832 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:42.833 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.833 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.833 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.833 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.833 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.833 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.833 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.833 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.833 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.833 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.834 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.834 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:42.834 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.834 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.835 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:42.835 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:42.835 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:42.835 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.837 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.837 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.837 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.837 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.838 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.838 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.838 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.838 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.838 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.839 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.839 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.839 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.839 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.839 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.839 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.839 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.839 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.839 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.839 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.839 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.840 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.840 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.840 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.840 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.840 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:42.841 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:42.841 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:42.841 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:42.843 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:42.853 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:42.853 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:42.853 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:42.853 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.853 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.853 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.854 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:42.854 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:42.854 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:42.855 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:42.855 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:42.855 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:42.855 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:42.855 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:42.855 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:42.855 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:42.855 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:42.856 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.856 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.856 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:42.856 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.856 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.856 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.857 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:42.857 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.857 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:42.857 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.857 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.857 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.857 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.858 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.858 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.858 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.858 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.859 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.859 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.859 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.859 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.859 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.859 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.859 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.859 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.859 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.859 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:42.860 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:42.860 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:42.860 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:42.860 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:42.861 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:42.861 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:42.861 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:42.864 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:42.864 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:42.865 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:42.866 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:42.866 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:42.866 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:42.866 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:42.866 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:42.867 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:42.867 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:42.867 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:42.867 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:42.867 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:42.868 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:42.868 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:42.868 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:42.869 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:42.869 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:42.869 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:42.869 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:42.869 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:42.869 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:42.869 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:42.870 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:42.870 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:42.870 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:42.872 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.872 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.873 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.873 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.873 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.873 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.872814  3396 consensus_queue.cc:1048] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:08:42.873 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.873 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.874 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.874 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.874 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.874 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.874 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.874 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.875 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.875 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.875 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.875 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.875 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.875 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.875 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.875 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.875 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.876 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.876 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.876 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.877 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.878 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.878 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.878 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.878 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.878 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.879 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.879 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.879 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.879 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.879 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.879 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.879 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.884 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:42.884 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:42.884 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:42.886 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:42.886 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:42.886 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:42.886 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:42.887 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:42.887 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:42.886 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:42.888 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:42.888 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:42.888 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:42.893 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.893 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.893 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.894 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.894 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.894 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.894 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.894 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.895 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.895 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.895 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.895 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.895 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.900 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:42.904 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:42.904 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:42.905 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:42.905 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:42.905 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:42.905 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.905 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.905 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:42.905 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.905 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:42.905 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:42.906 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:42.906 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:42.906 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:42.906 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:42.906 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:42.906 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.907 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.907 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.907 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.907 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.907 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.908 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.908 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.908 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.908 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.913 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.913 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.913 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.914 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.914 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.914 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.914 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.914 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.914 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.915 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.915 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.915 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.915 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:42.922473  3396 consensus_queue.cc:1048] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:08:42.933 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.933 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.933 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.934 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.934 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.934 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.935 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.935 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.935 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.935 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.935 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.935 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.935 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.937 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.938 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.938 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.938 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.938 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.938 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.939 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.939 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.939 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.939 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.939 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.939 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.940 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.945 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:42.945 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:42.945 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:42.946 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:42.946 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:42.946 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:42.946 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:42.947 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:42.947 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:42.947 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:42.948 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:42.948 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:42.948 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:42.948 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:42.965 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.965 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.966 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.966 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.966 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.966 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.966 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.966 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.966 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.967 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.967 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.967 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.967 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.978 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:42.979 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:42.979 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:42.979 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.979 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.979 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:42.980 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.980 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.980 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:42.981 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.981 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.981 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:42.981 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:42.985 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:42.986 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:42.986 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:42.986 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:42.986 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:42.986 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:42.986 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:42.987 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:42.987 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:42.987 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:42.987 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:42.987 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:42.987 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:43.026 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:43.026 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:43.026 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:43.027 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.027 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.027 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.027 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.027 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.027 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.031 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.031 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.031 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.031 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:43.040 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:43.043 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:43.044 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:43.044 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:43.044 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:43.044 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:43.044 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:43.044 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:43.045 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:43.045 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:43.045 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:43.045 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:43.045 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:43.045 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:43.053 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:43.053 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.053 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.053 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.054 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:43.055 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:43.055 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.055 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.055 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.055 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.055 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.055 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.055 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:43.062 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:43.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:43.068074  3397 consensus_queue.cc:1048] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c9c5ea12af94143abc1d9b757f8a3c2" member_type: VOTER last_known_addr { host: "127.1.134.194" port: 43489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:08:43.073 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:43.073 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:43.073 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:43.074 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.074 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.074 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.075 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.075 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.075 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.075 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.075 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.075 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.075 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:43.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:43.086395  2691 debug-util.cc:398] Leaking SignalData structure 0x7b08000aeda0 after lost signal to thread 2599
08:08:43.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:43.087311  2691 debug-util.cc:398] Leaking SignalData structure 0x7b08000aa5c0 after lost signal to thread 2694
08:08:43.098 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:43.099 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:43.099 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:43.100 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.100 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.100 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.100 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.100 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.100 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.100 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.100 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.100 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.100 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:43.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:43.102950  3397 consensus_queue.cc:1048] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad1db063d05747e7970018aed83fc0b5" member_type: VOTER last_known_addr { host: "127.1.134.193" port: 41847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:08:43.113 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:43.113 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:43.113 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:43.114 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.114 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.114 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.114 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.114 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.115 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.115 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.115 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.115 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.115 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:43.120 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:43.173 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:43.173 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:43.173 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:43.174 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.174 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.174 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.174 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.174 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.174 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.174 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.174 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.174 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.174 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:43.233 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:43.233 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:43.234 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:43.234 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.234 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.234 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.234 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.234 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.234 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.234 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.234 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.234 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.235 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:43.344 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:43.345 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:43.345 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:43.345 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.345 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.345 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.345 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.345 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.346 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.346 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.346 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.346 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.346 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:43.383 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:43.384 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:43.384 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:43.384 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:43.384 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:43.384 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:43.385 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:43.385 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:43.385 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:43.385 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:43.385 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:43.385 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:43.386 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:43.400 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:43.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:43.477 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:43.478 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:43.478 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:43.479 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:43.479 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:43.479 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:43.479 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:43.479 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:43.479 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:43.480 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:43.480 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:43.480 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:43.480 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:43.498 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:43.498 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:43.498 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:43.499 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:43.499 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:43.499 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:43.499 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:43.499 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:43.499 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:43.500 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:43.500 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:43.500 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:43.500 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:43.504 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:43.504 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:43.504 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:43.504 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:43.504 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:43.504 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:43.505 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:43.505 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:43.505 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:43.505 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:43.505 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:43.506 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:43.506 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:43.538 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:43.538 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:43.538 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:43.538 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.539 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.539 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.539 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.539 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.539 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.539 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.539 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.540 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.540 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:43.540 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:43.562 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:43.620 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:43.632 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:43.633 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:43.633 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:43.633 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.634 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.634 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.634 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.634 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.634 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.634 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.634 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.635 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.635 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:43.825 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:43.825 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:43.825 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:43.826 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.826 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.826 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.826 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.826 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.827 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.826 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.827 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.827 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.828 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:43.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:43.933 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:43.933 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:43.933 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:43.934 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.934 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.934 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.934 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:43.934 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.934 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.934 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.934 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:43.934 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:43.934 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:43.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:43.978 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:43.978 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:43.978 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:43.979 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:43.979 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:43.979 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:43.979 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:43.979 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:43.979 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:43.979 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:43.979 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:43.979 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:43.979 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:44.041 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:44.044 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:44.044 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:44.044 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:44.044 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:44.044 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:44.044 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:44.044 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:44.045 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:44.045 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:44.045 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:44.045 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:44.045 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:44.045 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:44.062 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:44.120 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:44.143 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:44.144 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:44.144 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:44.144 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:44.144 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:44.145 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:44.145 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:44.145 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:44.145 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:44.145 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:44.145 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:44.145 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:44.145 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:44.148 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:44.148 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:44.148 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:44.149 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:44.149 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:44.149 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:44.149 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:44.149 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:44.149 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:44.149 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:44.149 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:44.149 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:44.149 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:44.154 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:44.154 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:44.154 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:44.155 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:44.155 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:44.155 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:44.155 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:44.155 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:44.155 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:44.156 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:44.156 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:44.156 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:44.156 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:44.378 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:44.379 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:44.379 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:44.379 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:44.379 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:44.379 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:44.379 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:44.379 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:44.379 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:44.379 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:44.379 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:44.380 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:44.380 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:44.401 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:44.414 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 2a489752354241eebd5d00f80d2b9347
08:08:44.420 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 0127c24cdb254b3b9444ea5f96a1b0ab for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
08:08:44.420 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet aa8885af14cf410093b0fc307e337db3 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
08:08:44.421 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 5b322ee1784745bfbf45b3b4ff0b9eee for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
08:08:44.421 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 57ec20d798834ab1a9d6bad82e7002fe for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
08:08:44.421 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 76d8c41bbf134c32947c73f9414f7aab for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
08:08:44.421 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 72ad21258ea34269bce6ae4c80b8e589 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
08:08:44.421 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=0127c24cdb254b3b9444ea5f96a1b0ab@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=aa8885af14cf410093b0fc307e337db3@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=5b322ee1784745bfbf45b3b4ff0b9eee@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)[L],ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=57ec20d798834ab1a9d6bad82e7002fe@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=76d8c41bbf134c32947c73f9414f7aab@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)[L],ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=72ad21258ea34269bce6ae4c80b8e589@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)[L],ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
08:08:44.422 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=7), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.134.252:42093, [5ms] Sub RPC GetTableLocations: received response from server master-127.1.134.252:42093: OK, deferred=null) after lookup
08:08:44.423 [DEBUG - kudu-nio-2] (Connection.java:748) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] connecting to peer
08:08:44.424 [DEBUG - kudu-nio-3] (Connection.java:757) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] Successfully connected to peer
08:08:44.438 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:44.445 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xa2f7ee61, L:/127.0.0.1:53808 - R:/127.1.134.193:41847] using TOKEN/null
08:08:44.445 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:44.446 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:44.446 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:44.446 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:44.447 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:44.447 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:44.447 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:44.447 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:44.447 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:44.447 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:44.447 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:44.447 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:44.447 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:44.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:44.483 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:44.483 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:44.483 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:44.484 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:44.484 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:44.484 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:44.484 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:44.484 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:44.484 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:44.484 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:44.484 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:44.484 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:44.484 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:44.483 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:44.485 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:44.485 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:44.485 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:44.485 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:44.485 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:44.486 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:44.486 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:44.486 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:44.486 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:44.486 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:44.486 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:44.486 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:44.541 [DEBUG - main] (Connection.java:748) [peer 1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)] connecting to peer
08:08:44.542 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:44.552 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)] Successfully connected to peer
08:08:44.561 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:44.569 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:44.574 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x70d95c08, L:/127.0.0.1:48822 - R:/127.1.134.194:43489] using TOKEN/null
08:08:44.587 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:44.588 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:44.588 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:44.588 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:44.589 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:44.589 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:44.589 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:44.589 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:44.589 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:44.590 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:44.590 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:44.590 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:44.590 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:44.619 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:44.653 [DEBUG - main] (Connection.java:748) [peer a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)] connecting to peer
08:08:44.662 [DEBUG - kudu-nio-5] (Connection.java:757) [peer a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)] Successfully connected to peer
08:08:44.677 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:44.681 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0x5572c3b9, L:/127.0.0.1:51246 - R:/127.1.134.195:39383] using TOKEN/null
08:08:44.889 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:44.890 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:44.890 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:44.890 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:44.890 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:44.890 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:44.890 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:44.890 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:44.891 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:44.891 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:44.891 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:44.891 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:44.891 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:44.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:44.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:45.004 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:45.013 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:45.016 [DEBUG - main] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:08:45.016 [DEBUG - main] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:08:45.024 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.2.90.189:41065(127.2.90.189:41065)] Successfully connected to peer
08:08:45.033 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:45.033 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:45.033 [DEBUG - main] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:08:45.033 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:45.034 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:45.034 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:45.034 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:45.034 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.2.90.188:42457(127.2.90.188:42457)] Successfully connected to peer
08:08:45.035 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:45.035 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:45.035 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:45.035 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:45.035 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:45.035 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:45.035 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:45.038 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:45.039 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:45.039 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:45.039 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:45.039 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:45.039 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:45.039 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:45.039 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:45.039 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:45.039 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:45.039 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:45.039 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:45.040 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.90.189
08:08:45.040 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:45.042 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:45.053 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.90.188
08:08:45.055 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.2.90.190:42265(127.2.90.190:42265)] Successfully connected to peer
08:08:45.061 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:45.068 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.90.190
08:08:45.073 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:45.078 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xe80a2957, L:/127.0.0.1:52284 - R:/127.2.90.188:42457] using SASL/PLAIN
08:08:45.081 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:08:45.082 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=67), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.90.189:41065, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.90.188:42457, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.90.190:42265, [66ms] Sub RPC ConnectToMaster: received response from server master-127.2.90.188:42457: OK, deferred=null) after lookup
08:08:45.086 [DEBUG - main] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:08:45.087 [DEBUG - main] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:08:45.094 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:45.096 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.1.134.254:38449(127.1.134.254:38449)] Successfully connected to peer
08:08:45.106 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:45.109 [DEBUG - main] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:08:45.112 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x26d4efb8, L:/127.0.0.1:55122 - R:/127.2.90.189:41065] using SASL/PLAIN
08:08:45.118 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.1.134.253:41425(127.1.134.253:41425)] Successfully connected to peer
08:08:45.119 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:45.122 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xad48b866, L:/127.0.0.1:43270 - R:/127.2.90.190:42265] using SASL/PLAIN
08:08:45.123 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.254
08:08:45.131 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.1.134.252:42093(127.1.134.252:42093)] Successfully connected to peer
08:08:45.141 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.253
08:08:45.149 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.252
08:08:45.150 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:45.163 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:45.175 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:45.175 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:45.175 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:45.176 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:45.176 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:45.176 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:45.177 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:45.177 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:45.177 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:45.177 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:45.177 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:45.177 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:45.177 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:45.178 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:45.178 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:45.178 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:45.178 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:45.178 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:45.179 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:45.179 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:45.179 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:45.179 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:45.179 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:45.183 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:45.183 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:45.183 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:45.191 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd2b58a40, L:/127.0.0.1:39376 - R:/127.1.134.254:38449] using SASL/PLAIN
08:08:45.202 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x39dac1ed, L:/127.0.0.1:34198 - R:/127.1.134.252:42093] using SASL/PLAIN
08:08:45.207 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:45.212 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:08:45.212 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=127), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [113ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: OK, [120ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: OK, deferred=null) after lookup
08:08:45.221 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x755db900, L:/127.0.0.1:59108 - R:/127.1.134.253:41425] using SASL/PLAIN
08:08:45.223 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 2a489752354241eebd5d00f80d2b9347
08:08:45.224 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:45.224 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:45.225 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:45.225 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:45.225 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:45.225 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:45.225 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:45.225 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:45.225 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:45.225 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:45.225 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:45.225 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:45.225 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:45.233 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 0127c24cdb254b3b9444ea5f96a1b0ab for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
08:08:45.233 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet aa8885af14cf410093b0fc307e337db3 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
08:08:45.233 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 5b322ee1784745bfbf45b3b4ff0b9eee for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
08:08:45.233 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 57ec20d798834ab1a9d6bad82e7002fe for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
08:08:45.233 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 76d8c41bbf134c32947c73f9414f7aab for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
08:08:45.233 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 72ad21258ea34269bce6ae4c80b8e589 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
08:08:45.233 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=0127c24cdb254b3b9444ea5f96a1b0ab@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=aa8885af14cf410093b0fc307e337db3@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=5b322ee1784745bfbf45b3b4ff0b9eee@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)[L],ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=57ec20d798834ab1a9d6bad82e7002fe@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=76d8c41bbf134c32947c73f9414f7aab@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)[L],ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=72ad21258ea34269bce6ae4c80b8e589@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)[L],ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
08:08:45.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.237748  2660 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52284:
08:08:45.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
08:08:45.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
08:08:45.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:08:45.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:08:45.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\000\007\000"
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 3
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key2"
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key3"
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 42
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:08:45.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
08:08:45.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:08:45.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:08:45.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
08:08:45.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:45.248979  2660 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
08:08:45.401 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:45.403 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:45.403 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:45.403 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:45.404 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:45.404 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:45.404 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:45.405 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:45.405 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:45.405 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:45.406 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:45.406 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:45.406 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:45.406 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:45.413 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:45.413 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:45.413 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:45.413 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:45.413 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:45.413 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:45.414 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:45.414 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:45.414 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:45.414 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:45.414 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:45.414 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:45.414 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:45.427 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 1365359df50a4068a2562111037df6dd
08:08:45.440 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:45.441 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:45.441 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:45.441 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:45.441 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:45.441 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:45.441 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:45.441 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:45.441 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:45.442 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:45.442 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:45.442 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:45.442 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:45.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:45.524 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:45.524 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:45.524 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:45.528 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:45.528 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:45.528 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:45.529 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:45.529 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:45.529 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:45.529 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:45.530 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:45.530 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:45.530 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:45.541 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:45.542 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:45.542 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:45.542 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:45.543 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:45.543 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:45.543 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:45.543 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:45.544 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:45.544 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:45.544 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:45.544 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:45.547 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:45.547 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:45.563 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:45.592 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:45.592 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:45.593 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:45.593 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:45.593 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:45.593 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:45.593 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:45.594 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:45.594 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:45.593 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:45.594 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:45.594 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:45.594 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:45.621 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:45.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.664098  3257 tablet_service.cc:1511] Processing CreateTablet for tablet 753ee9c1b94445558ea041a6af8840ef (DEFAULT_TABLE table=replication_test_table [id=1365359df50a4068a2562111037df6dd]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
08:08:45.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.667786  3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 753ee9c1b94445558ea041a6af8840ef. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:45.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.666005  3258 tablet_service.cc:1511] Processing CreateTablet for tablet fa47c603eff647ba8370b640a0a12ca5 (DEFAULT_TABLE table=replication_test_table [id=1365359df50a4068a2562111037df6dd]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
08:08:45.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.670913  3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa47c603eff647ba8370b640a0a12ca5. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:45.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.675755  3256 tablet_service.cc:1511] Processing CreateTablet for tablet 3c2bc0e61f964830a3058e48aa1f73e7 (DEFAULT_TABLE table=replication_test_table [id=1365359df50a4068a2562111037df6dd]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
08:08:45.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.676849  3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c2bc0e61f964830a3058e48aa1f73e7. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:45.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.682559  3255 tablet_service.cc:1511] Processing CreateTablet for tablet aaa1bd80c257434880e2a4e22043c2fe (DEFAULT_TABLE table=replication_test_table [id=1365359df50a4068a2562111037df6dd]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
08:08:45.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.683619  3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaa1bd80c257434880e2a4e22043c2fe. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:45.698 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:45.699 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:45.699 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:45.699 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:45.699 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:45.699 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:45.700 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:45.700 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:45.700 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:45.702 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:45.702 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:45.702 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:45.702 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:45.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.701114  3253 tablet_service.cc:1511] Processing CreateTablet for tablet 680fb2eae00541b09ee3fae8748d9ec4 (DEFAULT_TABLE table=replication_test_table [id=1365359df50a4068a2562111037df6dd]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
08:08:45.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.706229  2898 tablet_service.cc:1511] Processing CreateTablet for tablet 680fb2eae00541b09ee3fae8748d9ec4 (DEFAULT_TABLE table=replication_test_table [id=1365359df50a4068a2562111037df6dd]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
08:08:45.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.709412  3254 tablet_service.cc:1511] Processing CreateTablet for tablet 8f15d82f9ab44ea68386995444340bdc (DEFAULT_TABLE table=replication_test_table [id=1365359df50a4068a2562111037df6dd]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
08:08:45.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.710985  2899 tablet_service.cc:1511] Processing CreateTablet for tablet 8f15d82f9ab44ea68386995444340bdc (DEFAULT_TABLE table=replication_test_table [id=1365359df50a4068a2562111037df6dd]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
08:08:45.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.713269  2899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f15d82f9ab44ea68386995444340bdc. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:45.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.717698  2901 tablet_service.cc:1511] Processing CreateTablet for tablet 3c2bc0e61f964830a3058e48aa1f73e7 (DEFAULT_TABLE table=replication_test_table [id=1365359df50a4068a2562111037df6dd]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
08:08:45.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.718803  2900 tablet_service.cc:1511] Processing CreateTablet for tablet aaa1bd80c257434880e2a4e22043c2fe (DEFAULT_TABLE table=replication_test_table [id=1365359df50a4068a2562111037df6dd]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
08:08:45.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.719022  2901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c2bc0e61f964830a3058e48aa1f73e7. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:45.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.720016  2900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaa1bd80c257434880e2a4e22043c2fe. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:45.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.722340  2902 tablet_service.cc:1511] Processing CreateTablet for tablet 753ee9c1b94445558ea041a6af8840ef (DEFAULT_TABLE table=replication_test_table [id=1365359df50a4068a2562111037df6dd]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
08:08:45.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.723275  2902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 753ee9c1b94445558ea041a6af8840ef. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:45.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.725347  2898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 680fb2eae00541b09ee3fae8748d9ec4. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:45.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.726016  3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f15d82f9ab44ea68386995444340bdc. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:45.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.726794  2903 tablet_service.cc:1511] Processing CreateTablet for tablet fa47c603eff647ba8370b640a0a12ca5 (DEFAULT_TABLE table=replication_test_table [id=1365359df50a4068a2562111037df6dd]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
08:08:45.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.727876  2903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa47c603eff647ba8370b640a0a12ca5. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:45.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.730356  3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 680fb2eae00541b09ee3fae8748d9ec4. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:45.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.752327  3058 tablet_service.cc:1511] Processing CreateTablet for tablet fa47c603eff647ba8370b640a0a12ca5 (DEFAULT_TABLE table=replication_test_table [id=1365359df50a4068a2562111037df6dd]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
08:08:45.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.754977  3055 tablet_service.cc:1511] Processing CreateTablet for tablet aaa1bd80c257434880e2a4e22043c2fe (DEFAULT_TABLE table=replication_test_table [id=1365359df50a4068a2562111037df6dd]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
08:08:45.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.756565  3054 tablet_service.cc:1511] Processing CreateTablet for tablet 8f15d82f9ab44ea68386995444340bdc (DEFAULT_TABLE table=replication_test_table [id=1365359df50a4068a2562111037df6dd]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
08:08:45.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.758107  3056 tablet_service.cc:1511] Processing CreateTablet for tablet 3c2bc0e61f964830a3058e48aa1f73e7 (DEFAULT_TABLE table=replication_test_table [id=1365359df50a4068a2562111037df6dd]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
08:08:45.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.763540  3053 tablet_service.cc:1511] Processing CreateTablet for tablet 680fb2eae00541b09ee3fae8748d9ec4 (DEFAULT_TABLE table=replication_test_table [id=1365359df50a4068a2562111037df6dd]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
08:08:45.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.759512  3058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa47c603eff647ba8370b640a0a12ca5. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:45.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.766595  3053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 680fb2eae00541b09ee3fae8748d9ec4. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:45.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.769408  3054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f15d82f9ab44ea68386995444340bdc. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:45.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.770762  3056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c2bc0e61f964830a3058e48aa1f73e7. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:45.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.772320  3055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaa1bd80c257434880e2a4e22043c2fe. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:45.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.782333  3057 tablet_service.cc:1511] Processing CreateTablet for tablet 753ee9c1b94445558ea041a6af8840ef (DEFAULT_TABLE table=replication_test_table [id=1365359df50a4068a2562111037df6dd]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
08:08:45.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.783496  3057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 753ee9c1b94445558ea041a6af8840ef. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:45.846 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:45.846 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:45.846 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:45.847 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:45.847 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:45.847 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:45.847 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:45.848 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:45.848 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:45.848 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:45.848 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:45.848 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:45.848 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:45.848 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:45.848 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:45.848 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:45.848 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:45.848 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:45.848 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:45.849 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:45.850 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:45.850 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:45.848 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:45.853 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:45.853 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:45.853 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:45.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.867734  3560 tablet_bootstrap.cc:492] T aaa1bd80c257434880e2a4e22043c2fe P fecbf6c21a40400fac9aa6a557be405c: Bootstrap starting.
08:08:45.889 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:45.889 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:45.889 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:45.890 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:45.890 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:45.890 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:45.890 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:45.890 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:45.891 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:45.891 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:45.891 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:45.891 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:45.891 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:45.902 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:45.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.917081  3561 tablet_bootstrap.cc:492] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b: Bootstrap starting.
08:08:45.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.928202  3561 tablet_bootstrap.cc:654] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b: Neither blocks nor log segments found. Creating new log.
08:08:45.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.933611  3561 log.cc:826] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b: Log is configured to *not* fsync() on all Append() calls
08:08:45.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.942653  3560 tablet_bootstrap.cc:654] T aaa1bd80c257434880e2a4e22043c2fe P fecbf6c21a40400fac9aa6a557be405c: Neither blocks nor log segments found. Creating new log.
08:08:45.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.945439  3560 log.cc:826] T aaa1bd80c257434880e2a4e22043c2fe P fecbf6c21a40400fac9aa6a557be405c: Log is configured to *not* fsync() on all Append() calls
08:08:45.947 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:45.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:45.983959  3564 tablet_bootstrap.cc:492] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0: Bootstrap starting.
08:08:46.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.002779  3561 tablet_bootstrap.cc:492] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b: No bootstrap required, opened a new log
08:08:46.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.003885  3561 ts_tablet_manager.cc:1403] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b: Time spent bootstrapping tablet: real 0.090s	user 0.019s	sys 0.004s
08:08:46.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.020707  3560 tablet_bootstrap.cc:492] T aaa1bd80c257434880e2a4e22043c2fe P fecbf6c21a40400fac9aa6a557be405c: No bootstrap required, opened a new log
08:08:46.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.021329  3560 ts_tablet_manager.cc:1403] T aaa1bd80c257434880e2a4e22043c2fe P fecbf6c21a40400fac9aa6a557be405c: Time spent bootstrapping tablet: real 0.154s	user 0.006s	sys 0.012s
08:08:46.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.037986  3564 tablet_bootstrap.cc:654] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0: Neither blocks nor log segments found. Creating new log.
08:08:46.041 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:46.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.050653  3564 log.cc:826] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0: Log is configured to *not* fsync() on all Append() calls
08:08:46.062 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:46.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.078997  3564 tablet_bootstrap.cc:492] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0: No bootstrap required, opened a new log
08:08:46.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.079618  3564 ts_tablet_manager.cc:1403] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0: Time spent bootstrapping tablet: real 0.097s	user 0.015s	sys 0.004s
08:08:46.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.087633  3561 raft_consensus.cc:359] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.090301  3561 raft_consensus.cc:385] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:46.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.091750  3561 raft_consensus.cc:740] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0eddb522ea89403b931e52e7ea0a535b, State: Initialized, Role: FOLLOWER
08:08:46.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.095381  3561 consensus_queue.cc:260] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.112361  3561 ts_tablet_manager.cc:1434] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b: Time spent starting tablet: real 0.108s	user 0.039s	sys 0.003s
08:08:46.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.112807  3560 raft_consensus.cc:359] T aaa1bd80c257434880e2a4e22043c2fe P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.115816  3560 raft_consensus.cc:385] T aaa1bd80c257434880e2a4e22043c2fe P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:46.120 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:46.133 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:46.133 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:46.133 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:46.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.116153  3560 raft_consensus.cc:740] T aaa1bd80c257434880e2a4e22043c2fe P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fecbf6c21a40400fac9aa6a557be405c, State: Initialized, Role: FOLLOWER
08:08:46.134 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:46.134 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:46.135 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:46.135 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:46.135 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:46.135 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:46.135 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:46.135 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:46.135 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:46.135 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:46.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.134307  3560 consensus_queue.cc:260] T aaa1bd80c257434880e2a4e22043c2fe P fecbf6c21a40400fac9aa6a557be405c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.138738  3561 tablet_bootstrap.cc:492] T 680fb2eae00541b09ee3fae8748d9ec4 P 0eddb522ea89403b931e52e7ea0a535b: Bootstrap starting.
08:08:46.168 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:46.168 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:46.169 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:46.169 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:46.169 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:46.169 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:46.170 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:46.170 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:46.170 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:46.170 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:46.170 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:46.170 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:46.170 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:46.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:46.172176  2972 tablet.cc:2404] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:08:46.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.170879  3561 tablet_bootstrap.cc:654] T 680fb2eae00541b09ee3fae8748d9ec4 P 0eddb522ea89403b931e52e7ea0a535b: Neither blocks nor log segments found. Creating new log.
08:08:46.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.182917  3564 raft_consensus.cc:359] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.190207  3564 raft_consensus.cc:385] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:46.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.190553  3564 raft_consensus.cc:740] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e3589ebfaf94fe5849b6322dc8e0be0, State: Initialized, Role: FOLLOWER
08:08:46.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.189783  3560 ts_tablet_manager.cc:1434] T aaa1bd80c257434880e2a4e22043c2fe P fecbf6c21a40400fac9aa6a557be405c: Time spent starting tablet: real 0.168s	user 0.025s	sys 0.020s
08:08:46.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.192997  3560 tablet_bootstrap.cc:492] T 680fb2eae00541b09ee3fae8748d9ec4 P fecbf6c21a40400fac9aa6a557be405c: Bootstrap starting.
08:08:46.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.191572  3564 consensus_queue.cc:260] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.219190  3564 ts_tablet_manager.cc:1434] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0: Time spent starting tablet: real 0.139s	user 0.031s	sys 0.007s
08:08:46.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.221071  3560 tablet_bootstrap.cc:654] T 680fb2eae00541b09ee3fae8748d9ec4 P fecbf6c21a40400fac9aa6a557be405c: Neither blocks nor log segments found. Creating new log.
08:08:46.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.233258  3564 tablet_bootstrap.cc:492] T 680fb2eae00541b09ee3fae8748d9ec4 P 5e3589ebfaf94fe5849b6322dc8e0be0: Bootstrap starting.
08:08:46.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.243953  3564 tablet_bootstrap.cc:654] T 680fb2eae00541b09ee3fae8748d9ec4 P 5e3589ebfaf94fe5849b6322dc8e0be0: Neither blocks nor log segments found. Creating new log.
08:08:46.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.266440  3560 tablet_bootstrap.cc:492] T 680fb2eae00541b09ee3fae8748d9ec4 P fecbf6c21a40400fac9aa6a557be405c: No bootstrap required, opened a new log
08:08:46.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.266932  3560 ts_tablet_manager.cc:1403] T 680fb2eae00541b09ee3fae8748d9ec4 P fecbf6c21a40400fac9aa6a557be405c: Time spent bootstrapping tablet: real 0.074s	user 0.007s	sys 0.005s
08:08:46.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.267266  3561 tablet_bootstrap.cc:492] T 680fb2eae00541b09ee3fae8748d9ec4 P 0eddb522ea89403b931e52e7ea0a535b: No bootstrap required, opened a new log
08:08:46.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.268101  3561 ts_tablet_manager.cc:1403] T 680fb2eae00541b09ee3fae8748d9ec4 P 0eddb522ea89403b931e52e7ea0a535b: Time spent bootstrapping tablet: real 0.131s	user 0.013s	sys 0.011s
08:08:46.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.269984  3560 raft_consensus.cc:359] T 680fb2eae00541b09ee3fae8748d9ec4 P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.270648  3560 raft_consensus.cc:385] T 680fb2eae00541b09ee3fae8748d9ec4 P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:46.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.270915  3560 raft_consensus.cc:740] T 680fb2eae00541b09ee3fae8748d9ec4 P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fecbf6c21a40400fac9aa6a557be405c, State: Initialized, Role: FOLLOWER
08:08:46.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.275225  3561 raft_consensus.cc:359] T 680fb2eae00541b09ee3fae8748d9ec4 P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.274710  3560 consensus_queue.cc:260] T 680fb2eae00541b09ee3fae8748d9ec4 P fecbf6c21a40400fac9aa6a557be405c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.279255  3560 ts_tablet_manager.cc:1434] T 680fb2eae00541b09ee3fae8748d9ec4 P fecbf6c21a40400fac9aa6a557be405c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
08:08:46.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.280149  3560 tablet_bootstrap.cc:492] T 8f15d82f9ab44ea68386995444340bdc P fecbf6c21a40400fac9aa6a557be405c: Bootstrap starting.
08:08:46.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.292078  3564 tablet_bootstrap.cc:492] T 680fb2eae00541b09ee3fae8748d9ec4 P 5e3589ebfaf94fe5849b6322dc8e0be0: No bootstrap required, opened a new log
08:08:46.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.292538  3564 ts_tablet_manager.cc:1403] T 680fb2eae00541b09ee3fae8748d9ec4 P 5e3589ebfaf94fe5849b6322dc8e0be0: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.001s
08:08:46.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.292984  3561 raft_consensus.cc:385] T 680fb2eae00541b09ee3fae8748d9ec4 P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:46.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.295485  3561 raft_consensus.cc:740] T 680fb2eae00541b09ee3fae8748d9ec4 P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0eddb522ea89403b931e52e7ea0a535b, State: Initialized, Role: FOLLOWER
08:08:46.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.297082  3564 raft_consensus.cc:359] T 680fb2eae00541b09ee3fae8748d9ec4 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.297767  3564 raft_consensus.cc:385] T 680fb2eae00541b09ee3fae8748d9ec4 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:46.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.298084  3564 raft_consensus.cc:740] T 680fb2eae00541b09ee3fae8748d9ec4 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e3589ebfaf94fe5849b6322dc8e0be0, State: Initialized, Role: FOLLOWER
08:08:46.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.298743  3564 consensus_queue.cc:260] T 680fb2eae00541b09ee3fae8748d9ec4 P 5e3589ebfaf94fe5849b6322dc8e0be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.299854  3568 raft_consensus.cc:493] T aaa1bd80c257434880e2a4e22043c2fe P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:46.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.300549  3568 raft_consensus.cc:515] T aaa1bd80c257434880e2a4e22043c2fe P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.304311  3568 leader_election.cc:290] T aaa1bd80c257434880e2a4e22043c2fe P fecbf6c21a40400fac9aa6a557be405c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135), 5e3589ebfaf94fe5849b6322dc8e0be0 (127.2.90.130:34617)
08:08:46.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.296849  3561 consensus_queue.cc:260] T 680fb2eae00541b09ee3fae8748d9ec4 P 0eddb522ea89403b931e52e7ea0a535b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.349543  3561 ts_tablet_manager.cc:1434] T 680fb2eae00541b09ee3fae8748d9ec4 P 0eddb522ea89403b931e52e7ea0a535b: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.000s
08:08:46.350 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:46.350 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:46.350 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:46.351 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:46.351 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:46.351 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:46.351 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:46.352 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:46.352 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:46.351 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:46.352 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:46.352 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:46.352 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:46.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:46.362982  3331 tablet.cc:2404] T 680fb2eae00541b09ee3fae8748d9ec4 P fecbf6c21a40400fac9aa6a557be405c: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:08:46.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.371723  3564 ts_tablet_manager.cc:1434] T 680fb2eae00541b09ee3fae8748d9ec4 P 5e3589ebfaf94fe5849b6322dc8e0be0: Time spent starting tablet: real 0.079s	user 0.003s	sys 0.004s
08:08:46.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.375336  3564 tablet_bootstrap.cc:492] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0: Bootstrap starting.
08:08:46.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.376238  3560 tablet_bootstrap.cc:654] T 8f15d82f9ab44ea68386995444340bdc P fecbf6c21a40400fac9aa6a557be405c: Neither blocks nor log segments found. Creating new log.
08:08:46.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.379128  3567 raft_consensus.cc:493] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:46.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.379783  3567 raft_consensus.cc:515] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.394837  3567 leader_election.cc:290] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e3589ebfaf94fe5849b6322dc8e0be0 (127.2.90.130:34617), fecbf6c21a40400fac9aa6a557be405c (127.2.90.131:33107)
08:08:46.401 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:46.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.403877  3564 tablet_bootstrap.cc:654] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0: Neither blocks nor log segments found. Creating new log.
08:08:46.412 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:46.413 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:46.413 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:46.414 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:46.414 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:46.414 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:46.415 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:46.415 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:46.415 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:46.415 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:46.415 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:46.415 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:46.415 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:46.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.416957  3560 tablet_bootstrap.cc:492] T 8f15d82f9ab44ea68386995444340bdc P fecbf6c21a40400fac9aa6a557be405c: No bootstrap required, opened a new log
08:08:46.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.417588  3560 ts_tablet_manager.cc:1403] T 8f15d82f9ab44ea68386995444340bdc P fecbf6c21a40400fac9aa6a557be405c: Time spent bootstrapping tablet: real 0.138s	user 0.005s	sys 0.008s
08:08:46.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.419587  3570 raft_consensus.cc:493] T 680fb2eae00541b09ee3fae8748d9ec4 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:46.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.420199  3570 raft_consensus.cc:515] T 680fb2eae00541b09ee3fae8748d9ec4 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.434227  3570 leader_election.cc:290] T 680fb2eae00541b09ee3fae8748d9ec4 P 5e3589ebfaf94fe5849b6322dc8e0be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135), fecbf6c21a40400fac9aa6a557be405c (127.2.90.131:33107)
08:08:46.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.440109  3560 raft_consensus.cc:359] T 8f15d82f9ab44ea68386995444340bdc P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.447 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:46.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.448074  3560 raft_consensus.cc:385] T 8f15d82f9ab44ea68386995444340bdc P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:46.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.449503  3560 raft_consensus.cc:740] T 8f15d82f9ab44ea68386995444340bdc P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fecbf6c21a40400fac9aa6a557be405c, State: Initialized, Role: FOLLOWER
08:08:46.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:46.449491  3130 tablet.cc:2404] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:08:46.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.450793  3560 consensus_queue.cc:260] T 8f15d82f9ab44ea68386995444340bdc P fecbf6c21a40400fac9aa6a557be405c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.455346  2923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680fb2eae00541b09ee3fae8748d9ec4" candidate_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0eddb522ea89403b931e52e7ea0a535b" is_pre_election: true
08:08:46.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.456461  2923 raft_consensus.cc:2468] T 680fb2eae00541b09ee3fae8748d9ec4 P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e3589ebfaf94fe5849b6322dc8e0be0 in term 0.
08:08:46.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.459534  3013 leader_election.cc:304] T 680fb2eae00541b09ee3fae8748d9ec4 P 5e3589ebfaf94fe5849b6322dc8e0be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0eddb522ea89403b931e52e7ea0a535b, 5e3589ebfaf94fe5849b6322dc8e0be0; no voters: 
08:08:46.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.461016  3570 raft_consensus.cc:2804] T 680fb2eae00541b09ee3fae8748d9ec4 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:08:46.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.461483  3570 raft_consensus.cc:493] T 680fb2eae00541b09ee3fae8748d9ec4 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:08:46.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.462859  3570 raft_consensus.cc:3060] T 680fb2eae00541b09ee3fae8748d9ec4 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Advancing to term 1
08:08:46.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.469406  3560 ts_tablet_manager.cc:1434] T 8f15d82f9ab44ea68386995444340bdc P fecbf6c21a40400fac9aa6a557be405c: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.003s
08:08:46.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.473819  3564 tablet_bootstrap.cc:492] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0: No bootstrap required, opened a new log
08:08:46.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.474552  3564 ts_tablet_manager.cc:1403] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0: Time spent bootstrapping tablet: real 0.099s	user 0.013s	sys 0.000s
08:08:46.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.484746  3560 tablet_bootstrap.cc:492] T 3c2bc0e61f964830a3058e48aa1f73e7 P fecbf6c21a40400fac9aa6a557be405c: Bootstrap starting.
08:08:46.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.491350  3570 raft_consensus.cc:515] T 680fb2eae00541b09ee3fae8748d9ec4 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.488082  3564 raft_consensus.cc:359] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.494568  3570 leader_election.cc:290] T 680fb2eae00541b09ee3fae8748d9ec4 P 5e3589ebfaf94fe5849b6322dc8e0be0 [CANDIDATE]: Term 1 election: Requested vote from peers 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135), fecbf6c21a40400fac9aa6a557be405c (127.2.90.131:33107)
08:08:46.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.494465  2923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa1bd80c257434880e2a4e22043c2fe" candidate_uuid: "fecbf6c21a40400fac9aa6a557be405c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0eddb522ea89403b931e52e7ea0a535b" is_pre_election: true
08:08:46.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.495805  2922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680fb2eae00541b09ee3fae8748d9ec4" candidate_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0eddb522ea89403b931e52e7ea0a535b"
08:08:46.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.493589  3564 raft_consensus.cc:385] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:46.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.496510  2922 raft_consensus.cc:3060] T 680fb2eae00541b09ee3fae8748d9ec4 P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Advancing to term 1
08:08:46.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.496728  3564 raft_consensus.cc:740] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e3589ebfaf94fe5849b6322dc8e0be0, State: Initialized, Role: FOLLOWER
08:08:46.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.497650  3564 consensus_queue.cc:260] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.504657  2922 raft_consensus.cc:2468] T 680fb2eae00541b09ee3fae8748d9ec4 P 0eddb522ea89403b931e52e7ea0a535b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e3589ebfaf94fe5849b6322dc8e0be0 in term 1.
08:08:46.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.506408  3013 leader_election.cc:304] T 680fb2eae00541b09ee3fae8748d9ec4 P 5e3589ebfaf94fe5849b6322dc8e0be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0eddb522ea89403b931e52e7ea0a535b, 5e3589ebfaf94fe5849b6322dc8e0be0; no voters: 
08:08:46.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.507639  3570 raft_consensus.cc:2804] T 680fb2eae00541b09ee3fae8748d9ec4 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 1 FOLLOWER]: Leader election won for term 1
08:08:46.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.509394  3564 ts_tablet_manager.cc:1434] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.002s
08:08:46.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.514681  3564 tablet_bootstrap.cc:492] T fa47c603eff647ba8370b640a0a12ca5 P 5e3589ebfaf94fe5849b6322dc8e0be0: Bootstrap starting.
08:08:46.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.518172  3560 tablet_bootstrap.cc:654] T 3c2bc0e61f964830a3058e48aa1f73e7 P fecbf6c21a40400fac9aa6a557be405c: Neither blocks nor log segments found. Creating new log.
08:08:46.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.524293  3570 raft_consensus.cc:697] T 680fb2eae00541b09ee3fae8748d9ec4 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 1 LEADER]: Becoming Leader. State: Replica: 5e3589ebfaf94fe5849b6322dc8e0be0, State: Running, Role: LEADER
08:08:46.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.525600  3570 consensus_queue.cc:237] T 680fb2eae00541b09ee3fae8748d9ec4 P 5e3589ebfaf94fe5849b6322dc8e0be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.541090  3561 tablet_bootstrap.cc:492] T aaa1bd80c257434880e2a4e22043c2fe P 0eddb522ea89403b931e52e7ea0a535b: Bootstrap starting.
08:08:46.541 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:46.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.542753  3564 tablet_bootstrap.cc:654] T fa47c603eff647ba8370b640a0a12ca5 P 5e3589ebfaf94fe5849b6322dc8e0be0: Neither blocks nor log segments found. Creating new log.
08:08:46.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.543507  3568 raft_consensus.cc:493] T 680fb2eae00541b09ee3fae8748d9ec4 P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:46.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.544034  3568 raft_consensus.cc:515] T 680fb2eae00541b09ee3fae8748d9ec4 P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.549587  3568 leader_election.cc:290] T 680fb2eae00541b09ee3fae8748d9ec4 P fecbf6c21a40400fac9aa6a557be405c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135), 5e3589ebfaf94fe5849b6322dc8e0be0 (127.2.90.130:34617)
08:08:46.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.559566  3564 tablet_bootstrap.cc:492] T fa47c603eff647ba8370b640a0a12ca5 P 5e3589ebfaf94fe5849b6322dc8e0be0: No bootstrap required, opened a new log
08:08:46.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.560135  3564 ts_tablet_manager.cc:1403] T fa47c603eff647ba8370b640a0a12ca5 P 5e3589ebfaf94fe5849b6322dc8e0be0: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.004s
08:08:46.562 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:46.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.569197  3564 raft_consensus.cc:359] T fa47c603eff647ba8370b640a0a12ca5 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } } peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } }
08:08:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.569926  3564 raft_consensus.cc:385] T fa47c603eff647ba8370b640a0a12ca5 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:46.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.570232  3564 raft_consensus.cc:740] T fa47c603eff647ba8370b640a0a12ca5 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e3589ebfaf94fe5849b6322dc8e0be0, State: Initialized, Role: FOLLOWER
08:08:46.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.570899  3564 consensus_queue.cc:260] T fa47c603eff647ba8370b640a0a12ca5 P 5e3589ebfaf94fe5849b6322dc8e0be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } } peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } }
08:08:46.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:46.574673  3213 leader_election.cc:343] T aaa1bd80c257434880e2a4e22043c2fe P fecbf6c21a40400fac9aa6a557be405c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135): Illegal state: must be running to vote when last-logged opid is not known
08:08:46.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.576941  2922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680fb2eae00541b09ee3fae8748d9ec4" candidate_uuid: "fecbf6c21a40400fac9aa6a557be405c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0eddb522ea89403b931e52e7ea0a535b" is_pre_election: true
08:08:46.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.577872  3564 ts_tablet_manager.cc:1434] T fa47c603eff647ba8370b640a0a12ca5 P 5e3589ebfaf94fe5849b6322dc8e0be0: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
08:08:46.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.578007  2922 raft_consensus.cc:2393] T 680fb2eae00541b09ee3fae8748d9ec4 P 0eddb522ea89403b931e52e7ea0a535b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fecbf6c21a40400fac9aa6a557be405c in current term 1: Already voted for candidate 5e3589ebfaf94fe5849b6322dc8e0be0 in this term.
08:08:46.603 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:46.603 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:46.604 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:46.604 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:46.604 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:46.604 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:46.605 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:46.605 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:46.607 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:46.607 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:46.607 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:46.607 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:46.607 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:46.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.613544  3564 tablet_bootstrap.cc:492] T 753ee9c1b94445558ea041a6af8840ef P 5e3589ebfaf94fe5849b6322dc8e0be0: Bootstrap starting.
08:08:46.620 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:46.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.625320  3564 tablet_bootstrap.cc:654] T 753ee9c1b94445558ea041a6af8840ef P 5e3589ebfaf94fe5849b6322dc8e0be0: Neither blocks nor log segments found. Creating new log.
08:08:46.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.633266  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680fb2eae00541b09ee3fae8748d9ec4" candidate_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fecbf6c21a40400fac9aa6a557be405c" is_pre_election: true
08:08:46.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.634665  3278 raft_consensus.cc:2468] T 680fb2eae00541b09ee3fae8748d9ec4 P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e3589ebfaf94fe5849b6322dc8e0be0 in term 0.
08:08:46.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.636957  3078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa1bd80c257434880e2a4e22043c2fe" candidate_uuid: "fecbf6c21a40400fac9aa6a557be405c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" is_pre_election: true
08:08:46.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.638931  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680fb2eae00541b09ee3fae8748d9ec4" candidate_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fecbf6c21a40400fac9aa6a557be405c"
08:08:46.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.639403  3278 raft_consensus.cc:3060] T 680fb2eae00541b09ee3fae8748d9ec4 P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Advancing to term 1
08:08:46.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.638794  2660 catalog_manager.cc:5696] T 680fb2eae00541b09ee3fae8748d9ec4 P 5e3589ebfaf94fe5849b6322dc8e0be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e3589ebfaf94fe5849b6322dc8e0be0 (127.2.90.130). New cstate: current_term: 1 leader_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } health_report { overall_health: UNKNOWN } } }
08:08:46.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.643841  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753ee9c1b94445558ea041a6af8840ef" candidate_uuid: "0eddb522ea89403b931e52e7ea0a535b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fecbf6c21a40400fac9aa6a557be405c" is_pre_election: true
08:08:46.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:46.646620  2856 leader_election.cc:343] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fecbf6c21a40400fac9aa6a557be405c (127.2.90.131:33107): Illegal state: must be running to vote when last-logged opid is not known
08:08:46.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.646663  3278 raft_consensus.cc:2468] T 680fb2eae00541b09ee3fae8748d9ec4 P fecbf6c21a40400fac9aa6a557be405c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e3589ebfaf94fe5849b6322dc8e0be0 in term 1.
08:08:46.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.650450  3078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680fb2eae00541b09ee3fae8748d9ec4" candidate_uuid: "fecbf6c21a40400fac9aa6a557be405c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" is_pre_election: true
08:08:46.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:46.652314  3213 leader_election.cc:343] T aaa1bd80c257434880e2a4e22043c2fe P fecbf6c21a40400fac9aa6a557be405c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e3589ebfaf94fe5849b6322dc8e0be0 (127.2.90.130:34617): Illegal state: must be running to vote when last-logged opid is not known
08:08:46.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.652973  3213 leader_election.cc:304] T aaa1bd80c257434880e2a4e22043c2fe P fecbf6c21a40400fac9aa6a557be405c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fecbf6c21a40400fac9aa6a557be405c; no voters: 0eddb522ea89403b931e52e7ea0a535b, 5e3589ebfaf94fe5849b6322dc8e0be0
08:08:46.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.653577  3560 tablet_bootstrap.cc:492] T 3c2bc0e61f964830a3058e48aa1f73e7 P fecbf6c21a40400fac9aa6a557be405c: No bootstrap required, opened a new log
08:08:46.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.654695  3560 ts_tablet_manager.cc:1403] T 3c2bc0e61f964830a3058e48aa1f73e7 P fecbf6c21a40400fac9aa6a557be405c: Time spent bootstrapping tablet: real 0.170s	user 0.030s	sys 0.048s
08:08:46.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.654935  3568 raft_consensus.cc:2749] T aaa1bd80c257434880e2a4e22043c2fe P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
08:08:46.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.657159  3213 leader_election.cc:304] T 680fb2eae00541b09ee3fae8748d9ec4 P fecbf6c21a40400fac9aa6a557be405c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fecbf6c21a40400fac9aa6a557be405c; no voters: 0eddb522ea89403b931e52e7ea0a535b, 5e3589ebfaf94fe5849b6322dc8e0be0
08:08:46.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.660025  3568 raft_consensus.cc:2749] T 680fb2eae00541b09ee3fae8748d9ec4 P fecbf6c21a40400fac9aa6a557be405c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
08:08:46.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.660200  3570 raft_consensus.cc:493] T fa47c603eff647ba8370b640a0a12ca5 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:46.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.660646  3570 raft_consensus.cc:515] T fa47c603eff647ba8370b640a0a12ca5 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } } peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } }
08:08:46.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.662664  3570 leader_election.cc:290] T fa47c603eff647ba8370b640a0a12ca5 P 5e3589ebfaf94fe5849b6322dc8e0be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fecbf6c21a40400fac9aa6a557be405c (127.2.90.131:33107), 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135)
08:08:46.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.663977  2922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa47c603eff647ba8370b640a0a12ca5" candidate_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0eddb522ea89403b931e52e7ea0a535b" is_pre_election: true
08:08:46.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:46.666007  3013 leader_election.cc:343] T fa47c603eff647ba8370b640a0a12ca5 P 5e3589ebfaf94fe5849b6322dc8e0be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135): Illegal state: must be running to vote when last-logged opid is not known
08:08:46.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.668663  3564 tablet_bootstrap.cc:492] T 753ee9c1b94445558ea041a6af8840ef P 5e3589ebfaf94fe5849b6322dc8e0be0: No bootstrap required, opened a new log
08:08:46.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.669114  3564 ts_tablet_manager.cc:1403] T 753ee9c1b94445558ea041a6af8840ef P 5e3589ebfaf94fe5849b6322dc8e0be0: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.003s
08:08:46.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.672629  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa47c603eff647ba8370b640a0a12ca5" candidate_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fecbf6c21a40400fac9aa6a557be405c" is_pre_election: true
08:08:46.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.673302  3564 raft_consensus.cc:359] T 753ee9c1b94445558ea041a6af8840ef P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.673573  3078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753ee9c1b94445558ea041a6af8840ef" candidate_uuid: "0eddb522ea89403b931e52e7ea0a535b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" is_pre_election: true
08:08:46.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.674024  3564 raft_consensus.cc:385] T 753ee9c1b94445558ea041a6af8840ef P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:46.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:46.674162  3011 leader_election.cc:343] T fa47c603eff647ba8370b640a0a12ca5 P 5e3589ebfaf94fe5849b6322dc8e0be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fecbf6c21a40400fac9aa6a557be405c (127.2.90.131:33107): Illegal state: must be running to vote when last-logged opid is not known
08:08:46.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.674316  3564 raft_consensus.cc:740] T 753ee9c1b94445558ea041a6af8840ef P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e3589ebfaf94fe5849b6322dc8e0be0, State: Initialized, Role: FOLLOWER
08:08:46.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.674575  3011 leader_election.cc:304] T fa47c603eff647ba8370b640a0a12ca5 P 5e3589ebfaf94fe5849b6322dc8e0be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e3589ebfaf94fe5849b6322dc8e0be0; no voters: 0eddb522ea89403b931e52e7ea0a535b, fecbf6c21a40400fac9aa6a557be405c
08:08:46.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.675422  3570 raft_consensus.cc:2749] T fa47c603eff647ba8370b640a0a12ca5 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
08:08:46.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.676143  3561 tablet_bootstrap.cc:654] T aaa1bd80c257434880e2a4e22043c2fe P 0eddb522ea89403b931e52e7ea0a535b: Neither blocks nor log segments found. Creating new log.
08:08:46.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.678418  3560 raft_consensus.cc:359] T 3c2bc0e61f964830a3058e48aa1f73e7 P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.679705  3560 raft_consensus.cc:385] T 3c2bc0e61f964830a3058e48aa1f73e7 P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:46.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.680114  3560 raft_consensus.cc:740] T 3c2bc0e61f964830a3058e48aa1f73e7 P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fecbf6c21a40400fac9aa6a557be405c, State: Initialized, Role: FOLLOWER
08:08:46.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.680935  3560 consensus_queue.cc:260] T 3c2bc0e61f964830a3058e48aa1f73e7 P fecbf6c21a40400fac9aa6a557be405c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.683976  3560 ts_tablet_manager.cc:1434] T 3c2bc0e61f964830a3058e48aa1f73e7 P fecbf6c21a40400fac9aa6a557be405c: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
08:08:46.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.685250  3560 tablet_bootstrap.cc:492] T 753ee9c1b94445558ea041a6af8840ef P fecbf6c21a40400fac9aa6a557be405c: Bootstrap starting.
08:08:46.685 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:46.686 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:46.686 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:46.686 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:46.686 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:46.686 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:46.686 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:46.687 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:46.687 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:46.687 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:46.687 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:46.687 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:46.687 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:46.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.690317  3570 raft_consensus.cc:493] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:46.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.690796  3570 raft_consensus.cc:515] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.692946  3570 leader_election.cc:290] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135), fecbf6c21a40400fac9aa6a557be405c (127.2.90.131:33107)
08:08:46.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.693929  2922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c2bc0e61f964830a3058e48aa1f73e7" candidate_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0eddb522ea89403b931e52e7ea0a535b" is_pre_election: true
08:08:46.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.694192  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c2bc0e61f964830a3058e48aa1f73e7" candidate_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fecbf6c21a40400fac9aa6a557be405c" is_pre_election: true
08:08:46.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:46.695557  3013 leader_election.cc:343] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135): Illegal state: must be running to vote when last-logged opid is not known
08:08:46.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.695959  3560 tablet_bootstrap.cc:654] T 753ee9c1b94445558ea041a6af8840ef P fecbf6c21a40400fac9aa6a557be405c: Neither blocks nor log segments found. Creating new log.
08:08:46.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.695374  3278 raft_consensus.cc:2468] T 3c2bc0e61f964830a3058e48aa1f73e7 P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e3589ebfaf94fe5849b6322dc8e0be0 in term 0.
08:08:46.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.699880  3011 leader_election.cc:304] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e3589ebfaf94fe5849b6322dc8e0be0, fecbf6c21a40400fac9aa6a557be405c; no voters: 0eddb522ea89403b931e52e7ea0a535b
08:08:46.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.700901  3570 raft_consensus.cc:2804] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:08:46.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.701227  3570 raft_consensus.cc:493] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:08:46.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.701501  3570 raft_consensus.cc:3060] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Advancing to term 1
08:08:46.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.674998  3564 consensus_queue.cc:260] T 753ee9c1b94445558ea041a6af8840ef P 5e3589ebfaf94fe5849b6322dc8e0be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.716 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:46.716 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:46.716 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:46.717 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:46.717 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:46.717 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:46.717 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:46.717 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:46.717 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:46.717 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:46.717 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:46.717 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:46.717 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:46.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.720098  3078 raft_consensus.cc:2468] T 753ee9c1b94445558ea041a6af8840ef P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0eddb522ea89403b931e52e7ea0a535b in term 0.
08:08:46.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.720897  3570 raft_consensus.cc:515] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.723022  3570 leader_election.cc:290] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0 [CANDIDATE]: Term 1 election: Requested vote from peers 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135), fecbf6c21a40400fac9aa6a557be405c (127.2.90.131:33107)
08:08:46.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.724151  2922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c2bc0e61f964830a3058e48aa1f73e7" candidate_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0eddb522ea89403b931e52e7ea0a535b"
08:08:46.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:46.725975  3013 leader_election.cc:343] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135): Illegal state: must be running to vote when last-logged opid is not known
08:08:46.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.726066  2858 leader_election.cc:304] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0eddb522ea89403b931e52e7ea0a535b, 5e3589ebfaf94fe5849b6322dc8e0be0; no voters: fecbf6c21a40400fac9aa6a557be405c
08:08:46.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.729207  3567 raft_consensus.cc:2804] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Leader pre-election won for term 1
08:08:46.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.729751  3567 raft_consensus.cc:493] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:08:46.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.730252  3567 raft_consensus.cc:3060] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Advancing to term 1
08:08:46.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.731410  3561 tablet_bootstrap.cc:492] T aaa1bd80c257434880e2a4e22043c2fe P 0eddb522ea89403b931e52e7ea0a535b: No bootstrap required, opened a new log
08:08:46.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.732105  3561 ts_tablet_manager.cc:1403] T aaa1bd80c257434880e2a4e22043c2fe P 0eddb522ea89403b931e52e7ea0a535b: Time spent bootstrapping tablet: real 0.192s	user 0.009s	sys 0.005s
08:08:46.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.728250  3564 ts_tablet_manager.cc:1434] T 753ee9c1b94445558ea041a6af8840ef P 5e3589ebfaf94fe5849b6322dc8e0be0: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.004s
08:08:46.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.741050  3564 tablet_bootstrap.cc:492] T aaa1bd80c257434880e2a4e22043c2fe P 5e3589ebfaf94fe5849b6322dc8e0be0: Bootstrap starting.
08:08:46.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.742564  3561 raft_consensus.cc:359] T aaa1bd80c257434880e2a4e22043c2fe P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.750602  3561 raft_consensus.cc:385] T aaa1bd80c257434880e2a4e22043c2fe P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:46.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.752328  3561 raft_consensus.cc:740] T aaa1bd80c257434880e2a4e22043c2fe P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0eddb522ea89403b931e52e7ea0a535b, State: Initialized, Role: FOLLOWER
08:08:46.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.753080  3564 tablet_bootstrap.cc:654] T aaa1bd80c257434880e2a4e22043c2fe P 5e3589ebfaf94fe5849b6322dc8e0be0: Neither blocks nor log segments found. Creating new log.
08:08:46.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.757207  3560 tablet_bootstrap.cc:492] T 753ee9c1b94445558ea041a6af8840ef P fecbf6c21a40400fac9aa6a557be405c: No bootstrap required, opened a new log
08:08:46.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.757943  3560 ts_tablet_manager.cc:1403] T 753ee9c1b94445558ea041a6af8840ef P fecbf6c21a40400fac9aa6a557be405c: Time spent bootstrapping tablet: real 0.073s	user 0.026s	sys 0.019s
08:08:46.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.754781  3561 consensus_queue.cc:260] T aaa1bd80c257434880e2a4e22043c2fe P 0eddb522ea89403b931e52e7ea0a535b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.762514  3560 raft_consensus.cc:359] T 753ee9c1b94445558ea041a6af8840ef P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.763600  3560 raft_consensus.cc:385] T 753ee9c1b94445558ea041a6af8840ef P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:46.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.763900  3560 raft_consensus.cc:740] T 753ee9c1b94445558ea041a6af8840ef P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fecbf6c21a40400fac9aa6a557be405c, State: Initialized, Role: FOLLOWER
08:08:46.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.764667  3560 consensus_queue.cc:260] T 753ee9c1b94445558ea041a6af8840ef P fecbf6c21a40400fac9aa6a557be405c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.768903  3560 ts_tablet_manager.cc:1434] T 753ee9c1b94445558ea041a6af8840ef P fecbf6c21a40400fac9aa6a557be405c: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.005s
08:08:46.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.770186  3560 tablet_bootstrap.cc:492] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c: Bootstrap starting.
08:08:46.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.777920  3560 tablet_bootstrap.cc:654] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c: Neither blocks nor log segments found. Creating new log.
08:08:46.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.778967  3568 raft_consensus.cc:493] T 753ee9c1b94445558ea041a6af8840ef P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:46.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.766151  3564 tablet_bootstrap.cc:492] T aaa1bd80c257434880e2a4e22043c2fe P 5e3589ebfaf94fe5849b6322dc8e0be0: No bootstrap required, opened a new log
08:08:46.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.779518  3568 raft_consensus.cc:515] T 753ee9c1b94445558ea041a6af8840ef P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.780093  3564 ts_tablet_manager.cc:1403] T aaa1bd80c257434880e2a4e22043c2fe P 5e3589ebfaf94fe5849b6322dc8e0be0: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.007s
08:08:46.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.784176  3564 raft_consensus.cc:359] T aaa1bd80c257434880e2a4e22043c2fe P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.784950  3564 raft_consensus.cc:385] T aaa1bd80c257434880e2a4e22043c2fe P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:46.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.785233  3564 raft_consensus.cc:740] T aaa1bd80c257434880e2a4e22043c2fe P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e3589ebfaf94fe5849b6322dc8e0be0, State: Initialized, Role: FOLLOWER
08:08:46.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.786018  3564 consensus_queue.cc:260] T aaa1bd80c257434880e2a4e22043c2fe P 5e3589ebfaf94fe5849b6322dc8e0be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.786583  3078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753ee9c1b94445558ea041a6af8840ef" candidate_uuid: "fecbf6c21a40400fac9aa6a557be405c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" is_pre_election: true
08:08:46.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.786590  2922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753ee9c1b94445558ea041a6af8840ef" candidate_uuid: "fecbf6c21a40400fac9aa6a557be405c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0eddb522ea89403b931e52e7ea0a535b" is_pre_election: true
08:08:46.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.787223  3568 leader_election.cc:290] T 753ee9c1b94445558ea041a6af8840ef P fecbf6c21a40400fac9aa6a557be405c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135), 5e3589ebfaf94fe5849b6322dc8e0be0 (127.2.90.130:34617)
08:08:46.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.787305  3078 raft_consensus.cc:2468] T 753ee9c1b94445558ea041a6af8840ef P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fecbf6c21a40400fac9aa6a557be405c in term 0.
08:08:46.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.788968  3564 ts_tablet_manager.cc:1434] T aaa1bd80c257434880e2a4e22043c2fe P 5e3589ebfaf94fe5849b6322dc8e0be0: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
08:08:46.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.791301  3213 leader_election.cc:304] T 753ee9c1b94445558ea041a6af8840ef P fecbf6c21a40400fac9aa6a557be405c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e3589ebfaf94fe5849b6322dc8e0be0, fecbf6c21a40400fac9aa6a557be405c; no voters: 
08:08:46.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.792968  3561 ts_tablet_manager.cc:1434] T aaa1bd80c257434880e2a4e22043c2fe P 0eddb522ea89403b931e52e7ea0a535b: Time spent starting tablet: real 0.060s	user 0.010s	sys 0.000s
08:08:46.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.796121  3570 raft_consensus.cc:493] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:46.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.796557  3570 raft_consensus.cc:515] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.798622  3570 leader_election.cc:290] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135), fecbf6c21a40400fac9aa6a557be405c (127.2.90.131:33107)
08:08:46.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.799664  2923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f15d82f9ab44ea68386995444340bdc" candidate_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0eddb522ea89403b931e52e7ea0a535b" is_pre_election: true
08:08:46.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:46.802068  3013 leader_election.cc:343] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135): Illegal state: must be running to vote when last-logged opid is not known
08:08:46.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.803241  3560 tablet_bootstrap.cc:492] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c: No bootstrap required, opened a new log
08:08:46.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.803844  3560 ts_tablet_manager.cc:1403] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.012s
08:08:46.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.794145  3561 tablet_bootstrap.cc:492] T 3c2bc0e61f964830a3058e48aa1f73e7 P 0eddb522ea89403b931e52e7ea0a535b: Bootstrap starting.
08:08:46.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.807405  3560 raft_consensus.cc:359] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } } peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } }
08:08:46.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.808492  3560 raft_consensus.cc:385] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:46.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.809032  3560 raft_consensus.cc:740] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fecbf6c21a40400fac9aa6a557be405c, State: Initialized, Role: FOLLOWER
08:08:46.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.809834  3560 consensus_queue.cc:260] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } } peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } }
08:08:46.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.809056  3568 raft_consensus.cc:2804] T 753ee9c1b94445558ea041a6af8840ef P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Leader pre-election won for term 1
08:08:46.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.811507  3568 raft_consensus.cc:493] T 753ee9c1b94445558ea041a6af8840ef P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:08:46.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.812331  3568 raft_consensus.cc:3060] T 753ee9c1b94445558ea041a6af8840ef P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Advancing to term 1
08:08:46.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.815352  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f15d82f9ab44ea68386995444340bdc" candidate_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fecbf6c21a40400fac9aa6a557be405c" is_pre_election: true
08:08:46.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.817773  3277 raft_consensus.cc:2468] T 8f15d82f9ab44ea68386995444340bdc P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e3589ebfaf94fe5849b6322dc8e0be0 in term 0.
08:08:46.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.819380  3011 leader_election.cc:304] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e3589ebfaf94fe5849b6322dc8e0be0, fecbf6c21a40400fac9aa6a557be405c; no voters: 0eddb522ea89403b931e52e7ea0a535b
08:08:46.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.820394  3570 raft_consensus.cc:2804] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:08:46.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.820757  3570 raft_consensus.cc:493] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:08:46.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.821089  3570 raft_consensus.cc:3060] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Advancing to term 1
08:08:46.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.821403  3560 ts_tablet_manager.cc:1434] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.010s
08:08:46.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.769769  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c2bc0e61f964830a3058e48aa1f73e7" candidate_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fecbf6c21a40400fac9aa6a557be405c"
08:08:46.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.828644  3570 raft_consensus.cc:515] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.830693  3570 leader_election.cc:290] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0 [CANDIDATE]: Term 1 election: Requested vote from peers 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135), fecbf6c21a40400fac9aa6a557be405c (127.2.90.131:33107)
08:08:46.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.832487  2923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f15d82f9ab44ea68386995444340bdc" candidate_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0eddb522ea89403b931e52e7ea0a535b"
08:08:46.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:46.833830  3013 leader_election.cc:343] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135): Illegal state: must be running to vote when last-logged opid is not known
08:08:46.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.834129  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f15d82f9ab44ea68386995444340bdc" candidate_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fecbf6c21a40400fac9aa6a557be405c"
08:08:46.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.834748  3277 raft_consensus.cc:3060] T 8f15d82f9ab44ea68386995444340bdc P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Advancing to term 1
08:08:46.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.837218  3278 raft_consensus.cc:3060] T 3c2bc0e61f964830a3058e48aa1f73e7 P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Advancing to term 1
08:08:46.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.857347  3561 tablet_bootstrap.cc:654] T 3c2bc0e61f964830a3058e48aa1f73e7 P 0eddb522ea89403b931e52e7ea0a535b: Neither blocks nor log segments found. Creating new log.
08:08:46.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.876677  3570 raft_consensus.cc:493] T aaa1bd80c257434880e2a4e22043c2fe P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:46.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.877188  3570 raft_consensus.cc:515] T aaa1bd80c257434880e2a4e22043c2fe P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.879427  3570 leader_election.cc:290] T aaa1bd80c257434880e2a4e22043c2fe P 5e3589ebfaf94fe5849b6322dc8e0be0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135), fecbf6c21a40400fac9aa6a557be405c (127.2.90.131:33107)
08:08:46.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.880390  2923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa1bd80c257434880e2a4e22043c2fe" candidate_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0eddb522ea89403b931e52e7ea0a535b" is_pre_election: true
08:08:46.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.881109  2923 raft_consensus.cc:2468] T aaa1bd80c257434880e2a4e22043c2fe P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e3589ebfaf94fe5849b6322dc8e0be0 in term 0.
08:08:46.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.882367  3013 leader_election.cc:304] T aaa1bd80c257434880e2a4e22043c2fe P 5e3589ebfaf94fe5849b6322dc8e0be0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0eddb522ea89403b931e52e7ea0a535b, 5e3589ebfaf94fe5849b6322dc8e0be0; no voters: 
08:08:46.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.883349  3570 raft_consensus.cc:2804] T aaa1bd80c257434880e2a4e22043c2fe P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:08:46.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.883664  3570 raft_consensus.cc:493] T aaa1bd80c257434880e2a4e22043c2fe P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:08:46.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.883960  3570 raft_consensus.cc:3060] T aaa1bd80c257434880e2a4e22043c2fe P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Advancing to term 1
08:08:46.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.882891  3567 raft_consensus.cc:515] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.886914  2922 raft_consensus.cc:2393] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fecbf6c21a40400fac9aa6a557be405c in current term 1: Already voted for candidate 0eddb522ea89403b931e52e7ea0a535b in this term.
08:08:46.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.887477  3561 tablet_bootstrap.cc:492] T 3c2bc0e61f964830a3058e48aa1f73e7 P 0eddb522ea89403b931e52e7ea0a535b: No bootstrap required, opened a new log
08:08:46.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.892560  3568 raft_consensus.cc:515] T 753ee9c1b94445558ea041a6af8840ef P fecbf6c21a40400fac9aa6a557be405c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.893123  3570 raft_consensus.cc:515] T aaa1bd80c257434880e2a4e22043c2fe P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.895411  3277 raft_consensus.cc:2468] T 8f15d82f9ab44ea68386995444340bdc P fecbf6c21a40400fac9aa6a557be405c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e3589ebfaf94fe5849b6322dc8e0be0 in term 1.
08:08:46.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.896217  2922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa1bd80c257434880e2a4e22043c2fe" candidate_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0eddb522ea89403b931e52e7ea0a535b"
08:08:46.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.896528  3570 leader_election.cc:290] T aaa1bd80c257434880e2a4e22043c2fe P 5e3589ebfaf94fe5849b6322dc8e0be0 [CANDIDATE]: Term 1 election: Requested vote from peers 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135), fecbf6c21a40400fac9aa6a557be405c (127.2.90.131:33107)
08:08:46.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.896879  2922 raft_consensus.cc:3060] T aaa1bd80c257434880e2a4e22043c2fe P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Advancing to term 1
08:08:46.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:46.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.888011  3561 ts_tablet_manager.cc:1403] T 3c2bc0e61f964830a3058e48aa1f73e7 P 0eddb522ea89403b931e52e7ea0a535b: Time spent bootstrapping tablet: real 0.094s	user 0.011s	sys 0.001s
08:08:46.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.904711  2922 raft_consensus.cc:2468] T aaa1bd80c257434880e2a4e22043c2fe P 0eddb522ea89403b931e52e7ea0a535b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e3589ebfaf94fe5849b6322dc8e0be0 in term 1.
08:08:46.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.906286  3013 leader_election.cc:304] T aaa1bd80c257434880e2a4e22043c2fe P 5e3589ebfaf94fe5849b6322dc8e0be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0eddb522ea89403b931e52e7ea0a535b, 5e3589ebfaf94fe5849b6322dc8e0be0; no voters: 
08:08:46.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.907213  3570 raft_consensus.cc:2804] T aaa1bd80c257434880e2a4e22043c2fe P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 1 FOLLOWER]: Leader election won for term 1
08:08:46.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.907943  3570 raft_consensus.cc:697] T aaa1bd80c257434880e2a4e22043c2fe P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 1 LEADER]: Becoming Leader. State: Replica: 5e3589ebfaf94fe5849b6322dc8e0be0, State: Running, Role: LEADER
08:08:46.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.908885  3570 consensus_queue.cc:237] T aaa1bd80c257434880e2a4e22043c2fe P 5e3589ebfaf94fe5849b6322dc8e0be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.909304  3275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa1bd80c257434880e2a4e22043c2fe" candidate_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fecbf6c21a40400fac9aa6a557be405c"
08:08:46.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.909235  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa1bd80c257434880e2a4e22043c2fe" candidate_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fecbf6c21a40400fac9aa6a557be405c" is_pre_election: true
08:08:46.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.910094  3275 raft_consensus.cc:3060] T aaa1bd80c257434880e2a4e22043c2fe P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Advancing to term 1
08:08:46.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.912885  3567 leader_election.cc:290] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b [CANDIDATE]: Term 1 election: Requested vote from peers 5e3589ebfaf94fe5849b6322dc8e0be0 (127.2.90.130:34617), fecbf6c21a40400fac9aa6a557be405c (127.2.90.131:33107)
08:08:46.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.915215  3078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753ee9c1b94445558ea041a6af8840ef" candidate_uuid: "0eddb522ea89403b931e52e7ea0a535b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0"
08:08:46.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.915814  3078 raft_consensus.cc:3060] T 753ee9c1b94445558ea041a6af8840ef P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Advancing to term 1
08:08:46.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.904865  3561 raft_consensus.cc:359] T 3c2bc0e61f964830a3058e48aa1f73e7 P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.919216  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753ee9c1b94445558ea041a6af8840ef" candidate_uuid: "0eddb522ea89403b931e52e7ea0a535b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fecbf6c21a40400fac9aa6a557be405c"
08:08:46.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.919166  3561 raft_consensus.cc:385] T 3c2bc0e61f964830a3058e48aa1f73e7 P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:46.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.920861  3561 raft_consensus.cc:740] T 3c2bc0e61f964830a3058e48aa1f73e7 P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0eddb522ea89403b931e52e7ea0a535b, State: Initialized, Role: FOLLOWER
08:08:46.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.921594  3561 consensus_queue.cc:260] T 3c2bc0e61f964830a3058e48aa1f73e7 P 0eddb522ea89403b931e52e7ea0a535b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.923873  3561 ts_tablet_manager.cc:1434] T 3c2bc0e61f964830a3058e48aa1f73e7 P 0eddb522ea89403b931e52e7ea0a535b: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
08:08:46.947 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:46.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.924882  3561 tablet_bootstrap.cc:492] T fa47c603eff647ba8370b640a0a12ca5 P 0eddb522ea89403b931e52e7ea0a535b: Bootstrap starting.
08:08:46.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.939868  3275 raft_consensus.cc:2468] T aaa1bd80c257434880e2a4e22043c2fe P fecbf6c21a40400fac9aa6a557be405c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e3589ebfaf94fe5849b6322dc8e0be0 in term 1.
08:08:46.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.942646  3011 leader_election.cc:304] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e3589ebfaf94fe5849b6322dc8e0be0, fecbf6c21a40400fac9aa6a557be405c; no voters: 0eddb522ea89403b931e52e7ea0a535b
08:08:46.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.943526  3570 raft_consensus.cc:2804] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 1 FOLLOWER]: Leader election won for term 1
08:08:46.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.944485  3604 raft_consensus.cc:493] T 3c2bc0e61f964830a3058e48aa1f73e7 P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:46.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.944962  3604 raft_consensus.cc:515] T 3c2bc0e61f964830a3058e48aa1f73e7 P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.944317  3278 raft_consensus.cc:2468] T 3c2bc0e61f964830a3058e48aa1f73e7 P fecbf6c21a40400fac9aa6a557be405c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e3589ebfaf94fe5849b6322dc8e0be0 in term 1.
08:08:46.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.947369  3011 leader_election.cc:304] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e3589ebfaf94fe5849b6322dc8e0be0, fecbf6c21a40400fac9aa6a557be405c; no voters: 0eddb522ea89403b931e52e7ea0a535b
08:08:46.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.947464  3604 leader_election.cc:290] T 3c2bc0e61f964830a3058e48aa1f73e7 P 0eddb522ea89403b931e52e7ea0a535b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e3589ebfaf94fe5849b6322dc8e0be0 (127.2.90.130:34617), fecbf6c21a40400fac9aa6a557be405c (127.2.90.131:33107)
08:08:46.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.948911  3584 raft_consensus.cc:2804] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 1 FOLLOWER]: Leader election won for term 1
08:08:46.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.950533  3077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c2bc0e61f964830a3058e48aa1f73e7" candidate_uuid: "0eddb522ea89403b931e52e7ea0a535b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" is_pre_election: true
08:08:46.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.957080  3561 tablet_bootstrap.cc:654] T fa47c603eff647ba8370b640a0a12ca5 P 0eddb522ea89403b931e52e7ea0a535b: Neither blocks nor log segments found. Creating new log.
08:08:46.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.959022  3570 raft_consensus.cc:697] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 1 LEADER]: Becoming Leader. State: Replica: 5e3589ebfaf94fe5849b6322dc8e0be0, State: Running, Role: LEADER
08:08:46.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.960215  3584 raft_consensus.cc:697] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 1 LEADER]: Becoming Leader. State: Replica: 5e3589ebfaf94fe5849b6322dc8e0be0, State: Running, Role: LEADER
08:08:46.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.961069  3584 consensus_queue.cc:237] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.960058  3570 consensus_queue.cc:237] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:46.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.971575  2922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753ee9c1b94445558ea041a6af8840ef" candidate_uuid: "fecbf6c21a40400fac9aa6a557be405c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0eddb522ea89403b931e52e7ea0a535b"
08:08:46.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.973503  2922 raft_consensus.cc:2393] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fecbf6c21a40400fac9aa6a557be405c in current term 1: Already voted for candidate 0eddb522ea89403b931e52e7ea0a535b in this term.
08:08:46.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.974256  3568 leader_election.cc:290] T 753ee9c1b94445558ea041a6af8840ef P fecbf6c21a40400fac9aa6a557be405c [CANDIDATE]: Term 1 election: Requested vote from peers 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135), 5e3589ebfaf94fe5849b6322dc8e0be0 (127.2.90.130:34617)
08:08:46.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.975880  3077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753ee9c1b94445558ea041a6af8840ef" candidate_uuid: "fecbf6c21a40400fac9aa6a557be405c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0"
08:08:46.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.982702  3276 raft_consensus.cc:2393] T 753ee9c1b94445558ea041a6af8840ef P fecbf6c21a40400fac9aa6a557be405c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0eddb522ea89403b931e52e7ea0a535b in current term 1: Already voted for candidate fecbf6c21a40400fac9aa6a557be405c in this term.
08:08:46.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.983180  3213 leader_election.cc:304] T 753ee9c1b94445558ea041a6af8840ef P fecbf6c21a40400fac9aa6a557be405c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fecbf6c21a40400fac9aa6a557be405c; no voters: 0eddb522ea89403b931e52e7ea0a535b, 5e3589ebfaf94fe5849b6322dc8e0be0
08:08:46.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.984289  3568 raft_consensus.cc:2749] T 753ee9c1b94445558ea041a6af8840ef P fecbf6c21a40400fac9aa6a557be405c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
08:08:46.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.991818  3561 tablet_bootstrap.cc:492] T fa47c603eff647ba8370b640a0a12ca5 P 0eddb522ea89403b931e52e7ea0a535b: No bootstrap required, opened a new log
08:08:46.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.992511  3561 ts_tablet_manager.cc:1403] T fa47c603eff647ba8370b640a0a12ca5 P 0eddb522ea89403b931e52e7ea0a535b: Time spent bootstrapping tablet: real 0.068s	user 0.008s	sys 0.006s
08:08:47.041 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:47.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:46.999368  3561 raft_consensus.cc:359] T fa47c603eff647ba8370b640a0a12ca5 P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } } peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } }
08:08:47.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.002053  3561 raft_consensus.cc:385] T fa47c603eff647ba8370b640a0a12ca5 P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:47.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.002138  3078 raft_consensus.cc:2468] T 753ee9c1b94445558ea041a6af8840ef P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0eddb522ea89403b931e52e7ea0a535b in term 1.
08:08:47.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.002362  3561 raft_consensus.cc:740] T fa47c603eff647ba8370b640a0a12ca5 P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0eddb522ea89403b931e52e7ea0a535b, State: Initialized, Role: FOLLOWER
08:08:47.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.003214  3561 consensus_queue.cc:260] T fa47c603eff647ba8370b640a0a12ca5 P 0eddb522ea89403b931e52e7ea0a535b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } } peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } }
08:08:47.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.003750  2858 leader_election.cc:304] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0eddb522ea89403b931e52e7ea0a535b, 5e3589ebfaf94fe5849b6322dc8e0be0; no voters: fecbf6c21a40400fac9aa6a557be405c
08:08:47.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.004719  3584 consensus_queue.cc:1048] T 680fb2eae00541b09ee3fae8748d9ec4 P 5e3589ebfaf94fe5849b6322dc8e0be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:08:47.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.006945  3567 raft_consensus.cc:2804] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b [term 1 FOLLOWER]: Leader election won for term 1
08:08:47.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.007522  3567 raft_consensus.cc:697] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b [term 1 LEADER]: Becoming Leader. State: Replica: 0eddb522ea89403b931e52e7ea0a535b, State: Running, Role: LEADER
08:08:47.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.008698  3567 consensus_queue.cc:237] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:47.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.010746  3561 ts_tablet_manager.cc:1434] T fa47c603eff647ba8370b640a0a12ca5 P 0eddb522ea89403b931e52e7ea0a535b: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
08:08:47.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.013677  3561 tablet_bootstrap.cc:492] T 8f15d82f9ab44ea68386995444340bdc P 0eddb522ea89403b931e52e7ea0a535b: Bootstrap starting.
08:08:47.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.043104  3561 tablet_bootstrap.cc:654] T 8f15d82f9ab44ea68386995444340bdc P 0eddb522ea89403b931e52e7ea0a535b: Neither blocks nor log segments found. Creating new log.
08:08:47.062 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:47.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.062994  3608 consensus_queue.cc:1048] T 680fb2eae00541b09ee3fae8748d9ec4 P 5e3589ebfaf94fe5849b6322dc8e0be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:08:47.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.067407  3561 tablet_bootstrap.cc:492] T 8f15d82f9ab44ea68386995444340bdc P 0eddb522ea89403b931e52e7ea0a535b: No bootstrap required, opened a new log
08:08:47.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.067906  3561 ts_tablet_manager.cc:1403] T 8f15d82f9ab44ea68386995444340bdc P 0eddb522ea89403b931e52e7ea0a535b: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.000s
08:08:47.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.070943  3561 raft_consensus.cc:359] T 8f15d82f9ab44ea68386995444340bdc P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:47.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.071754  3561 raft_consensus.cc:385] T 8f15d82f9ab44ea68386995444340bdc P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:47.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.072026  3561 raft_consensus.cc:740] T 8f15d82f9ab44ea68386995444340bdc P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0eddb522ea89403b931e52e7ea0a535b, State: Initialized, Role: FOLLOWER
08:08:47.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.072767  3561 consensus_queue.cc:260] T 8f15d82f9ab44ea68386995444340bdc P 0eddb522ea89403b931e52e7ea0a535b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:47.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.072513  3277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c2bc0e61f964830a3058e48aa1f73e7" candidate_uuid: "0eddb522ea89403b931e52e7ea0a535b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fecbf6c21a40400fac9aa6a557be405c" is_pre_election: true
08:08:47.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.075201  3561 ts_tablet_manager.cc:1434] T 8f15d82f9ab44ea68386995444340bdc P 0eddb522ea89403b931e52e7ea0a535b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
08:08:47.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.104987  3277 raft_consensus.cc:2393] T 3c2bc0e61f964830a3058e48aa1f73e7 P fecbf6c21a40400fac9aa6a557be405c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0eddb522ea89403b931e52e7ea0a535b in current term 1: Already voted for candidate 5e3589ebfaf94fe5849b6322dc8e0be0 in this term.
08:08:47.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.106588  2856 leader_election.cc:304] T 3c2bc0e61f964830a3058e48aa1f73e7 P 0eddb522ea89403b931e52e7ea0a535b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0eddb522ea89403b931e52e7ea0a535b; no voters: 5e3589ebfaf94fe5849b6322dc8e0be0, fecbf6c21a40400fac9aa6a557be405c
08:08:47.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.107686  3604 raft_consensus.cc:3060] T 3c2bc0e61f964830a3058e48aa1f73e7 P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Advancing to term 1
08:08:47.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.099968  2659 catalog_manager.cc:5696] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e3589ebfaf94fe5849b6322dc8e0be0 (127.2.90.130). New cstate: current_term: 1 leader_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } health_report { overall_health: UNKNOWN } } }
08:08:47.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.116633  3604 raft_consensus.cc:2749] T 3c2bc0e61f964830a3058e48aa1f73e7 P 0eddb522ea89403b931e52e7ea0a535b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
08:08:47.122 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:47.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.128999  2659 catalog_manager.cc:5696] T aaa1bd80c257434880e2a4e22043c2fe P 5e3589ebfaf94fe5849b6322dc8e0be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e3589ebfaf94fe5849b6322dc8e0be0 (127.2.90.130). New cstate: current_term: 1 leader_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } health_report { overall_health: UNKNOWN } } }
08:08:47.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.147686  2659 catalog_manager.cc:5696] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e3589ebfaf94fe5849b6322dc8e0be0 (127.2.90.130). New cstate: current_term: 1 leader_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } health_report { overall_health: UNKNOWN } } }
08:08:47.173 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:47.175 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:47.175 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:47.175 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:47.175 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:47.175 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:47.175 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:47.175 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:47.175 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:47.175 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:47.176 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:47.176 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:47.176 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:47.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.179468  3568 raft_consensus.cc:493] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:47.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.180027  3568 raft_consensus.cc:515] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } } peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } }
08:08:47.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.182145  3568 leader_election.cc:290] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135), 5e3589ebfaf94fe5849b6322dc8e0be0 (127.2.90.130:34617)
08:08:47.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.184149  2922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa47c603eff647ba8370b640a0a12ca5" candidate_uuid: "fecbf6c21a40400fac9aa6a557be405c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0eddb522ea89403b931e52e7ea0a535b" is_pre_election: true
08:08:47.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.184778  3078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa47c603eff647ba8370b640a0a12ca5" candidate_uuid: "fecbf6c21a40400fac9aa6a557be405c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" is_pre_election: true
08:08:47.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.184873  2922 raft_consensus.cc:2468] T fa47c603eff647ba8370b640a0a12ca5 P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fecbf6c21a40400fac9aa6a557be405c in term 0.
08:08:47.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.185457  3078 raft_consensus.cc:2468] T fa47c603eff647ba8370b640a0a12ca5 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fecbf6c21a40400fac9aa6a557be405c in term 0.
08:08:47.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.187618  3213 leader_election.cc:304] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e3589ebfaf94fe5849b6322dc8e0be0, fecbf6c21a40400fac9aa6a557be405c; no voters: 
08:08:47.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.190601  3568 raft_consensus.cc:2804] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Leader pre-election won for term 1
08:08:47.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.190981  3568 raft_consensus.cc:493] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:08:47.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.191299  3568 raft_consensus.cc:3060] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c [term 0 FOLLOWER]: Advancing to term 1
08:08:47.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.201599  3568 raft_consensus.cc:515] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } } peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } }
08:08:47.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.219300  2922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa47c603eff647ba8370b640a0a12ca5" candidate_uuid: "fecbf6c21a40400fac9aa6a557be405c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0eddb522ea89403b931e52e7ea0a535b"
08:08:47.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.219893  2922 raft_consensus.cc:3060] T fa47c603eff647ba8370b640a0a12ca5 P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Advancing to term 1
08:08:47.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.218048  2660 catalog_manager.cc:5696] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b reported cstate change: term changed from 0 to 1, leader changed from <none> to 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129). New cstate: current_term: 1 leader_uuid: "0eddb522ea89403b931e52e7ea0a535b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } health_report { overall_health: UNKNOWN } } }
08:08:47.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.223543  3568 leader_election.cc:290] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c [CANDIDATE]: Term 1 election: Requested vote from peers 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135), 5e3589ebfaf94fe5849b6322dc8e0be0 (127.2.90.130:34617)
08:08:47.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.224305  3078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa47c603eff647ba8370b640a0a12ca5" candidate_uuid: "fecbf6c21a40400fac9aa6a557be405c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0"
08:08:47.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.224897  3078 raft_consensus.cc:3060] T fa47c603eff647ba8370b640a0a12ca5 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 0 FOLLOWER]: Advancing to term 1
08:08:47.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.228662  2922 raft_consensus.cc:2468] T fa47c603eff647ba8370b640a0a12ca5 P 0eddb522ea89403b931e52e7ea0a535b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fecbf6c21a40400fac9aa6a557be405c in term 1.
08:08:47.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.229794  3213 leader_election.cc:304] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0eddb522ea89403b931e52e7ea0a535b, fecbf6c21a40400fac9aa6a557be405c; no voters: 
08:08:47.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.232827  3568 raft_consensus.cc:2804] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c [term 1 FOLLOWER]: Leader election won for term 1
08:08:47.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.233457  3568 raft_consensus.cc:697] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c [term 1 LEADER]: Becoming Leader. State: Replica: fecbf6c21a40400fac9aa6a557be405c, State: Running, Role: LEADER
08:08:47.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.235709  3568 consensus_queue.cc:237] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } } peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } }
08:08:47.264 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:47.264 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:47.264 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:47.264 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:47.265 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:47.265 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:47.265 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:47.265 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:47.265 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:47.265 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:47.265 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:47.265 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:47.266 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:47.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.266319  3567 raft_consensus.cc:493] T 8f15d82f9ab44ea68386995444340bdc P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:47.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.266969  3567 raft_consensus.cc:515] T 8f15d82f9ab44ea68386995444340bdc P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:47.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.270900  3278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f15d82f9ab44ea68386995444340bdc" candidate_uuid: "0eddb522ea89403b931e52e7ea0a535b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fecbf6c21a40400fac9aa6a557be405c" is_pre_election: true
08:08:47.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.271751  3278 raft_consensus.cc:2393] T 8f15d82f9ab44ea68386995444340bdc P fecbf6c21a40400fac9aa6a557be405c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0eddb522ea89403b931e52e7ea0a535b in current term 1: Already voted for candidate 5e3589ebfaf94fe5849b6322dc8e0be0 in this term.
08:08:47.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.269553  3567 leader_election.cc:290] T 8f15d82f9ab44ea68386995444340bdc P 0eddb522ea89403b931e52e7ea0a535b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e3589ebfaf94fe5849b6322dc8e0be0 (127.2.90.130:34617), fecbf6c21a40400fac9aa6a557be405c (127.2.90.131:33107)
08:08:47.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.274245  3077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f15d82f9ab44ea68386995444340bdc" candidate_uuid: "0eddb522ea89403b931e52e7ea0a535b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" is_pre_election: true
08:08:47.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.275867  2858 leader_election.cc:304] T 8f15d82f9ab44ea68386995444340bdc P 0eddb522ea89403b931e52e7ea0a535b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0eddb522ea89403b931e52e7ea0a535b; no voters: 5e3589ebfaf94fe5849b6322dc8e0be0, fecbf6c21a40400fac9aa6a557be405c
08:08:47.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.276194  3078 raft_consensus.cc:2468] T fa47c603eff647ba8370b640a0a12ca5 P 5e3589ebfaf94fe5849b6322dc8e0be0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fecbf6c21a40400fac9aa6a557be405c in term 1.
08:08:47.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.276750  3567 raft_consensus.cc:3060] T 8f15d82f9ab44ea68386995444340bdc P 0eddb522ea89403b931e52e7ea0a535b [term 0 FOLLOWER]: Advancing to term 1
08:08:47.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.302977  2660 catalog_manager.cc:5696] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c reported cstate change: term changed from 0 to 1, leader changed from <none> to fecbf6c21a40400fac9aa6a557be405c (127.2.90.131). New cstate: current_term: 1 leader_uuid: "fecbf6c21a40400fac9aa6a557be405c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } health_report { overall_health: UNKNOWN } } }
08:08:47.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.317008  3567 raft_consensus.cc:2749] T 8f15d82f9ab44ea68386995444340bdc P 0eddb522ea89403b931e52e7ea0a535b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
08:08:47.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.322431  3570 consensus_queue.cc:1048] T aaa1bd80c257434880e2a4e22043c2fe P 5e3589ebfaf94fe5849b6322dc8e0be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:08:47.338 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:47.338 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:47.338 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:47.339 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:47.339 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:47.339 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:47.339 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:47.339 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:47.339 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:47.340 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:47.340 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:47.340 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:47.340 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.389261  3570 consensus_queue.cc:1048] T aaa1bd80c257434880e2a4e22043c2fe P 5e3589ebfaf94fe5849b6322dc8e0be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:08:47.401 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:47.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.401826  3570 consensus_queue.cc:1048] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:08:47.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.442240  3609 consensus_queue.cc:1048] T 3c2bc0e61f964830a3058e48aa1f73e7 P 5e3589ebfaf94fe5849b6322dc8e0be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:08:47.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.443594  3609 consensus_queue.cc:1048] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:08:47.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:47.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.513264  3567 consensus_queue.cc:1048] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:08:47.540 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:47.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.551280  3604 consensus_queue.cc:1048] T 753ee9c1b94445558ea041a6af8840ef P 0eddb522ea89403b931e52e7ea0a535b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:08:47.562 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:47.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.604117  3584 consensus_queue.cc:1048] T 8f15d82f9ab44ea68386995444340bdc P 5e3589ebfaf94fe5849b6322dc8e0be0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:08:47.620 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:47.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.651357  3568 consensus_queue.cc:1048] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:08:47.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:47.695624  3605 consensus_queue.cc:1048] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:08:47.800 [DEBUG - main] (Connection.java:575) [peer master-127.1.134.252:42093(127.1.134.252:42093)] disconnecting while in state READY
08:08:47.800 [DEBUG - main] (Connection.java:575) [peer master-127.1.134.253:41425(127.1.134.253:41425)] disconnecting while in state READY
08:08:47.800 [DEBUG - main] (Connection.java:575) [peer master-127.1.134.254:38449(127.1.134.254:38449)] disconnecting while in state READY
08:08:47.801 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.1.134.252:42093(127.1.134.252:42093)] handling channelInactive
08:08:47.801 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state READY due to: connection closed
08:08:47.804 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:47.806 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.1.134.254:38449(127.1.134.254:38449)] handling channelInactive
08:08:47.807 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state READY due to: connection closed
08:08:47.808 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
08:08:47.809 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-2
08:08:47.819 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.1.134.253:41425(127.1.134.253:41425)] handling channelInactive
08:08:47.819 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state READY due to: connection closed
08:08:47.819 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-1
08:08:47.819 [DEBUG - main] (Connection.java:575) [peer master-127.2.90.189:41065(127.2.90.189:41065)] disconnecting while in state READY
08:08:47.819 [DEBUG - main] (Connection.java:575) [peer master-127.2.90.190:42265(127.2.90.190:42265)] disconnecting while in state READY
08:08:47.820 [DEBUG - main] (Connection.java:575) [peer master-127.2.90.188:42457(127.2.90.188:42457)] disconnecting while in state READY
08:08:47.820 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.2.90.189:41065(127.2.90.189:41065)] handling channelInactive
08:08:47.820 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state READY due to: connection closed
08:08:47.820 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.2.90.190:42265(127.2.90.190:42265)] handling channelInactive
08:08:47.821 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state READY due to: connection closed
08:08:47.822 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:47.824 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-2
08:08:47.825 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:47.825 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:47.825 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:47.826 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:47.826 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:47.826 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:47.826 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:47.826 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:47.826 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:47.827 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:47.827 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:47.827 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:47.827 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:47.830 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:08:47.835 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.2.90.188:42457(127.2.90.188:42457)] handling channelInactive
08:08:47.835 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state READY due to: connection closed
08:08:47.835 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-1
08:08:47.837 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:08:47.838 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
08:08:47.838 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
08:08:47.838 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:08:47.838 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:08:47.839 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:08:47.856 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
08:08:47.856 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
08:08:47.856 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
08:08:47.856 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
08:08:47.856 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
08:08:47.857 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
08:08:47.857 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
08:08:47.900 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:47.944 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:47.945 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:47.945 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:47.945 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:47.945 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:47.945 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:47.945 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:47.945 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:47.945 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:47.945 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:47.945 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:47.945 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:47.946 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:47.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:48.040 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:48.062 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:48.116 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
08:08:48.119 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:48.158 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:48.158 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:48.158 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:48.159 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:48.159 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:48.159 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:48.159 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:48.159 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:48.159 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:48.161 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:48.162 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:48.162 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:48.162 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:48.181 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
08:08:48.182 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
08:08:48.182 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
08:08:48.203 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
08:08:48.383 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:48.384 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:48.384 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:48.384 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:48.384 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:48.385 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:48.385 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:48.385 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:48.386 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:48.386 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:48.386 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:48.386 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:48.386 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:48.400 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:48.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:48.498 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:48.498 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:48.498 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:48.498 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:48.498 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:48.498 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:48.498 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:48.498 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:48.499 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:48.499 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:48.499 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:48.499 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:48.499 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:48.543 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:48.562 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:48.620 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:48.891 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:48.891 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:48.891 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:48.891 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:48.891 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:48.891 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:48.892 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:48.892 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:48.892 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:48.892 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:48.892 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:48.892 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:48.892 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:48.899 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:48.899 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:48.899 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:48.900 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:48.900 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:48.900 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:48.900 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:48.900 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:48.900 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:48.900 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:48.901 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:48.901 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:48.901 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:48.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:48.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:48.963 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:48.963 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:48.963 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:48.963 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:48.964 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:48.964 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:48.964 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:48.964 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:48.964 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:48.964 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:48.964 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:48.964 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:48.964 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:49.024 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:49.025 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:49.025 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:49.025 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:49.025 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:49.025 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:49.025 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:49.025 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:49.026 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:49.026 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:49.026 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:49.026 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:49.026 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:49.041 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:49.062 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:49.071 [INFO - flink-pekko.actor.default-dispatcher-4] (Slf4jLogger.scala:117) Slf4jLogger started
08:08:49.092 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:49.092 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:49.092 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:49.093 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:49.093 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:49.093 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:49.093 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:49.093 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:49.093 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:49.093 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:49.093 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:49.093 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:49.094 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:49.109 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:49.109 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:49.109 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:49.109 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:49.110 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:49.110 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:49.110 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:49.110 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:49.110 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:49.110 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:49.110 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:49.110 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:49.110 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:49.120 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:49.143 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:49.143 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:49.143 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:49.143 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:49.144 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:49.144 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:49.144 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:49.144 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:49.144 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:49.144 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:49.144 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:49.144 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:49.144 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:49.266 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
08:08:49.287 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
08:08:49.300 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:49.300 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:49.301 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:49.301 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:49.301 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:49.301 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:49.301 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:49.301 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:49.301 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:49.301 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:49.302 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:49.301 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:49.302 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:49.318 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
08:08:49.329 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:49.329 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:49.329 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:49.329 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:49.329 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:49.329 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:49.329 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:49.329 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:49.329 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:49.332 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:49.332 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:49.332 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:49.332 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:49.346 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
08:08:49.370 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
08:08:49.379 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
08:08:49.380 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
08:08:49.380 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
08:08:49.381 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
08:08:49.381 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
08:08:49.381 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
08:08:49.381 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
08:08:49.382 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
08:08:49.382 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
08:08:49.383 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
08:08:49.383 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
08:08:49.383 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
08:08:49.383 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
08:08:49.383 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
08:08:49.383 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
08:08:49.384 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
08:08:49.384 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
08:08:49.384 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
08:08:49.384 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
08:08:49.384 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
08:08:49.384 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
08:08:49.385 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
08:08:49.385 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
08:08:49.385 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
08:08:49.385 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_6d838f237e8c99d39078ef3ea05330b6/blobStorage
08:08:49.386 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:45149 - max concurrent requests: 50 - max backlog: 1000
08:08:49.389 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_6d838f237e8c99d39078ef3ea05330b6/blobStorage
08:08:49.394 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_6d838f237e8c99d39078ef3ea05330b6/blobStorage
08:08:49.395 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
08:08:49.396 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: 3f9ef920-d0fb-4b4e-a9c9-7b0ceae74c90
08:08:49.398 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 37 GB (77.08% usable)
08:08:49.398 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-0a9fae6f-2789-436d-8fb8-b056466ce212
08:08:49.400 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-04ecfb96-49ed-44fa-b1a2-d1f56090e293
08:08:49.400 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:49.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:49.538 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:49.538 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:49.539 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:49.539 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:49.539 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:49.539 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:49.539 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:49.539 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:49.539 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:49.539 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:49.539 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:49.540 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:49.540 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:49.540 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:49.562 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:49.564 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
08:08:49.570 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
08:08:49.570 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
08:08:49.570 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
08:08:49.571 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
08:08:49.573 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_20 .
08:08:49.581 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultJobLeaderService.java:127) Start job leader service.
08:08:49.581 [INFO - flink-pekko.actor.default-dispatcher-4] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-071a76e9-40a7-4fcc-9e58-b63f45e6157b
08:08:49.582 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
08:08:49.582 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
08:08:49.594 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
08:08:49.594 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
08:08:49.607 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:40673
08:08:49.608 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
08:08:49.623 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:49.628 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:40673 was granted leadership with leaderSessionID=025cbeba-07f1-4803-afd3-372601e5aedc
08:08:49.628 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:40673 , session=025cbeba-07f1-4803-afd3-372601e5aedc
08:08:49.629 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
08:08:49.637 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
08:08:49.638 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id b4aeae96-ff8b-4186-8c41-01dfff3a13ee. Creating new DispatcherLeaderProcess.
08:08:49.638 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
08:08:49.638 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
08:08:49.647 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
08:08:49.647 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
08:08:49.652 [INFO - mini-cluster-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_21 .
08:08:49.652 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:49.653 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:49.653 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:49.653 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:49.653 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:49.654 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:49.654 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:49.654 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:49.654 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:49.654 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:49.654 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:49.654 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:49.654 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:49.662 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
08:08:49.666 [INFO - pool-387-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id 0697a542-3a47-44a2-a62e-7816a7199f19.
08:08:49.670 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_21 , session=b4aeae96-ff8b-4186-8c41-01dfff3a13ee
08:08:49.682 [INFO - pool-387-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_22 .
08:08:49.700 [INFO - flink-pekko.actor.default-dispatcher-6] (ResourceManager.java:253) Starting the resource manager.
08:08:49.701 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:212) Starting the slot manager.
08:08:49.701 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultDelegationTokenManager.java:308) Starting tokens update task
08:08:49.701 [WARN - flink-pekko.actor.default-dispatcher-6] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
08:08:49.701 [WARN - flink-pekko.actor.default-dispatcher-6] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
08:08:49.702 [INFO - mini-cluster-io-thread-3] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_22 , session=0697a542-3a47-44a2-a62e-7816a7199f19
08:08:49.714 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_22(a62e7816a7199f190697a5423a4744a2).
08:08:49.725 [INFO - flink-pekko.actor.default-dispatcher-6] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
08:08:49.734 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:1080) Registering TaskManager with ResourceID 3f9ef920-d0fb-4b4e-a9c9-7b0ceae74c90 (pekko://flink/user/rpc/taskmanager_20) at ResourceManager
08:08:49.735 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_22 under registration id b618a67fca22fe9381889811eb07f3d5.
08:08:49.735 [INFO - flink-pekko.actor.default-dispatcher-6] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (09c2845f1c2e95ee63afce247a128bdd).
08:08:49.736 [INFO - flink-pekko.actor.default-dispatcher-6] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (09c2845f1c2e95ee63afce247a128bdd).
08:08:49.736 [INFO - flink-pekko.actor.default-dispatcher-6] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-09c2845f1c2e95ee63afce247a128bdd'.
08:08:49.737 [INFO - mini-cluster-io-thread-3] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job 09c2845f1c2e95ee63afce247a128bdd was granted leadership with leader id 508fc984-377c-413f-8ccf-5fc6bfd65b13. Creating new JobMasterServiceProcess.
08:08:49.738 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:344) Registering task executor 3f9ef920-d0fb-4b4e-a9c9-7b0ceae74c90 under b618a67fca22fe9381889811eb07f3d5 at the slot manager.
08:08:49.755 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_23 .
08:08:49.768 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (09c2845f1c2e95ee63afce247a128bdd).
08:08:49.770 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (09c2845f1c2e95ee63afce247a128bdd).
08:08:49.771 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph c0551ef584b55b7ad165726b2ceeec4e for job 09c2845f1c2e95ee63afce247a128bdd.
08:08:49.772 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (09c2845f1c2e95ee63afce247a128bdd).
08:08:49.772 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
08:08:49.774 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
08:08:49.775 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2d283655
08:08:49.775 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:49.775 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5480530168178470707/checkpoints")
08:08:49.778 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
08:08:49.779 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@6de0c3ea for Flink Streaming Job (09c2845f1c2e95ee63afce247a128bdd).
08:08:49.780 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_23 , session=508fc984-377c-413f-8ccf-5fc6bfd65b13
08:08:49.782 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (09c2845f1c2e95ee63afce247a128bdd) under job master id 8ccf5fc6bfd65b13508fc984377c413f.
08:08:49.782 [INFO - flink-pekko.actor.default-dispatcher-8] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
08:08:49.787 [DEBUG - flink-pekko.actor.default-dispatcher-8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:49.788 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
08:08:49.788 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (09c2845f1c2e95ee63afce247a128bdd) switched from state CREATED to RUNNING.
08:08:49.789 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
08:08:49.790 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
08:08:49.791 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
08:08:49.791 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
08:08:49.792 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_22(a62e7816a7199f190697a5423a4744a2)
08:08:49.794 [INFO - flink-pekko.actor.default-dispatcher-8] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
08:08:49.795 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:390) Registering job manager 8ccf5fc6bfd65b13508fc984377c413f@pekko://flink/user/rpc/jobmanager_23 for job 09c2845f1c2e95ee63afce247a128bdd.
08:08:49.800 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:1015) Registered job manager 8ccf5fc6bfd65b13508fc984377c413f@pekko://flink/user/rpc/jobmanager_23 for job 09c2845f1c2e95ee63afce247a128bdd.
08:08:49.806 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:08:49.818 [DEBUG - main] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:08:49.829 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:08:49.830 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.1.134.254:38449(127.1.134.254:38449)] Successfully connected to peer
08:08:49.835 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:08:49.836 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.1.134.253:41425(127.1.134.253:41425)] Successfully connected to peer
08:08:49.843 [INFO - flink-pekko.actor.default-dispatcher-4] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: a62e7816a7199f190697a5423a4744a2.
08:08:49.843 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 09c2845f1c2e95ee63afce247a128bdd: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:08:49.844 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.1.134.252:42093(127.1.134.252:42093)] Successfully connected to peer
08:08:49.849 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.253
08:08:49.864 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.254
08:08:49.875 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:49.880 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x366d3e58, L:/127.0.0.1:58306 - R:/127.1.134.254:38449] using SASL/PLAIN
08:08:49.882 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.252
08:08:49.882 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:49.884 [DEBUG - main] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:08:49.884 [DEBUG - main] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:08:49.886 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.2.90.189:41065(127.2.90.189:41065)] Successfully connected to peer
08:08:49.888 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.2.90.188:42457(127.2.90.188:42457)] Successfully connected to peer
08:08:49.890 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x39200e57, L:/127.0.0.1:41898 - R:/127.1.134.253:41425] using SASL/PLAIN
08:08:49.894 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.90.188
08:08:49.899 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.90.189
08:08:49.900 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.2.90.190:42265(127.2.90.190:42265)] Successfully connected to peer
08:08:49.905 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.90.190
08:08:49.906 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:49.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:49.914 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job 09c2845f1c2e95ee63afce247a128bdd
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager 3f9ef920-d0fb-4b4e-a9c9-7b0ceae74c90
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
08:08:49.916 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 75f01cd50c930be6f1c0818f09080115 from 3f9ef920-d0fb-4b4e-a9c9-7b0ceae74c90 for job 09c2845f1c2e95ee63afce247a128bdd with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:08:49.916 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:49.916 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot a4ed639f2cd0d766fcccf42665eb4955 from 3f9ef920-d0fb-4b4e-a9c9-7b0ceae74c90 for job 09c2845f1c2e95ee63afce247a128bdd with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:08:49.916 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1149) Receive slot request 75f01cd50c930be6f1c0818f09080115 for job 09c2845f1c2e95ee63afce247a128bdd from resource manager with leader id a62e7816a7199f190697a5423a4744a2.
08:08:49.917 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:321) Allocated slot for 75f01cd50c930be6f1c0818f09080115 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:08:49.917 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot c4c60e69048e64b8e7b04281803d47ab from 3f9ef920-d0fb-4b4e-a9c9-7b0ceae74c90 for job 09c2845f1c2e95ee63afce247a128bdd with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:08:49.919 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot b35f1e1089e429f924b5ed576b0b012d from 3f9ef920-d0fb-4b4e-a9c9-7b0ceae74c90 for job 09c2845f1c2e95ee63afce247a128bdd with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:08:49.920 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultJobLeaderService.java:192) Add job 09c2845f1c2e95ee63afce247a128bdd for job leader monitoring.
08:08:49.920 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:49.921 [INFO - mini-cluster-io-thread-3] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_23 with leader id 508fc984-377c-413f-8ccf-5fc6bfd65b13.
08:08:49.921 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1149) Receive slot request a4ed639f2cd0d766fcccf42665eb4955 for job 09c2845f1c2e95ee63afce247a128bdd from resource manager with leader id a62e7816a7199f190697a5423a4744a2.
08:08:49.921 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x60370182, L:/127.0.0.1:48248 - R:/127.2.90.190:42265] using SASL/PLAIN
08:08:49.921 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:321) Allocated slot for a4ed639f2cd0d766fcccf42665eb4955 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:08:49.922 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1149) Receive slot request c4c60e69048e64b8e7b04281803d47ab for job 09c2845f1c2e95ee63afce247a128bdd from resource manager with leader id a62e7816a7199f190697a5423a4744a2.
08:08:49.922 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:321) Allocated slot for c4c60e69048e64b8e7b04281803d47ab with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:08:49.924 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request b35f1e1089e429f924b5ed576b0b012d for job 09c2845f1c2e95ee63afce247a128bdd from resource manager with leader id a62e7816a7199f190697a5423a4744a2.
08:08:49.924 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for b35f1e1089e429f924b5ed576b0b012d with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:08:49.924 [INFO - flink-pekko.actor.default-dispatcher-6] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
08:08:49.926 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_23 for job 09c2845f1c2e95ee63afce247a128bdd.
08:08:49.927 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1783) Establish JobManager connection for job 09c2845f1c2e95ee63afce247a128bdd.
08:08:49.927 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 09c2845f1c2e95ee63afce247a128bdd.
08:08:49.930 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
08:08:49.930 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 3f9ef920-d0fb-4b4e-a9c9-7b0ceae74c90 @ 127.0.0.1 (dataPort=-1) with allocation id a4ed639f2cd0d766fcccf42665eb4955
08:08:49.931 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot a4ed639f2cd0d766fcccf42665eb4955.
08:08:49.934 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job 09c2845f1c2e95ee63afce247a128bdd.
08:08:49.934 [INFO - flink-pekko.actor.default-dispatcher-7] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
08:08:49.934 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id 09c2845f1c2e95ee63afce247a128bdd
08:08:49.935 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x4ab4cb5f, L:/127.0.0.1:51500 - R:/127.1.134.252:42093] using SASL/PLAIN
08:08:49.935 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
08:08:49.935 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 3f9ef920-d0fb-4b4e-a9c9-7b0ceae74c90 @ 127.0.0.1 (dataPort=-1) with allocation id 75f01cd50c930be6f1c0818f09080115
08:08:49.936 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
08:08:49.936 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 3f9ef920-d0fb-4b4e-a9c9-7b0ceae74c90 @ 127.0.0.1 (dataPort=-1) with allocation id c4c60e69048e64b8e7b04281803d47ab
08:08:49.938 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id a4ed639f2cd0d766fcccf42665eb4955.
08:08:49.938 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
08:08:49.938 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 3f9ef920-d0fb-4b4e-a9c9-7b0ceae74c90 @ 127.0.0.1 (dataPort=-1) with allocation id b35f1e1089e429f924b5ed576b0b012d
08:08:49.940 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
08:08:49.940 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
08:08:49.941 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 75f01cd50c930be6f1c0818f09080115.
08:08:49.942 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:08:49.943 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:49.943 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=139), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [85ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: OK, [91ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: OK, [137ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: OK, deferred=null) after lookup
08:08:49.943 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:49.943 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:49.943 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6a97b0ac
08:08:49.943 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:49.944 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:49.944 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:49.944 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:49.945 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:49.945 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:49.945 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:49.945 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5480530168178470707/checkpoints")
08:08:49.945 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:49.945 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:49.945 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
08:08:49.945 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:49.946 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
08:08:49.947 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:49.947 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:49.951 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:49.952 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 2a489752354241eebd5d00f80d2b9347
08:08:49.953 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:49.954 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:49.954 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:49.954 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:49.954 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:49.954 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:49.954 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:49.955 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:49.955 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:49.955 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:49.955 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:49.955 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:49.955 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:49.959 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb7e472d8, L:/127.0.0.1:42044 - R:/127.2.90.189:41065] using SASL/PLAIN
08:08:49.976 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:49.981 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 0127c24cdb254b3b9444ea5f96a1b0ab for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
08:08:49.981 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet aa8885af14cf410093b0fc307e337db3 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
08:08:49.981 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 5b322ee1784745bfbf45b3b4ff0b9eee for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
08:08:49.981 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 57ec20d798834ab1a9d6bad82e7002fe for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
08:08:49.982 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 76d8c41bbf134c32947c73f9414f7aab for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
08:08:49.982 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 72ad21258ea34269bce6ae4c80b8e589 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
08:08:49.982 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=0127c24cdb254b3b9444ea5f96a1b0ab@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=aa8885af14cf410093b0fc307e337db3@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=5b322ee1784745bfbf45b3b4ff0b9eee@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)[L],ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=57ec20d798834ab1a9d6bad82e7002fe@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=76d8c41bbf134c32947c73f9414f7aab@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)[L],ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=72ad21258ea34269bce6ae4c80b8e589@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)[L],ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
08:08:49.993 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x77e09f5c, L:/127.0.0.1:52020 - R:/127.2.90.188:42457] using SASL/PLAIN
08:08:50.001 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id 75f01cd50c930be6f1c0818f09080115.
08:08:50.014 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6e8eb8f2
08:08:50.017 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:08:50.017 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=211), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.90.189:41065, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.90.188:42457, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.90.190:42265, [116ms] Sub RPC ConnectToMaster: received response from server master-127.2.90.190:42265: OK, [158ms] Sub RPC ConnectToMaster: received response from server master-127.2.90.189:41065: OK, [198ms] Sub RPC ConnectToMaster: received response from server master-127.2.90.188:42457: OK, deferred=null) after lookup
08:08:50.028 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot c4c60e69048e64b8e7b04281803d47ab.
08:08:50.030 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:50.031 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
08:08:50.031 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
08:08:50.032 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@e76fe38
08:08:50.032 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:50.033 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5480530168178470707/checkpoints")
08:08:50.033 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
08:08:50.034 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
08:08:50.035 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id c4c60e69048e64b8e7b04281803d47ab.
08:08:50.038 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 1365359df50a4068a2562111037df6dd
08:08:50.041 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:50.056 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@10ea2e57
08:08:50.059 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:50.063 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:50.066 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot a4ed639f2cd0d766fcccf42665eb4955.
08:08:50.066 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 75f01cd50c930be6f1c0818f09080115.
08:08:50.066 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot c4c60e69048e64b8e7b04281803d47ab.
08:08:50.066 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot b35f1e1089e429f924b5ed576b0b012d.
08:08:50.066 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot b35f1e1089e429f924b5ed576b0b012d.
08:08:50.067 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
08:08:50.067 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
08:08:50.068 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet fa47c603eff647ba8370b640a0a12ca5 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
08:08:50.068 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 753ee9c1b94445558ea041a6af8840ef for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
08:08:50.068 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 3c2bc0e61f964830a3058e48aa1f73e7 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
08:08:50.068 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet aaa1bd80c257434880e2a4e22043c2fe for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
08:08:50.068 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8f15d82f9ab44ea68386995444340bdc for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
08:08:50.068 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 680fb2eae00541b09ee3fae8748d9ec4 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
08:08:50.069 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=fa47c603eff647ba8370b640a0a12ca5@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617),fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=753ee9c1b94445558ea041a6af8840ef@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135)[L],5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617),fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=3c2bc0e61f964830a3058e48aa1f73e7@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=aaa1bd80c257434880e2a4e22043c2fe@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=8f15d82f9ab44ea68386995444340bdc@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=680fb2eae00541b09ee3fae8748d9ec4@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
08:08:50.069 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id b35f1e1089e429f924b5ed576b0b012d.
08:08:50.070 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=27), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.2.90.188:42457, [26ms] Sub RPC GetTableLocations: received response from server master-127.2.90.188:42457: OK, deferred=null)) after lookup
08:08:50.070 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:08:50.071 [DEBUG - kudu-nio-1] (Connection.java:748) [peer fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)] connecting to peer
08:08:50.072 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5e0bef97
08:08:50.072 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:50.072 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5480530168178470707/checkpoints")
08:08:50.072 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
08:08:50.073 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
08:08:50.077 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:08:50.077 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@284b9882
08:08:50.078 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:08:50.080 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.2.90.189:41065(127.2.90.189:41065)] Successfully connected to peer
08:08:50.083 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:50.083 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:50.083 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:50.083 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
08:08:50.083 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:50.083 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
08:08:50.083 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:50.083 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:50.083 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:50.084 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:50.084 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:50.084 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:50.084 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3bc7808b
08:08:50.084 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.90.189
08:08:50.084 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:50.084 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5480530168178470707/checkpoints")
08:08:50.085 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
08:08:50.085 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
08:08:50.088 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@577b145b
08:08:50.090 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:50.091 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:50.092 [DEBUG - kudu-nio-3] (Connection.java:757) [peer fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)] Successfully connected to peer
08:08:50.094 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:50.094 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:50.100 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:50.100 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:50.101 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:50.101 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:50.101 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:50.101 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:50.103 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:50.103 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:50.103 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:50.104 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:50.104 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:50.104 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:50.104 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:50.119 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:50.122 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:50.125 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:08:50.127 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.2.90.188:42457(127.2.90.188:42457)] Successfully connected to peer
08:08:50.131 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.90.188
08:08:50.133 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:08:50.134 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.2.90.189:41065(127.2.90.189:41065)] Successfully connected to peer
08:08:50.136 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:08:50.139 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:50.139 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:50.140 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:50.140 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:50.140 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:50.140 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:50.141 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:50.141 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:50.141 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:50.141 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:50.141 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:50.141 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:50.141 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:50.146 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:50.208 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:50.209 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:50.209 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:50.210 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:50.211 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:50.212 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:50.215 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:50.215 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:50.215 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:50.216 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:50.216 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:50.216 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:50.216 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:50.231 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x8357de21, L:/127.0.0.1:42052 - R:/127.2.90.189:41065] using SASL/PLAIN
08:08:50.233 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.90.189
08:08:50.254 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:50.254 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:50.255 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:50.255 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:50.256 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:50.256 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:50.256 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:50.256 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:50.256 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:50.256 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:50.256 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:50.256 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:50.256 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:50.257 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:50.257 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:50.257 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:50.257 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:50.257 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:50.257 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:50.257 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:50.258 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:50.260 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:50.260 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:50.260 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:50.257 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:50.261 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:50.261 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:50.261 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:50.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:50.311776  2856 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.90.131:33107, user_credentials={real_user=slave}} blocked reactor thread for 48200.5us
08:08:50.325 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:50.325 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:50.325 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:50.326 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:50.326 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:50.326 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:50.326 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:50.327 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:50.327 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x93253d4f, L:/127.0.0.1:42058 - R:/127.2.90.189:41065] using SASL/PLAIN
08:08:50.327 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:50.334 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:50.334 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:50.334 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:50.334 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:50.341 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:50.348 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x7537716e, L:/127.0.0.1:52022 - R:/127.2.90.188:42457] using SASL/PLAIN
08:08:50.353 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:50.353 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:50.353 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:50.353 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:50.353 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:50.354 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:50.354 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:50.354 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:50.354 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:50.354 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:50.354 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:50.354 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:50.354 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:50.362 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x58b94ae1, L:/127.0.0.1:48342 - R:/127.2.90.131:33107] using TOKEN/null
08:08:50.363 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:50.363 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:50.363 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:50.364 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:50.364 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:50.364 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:50.364 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:50.364 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:50.364 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:50.364 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:50.364 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:50.364 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:50.365 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:50.381 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:08:50.387 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:08:50.387 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=356), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.90.189:41065, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.90.188:42457, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.90.190:42265, [256ms] Sub RPC ConnectToMaster: received response from server master-127.2.90.189:41065: OK, [287ms] Sub RPC ConnectToMaster: received response from server master-127.2.90.188:42457: OK, deferred=null) after lookup
08:08:50.392 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.2.90.190:42265(127.2.90.190:42265)] Successfully connected to peer
08:08:50.396 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 1365359df50a4068a2562111037df6dd
08:08:50.401 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:50.408 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:08:50.409 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:50.410 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 1365359df50a4068a2562111037df6dd
08:08:50.412 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3f4b5711
08:08:50.416 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:08:50.418 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.2.90.189:41065(127.2.90.189:41065)] Successfully connected to peer
08:08:50.418 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
08:08:50.419 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
08:08:50.426 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.90.189
08:08:50.428 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.2.90.188:42457(127.2.90.188:42457)] Successfully connected to peer
08:08:50.432 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.90.188
08:08:50.436 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fa47c603eff647ba8370b640a0a12ca5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:50.436 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fa47c603eff647ba8370b640a0a12ca5 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
08:08:50.437 [DEBUG - main] (Connection.java:748) [peer 0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135)] connecting to peer
08:08:50.440 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:08:50.448 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:50.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:50.454 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:50.454 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:50.454 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:50.455 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:50.455 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:50.455 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:50.456 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:50.456 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:50.456 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:50.456 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:50.456 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:50.456 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:50.456 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:50.441 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.2.90.188:42457(127.2.90.188:42457)] Successfully connected to peer
08:08:50.467 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x0db27139, L:/127.0.0.1:42074 - R:/127.2.90.189:41065] using SASL/PLAIN
08:08:50.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:50.479720  2646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.90.189:41065, user_credentials={real_user=slave}} blocked reactor thread for 206022us
08:08:50.482 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.2.90.190:42265(127.2.90.190:42265)] Successfully connected to peer
08:08:50.498 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:50.501 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
08:08:50.502 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='9f064cea2e475ee46707379dc1378fb0cf7bb119144e9cf2e0193bb0215e764f'}]
08:08:50.507 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:50.508 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.90.190
08:08:50.525 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.90.188
08:08:50.532 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:50.537 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xb4ebde6b, L:/127.0.0.1:52030 - R:/127.2.90.188:42457] using SASL/PLAIN
08:08:50.540 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x01d6b586, L:/127.0.0.1:48250 - R:/127.2.90.190:42265] using TOKEN/null
08:08:50.540 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:50.554 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:50.558 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135)] Successfully connected to peer
08:08:50.562 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:50.563 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x3d3036e5, L:/127.0.0.1:52046 - R:/127.2.90.188:42457] using SASL/PLAIN
08:08:50.564 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:50.569 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x9349151a, L:/127.0.0.1:48260 - R:/127.2.90.190:42265] using SASL/PLAIN
08:08:50.570 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:08:50.570 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=485), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.90.189:41065, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.90.188:42457, [305ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.90.190:42265, [336ms] Sub RPC ConnectToMaster: received response from server master-127.2.90.189:41065: OK, [434ms] Sub RPC ConnectToMaster: received response from server master-127.2.90.188:42457: OK, deferred=null) after lookup
08:08:50.574 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 1365359df50a4068a2562111037df6dd
08:08:50.575 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:08:50.576 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=516), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.90.189:41065, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.90.188:42457, [276ms] Sub RPC ConnectToMaster: received response from server master-127.2.90.189:41065: OK, [330ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.90.190:42265, [463ms] Sub RPC ConnectToMaster: received response from server master-127.2.90.188:42457: OK, deferred=null) after lookup
08:08:50.579 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 1365359df50a4068a2562111037df6dd
08:08:50.582 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.2.90.190:42265(127.2.90.190:42265)] Successfully connected to peer
08:08:50.585 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 1365359df50a4068a2562111037df6dd
08:08:50.586 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@58b1269
08:08:50.589 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 1365359df50a4068a2562111037df6dd
08:08:50.589 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3c197717
08:08:50.595 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:50.598 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:08:50.599 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.2.90.189:41065(127.2.90.189:41065)] Successfully connected to peer
08:08:50.601 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0xf0ff78cb, L:/127.0.0.1:54294 - R:/127.2.90.129:37135] using TOKEN/null
08:08:50.608 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.90.189
08:08:50.609 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:08:50.610 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.2.90.188:42457(127.2.90.188:42457)] Successfully connected to peer
08:08:50.619 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:50.620 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.2.90.190:42265(127.2.90.190:42265)] Successfully connected to peer
08:08:50.625 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
08:08:50.625 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.90.188
08:08:50.630 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
08:08:50.633 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
08:08:50.633 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
08:08:50.633 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
08:08:50.633 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
08:08:50.636 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:50.636 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.90.190
08:08:50.637 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
08:08:50.639 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='b436d13a7bc21fd6ca265ef79d26dd6199500bc76792762e98e1138b5cec2e7e'}]
08:08:50.641 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:50.646 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
08:08:50.647 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='9a829eb6cd2f39aa330c19c755390d5643e1d568888506d5482295c1b1f82be1'}]
08:08:50.649 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:50.654 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:08:50.655 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299997, tablet=5b322ee1784745bfbf45b3b4ff0b9eee@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}]
08:08:50.656 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x9944ebf3, L:/127.0.0.1:48272 - R:/127.2.90.190:42265] using TOKEN/null
08:08:50.656 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=753ee9c1b94445558ea041a6af8840ef, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:50.656 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 753ee9c1b94445558ea041a6af8840ef for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
08:08:50.657 [DEBUG - main] (Connection.java:748) [peer 5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)] connecting to peer
08:08:50.659 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:50.663 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:50.676 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x17dcb90f, L:/127.0.0.1:42088 - R:/127.2.90.189:41065] using SASL/PLAIN
08:08:50.678 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:08:50.679 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299997, tablet=aa8885af14cf410093b0fc307e337db3@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)[L]]}]
08:08:50.681 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:50.682 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x5f05444a, L:/127.0.0.1:52060 - R:/127.2.90.188:42457] using SASL/PLAIN
08:08:50.689 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x6e8098a2, L:/127.0.0.1:48278 - R:/127.2.90.190:42265] using SASL/PLAIN
08:08:50.720 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:08:50.720 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=597), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.90.189:41065, [217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.90.188:42457, [228ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.90.190:42265, [299ms] Sub RPC ConnectToMaster: received response from server master-127.2.90.189:41065: OK, [338ms] Sub RPC ConnectToMaster: received response from server master-127.2.90.190:42265: OK, [338ms] Sub RPC ConnectToMaster: received response from server master-127.2.90.188:42457: OK, deferred=null) after lookup
08:08:50.736 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:08:50.736 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 1365359df50a4068a2562111037df6dd
08:08:50.742 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 1365359df50a4068a2562111037df6dd
08:08:50.743 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299998, tablet=0127c24cdb254b3b9444ea5f96a1b0ab@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)[L]]}]
08:08:50.745 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6dc8df94
08:08:50.759 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] connecting to peer
08:08:50.766 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
08:08:50.768 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
08:08:50.768 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
08:08:50.779 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] connecting to peer
08:08:50.793 [DEBUG - kudu-nio-5] (Connection.java:757) [peer 5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)] Successfully connected to peer
08:08:50.828 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] connecting to peer
08:08:50.844 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:50.862 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0xa5d66060, L:/127.0.0.1:50938 - R:/127.2.90.130:34617] using TOKEN/null
08:08:50.862 [DEBUG - kudu-nio-0] (Connection.java:757) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] Successfully connected to peer
08:08:50.873 [DEBUG - kudu-nio-0] (Connection.java:757) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] Successfully connected to peer
08:08:50.878 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:50.879 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:50.879 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:50.879 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:50.879 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:50.879 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:50.879 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:50.879 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:50.879 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:50.880 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:50.880 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:50.880 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:50.880 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:50.885 [DEBUG - kudu-nio-0] (Connection.java:757) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] Successfully connected to peer
08:08:50.886 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3c2bc0e61f964830a3058e48aa1f73e7, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:50.886 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 3c2bc0e61f964830a3058e48aa1f73e7 for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
08:08:50.890 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.193
08:08:50.895 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=aaa1bd80c257434880e2a4e22043c2fe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:50.895 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet aaa1bd80c257434880e2a4e22043c2fe for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
08:08:50.899 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:50.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:50.902 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
08:08:50.903 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='a253569f330e92a02cdefabb650388e223241e800ac29bc63529c5f4486c2c3b'}]
08:08:50.905 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8f15d82f9ab44ea68386995444340bdc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:50.905 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8f15d82f9ab44ea68386995444340bdc for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
08:08:50.906 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
08:08:50.908 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.193
08:08:50.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091730908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:08:50.915 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:50.931 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.193
08:08:50.935 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=680fb2eae00541b09ee3fae8748d9ec4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:50.935 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 680fb2eae00541b09ee3fae8748d9ec4 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
08:08:50.944 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x72c4e2da, L:/127.0.0.1:47612 - R:/127.1.134.193:41847] using SASL/PLAIN
08:08:50.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:50.949 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:50.959 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd336eea2, L:/127.0.0.1:47618 - R:/127.1.134.193:41847] using SASL/PLAIN
08:08:50.967 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:50.982 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe0b9f3b4, L:/127.0.0.1:47630 - R:/127.1.134.193:41847] using SASL/PLAIN
08:08:51.000 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fa47c603eff647ba8370b640a0a12ca5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.001 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fa47c603eff647ba8370b640a0a12ca5 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
08:08:51.004 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:51.004 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:51.004 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:51.004 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:51.004 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:51.004 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:51.004 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:51.005 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:51.005 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:51.005 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:51.005 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:51.005 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:51.005 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:51.010 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=753ee9c1b94445558ea041a6af8840ef, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.011 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159725273088001) for scanner KuduScanner(table=replication_test_table, tablet=aa8885af14cf410093b0fc307e337db3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.011 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 753ee9c1b94445558ea041a6af8840ef for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
08:08:51.011 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [b436d13a7bc21fd6ca265ef79d26dd6199500bc76792762e98e1138b5cec2e7e]
08:08:51.012 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [b436d13a7bc21fd6ca265ef79d26dd6199500bc76792762e98e1138b5cec2e7e]
08:08:51.013 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
08:08:51.013 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
08:08:51.016 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split b436d13a7bc21fd6ca265ef79d26dd6199500bc76792762e98e1138b5cec2e7e finished by subtask 1; deferring removal (restored in pending)
08:08:51.017 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] disconnecting while in state READY
08:08:51.018 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='13258c35ba6e3bb06a90b7b12428563d94a691696a99169e16a7bca3e916f4c1'}]
08:08:51.024 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:51.025 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false, responseScanTimestamp = 7287159725273088001) for scanner KuduScanner(table=replication_test_table, tablet=0127c24cdb254b3b9444ea5f96a1b0ab, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.026 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [9f064cea2e475ee46707379dc1378fb0cf7bb119144e9cf2e0193bb0215e764f]
08:08:51.027 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
08:08:51.029 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3c2bc0e61f964830a3058e48aa1f73e7, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.029 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 3c2bc0e61f964830a3058e48aa1f73e7 for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
08:08:51.029 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:51.038 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=aaa1bd80c257434880e2a4e22043c2fe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.039 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet aaa1bd80c257434880e2a4e22043c2fe for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
08:08:51.042 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:51.046 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet fa47c603eff647ba8370b640a0a12ca5 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
08:08:51.046 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 753ee9c1b94445558ea041a6af8840ef for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
08:08:51.046 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 3c2bc0e61f964830a3058e48aa1f73e7 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
08:08:51.046 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet aaa1bd80c257434880e2a4e22043c2fe for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
08:08:51.046 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8f15d82f9ab44ea68386995444340bdc for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
08:08:51.046 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 680fb2eae00541b09ee3fae8748d9ec4 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
08:08:51.047 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=fa47c603eff647ba8370b640a0a12ca5@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617),fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=753ee9c1b94445558ea041a6af8840ef@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135)[L],5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617),fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=3c2bc0e61f964830a3058e48aa1f73e7@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=aaa1bd80c257434880e2a4e22043c2fe@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=8f15d82f9ab44ea68386995444340bdc@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=680fb2eae00541b09ee3fae8748d9ec4@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
08:08:51.051 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8f15d82f9ab44ea68386995444340bdc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.051 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false, responseScanTimestamp = 7287159725273088001) for scanner KuduScanner(table=replication_test_table, tablet=5b322ee1784745bfbf45b3b4ff0b9eee, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.051 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8f15d82f9ab44ea68386995444340bdc for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
08:08:51.052 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [9a829eb6cd2f39aa330c19c755390d5643e1d568888506d5482295c1b1f82be1]
08:08:51.053 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
08:08:51.058 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:08:51.059 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299997, tablet=57ec20d798834ab1a9d6bad82e7002fe@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)[L]]}]
08:08:51.061 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=680fb2eae00541b09ee3fae8748d9ec4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.061 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 680fb2eae00541b09ee3fae8748d9ec4 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
08:08:51.062 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:51.070 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:51.071 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:51.071 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:51.071 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:51.071 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:51.072 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:51.072 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:51.072 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:51.072 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:51.073 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:51.073 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:51.073 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:51.073 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:51.073 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:51.073 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:51.074 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:51.074 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:51.074 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:51.075 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:51.075 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:51.075 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:51.075 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:51.076 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:51.076 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:51.076 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:51.076 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:51.092 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduClient.java:2538) Learned about tablet 3c2bc0e61f964830a3058e48aa1f73e7 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
08:08:51.092 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduClient.java:2538) Learned about tablet aaa1bd80c257434880e2a4e22043c2fe for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
08:08:51.092 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduClient.java:2538) Learned about tablet 8f15d82f9ab44ea68386995444340bdc for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
08:08:51.092 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduClient.java:2538) Learned about tablet 680fb2eae00541b09ee3fae8748d9ec4 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
08:08:51.093 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [9f064cea2e475ee46707379dc1378fb0cf7bb119144e9cf2e0193bb0215e764f]
08:08:51.095 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 9f064cea2e475ee46707379dc1378fb0cf7bb119144e9cf2e0193bb0215e764f finished by subtask 0; deferring removal (restored in pending)
08:08:51.097 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=3c2bc0e61f964830a3058e48aa1f73e7@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299995, tablet=aaa1bd80c257434880e2a4e22043c2fe@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299994}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299994, tablet=8f15d82f9ab44ea68386995444340bdc@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299994, tablet=680fb2eae00541b09ee3fae8748d9ec4@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299994}]
08:08:51.098 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [9a829eb6cd2f39aa330c19c755390d5643e1d568888506d5482295c1b1f82be1]
08:08:51.101 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 9a829eb6cd2f39aa330c19c755390d5643e1d568888506d5482295c1b1f82be1 finished by subtask 2; deferring removal (restored in pending)
08:08:51.101 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
08:08:51.101 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
08:08:51.101 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] disconnecting while in state READY
08:08:51.102 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:51.102 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job 09c2845f1c2e95ee63afce247a128bdd (5044 bytes, checkpointDuration=193 ms, finalizationTime=1 ms).
08:08:51.104 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
08:08:51.104 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 9a829eb6cd2f39aa330c19c755390d5643e1d568888506d5482295c1b1f82be1 from pending
08:08:51.104 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split b436d13a7bc21fd6ca265ef79d26dd6199500bc76792762e98e1138b5cec2e7e from pending
08:08:51.104 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 9f064cea2e475ee46707379dc1378fb0cf7bb119144e9cf2e0193bb0215e764f from pending
08:08:51.104 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 3 finished splits from enumerator state
08:08:51.105 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
08:08:51.105 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
08:08:51.105 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] disconnecting while in state READY
08:08:51.105 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:51.106 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='1976a0ab76f5ca64dc5f6a3e42e502d8cfafe016fa6d0c351681b69d99799327'}]
08:08:51.111 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:51.115 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
08:08:51.120 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:51.120 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299996, tablet=76d8c41bbf134c32947c73f9414f7aab@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}]
08:08:51.123 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fa47c603eff647ba8370b640a0a12ca5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.123 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fa47c603eff647ba8370b640a0a12ca5 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
08:08:51.132 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=753ee9c1b94445558ea041a6af8840ef, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.133 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 753ee9c1b94445558ea041a6af8840ef for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
08:08:51.144 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3c2bc0e61f964830a3058e48aa1f73e7, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.144 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 3c2bc0e61f964830a3058e48aa1f73e7 for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
08:08:51.162 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=aaa1bd80c257434880e2a4e22043c2fe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.163 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet aaa1bd80c257434880e2a4e22043c2fe for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
08:08:51.190 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8f15d82f9ab44ea68386995444340bdc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.190 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8f15d82f9ab44ea68386995444340bdc for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
08:08:51.201 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=680fb2eae00541b09ee3fae8748d9ec4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.202 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 680fb2eae00541b09ee3fae8748d9ec4 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
08:08:51.213 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:51.213 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:51.213 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:51.214 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:51.214 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:51.214 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:51.214 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:51.214 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:51.214 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:51.215 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:51.215 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:51.215 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:51.215 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:51.263 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fa47c603eff647ba8370b640a0a12ca5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.263 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fa47c603eff647ba8370b640a0a12ca5 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
08:08:51.273 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=753ee9c1b94445558ea041a6af8840ef, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.273 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 753ee9c1b94445558ea041a6af8840ef for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
08:08:51.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:51.273597  2588 debug-util.cc:398] Leaking SignalData structure 0x7b0800070180 after lost signal to thread 2519
08:08:51.287 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3c2bc0e61f964830a3058e48aa1f73e7, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.288 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 3c2bc0e61f964830a3058e48aa1f73e7 for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
08:08:51.305 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:51.305 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=aaa1bd80c257434880e2a4e22043c2fe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.305 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:51.305 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:51.305 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet aaa1bd80c257434880e2a4e22043c2fe for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
08:08:51.306 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:51.306 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:51.306 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:51.306 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:51.306 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:51.307 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:51.307 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:51.307 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:51.307 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:51.307 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:51.309 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] connecting to peer
08:08:51.315 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8f15d82f9ab44ea68386995444340bdc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.315 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8f15d82f9ab44ea68386995444340bdc for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
08:08:51.343 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] connecting to peer
08:08:51.351 [DEBUG - kudu-nio-0] (Connection.java:239) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] handling channelInactive
08:08:51.351 [DEBUG - kudu-nio-0] (Connection.java:709) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] cleaning up while in state READY due to: connection closed
08:08:51.351 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
08:08:51.352 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
08:08:51.364 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=680fb2eae00541b09ee3fae8748d9ec4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.365 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 680fb2eae00541b09ee3fae8748d9ec4 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
08:08:51.374 [DEBUG - kudu-nio-0] (Connection.java:239) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] handling channelInactive
08:08:51.374 [DEBUG - kudu-nio-0] (Connection.java:709) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] cleaning up while in state READY due to: connection closed
08:08:51.374 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
08:08:51.375 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
08:08:51.384 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:51.384 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:51.384 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:51.385 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:51.385 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:51.385 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:51.386 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:51.386 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:51.386 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:51.386 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:51.387 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:51.387 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:51.387 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:51.401 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:51.406 [DEBUG - kudu-nio-0] (Connection.java:239) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] handling channelInactive
08:08:51.406 [DEBUG - kudu-nio-0] (Connection.java:709) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] cleaning up while in state READY due to: connection closed
08:08:51.407 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:08:51.407 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
08:08:51.408 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091731407 for job 09c2845f1c2e95ee63afce247a128bdd.
08:08:51.415 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=1, operationSize=63, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@5df52fc7, flushNotification=Deferred@625491618(state=PENDING, result=null, callback=<none>, errback=<none>)}
08:08:51.416 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)] connecting to peer
08:08:51.427 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fa47c603eff647ba8370b640a0a12ca5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.428 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fa47c603eff647ba8370b640a0a12ca5 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
08:08:51.439 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=753ee9c1b94445558ea041a6af8840ef, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.439 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=3, operationSize=189, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@3933a85a, flushNotification=Deferred@1647404484(state=PENDING, result=null, callback=<none>, errback=<none>)}
08:08:51.439 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 753ee9c1b94445558ea041a6af8840ef for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
08:08:51.440 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)] connecting to peer
08:08:51.441 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
08:08:51.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:51.449 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3c2bc0e61f964830a3058e48aa1f73e7, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.449 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 3c2bc0e61f964830a3058e48aa1f73e7 for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
08:08:51.457 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)] Successfully connected to peer
08:08:51.466 [DEBUG - kudu-nio-0] (Connection.java:757) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] Successfully connected to peer
08:08:51.468 [DEBUG - kudu-nio-0] (Connection.java:757) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] Successfully connected to peer
08:08:51.468 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:51.468 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:51.469 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:51.470 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:51.470 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:51.470 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:51.470 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:51.470 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:51.470 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:51.471 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:51.471 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:51.471 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:51.471 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:51.478 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.193
08:08:51.478 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:51.479 [DEBUG - kudu-nio-3] (Connection.java:757) [peer fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)] Successfully connected to peer
08:08:51.482 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:51.482 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:51.482 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:51.483 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:51.483 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:51.483 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:51.483 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299997, tablet=72ad21258ea34269bce6ae4c80b8e589@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}]
08:08:51.483 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:51.484 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:51.484 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:51.484 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:51.484 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:51.484 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:51.485 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:51.485 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:51.485 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:51.485 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:51.485 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:51.485 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:51.485 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:51.485 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:51.485 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:51.485 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:51.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:51.445554  2288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.134.194:43489, user_credentials={real_user=slave}} blocked reactor thread for 54444.6us
08:08:51.487 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:51.487 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:51.487 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:51.487 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.193
08:08:51.505 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=aaa1bd80c257434880e2a4e22043c2fe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.505 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet aaa1bd80c257434880e2a4e22043c2fe for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
08:08:51.526 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:51.529 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:51.530 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] connecting to peer
08:08:51.536 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x149bc3ef, L:/127.0.0.1:47642 - R:/127.1.134.193:41847] using SASL/PLAIN
08:08:51.542 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:51.543 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x56ffc07e, L:/127.0.0.1:47656 - R:/127.1.134.193:41847] using SASL/PLAIN
08:08:51.544 [DEBUG - kudu-nio-0] (Connection.java:757) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] Successfully connected to peer
08:08:51.553 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.193
08:08:51.558 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:51.562 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:51.567 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8f15d82f9ab44ea68386995444340bdc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.567 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8f15d82f9ab44ea68386995444340bdc for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
08:08:51.573 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xc5a6deb8, L:/127.0.0.1:50950 - R:/127.2.90.130:34617] using TOKEN/null
08:08:51.580 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false, responseScanTimestamp = 7287159725273088001) for scanner KuduScanner(table=replication_test_table, tablet=57ec20d798834ab1a9d6bad82e7002fe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.582 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [a253569f330e92a02cdefabb650388e223241e800ac29bc63529c5f4486c2c3b]
08:08:51.583 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:51.583 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
08:08:51.590 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:51.592 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [a253569f330e92a02cdefabb650388e223241e800ac29bc63529c5f4486c2c3b]
08:08:51.595 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
08:08:51.595 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
08:08:51.595 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] disconnecting while in state READY
08:08:51.596 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:51.596 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split a253569f330e92a02cdefabb650388e223241e800ac29bc63529c5f4486c2c3b finished by subtask 3; deferring removal (restored in pending)
08:08:51.598 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet aaa1bd80c257434880e2a4e22043c2fe for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
08:08:51.598 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8f15d82f9ab44ea68386995444340bdc for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
08:08:51.598 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 680fb2eae00541b09ee3fae8748d9ec4 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
08:08:51.599 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=aaa1bd80c257434880e2a4e22043c2fe@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=8f15d82f9ab44ea68386995444340bdc@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=680fb2eae00541b09ee3fae8748d9ec4@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
08:08:51.601 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x86d8cfdb, L:/127.0.0.1:47662 - R:/127.1.134.193:41847] using SASL/PLAIN
08:08:51.604 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet aaa1bd80c257434880e2a4e22043c2fe for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
08:08:51.604 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8f15d82f9ab44ea68386995444340bdc for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
08:08:51.605 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 680fb2eae00541b09ee3fae8748d9ec4 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
08:08:51.605 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=aaa1bd80c257434880e2a4e22043c2fe@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=8f15d82f9ab44ea68386995444340bdc@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=680fb2eae00541b09ee3fae8748d9ec4@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
08:08:51.607 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet aaa1bd80c257434880e2a4e22043c2fe for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
08:08:51.607 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8f15d82f9ab44ea68386995444340bdc for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
08:08:51.608 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 680fb2eae00541b09ee3fae8748d9ec4 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
08:08:51.608 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=aaa1bd80c257434880e2a4e22043c2fe@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=8f15d82f9ab44ea68386995444340bdc@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=680fb2eae00541b09ee3fae8748d9ec4@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
08:08:51.608 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false, responseScanTimestamp = 7287159725273088001) for scanner KuduScanner(table=replication_test_table, tablet=76d8c41bbf134c32947c73f9414f7aab, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.614 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [13258c35ba6e3bb06a90b7b12428563d94a691696a99169e16a7bca3e916f4c1]
08:08:51.615 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
08:08:51.620 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:51.623 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [13258c35ba6e3bb06a90b7b12428563d94a691696a99169e16a7bca3e916f4c1]
08:08:51.625 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 13258c35ba6e3bb06a90b7b12428563d94a691696a99169e16a7bca3e916f4c1 finished by subtask 1; deferring removal (restored in pending)
08:08:51.626 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
08:08:51.626 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
08:08:51.626 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] disconnecting while in state READY
08:08:51.631 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8f15d82f9ab44ea68386995444340bdc for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
08:08:51.631 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 680fb2eae00541b09ee3fae8748d9ec4 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
08:08:51.631 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=8f15d82f9ab44ea68386995444340bdc@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=680fb2eae00541b09ee3fae8748d9ec4@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
08:08:51.632 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:51.632 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8f15d82f9ab44ea68386995444340bdc for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
08:08:51.632 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 680fb2eae00541b09ee3fae8748d9ec4 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
08:08:51.632 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=8f15d82f9ab44ea68386995444340bdc@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=680fb2eae00541b09ee3fae8748d9ec4@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
08:08:51.633 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x9e999962, L:/127.0.0.1:48346 - R:/127.2.90.131:33107] using TOKEN/null
08:08:51.664 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:51.664 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:51.664 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:51.665 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:51.665 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:51.665 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:51.666 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:51.666 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:51.666 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:51.666 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:51.666 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:51.666 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:51.667 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:51.687 [DEBUG - kudu-nio-0] (Connection.java:239) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] handling channelInactive
08:08:51.687 [DEBUG - kudu-nio-0] (Connection.java:709) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] cleaning up while in state READY due to: connection closed
08:08:51.688 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:08:51.688 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
08:08:51.695 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=680fb2eae00541b09ee3fae8748d9ec4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.695 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 680fb2eae00541b09ee3fae8748d9ec4 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
08:08:51.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:51.707989  1872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.134.253:41425, user_credentials={real_user=slave}} blocked reactor thread for 60856.7us
08:08:51.722 [DEBUG - kudu-nio-0] (Connection.java:239) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] handling channelInactive
08:08:51.722 [DEBUG - kudu-nio-0] (Connection.java:709) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] cleaning up while in state READY due to: connection closed
08:08:51.722 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:08:51.723 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
08:08:51.738 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false, responseScanTimestamp = 7287159725273088001) for scanner KuduScanner(table=replication_test_table, tablet=72ad21258ea34269bce6ae4c80b8e589, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.739 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [1976a0ab76f5ca64dc5f6a3e42e502d8cfafe016fa6d0c351681b69d99799327]
08:08:51.797 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fa47c603eff647ba8370b640a0a12ca5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.798 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fa47c603eff647ba8370b640a0a12ca5 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
08:08:51.810 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=753ee9c1b94445558ea041a6af8840ef, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.811 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 753ee9c1b94445558ea041a6af8840ef for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
08:08:51.821 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3c2bc0e61f964830a3058e48aa1f73e7, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.821 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 3c2bc0e61f964830a3058e48aa1f73e7 for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
08:08:51.831 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=aaa1bd80c257434880e2a4e22043c2fe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.831 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet aaa1bd80c257434880e2a4e22043c2fe for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
08:08:51.840 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8f15d82f9ab44ea68386995444340bdc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.840 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8f15d82f9ab44ea68386995444340bdc for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
08:08:51.849 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=680fb2eae00541b09ee3fae8748d9ec4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.850 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 680fb2eae00541b09ee3fae8748d9ec4 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
08:08:51.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:51.910 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fa47c603eff647ba8370b640a0a12ca5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.910 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fa47c603eff647ba8370b640a0a12ca5 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
08:08:51.933 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=753ee9c1b94445558ea041a6af8840ef, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.933 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 753ee9c1b94445558ea041a6af8840ef for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
08:08:51.940 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:51.940 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:51.940 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:51.941 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:51.941 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:51.941 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:51.941 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:51.941 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:51.941 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:51.941 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:51.941 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:51.941 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:51.941 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:51.949 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:51.953 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [1976a0ab76f5ca64dc5f6a3e42e502d8cfafe016fa6d0c351681b69d99799327]
08:08:51.953 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
08:08:51.969 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
08:08:51.971 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] disconnecting while in state READY
08:08:51.957 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 1976a0ab76f5ca64dc5f6a3e42e502d8cfafe016fa6d0c351681b69d99799327 finished by subtask 0; deferring removal (restored in pending)
08:08:51.971 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:51.972 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job 09c2845f1c2e95ee63afce247a128bdd (3004 bytes, checkpointDuration=564 ms, finalizationTime=1 ms).
08:08:51.990 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091731983 for job 09c2845f1c2e95ee63afce247a128bdd.
08:08:51.991 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
08:08:51.991 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split a253569f330e92a02cdefabb650388e223241e800ac29bc63529c5f4486c2c3b from pending
08:08:51.991 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 13258c35ba6e3bb06a90b7b12428563d94a691696a99169e16a7bca3e916f4c1 from pending
08:08:51.991 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 1976a0ab76f5ca64dc5f6a3e42e502d8cfafe016fa6d0c351681b69d99799327 from pending
08:08:51.991 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 2 complete: removed 3 finished splits from enumerator state
08:08:51.994 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3c2bc0e61f964830a3058e48aa1f73e7, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:51.994 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 3c2bc0e61f964830a3058e48aa1f73e7 for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
08:08:51.997 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=3, operationSize=189, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@58b7be0f, flushNotification=Deferred@1882163501(state=PENDING, result=null, callback=<none>, errback=<none>)}
08:08:51.998 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)] connecting to peer
08:08:51.999 [DEBUG - kudu-nio-0] (Connection.java:239) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] handling channelInactive
08:08:51.999 [DEBUG - kudu-nio-0] (Connection.java:709) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] cleaning up while in state READY due to: connection closed
08:08:51.999 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:08:52.000 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
08:08:52.000 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=2, operationSize=126, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@5789ceac, flushNotification=Deferred@1849032423(state=PENDING, result=null, callback=<none>, errback=<none>)}
08:08:52.001 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)] connecting to peer
08:08:52.004 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=aaa1bd80c257434880e2a4e22043c2fe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:52.005 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet aaa1bd80c257434880e2a4e22043c2fe for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
08:08:52.032 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8f15d82f9ab44ea68386995444340bdc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:52.033 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8f15d82f9ab44ea68386995444340bdc for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
08:08:52.034 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)] Successfully connected to peer
08:08:52.039 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=1, operationSize=63, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@117be9ac, flushNotification=Deferred@1661366888(state=PENDING, result=null, callback=<none>, errback=<none>)}
08:08:52.039 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)] connecting to peer
08:08:52.041 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:52.048 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=680fb2eae00541b09ee3fae8748d9ec4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:52.048 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 680fb2eae00541b09ee3fae8748d9ec4 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
08:08:52.057 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)] Successfully connected to peer
08:08:52.062 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:52.062 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:52.076 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x92ab8ec8, L:/127.0.0.1:50960 - R:/127.2.90.130:34617] using TOKEN/null
08:08:52.120 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)] Successfully connected to peer
08:08:52.120 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:52.129 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:52.129 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:52.129 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:52.129 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:52.130 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:52.130 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:52.130 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:52.130 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:52.130 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:52.131 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:52.131 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:52.131 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:52.131 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:52.176 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:52.177 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:52.177 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:52.178 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:52.178 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:52.178 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:52.179 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:52.179 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:52.179 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:52.180 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:52.180 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:52.180 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:52.180 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:52.184 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29250), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [4ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [5ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [10ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [10ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [22ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [23ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [31ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [31ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [56ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [58ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [59ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [59ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [59ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [61ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [62ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [62ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [62ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [81ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [81ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [81ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [81ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [102ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [143ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [281ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [281ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [282ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [282ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [443ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [443ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [444ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [444ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [462ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [463ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [463ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [464ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1200ms] refreshing cache from master, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1203ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1204ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1204ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1204ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1580ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1583ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1584ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1584ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1584ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [4520ms] refreshing cache from master, [4520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [4521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [4522ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [4523ms] too many traces: truncated at 100 traces, deferred=Deferred@528857224(state=PENDING, result=null, callback=(continuation of Deferred@1951954714 after retry RPC after error@197858225) -> (continuation of Deferred@431387237 after retry RPC after error@725993507) -> (continuation of Deferred@479369974 after retry RPC after error@1326924878) -> (continuation of Deferred@1704473235 after retry RPC after error@1612315347) -> (continuation of Deferred@1750374668 after retry RPC after error@496276860) -> (continuation of Deferred@968630519 after retry RPC after error@383556209) -> (continuation of Deferred@1519189343 after retry RPC after error@1670032391) -> (continuation of Deferred@996774681 after retry RPC after error@1234475287) -> (continuation of Deferred@1951396735 after retry RPC after error@1108579173) -> (continuation of Deferred@890581349 after retry RPC after error@1487166193) -> (continuation of Deferred@1408994961 after retry RPC after error@229484336) -> (continuation of Deferred@288301561 after retry RPC after error@1797686015) -> (continuation of Deferred@1688602124 after retry RPC after error@72530319) -> (continuation of Deferred@1813671957 after retry RPC after error@863254035) -> (continuation of Deferred@1740029975 after retry RPC after error@1991873455) -> (continuation of Deferred@1235013557 after retry RPC after error@1540009019) -> (continuation of Deferred@179140909 after retry RPC after error@817084220) -> (continuation of Deferred@536688632 after retry RPC after error@299432776) -> (continuation of Deferred@1893567567 after retry RPC after error@1568333631) -> (continuation of Deferred@726561183 after retry RPC after error@2107301125) -> (continuation of Deferred@1639553293 after retry RPC after error@1781604642) -> (continuation of Deferred@841709426 after retry RPC after error@435353287) -> (continuation of Deferred@883844357 after retry RPC after error@1475705475) -> (continuation of Deferred@1040979944 after retry RPC after error@809929248), errback=(continuation of Deferred@1951954714 after retry RPC after error@197858225) -> (continuation of Deferred@431387237 after retry RPC after error@725993507) -> (continuation of Deferred@479369974 after retry RPC after error@1326924878) -> (continuation of Deferred@1704473235 after retry RPC after error@1612315347) -> (continuation of Deferred@1750374668 after retry RPC after error@496276860) -> (continuation of Deferred@968630519 after retry RPC after error@383556209) -> (continuation of Deferred@1519189343 after retry RPC after error@1670032391) -> (continuation of Deferred@996774681 after retry RPC after error@1234475287) -> (continuation of Deferred@1951396735 after retry RPC after error@1108579173) -> (continuation of Deferred@890581349 after retry RPC after error@1487166193) -> (continuation of Deferred@1408994961 after retry RPC after error@229484336) -> (continuation of Deferred@288301561 after retry RPC after error@1797686015) -> (continuation of Deferred@1688602124 after retry RPC after error@72530319) -> (continuation of Deferred@1813671957 after retry RPC after error@863254035) -> (continuation of Deferred@1740029975 after retry RPC after error@1991873455) -> (continuation of Deferred@1235013557 after retry RPC after error@1540009019) -> (continuation of Deferred@179140909 after retry RPC after error@817084220) -> (continuation of Deferred@536688632 after retry RPC after error@299432776) -> (continuation of Deferred@1893567567 after retry RPC after error@1568333631) -> (continuation of Deferred@726561183 after retry RPC after error@2107301125) -> (continuation of Deferred@1639553293 after retry RPC after error@1781604642) -> (continuation of Deferred@841709426 after retry RPC after error@435353287) -> (continuation of Deferred@883844357 after retry RPC after error@1475705475) -> (continuation of Deferred@1040979944 after retry RPC after error@809929248)))
08:08:52.197 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:52.197 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fa47c603eff647ba8370b640a0a12ca5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:52.198 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:52.198 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:52.199 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:52.199 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:52.199 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:52.199 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:52.200 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:52.200 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:52.200 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:52.200 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:52.200 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:52.200 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:52.203 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fa47c603eff647ba8370b640a0a12ca5 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
08:08:52.212 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:52.221 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=753ee9c1b94445558ea041a6af8840ef, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:52.222 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 753ee9c1b94445558ea041a6af8840ef for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
08:08:52.236 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0xe2b0a120, L:/127.0.0.1:50970 - R:/127.2.90.130:34617] using TOKEN/null
08:08:52.244 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (SourceReaderBase.java:338) Closing Source Reader.
08:08:52.245 [WARN - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#7 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29250), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [4ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [5ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [10ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [10ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [22ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [23ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [31ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [31ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [56ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [58ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [59ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [59ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [59ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [61ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [62ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [62ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [62ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [81ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [81ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [81ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [81ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [102ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [143ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [281ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [281ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [282ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [282ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [443ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [443ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [444ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [444ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [462ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [463ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [463ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [464ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1200ms] refreshing cache from master, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1203ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1204ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1204ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1204ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1580ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1583ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1584ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1584ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1584ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [4520ms] refreshing cache from master, [4520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [4521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [4522ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [4523ms] too many traces: truncated at 100 traces, deferred=Deferred@528857224(state=PENDING, result=null, callback=(continuation of Deferred@1951954714 after retry RPC after error@197858225) -> (continuation of Deferred@431387237 after retry RPC after error@725993507) -> (continuation of Deferred@479369974 after retry RPC after error@1326924878) -> (continuation of Deferred@1704473235 after retry RPC after error@1612315347) -> (continuation of Deferred@1750374668 after retry RPC after error@496276860) -> (continuation of Deferred@968630519 after retry RPC after error@383556209) -> (continuation of Deferred@1519189343 after retry RPC after error@1670032391) -> (continuation of Deferred@996774681 after retry RPC after error@1234475287) -> (continuation of Deferred@1951396735 after retry RPC after error@1108579173) -> (continuation of Deferred@890581349 after retry RPC after error@1487166193) -> (continuation of Deferred@1408994961 after retry RPC after error@229484336) -> (continuation of Deferred@288301561 after retry RPC after error@1797686015) -> (continuation of Deferred@1688602124 after retry RPC after error@72530319) -> (continuation of Deferred@1813671957 after retry RPC after error@863254035) -> (continuation of Deferred@1740029975 after retry RPC after error@1991873455) -> (continuation of Deferred@1235013557 after retry RPC after error@1540009019) -> (continuation of Deferred@179140909 after retry RPC after error@817084220) -> (continuation of Deferred@536688632 after retry RPC after error@299432776) -> (continuation of Deferred@1893567567 after retry RPC after error@1568333631) -> (continuation of Deferred@726561183 after retry RPC after error@2107301125) -> (continuation of Deferred@1639553293 after retry RPC after error@1781604642) -> (continuation of Deferred@841709426 after retry RPC after error@435353287) -> (continuation of Deferred@883844357 after retry RPC after error@1475705475) -> (continuation of Deferred@1040979944 after retry RPC after error@809929248), errback=(continuation of Deferred@1951954714 after retry RPC after error@197858225) -> (continuation of Deferred@431387237 after retry RPC after error@725993507) -> (continuation of Deferred@479369974 after retry RPC after error@1326924878) -> (continuation of Deferred@1704473235 after retry RPC after error@1612315347) -> (continuation of Deferred@1750374668 after retry RPC after error@496276860) -> (continuation of Deferred@968630519 after retry RPC after error@383556209) -> (continuation of Deferred@1519189343 after retry RPC after error@1670032391) -> (continuation of Deferred@996774681 after retry RPC after error@1234475287) -> (continuation of Deferred@1951396735 after retry RPC after error@1108579173) -> (continuation of Deferred@890581349 after retry RPC after error@1487166193) -> (continuation of Deferred@1408994961 after retry RPC after error@229484336) -> (continuation of Deferred@288301561 after retry RPC after error@1797686015) -> (continuation of Deferred@1688602124 after retry RPC after error@72530319) -> (continuation of Deferred@1813671957 after retry RPC after error@863254035) -> (continuation of Deferred@1740029975 after retry RPC after error@1991873455) -> (continuation of Deferred@1235013557 after retry RPC after error@1540009019) -> (continuation of Deferred@179140909 after retry RPC after error@817084220) -> (continuation of Deferred@536688632 after retry RPC after error@299432776) -> (continuation of Deferred@1893567567 after retry RPC after error@1568333631) -> (continuation of Deferred@726561183 after retry RPC after error@2107301125) -> (continuation of Deferred@1639553293 after retry RPC after error@1781604642) -> (continuation of Deferred@841709426 after retry RPC after error@435353287) -> (continuation of Deferred@883844357 after retry RPC after error@1475705475) -> (continuation of Deferred@1040979944 after retry RPC after error@809929248)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:52.253 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3c2bc0e61f964830a3058e48aa1f73e7, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:52.254 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 3c2bc0e61f964830a3058e48aa1f73e7 for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
08:08:52.270 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=aaa1bd80c257434880e2a4e22043c2fe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:52.270 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet aaa1bd80c257434880e2a4e22043c2fe for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
08:08:52.288 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#7 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_7).
08:08:52.354 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8f15d82f9ab44ea68386995444340bdc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:52.355 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8f15d82f9ab44ea68386995444340bdc for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
08:08:52.372 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#7 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_7.
08:08:52.372 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:52.374 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:52.374 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=680fb2eae00541b09ee3fae8748d9ec4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:52.374 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 680fb2eae00541b09ee3fae8748d9ec4 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
08:08:52.374 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:52.375 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:52.375 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:52.375 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:52.376 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:52.376 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:52.376 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:52.377 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:52.377 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:52.377 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:52.377 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:52.378 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:52.401 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:52.405 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from INITIALIZING to FAILED on 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29250), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [4ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [5ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [10ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [10ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [22ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [23ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [31ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [31ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [56ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [58ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [59ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [59ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [59ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [61ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [62ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [62ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [62ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [81ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [81ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [81ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [81ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [102ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [143ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [281ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [281ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [282ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [282ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [443ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [443ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [444ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [444ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [462ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [463ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [463ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [464ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1200ms] refreshing cache from master, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1203ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1204ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1204ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1204ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1580ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1583ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1584ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1584ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1584ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [4520ms] refreshing cache from master, [4520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [4521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [4522ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [4523ms] too many traces: truncated at 100 traces, deferred=Deferred@528857224(state=PENDING, result=null, callback=(continuation of Deferred@1951954714 after retry RPC after error@197858225) -> (continuation of Deferred@431387237 after retry RPC after error@725993507) -> (continuation of Deferred@479369974 after retry RPC after error@1326924878) -> (continuation of Deferred@1704473235 after retry RPC after error@1612315347) -> (continuation of Deferred@1750374668 after retry RPC after error@496276860) -> (continuation of Deferred@968630519 after retry RPC after error@383556209) -> (continuation of Deferred@1519189343 after retry RPC after error@1670032391) -> (continuation of Deferred@996774681 after retry RPC after error@1234475287) -> (continuation of Deferred@1951396735 after retry RPC after error@1108579173) -> (continuation of Deferred@890581349 after retry RPC after error@1487166193) -> (continuation of Deferred@1408994961 after retry RPC after error@229484336) -> (continuation of Deferred@288301561 after retry RPC after error@1797686015) -> (continuation of Deferred@1688602124 after retry RPC after error@72530319) -> (continuation of Deferred@1813671957 after retry RPC after error@863254035) -> (continuation of Deferred@1740029975 after retry RPC after error@1991873455) -> (continuation of Deferred@1235013557 after retry RPC after error@1540009019) -> (continuation of Deferred@179140909 after retry RPC after error@817084220) -> (continuation of Deferred@536688632 after retry RPC after error@299432776) -> (continuation of Deferred@1893567567 after retry RPC after error@1568333631) -> (continuation of Deferred@726561183 after retry RPC after error@2107301125) -> (continuation of Deferred@1639553293 after retry RPC after error@1781604642) -> (continuation of Deferred@841709426 after retry RPC after error@435353287) -> (continuation of Deferred@883844357 after retry RPC after error@1475705475) -> (continuation of Deferred@1040979944 after retry RPC after error@809929248), errback=(continuation of Deferred@1951954714 after retry RPC after error@197858225) -> (continuation of Deferred@431387237 after retry RPC after error@725993507) -> (continuation of Deferred@479369974 after retry RPC after error@1326924878) -> (continuation of Deferred@1704473235 after retry RPC after error@1612315347) -> (continuation of Deferred@1750374668 after retry RPC after error@496276860) -> (continuation of Deferred@968630519 after retry RPC after error@383556209) -> (continuation of Deferred@1519189343 after retry RPC after error@1670032391) -> (continuation of Deferred@996774681 after retry RPC after error@1234475287) -> (continuation of Deferred@1951396735 after retry RPC after error@1108579173) -> (continuation of Deferred@890581349 after retry RPC after error@1487166193) -> (continuation of Deferred@1408994961 after retry RPC after error@229484336) -> (continuation of Deferred@288301561 after retry RPC after error@1797686015) -> (continuation of Deferred@1688602124 after retry RPC after error@72530319) -> (continuation of Deferred@1813671957 after retry RPC after error@863254035) -> (continuation of Deferred@1740029975 after retry RPC after error@1991873455) -> (continuation of Deferred@1235013557 after retry RPC after error@1540009019) -> (continuation of Deferred@179140909 after retry RPC after error@817084220) -> (continuation of Deferred@536688632 after retry RPC after error@299432776) -> (continuation of Deferred@1893567567 after retry RPC after error@1568333631) -> (continuation of Deferred@726561183 after retry RPC after error@2107301125) -> (continuation of Deferred@1639553293 after retry RPC after error@1781604642) -> (continuation of Deferred@841709426 after retry RPC after error@435353287) -> (continuation of Deferred@883844357 after retry RPC after error@1475705475) -> (continuation of Deferred@1040979944 after retry RPC after error@809929248)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:52.440 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:08:52.447 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#7) of source Source: KuduSource.
08:08:52.448 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_7.
08:08:52.454 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (b42812d69c586178cf7556c3c92998f3) switched from state RUNNING to RESTARTING.
08:08:52.458 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:52.458 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:52.458 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:52.459 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:52.459 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:52.459 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:52.460 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:52.460 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:52.460 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:52.461 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:52.461 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:52.461 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:52.461 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:52.465 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x0d24eff9, L:/127.0.0.1:50966 - R:/127.2.90.130:34617] using TOKEN/null
08:08:52.496 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:52.496 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:52.496 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:52.497 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:52.497 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:52.497 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:52.498 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:52.498 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:52.498 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:52.498 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:52.498 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:52.498 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:52.498 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:52.513 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:52.541 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:52.546 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fa47c603eff647ba8370b640a0a12ca5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:52.547 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fa47c603eff647ba8370b640a0a12ca5 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
08:08:52.556 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=753ee9c1b94445558ea041a6af8840ef, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:52.556 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 753ee9c1b94445558ea041a6af8840ef for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
08:08:52.562 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:52.574 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3c2bc0e61f964830a3058e48aa1f73e7, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:52.575 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 3c2bc0e61f964830a3058e48aa1f73e7 for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
08:08:52.589 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=605 ms, finalizationTime=1 ms).
08:08:52.592 [INFO - Checkpoint Timer] (CheckpointRequestDecider.java:220) checkpoint request time in queue: 184
08:08:52.593 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
08:08:52.593 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091732592 for job 09c2845f1c2e95ee63afce247a128bdd.
08:08:52.600 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=aaa1bd80c257434880e2a4e22043c2fe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:52.600 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet aaa1bd80c257434880e2a4e22043c2fe for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
08:08:52.610 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
08:08:52.612 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
08:08:52.620 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:52.648 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8f15d82f9ab44ea68386995444340bdc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:52.649 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8f15d82f9ab44ea68386995444340bdc for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
08:08:52.664 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=680fb2eae00541b09ee3fae8748d9ec4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:52.665 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 680fb2eae00541b09ee3fae8748d9ec4 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
08:08:52.674 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 2a489752354241eebd5d00f80d2b9347
08:08:52.683 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 1365359df50a4068a2562111037df6dd
08:08:52.703 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 2a489752354241eebd5d00f80d2b9347
08:08:52.708 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:52.709 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:52.709 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:52.710 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:52.710 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:52.710 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:52.710 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:52.710 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:52.711 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:52.711 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:52.711 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:52.711 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:52.711 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:52.717 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 1365359df50a4068a2562111037df6dd
08:08:52.724 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 0127c24cdb254b3b9444ea5f96a1b0ab for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
08:08:52.724 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet aa8885af14cf410093b0fc307e337db3 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
08:08:52.724 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 5b322ee1784745bfbf45b3b4ff0b9eee for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
08:08:52.724 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 57ec20d798834ab1a9d6bad82e7002fe for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
08:08:52.725 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 76d8c41bbf134c32947c73f9414f7aab for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
08:08:52.725 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 72ad21258ea34269bce6ae4c80b8e589 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
08:08:52.725 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=0127c24cdb254b3b9444ea5f96a1b0ab@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=aa8885af14cf410093b0fc307e337db3@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=5b322ee1784745bfbf45b3b4ff0b9eee@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)[L],ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=57ec20d798834ab1a9d6bad82e7002fe@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=76d8c41bbf134c32947c73f9414f7aab@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)[L],ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=72ad21258ea34269bce6ae4c80b8e589@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)[L],ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
08:08:52.749 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:08:52.749 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:08:52.749 [DEBUG - pool-342-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:08:52.750 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:52.750 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:52.751 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:08:52.751 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:52.751 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:52.751 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:08:52.752 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:52.752 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:52.752 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:08:52.752 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:08:52.756 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29824), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [3ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [4ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [4ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [23ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [24ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [25ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [25ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [59ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [60ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [61ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [61ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [82ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [103ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [103ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [121ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [123ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [162ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [165ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [166ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [166ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [282ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [282ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [283ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [283ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [322ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [323ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [324ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [324ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [502ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [503ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [503ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [504ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [820ms] refreshing cache from master, [820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [821ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [821ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [821ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [822ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [2640ms] refreshing cache from master, [2640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [2643ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [2643ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2643ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3700ms] refreshing cache from master, [3700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [3701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [3701ms] too many traces: truncated at 100 traces, deferred=Deferred@1913205209(state=PENDING, result=null, callback=(continuation of Deferred@1770207862 after retry RPC after error@459905989) -> (continuation of Deferred@520782319 after retry RPC after error@607579182) -> (continuation of Deferred@1410740820 after retry RPC after error@66469024) -> (continuation of Deferred@1211678920 after retry RPC after error@1543246461) -> (continuation of Deferred@1050480580 after retry RPC after error@205272971) -> (continuation of Deferred@34375748 after retry RPC after error@970464642) -> (continuation of Deferred@1869465170 after retry RPC after error@33567835) -> (continuation of Deferred@1680397047 after retry RPC after error@493217789) -> (continuation of Deferred@482078037 after retry RPC after error@521842805) -> (continuation of Deferred@1032287755 after retry RPC after error@267334729) -> (continuation of Deferred@1283305892 after retry RPC after error@112077126) -> (continuation of Deferred@2039990 after retry RPC after error@1990463872) -> (continuation of Deferred@1467313761 after retry RPC after error@543590864) -> (continuation of Deferred@1501890554 after retry RPC after error@259728731) -> (continuation of Deferred@1929462963 after retry RPC after error@1732078346) -> (continuation of Deferred@376834752 after retry RPC after error@1089582248) -> (continuation of Deferred@967591129 after retry RPC after error@893722077) -> (continuation of Deferred@323166655 after retry RPC after error@1591382923) -> (continuation of Deferred@84647429 after retry RPC after error@406700172) -> (continuation of Deferred@318325997 after retry RPC after error@406178802) -> (continuation of Deferred@1100453191 after retry RPC after error@936907865), errback=(continuation of Deferred@1770207862 after retry RPC after error@459905989) -> (continuation of Deferred@520782319 after retry RPC after error@607579182) -> (continuation of Deferred@1410740820 after retry RPC after error@66469024) -> (continuation of Deferred@1211678920 after retry RPC after error@1543246461) -> (continuation of Deferred@1050480580 after retry RPC after error@205272971) -> (continuation of Deferred@34375748 after retry RPC after error@970464642) -> (continuation of Deferred@1869465170 after retry RPC after error@33567835) -> (continuation of Deferred@1680397047 after retry RPC after error@493217789) -> (continuation of Deferred@482078037 after retry RPC after error@521842805) -> (continuation of Deferred@1032287755 after retry RPC after error@267334729) -> (continuation of Deferred@1283305892 after retry RPC after error@112077126) -> (continuation of Deferred@2039990 after retry RPC after error@1990463872) -> (continuation of Deferred@1467313761 after retry RPC after error@543590864) -> (continuation of Deferred@1501890554 after retry RPC after error@259728731) -> (continuation of Deferred@1929462963 after retry RPC after error@1732078346) -> (continuation of Deferred@376834752 after retry RPC after error@1089582248) -> (continuation of Deferred@967591129 after retry RPC after error@893722077) -> (continuation of Deferred@323166655 after retry RPC after error@1591382923) -> (continuation of Deferred@84647429 after retry RPC after error@406700172) -> (continuation of Deferred@318325997 after retry RPC after error@406178802) -> (continuation of Deferred@1100453191 after retry RPC after error@936907865)))
08:08:52.759 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:52.759 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:52.759 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:52.759 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (SourceReaderBase.java:338) Closing Source Reader.
08:08:52.760 [WARN - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#7 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29824), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [3ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [4ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [4ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [23ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [24ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [25ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [25ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [59ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [60ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [61ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [61ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [82ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [103ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [103ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [121ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [123ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [162ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [165ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [166ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [166ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [282ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [282ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [283ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [283ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [322ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [323ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [324ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [324ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [502ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [503ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [503ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [504ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [820ms] refreshing cache from master, [820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [821ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [821ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [821ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [822ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [2640ms] refreshing cache from master, [2640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [2643ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [2643ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2643ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3700ms] refreshing cache from master, [3700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [3701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [3701ms] too many traces: truncated at 100 traces, deferred=Deferred@1913205209(state=PENDING, result=null, callback=(continuation of Deferred@1770207862 after retry RPC after error@459905989) -> (continuation of Deferred@520782319 after retry RPC after error@607579182) -> (continuation of Deferred@1410740820 after retry RPC after error@66469024) -> (continuation of Deferred@1211678920 after retry RPC after error@1543246461) -> (continuation of Deferred@1050480580 after retry RPC after error@205272971) -> (continuation of Deferred@34375748 after retry RPC after error@970464642) -> (continuation of Deferred@1869465170 after retry RPC after error@33567835) -> (continuation of Deferred@1680397047 after retry RPC after error@493217789) -> (continuation of Deferred@482078037 after retry RPC after error@521842805) -> (continuation of Deferred@1032287755 after retry RPC after error@267334729) -> (continuation of Deferred@1283305892 after retry RPC after error@112077126) -> (continuation of Deferred@2039990 after retry RPC after error@1990463872) -> (continuation of Deferred@1467313761 after retry RPC after error@543590864) -> (continuation of Deferred@1501890554 after retry RPC after error@259728731) -> (continuation of Deferred@1929462963 after retry RPC after error@1732078346) -> (continuation of Deferred@376834752 after retry RPC after error@1089582248) -> (continuation of Deferred@967591129 after retry RPC after error@893722077) -> (continuation of Deferred@323166655 after retry RPC after error@1591382923) -> (continuation of Deferred@84647429 after retry RPC after error@406700172) -> (continuation of Deferred@318325997 after retry RPC after error@406178802) -> (continuation of Deferred@1100453191 after retry RPC after error@936907865), errback=(continuation of Deferred@1770207862 after retry RPC after error@459905989) -> (continuation of Deferred@520782319 after retry RPC after error@607579182) -> (continuation of Deferred@1410740820 after retry RPC after error@66469024) -> (continuation of Deferred@1211678920 after retry RPC after error@1543246461) -> (continuation of Deferred@1050480580 after retry RPC after error@205272971) -> (continuation of Deferred@34375748 after retry RPC after error@970464642) -> (continuation of Deferred@1869465170 after retry RPC after error@33567835) -> (continuation of Deferred@1680397047 after retry RPC after error@493217789) -> (continuation of Deferred@482078037 after retry RPC after error@521842805) -> (continuation of Deferred@1032287755 after retry RPC after error@267334729) -> (continuation of Deferred@1283305892 after retry RPC after error@112077126) -> (continuation of Deferred@2039990 after retry RPC after error@1990463872) -> (continuation of Deferred@1467313761 after retry RPC after error@543590864) -> (continuation of Deferred@1501890554 after retry RPC after error@259728731) -> (continuation of Deferred@1929462963 after retry RPC after error@1732078346) -> (continuation of Deferred@376834752 after retry RPC after error@1089582248) -> (continuation of Deferred@967591129 after retry RPC after error@893722077) -> (continuation of Deferred@323166655 after retry RPC after error@1591382923) -> (continuation of Deferred@84647429 after retry RPC after error@406700172) -> (continuation of Deferred@318325997 after retry RPC after error@406178802) -> (continuation of Deferred@1100453191 after retry RPC after error@936907865)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:52.761 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:52.761 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:52.761 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:52.762 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:52.762 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:52.762 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:52.760 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:52.762 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:52.763 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:52.763 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:52.772 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet fa47c603eff647ba8370b640a0a12ca5 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
08:08:52.772 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 753ee9c1b94445558ea041a6af8840ef for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
08:08:52.772 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 3c2bc0e61f964830a3058e48aa1f73e7 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
08:08:52.772 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet aaa1bd80c257434880e2a4e22043c2fe for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
08:08:52.772 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8f15d82f9ab44ea68386995444340bdc for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
08:08:52.772 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 680fb2eae00541b09ee3fae8748d9ec4 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
08:08:52.773 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=fa47c603eff647ba8370b640a0a12ca5@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617),fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=753ee9c1b94445558ea041a6af8840ef@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135)[L],5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617),fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=3c2bc0e61f964830a3058e48aa1f73e7@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=aaa1bd80c257434880e2a4e22043c2fe@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=8f15d82f9ab44ea68386995444340bdc@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=680fb2eae00541b09ee3fae8748d9ec4@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
08:08:52.780 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 2a489752354241eebd5d00f80d2b9347
08:08:52.783 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#7 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_7).
08:08:52.786 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 1365359df50a4068a2562111037df6dd
08:08:52.792 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#7 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_7.
08:08:52.797 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from INITIALIZING to FAILED on 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29824), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [3ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [4ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [4ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [23ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [24ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [25ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [25ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [59ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [60ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [61ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [61ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [82ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [82ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [103ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [103ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [121ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [123ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [162ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [165ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [166ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [166ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [282ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [282ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [283ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [283ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [322ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [323ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [324ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [324ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [502ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [503ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [503ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [504ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [820ms] refreshing cache from master, [820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [821ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [821ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [821ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [822ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [2640ms] refreshing cache from master, [2640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [2643ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [2643ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [2643ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3700ms] refreshing cache from master, [3700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [3701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [3701ms] too many traces: truncated at 100 traces, deferred=Deferred@1913205209(state=PENDING, result=null, callback=(continuation of Deferred@1770207862 after retry RPC after error@459905989) -> (continuation of Deferred@520782319 after retry RPC after error@607579182) -> (continuation of Deferred@1410740820 after retry RPC after error@66469024) -> (continuation of Deferred@1211678920 after retry RPC after error@1543246461) -> (continuation of Deferred@1050480580 after retry RPC after error@205272971) -> (continuation of Deferred@34375748 after retry RPC after error@970464642) -> (continuation of Deferred@1869465170 after retry RPC after error@33567835) -> (continuation of Deferred@1680397047 after retry RPC after error@493217789) -> (continuation of Deferred@482078037 after retry RPC after error@521842805) -> (continuation of Deferred@1032287755 after retry RPC after error@267334729) -> (continuation of Deferred@1283305892 after retry RPC after error@112077126) -> (continuation of Deferred@2039990 after retry RPC after error@1990463872) -> (continuation of Deferred@1467313761 after retry RPC after error@543590864) -> (continuation of Deferred@1501890554 after retry RPC after error@259728731) -> (continuation of Deferred@1929462963 after retry RPC after error@1732078346) -> (continuation of Deferred@376834752 after retry RPC after error@1089582248) -> (continuation of Deferred@967591129 after retry RPC after error@893722077) -> (continuation of Deferred@323166655 after retry RPC after error@1591382923) -> (continuation of Deferred@84647429 after retry RPC after error@406700172) -> (continuation of Deferred@318325997 after retry RPC after error@406178802) -> (continuation of Deferred@1100453191 after retry RPC after error@936907865), errback=(continuation of Deferred@1770207862 after retry RPC after error@459905989) -> (continuation of Deferred@520782319 after retry RPC after error@607579182) -> (continuation of Deferred@1410740820 after retry RPC after error@66469024) -> (continuation of Deferred@1211678920 after retry RPC after error@1543246461) -> (continuation of Deferred@1050480580 after retry RPC after error@205272971) -> (continuation of Deferred@34375748 after retry RPC after error@970464642) -> (continuation of Deferred@1869465170 after retry RPC after error@33567835) -> (continuation of Deferred@1680397047 after retry RPC after error@493217789) -> (continuation of Deferred@482078037 after retry RPC after error@521842805) -> (continuation of Deferred@1032287755 after retry RPC after error@267334729) -> (continuation of Deferred@1283305892 after retry RPC after error@112077126) -> (continuation of Deferred@2039990 after retry RPC after error@1990463872) -> (continuation of Deferred@1467313761 after retry RPC after error@543590864) -> (continuation of Deferred@1501890554 after retry RPC after error@259728731) -> (continuation of Deferred@1929462963 after retry RPC after error@1732078346) -> (continuation of Deferred@376834752 after retry RPC after error@1089582248) -> (continuation of Deferred@967591129 after retry RPC after error@893722077) -> (continuation of Deferred@323166655 after retry RPC after error@1591382923) -> (continuation of Deferred@84647429 after retry RPC after error@406700172) -> (continuation of Deferred@318325997 after retry RPC after error@406178802) -> (continuation of Deferred@1100453191 after retry RPC after error@936907865)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:52.802 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 0127c24cdb254b3b9444ea5f96a1b0ab for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
08:08:52.802 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet aa8885af14cf410093b0fc307e337db3 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
08:08:52.802 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 5b322ee1784745bfbf45b3b4ff0b9eee for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
08:08:52.802 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 57ec20d798834ab1a9d6bad82e7002fe for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
08:08:52.805 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 76d8c41bbf134c32947c73f9414f7aab for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
08:08:52.805 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 72ad21258ea34269bce6ae4c80b8e589 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
08:08:52.807 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=0127c24cdb254b3b9444ea5f96a1b0ab@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=aa8885af14cf410093b0fc307e337db3@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=5b322ee1784745bfbf45b3b4ff0b9eee@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)[L],ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=57ec20d798834ab1a9d6bad82e7002fe@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=76d8c41bbf134c32947c73f9414f7aab@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)[L],ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=72ad21258ea34269bce6ae4c80b8e589@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)[L],ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
08:08:52.807 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:08:52.808 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=12), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.134.252:42093, [7ms] Sub RPC GetTableLocations: received response from server master-127.1.134.252:42093: OK, deferred=null)) after lookup
08:08:52.817 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#7) of source Source: KuduSource.
08:08:52.817 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_7.
08:08:52.836 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0127c24cdb254b3b9444ea5f96a1b0ab, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:52.837 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0127c24cdb254b3b9444ea5f96a1b0ab for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
08:08:52.839 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:52.839 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:52.839 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:52.840 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:52.840 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:52.840 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:52.840 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:52.840 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:52.840 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:52.841 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:52.841 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:52.842 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:52.842 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:52.886 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=aa8885af14cf410093b0fc307e337db3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:52.886 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet aa8885af14cf410093b0fc307e337db3 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
08:08:52.902 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:52.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091732908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:08:52.930 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=21 ms, finalizationTime=1 ms).
08:08:52.933 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
08:08:52.995 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:52.995 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:52.995 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:52.996 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:52.996 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:52.996 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:52.997 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:52.997 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:52.997 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:52.997 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:52.997 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:52.997 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:52.998 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:53.040 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:53.061 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5b322ee1784745bfbf45b3b4ff0b9eee, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:53.062 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 5b322ee1784745bfbf45b3b4ff0b9eee for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
08:08:53.062 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:53.075 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=57ec20d798834ab1a9d6bad82e7002fe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:53.075 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 57ec20d798834ab1a9d6bad82e7002fe for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
08:08:53.118 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=76d8c41bbf134c32947c73f9414f7aab, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:53.118 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 76d8c41bbf134c32947c73f9414f7aab for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
08:08:53.119 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:53.130 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=72ad21258ea34269bce6ae4c80b8e589, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:53.131 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 72ad21258ea34269bce6ae4c80b8e589 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
08:08:53.141 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet fa47c603eff647ba8370b640a0a12ca5 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
08:08:53.141 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 753ee9c1b94445558ea041a6af8840ef for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
08:08:53.141 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 3c2bc0e61f964830a3058e48aa1f73e7 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
08:08:53.141 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet aaa1bd80c257434880e2a4e22043c2fe for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
08:08:53.141 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8f15d82f9ab44ea68386995444340bdc for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
08:08:53.141 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 680fb2eae00541b09ee3fae8748d9ec4 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
08:08:53.141 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=fa47c603eff647ba8370b640a0a12ca5@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617),fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=753ee9c1b94445558ea041a6af8840ef@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135)[L],5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617),fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=3c2bc0e61f964830a3058e48aa1f73e7@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=aaa1bd80c257434880e2a4e22043c2fe@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=8f15d82f9ab44ea68386995444340bdc@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=680fb2eae00541b09ee3fae8748d9ec4@[0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135),5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)[L],fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
08:08:53.149 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=17), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.2.90.188:42457, [8ms] Sub RPC GetTableLocations: received response from server master-127.2.90.188:42457: OK, deferred=null)) after lookup
08:08:53.162 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fa47c603eff647ba8370b640a0a12ca5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:53.162 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fa47c603eff647ba8370b640a0a12ca5 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
08:08:53.179 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=753ee9c1b94445558ea041a6af8840ef, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:53.184 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 753ee9c1b94445558ea041a6af8840ef for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
08:08:53.209 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3c2bc0e61f964830a3058e48aa1f73e7, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:53.210 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 3c2bc0e61f964830a3058e48aa1f73e7 for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
08:08:53.229 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=aaa1bd80c257434880e2a4e22043c2fe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:53.229 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet aaa1bd80c257434880e2a4e22043c2fe for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
08:08:53.240 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8f15d82f9ab44ea68386995444340bdc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:53.241 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8f15d82f9ab44ea68386995444340bdc for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
08:08:53.259 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:53.259 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:53.259 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:53.260 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:53.260 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:53.260 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:53.261 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:53.261 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:53.261 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:53.261 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:53.261 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:53.261 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:53.262 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:53.268 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:53.268 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:53.268 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:53.269 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:53.269 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=680fb2eae00541b09ee3fae8748d9ec4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:53.269 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:53.269 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:53.269 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 680fb2eae00541b09ee3fae8748d9ec4 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
08:08:53.270 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:53.270 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:53.270 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:53.270 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:53.270 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:53.270 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:53.270 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:53.295 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0127c24cdb254b3b9444ea5f96a1b0ab, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:53.296 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0127c24cdb254b3b9444ea5f96a1b0ab for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
08:08:53.307 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=aa8885af14cf410093b0fc307e337db3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:53.308 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet aa8885af14cf410093b0fc307e337db3 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
08:08:53.313 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:53.313 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:53.313 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:53.314 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:53.314 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:53.314 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:53.314 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:53.315 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:53.315 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:53.315 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:53.315 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:53.315 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:53.316 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:53.324 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5b322ee1784745bfbf45b3b4ff0b9eee, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:53.324 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 5b322ee1784745bfbf45b3b4ff0b9eee for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
08:08:53.397 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=57ec20d798834ab1a9d6bad82e7002fe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:53.397 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:53.398 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 57ec20d798834ab1a9d6bad82e7002fe for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
08:08:53.398 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:53.398 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:53.398 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:53.398 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:53.398 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:53.399 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:53.399 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:53.399 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:53.399 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:53.399 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:53.399 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:53.400 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:53.401 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:53.410 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091733408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:08:53.418 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:53.419 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:53.419 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:53.420 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:53.420 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:53.420 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:53.420 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:53.421 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:53.421 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:53.422 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:53.422 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:53.423 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:53.423 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:53.423 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:53.423 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:53.423 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:53.424 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:53.424 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:53.424 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:53.424 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:53.424 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:53.424 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:53.424 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:53.425 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:53.425 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:53.425 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:53.439 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=30 ms, finalizationTime=0 ms).
08:08:53.442 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
08:08:53.500 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=76d8c41bbf134c32947c73f9414f7aab, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:53.501 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 76d8c41bbf134c32947c73f9414f7aab for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
08:08:53.543 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:53.545 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:53.546 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:53.546 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:53.546 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:53.547 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:53.547 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:53.547 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:53.547 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:53.548 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:53.548 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:53.548 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:53.548 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:53.548 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:53.551 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=72ad21258ea34269bce6ae4c80b8e589, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:53.551 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 72ad21258ea34269bce6ae4c80b8e589 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
08:08:53.562 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:53.577 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:53.578 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:53.578 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:53.579 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:53.579 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:53.579 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:53.579 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:53.580 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:53.580 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:53.580 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:53.581 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:53.581 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:53.581 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:53.595 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fa47c603eff647ba8370b640a0a12ca5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:53.595 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fa47c603eff647ba8370b640a0a12ca5 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
08:08:53.619 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=753ee9c1b94445558ea041a6af8840ef, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:53.619 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 753ee9c1b94445558ea041a6af8840ef for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
08:08:53.620 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:53.665 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:53.666 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:53.666 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:53.667 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:53.667 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:53.667 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:53.668 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:53.668 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:53.668 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:53.669 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:53.669 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:53.669 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:53.669 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:53.689 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3c2bc0e61f964830a3058e48aa1f73e7, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:53.690 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 3c2bc0e61f964830a3058e48aa1f73e7 for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
08:08:53.704 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:53.704 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:53.704 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:53.705 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:53.705 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:53.706 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:53.706 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:53.706 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:53.706 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:53.706 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:53.706 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:53.708 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:53.708 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:53.764 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=aaa1bd80c257434880e2a4e22043c2fe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:53.764 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet aaa1bd80c257434880e2a4e22043c2fe for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
08:08:53.782 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:53.783 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:53.783 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:53.783 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:53.783 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:53.783 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:53.783 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:53.783 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:53.783 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:53.784 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:53.784 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:53.784 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:53.784 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:53.796 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 2a489752354241eebd5d00f80d2b9347
08:08:53.803 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 0127c24cdb254b3b9444ea5f96a1b0ab for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
08:08:53.803 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet aa8885af14cf410093b0fc307e337db3 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
08:08:53.803 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 5b322ee1784745bfbf45b3b4ff0b9eee for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
08:08:53.803 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 57ec20d798834ab1a9d6bad82e7002fe for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
08:08:53.803 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 76d8c41bbf134c32947c73f9414f7aab for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
08:08:53.803 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 72ad21258ea34269bce6ae4c80b8e589 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
08:08:53.804 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=0127c24cdb254b3b9444ea5f96a1b0ab@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=aa8885af14cf410093b0fc307e337db3@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=5b322ee1784745bfbf45b3b4ff0b9eee@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)[L],ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=57ec20d798834ab1a9d6bad82e7002fe@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=76d8c41bbf134c32947c73f9414f7aab@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)[L],ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=72ad21258ea34269bce6ae4c80b8e589@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)[L],ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
08:08:53.808 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='8bd6a15fed43391a5ae5f9e5cfd70181ab79571965626a83f96fb7275c9b22e1'}]
08:08:53.808 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='18a96b295423912b143b1dbe4b868661e33704cb287a2602f7a6016f71076df2'}]
08:08:53.810 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='154a05f296ece7cd8c3d9bc4a76b219efad1c2f978f8b420832de3e105b44fdc'}]
08:08:53.810 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:53.811 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
08:08:53.811 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:53.812 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299997, tablet=5b322ee1784745bfbf45b3b4ff0b9eee@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}]
08:08:53.812 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='b11944926a5f2d12ec60e5a4b33844a86b87aba785998d80f4cbd0102ccc6711'}]
08:08:53.812 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:53.813 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
08:08:53.814 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299997, tablet=0127c24cdb254b3b9444ea5f96a1b0ab@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)[L]]}]
08:08:53.814 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:53.815 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
08:08:53.815 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299997, tablet=aa8885af14cf410093b0fc307e337db3@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)[L]]}]
08:08:53.816 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
08:08:53.816 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299997, tablet=57ec20d798834ab1a9d6bad82e7002fe@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)[L]]}]
08:08:53.821 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] connecting to peer
08:08:53.830 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] connecting to peer
08:08:53.832 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8f15d82f9ab44ea68386995444340bdc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:53.832 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8f15d82f9ab44ea68386995444340bdc for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
08:08:53.837 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] connecting to peer
08:08:53.845 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] connecting to peer
08:08:53.846 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=680fb2eae00541b09ee3fae8748d9ec4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:53.847 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 680fb2eae00541b09ee3fae8748d9ec4 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
08:08:53.847 [DEBUG - main] (Connection.java:575) [peer 0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135)] disconnecting while in state READY
08:08:53.848 [DEBUG - main] (Connection.java:575) [peer master-127.2.90.189:41065(127.2.90.189:41065)] disconnecting while in state READY
08:08:53.848 [DEBUG - main] (Connection.java:575) [peer fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)] disconnecting while in state READY
08:08:53.848 [DEBUG - main] (Connection.java:575) [peer master-127.2.90.190:42265(127.2.90.190:42265)] disconnecting while in state READY
08:08:53.848 [DEBUG - main] (Connection.java:575) [peer master-127.2.90.188:42457(127.2.90.188:42457)] disconnecting while in state READY
08:08:53.848 [DEBUG - main] (Connection.java:575) [peer 5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)] disconnecting while in state READY
08:08:53.848 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.2.90.189:41065(127.2.90.189:41065)] handling channelInactive
08:08:53.848 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state READY due to: connection closed
08:08:53.849 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135)] handling channelInactive
08:08:53.849 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 0eddb522ea89403b931e52e7ea0a535b(127.2.90.129:37135)] cleaning up while in state READY due to: connection closed
08:08:53.849 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.2.90.190:42265(127.2.90.190:42265)] handling channelInactive
08:08:53.849 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state READY due to: connection closed
08:08:53.849 [DEBUG - kudu-nio-3] (Connection.java:239) [peer fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)] handling channelInactive
08:08:53.849 [DEBUG - kudu-nio-3] (Connection.java:709) [peer fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)] cleaning up while in state READY due to: connection closed
08:08:53.850 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.2.90.188:42457(127.2.90.188:42457)] handling channelInactive
08:08:53.850 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state READY due to: connection closed
08:08:53.850 [DEBUG - kudu-nio-0] (Connection.java:757) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] Successfully connected to peer
08:08:53.856 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:53.857 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-1
08:08:53.857 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-2
08:08:53.857 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-3
08:08:53.857 [DEBUG - kudu-nio-0] (Connection.java:757) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] Successfully connected to peer
08:08:53.858 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-4
08:08:53.859 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:53.859 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
08:08:53.860 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:53.860 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:53.860 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:53.861 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:53.861 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:53.861 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:53.861 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:53.861 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:53.862 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:53.862 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:53.862 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:53.862 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:53.867 [DEBUG - kudu-nio-0] (Connection.java:757) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] Successfully connected to peer
08:08:53.876 [DEBUG - kudu-nio-0] (Connection.java:757) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] Successfully connected to peer
08:08:53.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:53.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091733908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:08:53.926 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job 09c2845f1c2e95ee63afce247a128bdd (5104 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
08:08:53.929 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
08:08:53.948 [DEBUG - kudu-nio-5] (Connection.java:239) [peer 5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)] handling channelInactive
08:08:53.949 [DEBUG - kudu-nio-5] (Connection.java:709) [peer 5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)] cleaning up while in state READY due to: connection closed
08:08:53.949 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-5
08:08:53.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:53.951843  2410 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 2812
08:08:54.002 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.193
08:08:54.005 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.193
08:08:54.016 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.193
08:08:54.028 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:54.033 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.193
08:08:54.034 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:54.034 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:54.041 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:54.045 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x5ab2a628, L:/127.0.0.1:47678 - R:/127.1.134.193:41847] using SASL/PLAIN
08:08:54.047 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:54.048 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:54.048 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x5a4e5d6f, L:/127.0.0.1:47712 - R:/127.1.134.193:41847] using SASL/PLAIN
08:08:54.048 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:54.048 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:54.048 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:54.049 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:54.049 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:54.049 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:54.049 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:54.050 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:54.050 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:54.051 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x9ef793dc, L:/127.0.0.1:47690 - R:/127.1.134.193:41847] using SASL/PLAIN
08:08:54.062 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:54.065 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:54.065 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:54.086 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159741607936001) for scanner KuduScanner(table=replication_test_table, tablet=aa8885af14cf410093b0fc307e337db3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:54.087 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [154a05f296ece7cd8c3d9bc4a76b219efad1c2f978f8b420832de3e105b44fdc]
08:08:54.087 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [154a05f296ece7cd8c3d9bc4a76b219efad1c2f978f8b420832de3e105b44fdc]
08:08:54.088 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
08:08:54.088 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
08:08:54.091 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 154a05f296ece7cd8c3d9bc4a76b219efad1c2f978f8b420832de3e105b44fdc finished by subtask 3; deferring removal (restored in pending)
08:08:54.092 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] disconnecting while in state READY
08:08:54.093 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:54.094 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='573d93efb4cf9caa54d1fae28cd8c5b32f1a3b1b48da395a5884bcbe42124677'}]
08:08:54.096 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:54.106 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
08:08:54.109 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
08:08:54.110 [DEBUG - kudu-nio-0] (Connection.java:239) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] handling channelInactive
08:08:54.110 [DEBUG - kudu-nio-0] (Connection.java:709) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] cleaning up while in state READY due to: connection closed
08:08:54.110 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
08:08:54.113 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299995, tablet=76d8c41bbf134c32947c73f9414f7aab@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}]
08:08:54.120 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:54.125 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:54.134 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159741607936001) for scanner KuduScanner(table=replication_test_table, tablet=5b322ee1784745bfbf45b3b4ff0b9eee, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:54.136 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [8bd6a15fed43391a5ae5f9e5cfd70181ab79571965626a83f96fb7275c9b22e1]
08:08:54.136 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [8bd6a15fed43391a5ae5f9e5cfd70181ab79571965626a83f96fb7275c9b22e1]
08:08:54.137 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
08:08:54.137 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
08:08:54.139 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 8bd6a15fed43391a5ae5f9e5cfd70181ab79571965626a83f96fb7275c9b22e1 finished by subtask 1; deferring removal (restored in pending)
08:08:54.140 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] disconnecting while in state READY
08:08:54.141 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:54.142 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='58a31788578393d7f6f63d6957673a38c278d722b5436f5e54c0ad6e6097a899'}]
08:08:54.145 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:54.146 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
08:08:54.147 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299997, tablet=72ad21258ea34269bce6ae4c80b8e589@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}]
08:08:54.148 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] connecting to peer
08:08:54.164 [DEBUG - kudu-nio-0] (Connection.java:239) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] handling channelInactive
08:08:54.164 [DEBUG - kudu-nio-0] (Connection.java:709) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] cleaning up while in state READY due to: connection closed
08:08:54.165 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
08:08:54.165 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
08:08:54.167 [DEBUG - kudu-nio-0] (Connection.java:757) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] Successfully connected to peer
08:08:54.169 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] connecting to peer
08:08:54.171 [DEBUG - kudu-nio-0] (Connection.java:757) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] Successfully connected to peer
08:08:54.210 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159741607936001) for scanner KuduScanner(table=replication_test_table, tablet=0127c24cdb254b3b9444ea5f96a1b0ab, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:54.212 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [18a96b295423912b143b1dbe4b868661e33704cb287a2602f7a6016f71076df2]
08:08:54.212 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [18a96b295423912b143b1dbe4b868661e33704cb287a2602f7a6016f71076df2]
08:08:54.213 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
08:08:54.213 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
08:08:54.215 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 18a96b295423912b143b1dbe4b868661e33704cb287a2602f7a6016f71076df2 finished by subtask 2; deferring removal (restored in pending)
08:08:54.219 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] disconnecting while in state READY
08:08:54.225 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:54.238 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:54.238 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:54.238 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:54.239 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.193
08:08:54.239 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:54.239 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:54.239 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:54.240 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:54.240 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:54.240 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:54.240 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:54.240 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:54.241 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:54.241 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:54.245 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x2a0eabbc, L:/127.0.0.1:47700 - R:/127.1.134.193:41847] using SASL/PLAIN
08:08:54.246 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.193
08:08:54.280 [DEBUG - kudu-nio-0] (Connection.java:239) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] handling channelInactive
08:08:54.280 [DEBUG - kudu-nio-0] (Connection.java:709) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] cleaning up while in state READY due to: connection closed
08:08:54.281 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
08:08:54.281 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
08:08:54.292 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:54.298 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:54.311 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159741607936001) for scanner KuduScanner(table=replication_test_table, tablet=57ec20d798834ab1a9d6bad82e7002fe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:54.313 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [b11944926a5f2d12ec60e5a4b33844a86b87aba785998d80f4cbd0102ccc6711]
08:08:54.313 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [b11944926a5f2d12ec60e5a4b33844a86b87aba785998d80f4cbd0102ccc6711]
08:08:54.313 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
08:08:54.313 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
08:08:54.314 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] disconnecting while in state READY
08:08:54.314 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split b11944926a5f2d12ec60e5a4b33844a86b87aba785998d80f4cbd0102ccc6711 finished by subtask 0; deferring removal (restored in pending)
08:08:54.318 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:54.321 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd92ad7c2, L:/127.0.0.1:47728 - R:/127.1.134.193:41847] using SASL/PLAIN
08:08:54.349 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:54.349 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:54.349 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:54.350 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:54.350 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:54.350 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:54.351 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:54.351 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:54.351 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:54.351 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:54.351 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:54.351 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:54.351 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:54.359 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x55a66ad2, L:/127.0.0.1:47722 - R:/127.1.134.193:41847] using SASL/PLAIN
08:08:54.360 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159741607936001) for scanner KuduScanner(table=replication_test_table, tablet=72ad21258ea34269bce6ae4c80b8e589, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:54.361 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [58a31788578393d7f6f63d6957673a38c278d722b5436f5e54c0ad6e6097a899]
08:08:54.361 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [58a31788578393d7f6f63d6957673a38c278d722b5436f5e54c0ad6e6097a899]
08:08:54.362 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
08:08:54.362 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
08:08:54.363 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 58a31788578393d7f6f63d6957673a38c278d722b5436f5e54c0ad6e6097a899 finished by subtask 1; deferring removal (restored in pending)
08:08:54.363 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] disconnecting while in state READY
08:08:54.369 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:54.385 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:54.386 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:54.386 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:54.386 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:54.386 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:54.386 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:54.387 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:54.387 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:54.386 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:54.387 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:54.387 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:54.387 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:54.387 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:54.388 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:54.388 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:54.388 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:54.389 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:54.389 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:54.389 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:54.389 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:54.389 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:54.389 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:54.390 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:54.390 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:54.390 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:54.390 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:54.401 [DEBUG - kudu-nio-0] (Connection.java:239) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] handling channelInactive
08:08:54.401 [DEBUG - kudu-nio-0] (Connection.java:709) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] cleaning up while in state READY due to: connection closed
08:08:54.401 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
08:08:54.402 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
08:08:54.404 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:54.405 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:54.405 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:54.406 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:54.406 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:54.406 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:54.406 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:54.407 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:54.407 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:54.407 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:54.407 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:54.407 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:54.407 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:54.408 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:54.410 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091734409 for job 09c2845f1c2e95ee63afce247a128bdd.
08:08:54.433 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job 09c2845f1c2e95ee63afce247a128bdd (5104 bytes, checkpointDuration=23 ms, finalizationTime=0 ms).
08:08:54.439 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
08:08:54.439 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 58a31788578393d7f6f63d6957673a38c278d722b5436f5e54c0ad6e6097a899 from pending
08:08:54.440 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 18a96b295423912b143b1dbe4b868661e33704cb287a2602f7a6016f71076df2 from pending
08:08:54.440 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 154a05f296ece7cd8c3d9bc4a76b219efad1c2f978f8b420832de3e105b44fdc from pending
08:08:54.440 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 8bd6a15fed43391a5ae5f9e5cfd70181ab79571965626a83f96fb7275c9b22e1 from pending
08:08:54.440 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split b11944926a5f2d12ec60e5a4b33844a86b87aba785998d80f4cbd0102ccc6711 from pending
08:08:54.440 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 8 complete: removed 5 finished splits from enumerator state
08:08:54.442 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159741607936001) for scanner KuduScanner(table=replication_test_table, tablet=76d8c41bbf134c32947c73f9414f7aab, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:54.443 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [573d93efb4cf9caa54d1fae28cd8c5b32f1a3b1b48da395a5884bcbe42124677]
08:08:54.443 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [573d93efb4cf9caa54d1fae28cd8c5b32f1a3b1b48da395a5884bcbe42124677]
08:08:54.444 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
08:08:54.444 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
08:08:54.445 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 573d93efb4cf9caa54d1fae28cd8c5b32f1a3b1b48da395a5884bcbe42124677 finished by subtask 3; deferring removal (restored in pending)
08:08:54.445 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] disconnecting while in state READY
08:08:54.446 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:54.481 [DEBUG - kudu-nio-0] (Connection.java:239) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] handling channelInactive
08:08:54.481 [DEBUG - kudu-nio-0] (Connection.java:709) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] cleaning up while in state READY due to: connection closed
08:08:54.482 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:08:54.482 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
08:08:54.507 [DEBUG - kudu-nio-0] (Connection.java:239) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] handling channelInactive
08:08:54.507 [DEBUG - kudu-nio-0] (Connection.java:709) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] cleaning up while in state READY due to: connection closed
08:08:54.507 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:08:54.508 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
08:08:54.540 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:54.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:54.550786  1916 debug-util.cc:398] Leaking SignalData structure 0x7b08000af500 after lost signal to thread 1738
08:08:54.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:54.551687  1916 debug-util.cc:398] Leaking SignalData structure 0x7b0800098d00 after lost signal to thread 1919
08:08:54.562 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:54.568 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:54.568 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:54.568 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:54.569 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:54.569 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:54.569 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:54.570 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:54.570 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:54.570 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:54.572 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:54.572 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:54.572 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:54.572 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:54.620 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:54.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:54.645756  3013 connection.cc:582] client connection to 127.2.90.129:37135 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:08:54.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:54.646293  3013 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:08:54.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:54.653028  3213 connection.cc:582] client connection to 127.2.90.129:37135 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:08:54.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:54.653638  3213 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:08:54.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:54.671166  2410 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 2978
08:08:54.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:54.708513  3213 consensus_peers.cc:597] T fa47c603eff647ba8370b640a0a12ca5 P fecbf6c21a40400fac9aa6a557be405c -> Peer 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135): Couldn't send request to peer 0eddb522ea89403b931e52e7ea0a535b. Status: Network error: Client connection negotiation failed: client connection to 127.2.90.129:37135: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
08:08:54.880 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:54.881 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:54.881 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:54.881 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:54.881 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:54.882 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:54.882 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:54.881 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:54.882 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:54.882 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:54.882 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:54.882 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:54.882 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:54.884 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=20, TimeoutTracker(timeout=30000, elapsed=26080), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [47ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [48ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [49ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [49ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [149ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [157ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [181ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [181ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [228ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [230ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [230ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [231ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [232ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [233ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [242ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [243ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [243ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [243ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [262ms] refreshing cache from master, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [263ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [264ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [264ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [264ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [302ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [303ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [303ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [303ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [380ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [382ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [383ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [383ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [383ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [503ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [504ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [504ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [504ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [522ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [523ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [524ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [524ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1003ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1020ms] refreshing cache from master, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1023ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1023ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1761ms] refreshing cache from master, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1764ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [5020ms] refreshing cache from master, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [5022ms] too many traces: truncated at 100 traces, deferred=Deferred@543316077(state=PENDING, result=null, callback=(continuation of Deferred@530862882 after retry RPC after error@1436614164) -> (continuation of Deferred@246168416 after retry RPC after error@1010805736) -> (continuation of Deferred@29348366 after retry RPC after error@1396558963) -> (continuation of Deferred@1009093199 after retry RPC after error@2105804488) -> (continuation of Deferred@47486164 after retry RPC after error@1060605609) -> (continuation of Deferred@793775346 after retry RPC after error@1916796310) -> (continuation of Deferred@1416340785 after retry RPC after error@1470774227) -> (continuation of Deferred@2016582216 after retry RPC after error@1978407829) -> (continuation of Deferred@2082957876 after retry RPC after error@2052436672) -> (continuation of Deferred@383354648 after retry RPC after error@58459877) -> (continuation of Deferred@1145940596 after retry RPC after error@324649871) -> (continuation of Deferred@1231185851 after retry RPC after error@709499740) -> (continuation of Deferred@66919019 after retry RPC after error@1583735840) -> (continuation of Deferred@81797096 after retry RPC after error@2123003091) -> (continuation of Deferred@357500715 after retry RPC after error@1694147910) -> (continuation of Deferred@1625422190 after retry RPC after error@1298146637) -> (continuation of Deferred@544933269 after retry RPC after error@295322697) -> (continuation of Deferred@2120213917 after retry RPC after error@844758358) -> (continuation of Deferred@1257640229 after retry RPC after error@160279614), errback=(continuation of Deferred@530862882 after retry RPC after error@1436614164) -> (continuation of Deferred@246168416 after retry RPC after error@1010805736) -> (continuation of Deferred@29348366 after retry RPC after error@1396558963) -> (continuation of Deferred@1009093199 after retry RPC after error@2105804488) -> (continuation of Deferred@47486164 after retry RPC after error@1060605609) -> (continuation of Deferred@793775346 after retry RPC after error@1916796310) -> (continuation of Deferred@1416340785 after retry RPC after error@1470774227) -> (continuation of Deferred@2016582216 after retry RPC after error@1978407829) -> (continuation of Deferred@2082957876 after retry RPC after error@2052436672) -> (continuation of Deferred@383354648 after retry RPC after error@58459877) -> (continuation of Deferred@1145940596 after retry RPC after error@324649871) -> (continuation of Deferred@1231185851 after retry RPC after error@709499740) -> (continuation of Deferred@66919019 after retry RPC after error@1583735840) -> (continuation of Deferred@81797096 after retry RPC after error@2123003091) -> (continuation of Deferred@357500715 after retry RPC after error@1694147910) -> (continuation of Deferred@1625422190 after retry RPC after error@1298146637) -> (continuation of Deferred@544933269 after retry RPC after error@295322697) -> (continuation of Deferred@2120213917 after retry RPC after error@844758358) -> (continuation of Deferred@1257640229 after retry RPC after error@160279614)))
08:08:54.886 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:54.886 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:54.886 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:54.888 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:54.888 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:54.888 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:54.888 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=20, TimeoutTracker(timeout=30000, elapsed=26080), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [47ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [48ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [49ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [49ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [149ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [157ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [181ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [181ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [228ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [230ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [230ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [231ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [232ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [233ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [242ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [243ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [243ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [243ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [262ms] refreshing cache from master, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [263ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [264ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [264ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [264ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [302ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [303ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [303ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [303ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [380ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [382ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [383ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [383ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [383ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [503ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [504ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [504ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [504ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [522ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [523ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [524ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [524ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1003ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1020ms] refreshing cache from master, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1023ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1023ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1761ms] refreshing cache from master, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1764ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [5020ms] refreshing cache from master, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [5022ms] too many traces: truncated at 100 traces, deferred=Deferred@543316077(state=PENDING, result=null, callback=(continuation of Deferred@530862882 after retry RPC after error@1436614164) -> (continuation of Deferred@246168416 after retry RPC after error@1010805736) -> (continuation of Deferred@29348366 after retry RPC after error@1396558963) -> (continuation of Deferred@1009093199 after retry RPC after error@2105804488) -> (continuation of Deferred@47486164 after retry RPC after error@1060605609) -> (continuation of Deferred@793775346 after retry RPC after error@1916796310) -> (continuation of Deferred@1416340785 after retry RPC after error@1470774227) -> (continuation of Deferred@2016582216 after retry RPC after error@1978407829) -> (continuation of Deferred@2082957876 after retry RPC after error@2052436672) -> (continuation of Deferred@383354648 after retry RPC after error@58459877) -> (continuation of Deferred@1145940596 after retry RPC after error@324649871) -> (continuation of Deferred@1231185851 after retry RPC after error@709499740) -> (continuation of Deferred@66919019 after retry RPC after error@1583735840) -> (continuation of Deferred@81797096 after retry RPC after error@2123003091) -> (continuation of Deferred@357500715 after retry RPC after error@1694147910) -> (continuation of Deferred@1625422190 after retry RPC after error@1298146637) -> (continuation of Deferred@544933269 after retry RPC after error@295322697) -> (continuation of Deferred@2120213917 after retry RPC after error@844758358) -> (continuation of Deferred@1257640229 after retry RPC after error@160279614), errback=(continuation of Deferred@530862882 after retry RPC after error@1436614164) -> (continuation of Deferred@246168416 after retry RPC after error@1010805736) -> (continuation of Deferred@29348366 after retry RPC after error@1396558963) -> (continuation of Deferred@1009093199 after retry RPC after error@2105804488) -> (continuation of Deferred@47486164 after retry RPC after error@1060605609) -> (continuation of Deferred@793775346 after retry RPC after error@1916796310) -> (continuation of Deferred@1416340785 after retry RPC after error@1470774227) -> (continuation of Deferred@2016582216 after retry RPC after error@1978407829) -> (continuation of Deferred@2082957876 after retry RPC after error@2052436672) -> (continuation of Deferred@383354648 after retry RPC after error@58459877) -> (continuation of Deferred@1145940596 after retry RPC after error@324649871) -> (continuation of Deferred@1231185851 after retry RPC after error@709499740) -> (continuation of Deferred@66919019 after retry RPC after error@1583735840) -> (continuation of Deferred@81797096 after retry RPC after error@2123003091) -> (continuation of Deferred@357500715 after retry RPC after error@1694147910) -> (continuation of Deferred@1625422190 after retry RPC after error@1298146637) -> (continuation of Deferred@544933269 after retry RPC after error@295322697) -> (continuation of Deferred@2120213917 after retry RPC after error@844758358) -> (continuation of Deferred@1257640229 after retry RPC after error@160279614)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=20, TimeoutTracker(timeout=30000, elapsed=26080), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [47ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [48ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [49ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [49ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [149ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [157ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [181ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [181ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [228ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [230ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [230ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [231ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [232ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [233ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [242ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [243ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [243ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [243ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [262ms] refreshing cache from master, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [263ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [264ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [264ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [264ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [302ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [303ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [303ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [303ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [380ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [382ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [383ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [383ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [383ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [503ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [504ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [504ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [504ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [522ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [523ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [524ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [524ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1003ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1020ms] refreshing cache from master, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1023ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1023ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1761ms] refreshing cache from master, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1764ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [5020ms] refreshing cache from master, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [5022ms] too many traces: truncated at 100 traces, deferred=Deferred@543316077(state=PENDING, result=null, callback=(continuation of Deferred@530862882 after retry RPC after error@1436614164) -> (continuation of Deferred@246168416 after retry RPC after error@1010805736) -> (continuation of Deferred@29348366 after retry RPC after error@1396558963) -> (continuation of Deferred@1009093199 after retry RPC after error@2105804488) -> (continuation of Deferred@47486164 after retry RPC after error@1060605609) -> (continuation of Deferred@793775346 after retry RPC after error@1916796310) -> (continuation of Deferred@1416340785 after retry RPC after error@1470774227) -> (continuation of Deferred@2016582216 after retry RPC after error@1978407829) -> (continuation of Deferred@2082957876 after retry RPC after error@2052436672) -> (continuation of Deferred@383354648 after retry RPC after error@58459877) -> (continuation of Deferred@1145940596 after retry RPC after error@324649871) -> (continuation of Deferred@1231185851 after retry RPC after error@709499740) -> (continuation of Deferred@66919019 after retry RPC after error@1583735840) -> (continuation of Deferred@81797096 after retry RPC after error@2123003091) -> (continuation of Deferred@357500715 after retry RPC after error@1694147910) -> (continuation of Deferred@1625422190 after retry RPC after error@1298146637) -> (continuation of Deferred@544933269 after retry RPC after error@295322697) -> (continuation of Deferred@2120213917 after retry RPC after error@844758358) -> (continuation of Deferred@1257640229 after retry RPC after error@160279614), errback=(continuation of Deferred@530862882 after retry RPC after error@1436614164) -> (continuation of Deferred@246168416 after retry RPC after error@1010805736) -> (continuation of Deferred@29348366 after retry RPC after error@1396558963) -> (continuation of Deferred@1009093199 after retry RPC after error@2105804488) -> (continuation of Deferred@47486164 after retry RPC after error@1060605609) -> (continuation of Deferred@793775346 after retry RPC after error@1916796310) -> (continuation of Deferred@1416340785 after retry RPC after error@1470774227) -> (continuation of Deferred@2016582216 after retry RPC after error@1978407829) -> (continuation of Deferred@2082957876 after retry RPC after error@2052436672) -> (continuation of Deferred@383354648 after retry RPC after error@58459877) -> (continuation of Deferred@1145940596 after retry RPC after error@324649871) -> (continuation of Deferred@1231185851 after retry RPC after error@709499740) -> (continuation of Deferred@66919019 after retry RPC after error@1583735840) -> (continuation of Deferred@81797096 after retry RPC after error@2123003091) -> (continuation of Deferred@357500715 after retry RPC after error@1694147910) -> (continuation of Deferred@1625422190 after retry RPC after error@1298146637) -> (continuation of Deferred@544933269 after retry RPC after error@295322697) -> (continuation of Deferred@2120213917 after retry RPC after error@844758358) -> (continuation of Deferred@1257640229 after retry RPC after error@160279614)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.31.46.253:46697
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:54.890 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:54.890 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:54.890 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:54.890 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:54.890 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:54.890 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:54.891 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:54.900 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:54.900 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:54.901 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:54.901 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:54.901 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:54.901 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:54.901 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:54.901 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:54.901 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:54.902 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:54.902 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:54.902 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:54.902 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:54.902 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:54.906 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=20, TimeoutTracker(timeout=30000, elapsed=26080), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [47ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [48ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [49ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [49ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [149ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [157ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [181ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [181ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [228ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [230ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [230ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [231ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [232ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [233ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [242ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [243ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [243ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [243ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [262ms] refreshing cache from master, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [263ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [264ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [264ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [264ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [302ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [303ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [303ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [303ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [380ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [382ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [383ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [383ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [383ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [503ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [504ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [504ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [504ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [522ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [523ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [524ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [524ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1003ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1020ms] refreshing cache from master, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1023ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1023ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1761ms] refreshing cache from master, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1764ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [5020ms] refreshing cache from master, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [5022ms] too many traces: truncated at 100 traces, deferred=Deferred@543316077(state=PENDING, result=null, callback=(continuation of Deferred@530862882 after retry RPC after error@1436614164) -> (continuation of Deferred@246168416 after retry RPC after error@1010805736) -> (continuation of Deferred@29348366 after retry RPC after error@1396558963) -> (continuation of Deferred@1009093199 after retry RPC after error@2105804488) -> (continuation of Deferred@47486164 after retry RPC after error@1060605609) -> (continuation of Deferred@793775346 after retry RPC after error@1916796310) -> (continuation of Deferred@1416340785 after retry RPC after error@1470774227) -> (continuation of Deferred@2016582216 after retry RPC after error@1978407829) -> (continuation of Deferred@2082957876 after retry RPC after error@2052436672) -> (continuation of Deferred@383354648 after retry RPC after error@58459877) -> (continuation of Deferred@1145940596 after retry RPC after error@324649871) -> (continuation of Deferred@1231185851 after retry RPC after error@709499740) -> (continuation of Deferred@66919019 after retry RPC after error@1583735840) -> (continuation of Deferred@81797096 after retry RPC after error@2123003091) -> (continuation of Deferred@357500715 after retry RPC after error@1694147910) -> (continuation of Deferred@1625422190 after retry RPC after error@1298146637) -> (continuation of Deferred@544933269 after retry RPC after error@295322697) -> (continuation of Deferred@2120213917 after retry RPC after error@844758358) -> (continuation of Deferred@1257640229 after retry RPC after error@160279614), errback=(continuation of Deferred@530862882 after retry RPC after error@1436614164) -> (continuation of Deferred@246168416 after retry RPC after error@1010805736) -> (continuation of Deferred@29348366 after retry RPC after error@1396558963) -> (continuation of Deferred@1009093199 after retry RPC after error@2105804488) -> (continuation of Deferred@47486164 after retry RPC after error@1060605609) -> (continuation of Deferred@793775346 after retry RPC after error@1916796310) -> (continuation of Deferred@1416340785 after retry RPC after error@1470774227) -> (continuation of Deferred@2016582216 after retry RPC after error@1978407829) -> (continuation of Deferred@2082957876 after retry RPC after error@2052436672) -> (continuation of Deferred@383354648 after retry RPC after error@58459877) -> (continuation of Deferred@1145940596 after retry RPC after error@324649871) -> (continuation of Deferred@1231185851 after retry RPC after error@709499740) -> (continuation of Deferred@66919019 after retry RPC after error@1583735840) -> (continuation of Deferred@81797096 after retry RPC after error@2123003091) -> (continuation of Deferred@357500715 after retry RPC after error@1694147910) -> (continuation of Deferred@1625422190 after retry RPC after error@1298146637) -> (continuation of Deferred@544933269 after retry RPC after error@295322697) -> (continuation of Deferred@2120213917 after retry RPC after error@844758358) -> (continuation of Deferred@1257640229 after retry RPC after error@160279614)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=20, TimeoutTracker(timeout=30000, elapsed=26080), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [47ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [48ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [49ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [49ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [149ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [157ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [181ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [181ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [228ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [230ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [230ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [231ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [232ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [233ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [242ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [243ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [243ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [243ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [262ms] refreshing cache from master, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [263ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [264ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [264ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [264ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [302ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [303ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [303ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [303ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [380ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [382ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [383ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [383ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [383ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [503ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [504ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [504ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [504ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [522ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [523ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [524ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [524ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1003ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1020ms] refreshing cache from master, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1023ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1023ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1761ms] refreshing cache from master, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1764ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [5020ms] refreshing cache from master, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [5022ms] too many traces: truncated at 100 traces, deferred=Deferred@543316077(state=PENDING, result=null, callback=(continuation of Deferred@530862882 after retry RPC after error@1436614164) -> (continuation of Deferred@246168416 after retry RPC after error@1010805736) -> (continuation of Deferred@29348366 after retry RPC after error@1396558963) -> (continuation of Deferred@1009093199 after retry RPC after error@2105804488) -> (continuation of Deferred@47486164 after retry RPC after error@1060605609) -> (continuation of Deferred@793775346 after retry RPC after error@1916796310) -> (continuation of Deferred@1416340785 after retry RPC after error@1470774227) -> (continuation of Deferred@2016582216 after retry RPC after error@1978407829) -> (continuation of Deferred@2082957876 after retry RPC after error@2052436672) -> (continuation of Deferred@383354648 after retry RPC after error@58459877) -> (continuation of Deferred@1145940596 after retry RPC after error@324649871) -> (continuation of Deferred@1231185851 after retry RPC after error@709499740) -> (continuation of Deferred@66919019 after retry RPC after error@1583735840) -> (continuation of Deferred@81797096 after retry RPC after error@2123003091) -> (continuation of Deferred@357500715 after retry RPC after error@1694147910) -> (continuation of Deferred@1625422190 after retry RPC after error@1298146637) -> (continuation of Deferred@544933269 after retry RPC after error@295322697) -> (continuation of Deferred@2120213917 after retry RPC after error@844758358) -> (continuation of Deferred@1257640229 after retry RPC after error@160279614), errback=(continuation of Deferred@530862882 after retry RPC after error@1436614164) -> (continuation of Deferred@246168416 after retry RPC after error@1010805736) -> (continuation of Deferred@29348366 after retry RPC after error@1396558963) -> (continuation of Deferred@1009093199 after retry RPC after error@2105804488) -> (continuation of Deferred@47486164 after retry RPC after error@1060605609) -> (continuation of Deferred@793775346 after retry RPC after error@1916796310) -> (continuation of Deferred@1416340785 after retry RPC after error@1470774227) -> (continuation of Deferred@2016582216 after retry RPC after error@1978407829) -> (continuation of Deferred@2082957876 after retry RPC after error@2052436672) -> (continuation of Deferred@383354648 after retry RPC after error@58459877) -> (continuation of Deferred@1145940596 after retry RPC after error@324649871) -> (continuation of Deferred@1231185851 after retry RPC after error@709499740) -> (continuation of Deferred@66919019 after retry RPC after error@1583735840) -> (continuation of Deferred@81797096 after retry RPC after error@2123003091) -> (continuation of Deferred@357500715 after retry RPC after error@1694147910) -> (continuation of Deferred@1625422190 after retry RPC after error@1298146637) -> (continuation of Deferred@544933269 after retry RPC after error@295322697) -> (continuation of Deferred@2120213917 after retry RPC after error@844758358) -> (continuation of Deferred@1257640229 after retry RPC after error@160279614)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.31.46.253:46697
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:54.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091734908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:08:54.920 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:54.922 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job 09c2845f1c2e95ee63afce247a128bdd (1654 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
08:08:54.925 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:54.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:54.938599  2290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.134.193:41847, user_credentials={real_user=slave}} blocked reactor thread for 44147.8us
08:08:54.939 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:54.939 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:54.939 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:54.940 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:54.940 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:54.940 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:54.940 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:54.940 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:54.941 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:54.941 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:54.942 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
08:08:54.959 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 573d93efb4cf9caa54d1fae28cd8c5b32f1a3b1b48da395a5884bcbe42124677 from pending
08:08:54.959 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 9 complete: removed 1 finished splits from enumerator state
08:08:54.959 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:54.959 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
08:08:54.959 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:54.959 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:54.959 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:54.960 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:54.960 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:54.960 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:54.960 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:54.960 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:54.960 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:54.960 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:54.961 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:54.961 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:54.961 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:54.961 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (da74ffd3de6ba1563e412fcb34de5c51) switched from state RUNNING to RESTARTING.
08:08:54.963 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#1) of source Source: KuduSource.
08:08:54.964 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to CANCELING.
08:08:54.964 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#1) of source Source: KuduSource.
08:08:54.965 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to CANCELING.
08:08:54.966 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
08:08:54.966 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to CANCELING.
08:08:54.966 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
08:08:54.966 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#1) of source Source: KuduSource.
08:08:54.966 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to CANCELING.
08:08:54.967 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#1) of source Source: KuduSource.
08:08:54.967 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to CANCELING.
08:08:54.980 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:54.981 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:54.981 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:54.982 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:54.982 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:54.982 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:54.982 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:54.982 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:54.982 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:54.983 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:54.983 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:54.983 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:54.983 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:55.000 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:55.001 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:55.001 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:55.001 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:55.001 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:55.001 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:55.002 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:55.002 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:55.002 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:55.002 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:55.002 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:55.002 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:55.002 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:55.007 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
08:08:55.007 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CANCELING to CANCELED.
08:08:55.007 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
08:08:55.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:55.004276  3928 raft_consensus.cc:493] T 753ee9c1b94445558ea041a6af8840ef P fecbf6c21a40400fac9aa6a557be405c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0eddb522ea89403b931e52e7ea0a535b)
08:08:55.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:55.005090  3928 raft_consensus.cc:515] T 753ee9c1b94445558ea041a6af8840ef P fecbf6c21a40400fac9aa6a557be405c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0eddb522ea89403b931e52e7ea0a535b" member_type: VOTER last_known_addr { host: "127.2.90.129" port: 37135 } } peers { permanent_uuid: "5e3589ebfaf94fe5849b6322dc8e0be0" member_type: VOTER last_known_addr { host: "127.2.90.130" port: 34617 } } peers { permanent_uuid: "fecbf6c21a40400fac9aa6a557be405c" member_type: VOTER last_known_addr { host: "127.2.90.131" port: 33107 } }
08:08:55.020 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:55.020 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:55.021 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:55.021 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:55.021 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:55.022 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:55.022 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:55.022 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:55.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:55.022171  3213 leader_election.cc:336] T 753ee9c1b94445558ea041a6af8840ef P fecbf6c21a40400fac9aa6a557be405c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135): Network error: Client connection negotiation failed: client connection to 127.2.90.129:37135: connect: Connection refused (error 111)
08:08:55.022 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:55.022 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:55.022 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:55.023 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:55.023 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:55.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:55.007520  3928 leader_election.cc:290] T 753ee9c1b94445558ea041a6af8840ef P fecbf6c21a40400fac9aa6a557be405c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0eddb522ea89403b931e52e7ea0a535b (127.2.90.129:37135), 5e3589ebfaf94fe5849b6322dc8e0be0 (127.2.90.130:34617)
08:08:55.038 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
08:08:55.038 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to CANCELING.
08:08:55.038 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
08:08:55.040 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:55.045 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)] handling channelInactive
08:08:55.045 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)] cleaning up while in state READY due to: connection closed
08:08:55.062 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:55.065 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
08:08:55.066 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CANCELING to CANCELED.
08:08:55.066 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
08:08:55.086 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)] handling channelInactive
08:08:55.086 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)] cleaning up while in state READY due to: connection closed
08:08:55.086 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)] handling channelInactive
08:08:55.086 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)] cleaning up while in state READY due to: connection closed
08:08:55.087 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)] handling channelInactive
08:08:55.087 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)] cleaning up while in state READY due to: connection closed
08:08:55.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:55.089197  3213 connection.cc:582] client connection to 127.2.90.130:34617 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:08:55.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:55.098253  2410 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 3134
08:08:55.100 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:55.100 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:55.101 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:55.101 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:55.101 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:55.101 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:55.102 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:55.102 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:55.102 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:55.102 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:55.102 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:55.103 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:55.103 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:55.105 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
08:08:55.105 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to CANCELING.
08:08:55.105 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
08:08:55.115 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
08:08:55.115 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CANCELING to CANCELED.
08:08:55.115 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
08:08:55.125 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
08:08:55.125 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to CANCELING.
08:08:55.126 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
08:08:55.131 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
08:08:55.131 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CANCELING to CANCELED.
08:08:55.131 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#1 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
08:08:55.160 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:55.160 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:55.161 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:55.161 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:55.161 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:55.162 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:55.162 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:55.162 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:55.162 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:55.162 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:55.162 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:55.162 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:55.162 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:55.168 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#1 baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
08:08:55.169 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#1 baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
08:08:55.169 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#1 baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
08:08:55.169 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#1 baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
08:08:55.170 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CANCELING to CANCELED.
08:08:55.171 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CANCELING to CANCELED.
08:08:55.171 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job da74ffd3de6ba1563e412fcb34de5c51: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:08:55.173 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job da74ffd3de6ba1563e412fcb34de5c51: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:08:55.174 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CANCELING to CANCELED.
08:08:55.175 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job da74ffd3de6ba1563e412fcb34de5c51: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:08:55.175 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CANCELING to CANCELED.
08:08:55.176 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:318) Clearing resource requirements of job da74ffd3de6ba1563e412fcb34de5c51
08:08:55.323 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:55.323 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:55.324 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:55.324 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:55.324 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:55.324 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:55.324 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:55.324 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:55.324 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:55.324 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:55.325 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:55.325 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:55.325 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:55.343 [DEBUG - kudu-nio-3] (Connection.java:239) [peer fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)] handling channelInactive
08:08:55.343 [DEBUG - kudu-nio-3] (Connection.java:709) [peer fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)] cleaning up while in state READY due to: connection closed
08:08:55.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:55.359151  2410 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 2422
08:08:55.380 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:55.380 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:55.381 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:55.381 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:55.381 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:55.381 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:55.381 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:55.381 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:55.382 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:55.382 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:55.382 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:55.381 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:55.385 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:55.400 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:55.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091735408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:08:55.424 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
08:08:55.427 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
08:08:55.487 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.2.90.190:42265(127.2.90.190:42265)] handling channelInactive
08:08:55.487 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state READY due to: connection closed
08:08:55.489 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.2.90.190:42265(127.2.90.190:42265)] handling channelInactive
08:08:55.489 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state READY due to: connection closed
08:08:55.502 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.2.90.190:42265(127.2.90.190:42265)] handling channelInactive
08:08:55.502 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state READY due to: connection closed
08:08:55.502 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:55.502 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:55.502 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.2.90.190:42265(127.2.90.190:42265)] handling channelInactive
08:08:55.503 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:55.503 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state READY due to: connection closed
08:08:55.503 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:55.503 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:55.502059  2645 connection.cc:582] client connection to 127.2.90.190:42265 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:08:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:55.502624  2645 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:08:55.503 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:55.504 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:55.504 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:55.504 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:55.505 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:55.505 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:55.505 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:55.505 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:55.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:55.510876  2410 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 2515
08:08:55.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:55.534004  2645 consensus_peers.cc:597] T 00000000000000000000000000000000 P f53cc5e7046643509bdbfd90a8351029 -> Peer f8c639184e474686ba6ce9a8bd838d4c (127.2.90.190:42265): Couldn't send request to peer f8c639184e474686ba6ce9a8bd838d4c. Status: Network error: Client connection negotiation failed: client connection to 127.2.90.190:42265: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
08:08:55.541 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:55.562 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:55.613 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:55.613 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:55.613 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:55.614 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:55.614 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:55.614 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:55.614 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:55.615 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:55.615 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:55.615 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:55.615 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:55.615 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:55.615 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:55.620 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:55.620 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:55.620 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:55.621 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:55.621 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:55.621 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:55.622 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:55.622 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:55.622 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:55.622 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:55.622 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:55.622 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:55.622 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:55.640 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.2.90.189:41065(127.2.90.189:41065)] handling channelInactive
08:08:55.640 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state READY due to: connection closed
08:08:55.641 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.2.90.189:41065(127.2.90.189:41065)] handling channelInactive
08:08:55.641 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state READY due to: connection closed
08:08:55.642 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.2.90.189:41065(127.2.90.189:41065)] handling channelInactive
08:08:55.642 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state READY due to: connection closed
08:08:55.642 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.2.90.189:41065(127.2.90.189:41065)] handling channelInactive
08:08:55.642 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state READY due to: connection closed
08:08:55.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:55.652545  2410 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 2594
08:08:55.788 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.2.90.188:42457(127.2.90.188:42457)] handling channelInactive
08:08:55.789 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state READY due to: connection closed
08:08:55.795 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 2a489752354241eebd5d00f80d2b9347
08:08:55.795 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.2.90.188:42457(127.2.90.188:42457)] handling channelInactive
08:08:55.795 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state READY due to: connection closed
08:08:55.796 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.2.90.188:42457(127.2.90.188:42457)] handling channelInactive
08:08:55.796 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state READY due to: connection closed
08:08:55.796 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.2.90.188:42457(127.2.90.188:42457)] handling channelInactive
08:08:55.796 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state READY due to: connection closed
08:08:55.805 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 0127c24cdb254b3b9444ea5f96a1b0ab for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
08:08:55.805 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet aa8885af14cf410093b0fc307e337db3 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
08:08:55.805 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 5b322ee1784745bfbf45b3b4ff0b9eee for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
08:08:55.805 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 57ec20d798834ab1a9d6bad82e7002fe for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
08:08:55.805 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 76d8c41bbf134c32947c73f9414f7aab for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
08:08:55.805 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 72ad21258ea34269bce6ae4c80b8e589 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
08:08:55.805 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=0127c24cdb254b3b9444ea5f96a1b0ab@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=aa8885af14cf410093b0fc307e337db3@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=5b322ee1784745bfbf45b3b4ff0b9eee@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)[L],ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=57ec20d798834ab1a9d6bad82e7002fe@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=76d8c41bbf134c32947c73f9414f7aab@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)[L],ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=72ad21258ea34269bce6ae4c80b8e589@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)[L],ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
08:08:55.811 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='e00b53bb9a55fc39f27568a1bc8b714e780ca74f417bc902e05b2722ae334843'}]
08:08:55.813 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:55.814 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
08:08:55.815 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299997, tablet=aa8885af14cf410093b0fc307e337db3@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)[L]]}]
08:08:55.815 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='39196e177c5d8accb0e8a887872f1eda86105242cf56309b0579c4fbe2032e0d'}]
08:08:55.817 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:55.817 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
08:08:55.817 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='86343c581d8a94863f2c9bf1b8a5a8b1b21f193db36b1a3cc6861072e106edac'}]
08:08:55.817 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='19492abe7fdd3ba4cc03e48ccb579a49e7a891e9a6a58a05102dc26713c99c0a'}]
08:08:55.818 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299997, tablet=0127c24cdb254b3b9444ea5f96a1b0ab@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)[L]]}]
08:08:55.819 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:55.819 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
08:08:55.820 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299997, tablet=57ec20d798834ab1a9d6bad82e7002fe@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)[L]]}]
08:08:55.821 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:55.821 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
08:08:55.822 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299997, tablet=5b322ee1784745bfbf45b3b4ff0b9eee@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}]
08:08:55.823 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] connecting to peer
08:08:55.843 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] connecting to peer
08:08:55.851 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] connecting to peer
08:08:55.860 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:55.860 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:55.860 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:55.861 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:55.861 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:55.861 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:55.862 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:55.862 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:55.862 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:55.862 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:55.862 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:55.862 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:55.862 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:55.863 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] connecting to peer
08:08:55.868 [DEBUG - kudu-nio-0] (Connection.java:757) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] Successfully connected to peer
08:08:55.878 [DEBUG - kudu-nio-0] (Connection.java:757) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] Successfully connected to peer
08:08:55.894 [DEBUG - kudu-nio-0] (Connection.java:757) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] Successfully connected to peer
08:08:55.896 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:55.896 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:55.896 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:55.897 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:55.897 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:55.897 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:55.897 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:55.897 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:55.897 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:55.898 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:55.898 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:55.898 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:55.898 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:55.899 [DEBUG - kudu-nio-0] (Connection.java:757) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] Successfully connected to peer
08:08:55.900 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:55.902 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.193
08:08:55.905 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:55.905 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:55.905 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:55.906 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:55.906 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:55.906 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:55.906 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.193
08:08:55.906 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:55.906 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:55.906 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:55.906 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:55.907 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:55.907 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:55.907 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:55.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091735908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:08:55.915 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:55.924 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job 09c2845f1c2e95ee63afce247a128bdd (5104 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
08:08:55.926 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
08:08:55.926 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x201d757d, L:/127.0.0.1:47734 - R:/127.1.134.193:41847] using SASL/PLAIN
08:08:55.930 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.193
08:08:55.939 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.193
08:08:55.949 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:55.955 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x00c3855b, L:/127.0.0.1:47762 - R:/127.1.134.193:41847] using SASL/PLAIN
08:08:55.960 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:55.974 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x1e30f1fe, L:/127.0.0.1:47744 - R:/127.1.134.193:41847] using SASL/PLAIN
08:08:55.985 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:55.997 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x1351e979, L:/127.0.0.1:47754 - R:/127.1.134.193:41847] using SASL/PLAIN
08:08:56.009 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159749799936001) for scanner KuduScanner(table=replication_test_table, tablet=0127c24cdb254b3b9444ea5f96a1b0ab, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:56.011 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [39196e177c5d8accb0e8a887872f1eda86105242cf56309b0579c4fbe2032e0d]
08:08:56.011 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [39196e177c5d8accb0e8a887872f1eda86105242cf56309b0579c4fbe2032e0d]
08:08:56.012 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
08:08:56.012 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
08:08:56.013 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 39196e177c5d8accb0e8a887872f1eda86105242cf56309b0579c4fbe2032e0d finished by subtask 2; deferring removal (restored in pending)
08:08:56.014 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] disconnecting while in state READY
08:08:56.014 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='7c14f561f3f4c96d4f55e14eae92c2f286416d1186eeb788ec6e5ad4f167f1bd'}]
08:08:56.016 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:56.026 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
08:08:56.028 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299997, tablet=76d8c41bbf134c32947c73f9414f7aab@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}]
08:08:56.035 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159749799936001) for scanner KuduScanner(table=replication_test_table, tablet=aa8885af14cf410093b0fc307e337db3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:56.036 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [e00b53bb9a55fc39f27568a1bc8b714e780ca74f417bc902e05b2722ae334843]
08:08:56.037 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [e00b53bb9a55fc39f27568a1bc8b714e780ca74f417bc902e05b2722ae334843]
08:08:56.038 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
08:08:56.038 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
08:08:56.038 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] disconnecting while in state READY
08:08:56.039 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split e00b53bb9a55fc39f27568a1bc8b714e780ca74f417bc902e05b2722ae334843 finished by subtask 0; deferring removal (restored in pending)
08:08:56.041 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:56.041 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='31979213e1dc06e78b43e83e01be6fe3db554d7fbd61450b0d3425158e3880a9'}]
08:08:56.043 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:56.044 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
08:08:56.044 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299997, tablet=72ad21258ea34269bce6ae4c80b8e589@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}]
08:08:56.045 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:56.055 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159749799936001) for scanner KuduScanner(table=replication_test_table, tablet=57ec20d798834ab1a9d6bad82e7002fe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:56.056 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [19492abe7fdd3ba4cc03e48ccb579a49e7a891e9a6a58a05102dc26713c99c0a]
08:08:56.056 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [19492abe7fdd3ba4cc03e48ccb579a49e7a891e9a6a58a05102dc26713c99c0a]
08:08:56.056 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
08:08:56.056 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
08:08:56.057 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] connecting to peer
08:08:56.058 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 19492abe7fdd3ba4cc03e48ccb579a49e7a891e9a6a58a05102dc26713c99c0a finished by subtask 3; deferring removal (restored in pending)
08:08:56.058 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] disconnecting while in state READY
08:08:56.058 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:56.061 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:56.065 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:56.067 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] connecting to peer
08:08:56.078 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:56.078 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:56.078 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:56.079 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:56.079 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:56.079 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:56.079 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:56.080 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:56.080 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:56.080 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:56.080 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:56.080 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:56.080 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:56.098 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:56.098 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:56.098 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:56.099 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:56.099 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:56.099 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:56.099 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:56.099 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:56.099 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:56.100 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:56.100 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:56.100 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:56.100 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:56.108 [DEBUG - kudu-nio-0] (Connection.java:239) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] handling channelInactive
08:08:56.108 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:56.108 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
08:08:56.109 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:56.109 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:56.108 [DEBUG - kudu-nio-0] (Connection.java:709) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] cleaning up while in state READY due to: connection closed
08:08:56.109 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:56.109 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:56.109 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:56.109 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:08:56.110 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:56.110 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:56.110 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:56.110 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:56.110 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:56.110 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:56.110 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:56.165 [DEBUG - kudu-nio-0] (Connection.java:239) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] handling channelInactive
08:08:56.165 [DEBUG - kudu-nio-0] (Connection.java:709) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] cleaning up while in state READY due to: connection closed
08:08:56.166 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:08:56.166 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
08:08:56.168 [DEBUG - kudu-nio-0] (Connection.java:757) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] Successfully connected to peer
08:08:56.171 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.193
08:08:56.184 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159749799936001) for scanner KuduScanner(table=replication_test_table, tablet=5b322ee1784745bfbf45b3b4ff0b9eee, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:56.185 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [86343c581d8a94863f2c9bf1b8a5a8b1b21f193db36b1a3cc6861072e106edac]
08:08:56.185 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [86343c581d8a94863f2c9bf1b8a5a8b1b21f193db36b1a3cc6861072e106edac]
08:08:56.186 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
08:08:56.186 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
08:08:56.187 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 86343c581d8a94863f2c9bf1b8a5a8b1b21f193db36b1a3cc6861072e106edac finished by subtask 1; deferring removal (restored in pending)
08:08:56.187 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] disconnecting while in state READY
08:08:56.188 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:56.204 [DEBUG - kudu-nio-0] (Connection.java:757) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] Successfully connected to peer
08:08:56.228 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.193
08:08:56.231 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:56.245 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe13232c7, L:/127.0.0.1:47774 - R:/127.1.134.193:41847] using SASL/PLAIN
08:08:56.259 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159749799936001) for scanner KuduScanner(table=replication_test_table, tablet=72ad21258ea34269bce6ae4c80b8e589, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:56.259 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [31979213e1dc06e78b43e83e01be6fe3db554d7fbd61450b0d3425158e3880a9]
08:08:56.260 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [31979213e1dc06e78b43e83e01be6fe3db554d7fbd61450b0d3425158e3880a9]
08:08:56.260 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
08:08:56.260 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
08:08:56.261 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 31979213e1dc06e78b43e83e01be6fe3db554d7fbd61450b0d3425158e3880a9 finished by subtask 0; deferring removal (restored in pending)
08:08:56.261 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] disconnecting while in state READY
08:08:56.265 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:56.276 [DEBUG - kudu-nio-0] (Connection.java:239) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] handling channelInactive
08:08:56.276 [DEBUG - kudu-nio-0] (Connection.java:709) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] cleaning up while in state READY due to: connection closed
08:08:56.276 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:08:56.281 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
08:08:56.283 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:56.283 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:56.283 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:56.284 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.284 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.284 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.284 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.284 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.284 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.284 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.285 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.285 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.285 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:56.287 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:56.293 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:56.293 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:56.293 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:56.294 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:56.294 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:56.294 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:56.294 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:56.294 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:56.294 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:56.295 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:56.295 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:56.295 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:56.295 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:56.296 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc5a0eafb, L:/127.0.0.1:47788 - R:/127.1.134.193:41847] using SASL/PLAIN
08:08:56.334 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159749799936001) for scanner KuduScanner(table=replication_test_table, tablet=76d8c41bbf134c32947c73f9414f7aab, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:56.335 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [7c14f561f3f4c96d4f55e14eae92c2f286416d1186eeb788ec6e5ad4f167f1bd]
08:08:56.335 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [7c14f561f3f4c96d4f55e14eae92c2f286416d1186eeb788ec6e5ad4f167f1bd]
08:08:56.336 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
08:08:56.336 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
08:08:56.337 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 7c14f561f3f4c96d4f55e14eae92c2f286416d1186eeb788ec6e5ad4f167f1bd finished by subtask 2; deferring removal (restored in pending)
08:08:56.338 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:56.338 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:56.338 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:56.338 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.338 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.338 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.339 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.339 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.339 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.339 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.339 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.339 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.339 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:56.340 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] disconnecting while in state READY
08:08:56.347 [DEBUG - kudu-nio-0] (Connection.java:239) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] handling channelInactive
08:08:56.347 [DEBUG - kudu-nio-0] (Connection.java:709) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] cleaning up while in state READY due to: connection closed
08:08:56.347 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
08:08:56.347 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
08:08:56.356 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:56.364 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
08:08:56.364 [DEBUG - kudu-nio-0] (Connection.java:239) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] handling channelInactive
08:08:56.365 [DEBUG - kudu-nio-0] (Connection.java:709) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] cleaning up while in state READY due to: connection closed
08:08:56.365 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:08:56.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:56.370230  2148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.134.195:39383, user_credentials={real_user=slave}} blocked reactor thread for 73138.2us
08:08:56.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:56.381614  1870 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.134.254:38449, user_credentials={real_user=slave}} blocked reactor thread for 83721.2us
08:08:56.390 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (da74ffd3de6ba1563e412fcb34de5c51) switched from state RESTARTING to RUNNING.
08:08:56.391 [INFO - flink-pekko.actor.default-dispatcher-5] (CheckpointCoordinator.java:1805) Restoring job da74ffd3de6ba1563e412fcb34de5c51 from Checkpoint 68 @ 1779091707149 for da74ffd3de6ba1563e412fcb34de5c51 located at file:/tmp/junit5660276855152915670/checkpoints/da74ffd3de6ba1563e412fcb34de5c51/chk-68.
08:08:56.392 [INFO - flink-pekko.actor.default-dispatcher-5] (MasterHooks.java:201) No master state to restore
08:08:56.393 [INFO - flink-pekko.actor.default-dispatcher-5] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
08:08:56.400 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:56.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091736408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:08:56.414 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to SCHEDULED.
08:08:56.416 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from SCHEDULED to DEPLOYING.
08:08:56.416 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #2) with attempt id baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to c1befdc5-4ac6-48c0-985f-201fc5cdc5a6 @ 127.0.0.1 (dataPort=-1) with allocation id 9b941a5fbbbdb04dacdc14d5e09c626f
08:08:56.416 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to SCHEDULED.
08:08:56.418 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job 09c2845f1c2e95ee63afce247a128bdd (5104 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
08:08:56.417 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 9b941a5fbbbdb04dacdc14d5e09c626f.
08:08:56.420 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
08:08:56.420 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split 7c14f561f3f4c96d4f55e14eae92c2f286416d1186eeb788ec6e5ad4f167f1bd from pending
08:08:56.420 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_2), deploy into slot with allocation id 9b941a5fbbbdb04dacdc14d5e09c626f.
08:08:56.420 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split e00b53bb9a55fc39f27568a1bc8b714e780ca74f417bc902e05b2722ae334843 from pending
08:08:56.417 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job da74ffd3de6ba1563e412fcb34de5c51: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:08:56.420 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split 31979213e1dc06e78b43e83e01be6fe3db554d7fbd61450b0d3425158e3880a9 from pending
08:08:56.420 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split 86343c581d8a94863f2c9bf1b8a5a8b1b21f193db36b1a3cc6861072e106edac from pending
08:08:56.420 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split 39196e177c5d8accb0e8a887872f1eda86105242cf56309b0579c4fbe2032e0d from pending
08:08:56.420 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split 19492abe7fdd3ba4cc03e48ccb579a49e7a891e9a6a58a05102dc26713c99c0a from pending
08:08:56.420 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 12 complete: removed 6 finished splits from enumerator state
08:08:56.421 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job da74ffd3de6ba1563e412fcb34de5c51: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:08:56.422 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from SCHEDULED to DEPLOYING.
08:08:56.424 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #2) with attempt id baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to c1befdc5-4ac6-48c0-985f-201fc5cdc5a6 @ 127.0.0.1 (dataPort=-1) with allocation id a7a5d41ebc10c1cb065f8992e3a1fcb8
08:08:56.424 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to SCHEDULED.
08:08:56.425 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job da74ffd3de6ba1563e412fcb34de5c51: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:08:56.425 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from SCHEDULED to DEPLOYING.
08:08:56.425 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #2) with attempt id baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to c1befdc5-4ac6-48c0-985f-201fc5cdc5a6 @ 127.0.0.1 (dataPort=-1) with allocation id fc644b3daf65704dd575ddb1e126a17f
08:08:56.425 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to SCHEDULED.
08:08:56.426 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job da74ffd3de6ba1563e412fcb34de5c51: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:08:56.430 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from SCHEDULED to DEPLOYING.
08:08:56.430 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #2) with attempt id baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to c1befdc5-4ac6-48c0-985f-201fc5cdc5a6 @ 127.0.0.1 (dataPort=-1) with allocation id e0ded49cc18cf9d68a3f4d967ddb5165
08:08:56.431 [INFO - Thread-57] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
08:08:56.432 [DEBUG - Thread-57] (Connection.java:575) [peer master-127.31.46.252:40541(127.31.46.252:40541)] disconnecting while in state TERMINATED
08:08:56.432 [DEBUG - Thread-57] (Connection.java:575) [peer master-127.31.46.253:46697(127.31.46.253:46697)] disconnecting while in state TERMINATED
08:08:56.436 [DEBUG - Thread-57] (Connection.java:575) [peer master-127.31.46.254:45015(127.31.46.254:45015)] disconnecting while in state TERMINATED
08:08:56.436 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:56.440 [INFO - Thread-57] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
08:08:56.440 [INFO - Thread-57] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
08:08:56.442 [DEBUG - Thread-57] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:56.443 [INFO - Thread-57] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
08:08:56.452 [DEBUG - kudu-nio-0] (Connection.java:239) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] handling channelInactive
08:08:56.453 [DEBUG - kudu-nio-0] (Connection.java:709) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] cleaning up while in state READY due to: connection closed
08:08:56.453 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:08:56.453 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
08:08:56.469 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot a7a5d41ebc10c1cb065f8992e3a1fcb8.
08:08:56.471 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_2), deploy into slot with allocation id a7a5d41ebc10c1cb065f8992e3a1fcb8.
08:08:56.473 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to DEPLOYING.
08:08:56.474 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_2) [DEPLOYING].
08:08:56.475 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1f5390bd
08:08:56.475 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:56.476 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:08:56.477 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:08:56.477 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:08:56.477 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:08:56.486 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5660276855152915670/checkpoints")
08:08:56.490 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
08:08:56.490 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
08:08:56.500 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot fc644b3daf65704dd575ddb1e126a17f.
08:08:56.501 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_2), deploy into slot with allocation id fc644b3daf65704dd575ddb1e126a17f.
08:08:56.502 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to DEPLOYING.
08:08:56.502 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_2) [DEPLOYING].
08:08:56.503 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@526d7990
08:08:56.503 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:56.504 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5660276855152915670/checkpoints")
08:08:56.504 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
08:08:56.505 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
08:08:56.512 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot e0ded49cc18cf9d68a3f4d967ddb5165.
08:08:56.513 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_2), deploy into slot with allocation id e0ded49cc18cf9d68a3f4d967ddb5165.
08:08:56.514 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to DEPLOYING.
08:08:56.514 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_2) [DEPLOYING].
08:08:56.517 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@762d6684
08:08:56.518 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:56.518 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5660276855152915670/checkpoints")
08:08:56.518 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
08:08:56.519 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
08:08:56.521 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to DEPLOYING.
08:08:56.521 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_2) [DEPLOYING].
08:08:56.521 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6e9d5fae
08:08:56.521 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:08:56.522 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5660276855152915670/checkpoints")
08:08:56.526 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@18c8c69b
08:08:56.528 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
08:08:56.528 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
08:08:56.529 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:56.529 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:56.529 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:56.529 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.529 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.530 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.530 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.530 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.530 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.530 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.530 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.530 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.530 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:56.531 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27746), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [36ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [42ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [68ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [68ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [92ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [99ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [121ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [121ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [150ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [151ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [167ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [168ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [169ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [169ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [182ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [182ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [183ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [183ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [201ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [202ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [202ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [202ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [242ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [243ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [243ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [243ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [321ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [322ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [322ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [322ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [441ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [442ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [442ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [442ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [622ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [623ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [624ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [624ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1122ms] refreshing cache from master, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [1123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [1124ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [1124ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [1125ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1125ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1540ms] refreshing cache from master, [1540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [1540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [1541ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [1541ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1542ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [2800ms] refreshing cache from master, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [2802ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [2803ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [2803ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [2804ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [5460ms] refreshing cache from master, [5461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [5461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [5462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [5462ms] too many traces: truncated at 100 traces, deferred=Deferred@2037561645(state=PENDING, result=null, callback=(continuation of Deferred@14872480 after retry RPC after error@443868350) -> (continuation of Deferred@113314009 after retry RPC after error@1788244733) -> (continuation of Deferred@2099122144 after retry RPC after error@1089619433) -> (continuation of Deferred@1325079278 after retry RPC after error@388204630) -> (continuation of Deferred@449836125 after retry RPC after error@1212164064) -> (continuation of Deferred@1593469036 after retry RPC after error@1427122909) -> (continuation of Deferred@806900030 after retry RPC after error@2033061882) -> (continuation of Deferred@1956295099 after retry RPC after error@537410359) -> (continuation of Deferred@1382752169 after retry RPC after error@1530108865) -> (continuation of Deferred@2055597685 after retry RPC after error@464888721) -> (continuation of Deferred@287924505 after retry RPC after error@1443044718) -> (continuation of Deferred@52475805 after retry RPC after error@893334851) -> (continuation of Deferred@1866771284 after retry RPC after error@560083903) -> (continuation of Deferred@670626897 after retry RPC after error@1797343424) -> (continuation of Deferred@569725179 after retry RPC after error@289042609) -> (continuation of Deferred@1904231611 after retry RPC after error@277243139) -> (continuation of Deferred@469736800 after retry RPC after error@1493358934) -> (continuation of Deferred@718596945 after retry RPC after error@156843381) -> (continuation of Deferred@1856681379 after retry RPC after error@556599625) -> (continuation of Deferred@741273694 after retry RPC after error@1818022459) -> (continuation of Deferred@1474323902 after retry RPC after error@508447050) -> (continuation of Deferred@1169815261 after retry RPC after error@1333668187) -> (continuation of Deferred@468150431 after retry RPC after error@1997498032), errback=(continuation of Deferred@14872480 after retry RPC after error@443868350) -> (continuation of Deferred@113314009 after retry RPC after error@1788244733) -> (continuation of Deferred@2099122144 after retry RPC after error@1089619433) -> (continuation of Deferred@1325079278 after retry RPC after error@388204630) -> (continuation of Deferred@449836125 after retry RPC after error@1212164064) -> (continuation of Deferred@1593469036 after retry RPC after error@1427122909) -> (continuation of Deferred@806900030 after retry RPC after error@2033061882) -> (continuation of Deferred@1956295099 after retry RPC after error@537410359) -> (continuation of Deferred@1382752169 after retry RPC after error@1530108865) -> (continuation of Deferred@2055597685 after retry RPC after error@464888721) -> (continuation of Deferred@287924505 after retry RPC after error@1443044718) -> (continuation of Deferred@52475805 after retry RPC after error@893334851) -> (continuation of Deferred@1866771284 after retry RPC after error@560083903) -> (continuation of Deferred@670626897 after retry RPC after error@1797343424) -> (continuation of Deferred@569725179 after retry RPC after error@289042609) -> (continuation of Deferred@1904231611 after retry RPC after error@277243139) -> (continuation of Deferred@469736800 after retry RPC after error@1493358934) -> (continuation of Deferred@718596945 after retry RPC after error@156843381) -> (continuation of Deferred@1856681379 after retry RPC after error@556599625) -> (continuation of Deferred@741273694 after retry RPC after error@1818022459) -> (continuation of Deferred@1474323902 after retry RPC after error@508447050) -> (continuation of Deferred@1169815261 after retry RPC after error@1333668187) -> (continuation of Deferred@468150431 after retry RPC after error@1997498032)))
08:08:56.536 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6f673e3e
08:08:56.537 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6eb787d5
08:08:56.538 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:56.539 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:56.540 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6f3b82ca
08:08:56.541 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:56.544 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:56.549 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:56.553 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:56.561 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:56.566 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:56.572 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:56.585 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:56.585 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:56.585 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:56.586 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:56.586 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:56.586 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:56.586 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:56.586 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:56.587 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:56.587 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:56.587 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:56.587 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:56.587 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:56.601 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:56.612 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:56.614 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:56.614 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:56.614 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:56.629 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:56.631 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:56.635 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:56.635 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:56.640 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:56.640 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:56.640 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:56.640 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:56.650 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:56.670 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:56.670 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.673 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.674 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.676 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:56.677 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.677 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.677 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.694 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.694 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.694 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.694 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:56.697 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:56.697 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:56.697 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:56.698 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:56.698 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.698 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.698 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.698 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:56.698 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:56.698 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:56.699 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:56.699 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:56.699 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:56.699 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:56.699 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:56.699 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:56.699 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:56.711 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:56.714 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:56.715 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:56.716 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:56.716 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:56.716 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:56.716 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:56.717 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:56.717 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:56.720 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:56.720 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:56.720 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:56.720 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:56.725 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:56.725 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:56.725 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:56.725 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:56.725 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:56.725 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:56.725 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:56.726 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:56.726 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:56.726 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:56.726 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:56.726 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:56.726 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:56.726 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:56.726 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.726 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.726 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.729 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:56.768 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.768 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.768 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.768 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:56.782 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:56.784 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.784 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.784 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.786 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:56.786 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:56.787 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:56.787 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:56.787 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.787 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.788 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.788 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:56.788 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.788 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.788 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.788 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.789 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.789 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.789 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.789 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.789 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.789 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:56.794 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.794 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.794 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.794 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:56.798 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:56.798 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:56.798 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:56.799 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:56.799 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:56.799 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:56.799 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:56.799 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:56.799 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:56.799 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:56.800 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:56.800 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:56.800 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:56.802 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:56.802 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:56.802 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:56.802 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:56.807 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:56.807 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:56.808 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:56.808 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:56.808 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:56.808 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:56.808 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:56.808 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:56.812 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:56.817 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:56.818 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.818 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.818 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.824 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:56.825 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.825 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.825 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.829 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:56.830 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:56.830 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:56.830 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.830 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.830 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:56.830 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:56.830 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:56.831 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:56.831 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:56.831 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:56.831 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:56.831 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:56.831 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:56.831 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:56.830 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.833 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:56.842 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:56.847 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:56.850 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:56.850 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:56.850 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:56.851 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:56.851 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:56.851 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:56.851 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:56.851 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:56.851 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:56.851 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:56.851 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:56.851 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:56.851 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:56.862 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:56.863 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.863 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.863 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.870 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:56.870 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:56.870 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:56.870 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:56.870 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:56.871 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:56.871 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:56.871 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:56.871 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:56.871 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:56.871 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:56.871 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:56.871 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:56.872 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:56.873 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.873 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.873 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.876 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.876 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.876 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.877 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:56.877 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:56.890 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:56.891 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.892 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.892 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.892 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:56.893 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:56.893 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:56.893 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.893 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.893 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.893 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.893 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.894 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.894 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.894 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.894 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.894 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:56.896 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:56.896 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.896 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.896 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.897 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.897 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.897 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.898 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:56.900 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:56.904 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:56.905 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:56.905 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:56.905 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:56.905 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.905 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.906 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:56.906 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.906 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:56.906 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:56.906 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:56.906 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:56.906 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:56.906 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:56.906 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:56.907 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:56.907 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.907 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.907 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.907 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.907 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.907 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.907 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.907 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.908 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.908 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:56.906 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:56.908 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:56.908 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:56.908 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:56.911 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091736909 for job 09c2845f1c2e95ee63afce247a128bdd.
08:08:56.912 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:56.912 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:56.913 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.913 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:56.913 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.913 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.913 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.913 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.913 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.913 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.913 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.914 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.914 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:56.914 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:56.915 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.915 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.915 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.920 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.921 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.921 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.922 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:56.925 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
08:08:56.926 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
08:08:56.927 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:56.927 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:56.927 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:56.927 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:56.927 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.927 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.927 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.928 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.928 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.928 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.929 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.929 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.929 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.929 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:56.929 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.929 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.929 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.930 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:56.930 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:56.930 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:56.931 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:56.931 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:56.931 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:56.931 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:56.931 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:56.931 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:56.932 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:56.932 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:56.932 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:56.932 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:56.936 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:56.937 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.937 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.937 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.938 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:56.943 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.943 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.943 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.944 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:56.946 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:56.946 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:56.946 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:56.947 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.947 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.947 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.947 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.947 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.947 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.948 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.948 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.948 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.948 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:56.952 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:56.952 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:56.952 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:56.953 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.953 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.953 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.954 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.954 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.954 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.954 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.954 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.954 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.954 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:56.955 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:56.956 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.956 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.956 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.956 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:56.957 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.957 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.957 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.962 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:56.972 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:56.972 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:56.972 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:56.973 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.973 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.973 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.973 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.973 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.973 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.973 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.973 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.973 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.973 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:56.974 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.974 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.974 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.974 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:56.977 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:56.978 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:56.978 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.979 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.980 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.984 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:56.984 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.984 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.984 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.986 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:56.987 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:56.987 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:56.987 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.987 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.987 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.987 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.988 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.988 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:56.988 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.988 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.988 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.988 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:56.989 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.989 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.989 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.989 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:56.996 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:56.997 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.997 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.997 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:56.999 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:56.999 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.999 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:56.999 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.000 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.000 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.000 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.000 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.001 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:57.009 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:57.012 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.012 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.012 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.014 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:57.014 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.014 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.014 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.014 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.014 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.014 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.014 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.018 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:57.018 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:57.018 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:57.018 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.019 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.019 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.019 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.019 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.019 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.019 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.019 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.019 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.019 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.022 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:57.022 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:57.022 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:57.022 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.022 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.023 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.023 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.023 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.023 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.023 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.023 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.023 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.024 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:57.024 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.024 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:57.024 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:57.024 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:57.024 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:57.024 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:57.025 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:57.025 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:57.025 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:57.025 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:57.025 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:57.025 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:57.025 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:57.038 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:57.038 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:57.038 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:57.039 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.039 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.039 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.039 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.039 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.039 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.039 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.039 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.039 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.039 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.041 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:57.042 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:57.042 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:57.043 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:57.043 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.043 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.043 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.043 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.044 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.044 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.044 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.044 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.044 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.044 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.057 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:57.058 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:57.058 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:57.058 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:57.058 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:57.058 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.058 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.058 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:57.058 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.059 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.059 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.059 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.059 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.059 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.059 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.059 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.059 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.060 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.060 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.060 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.060 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.060 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.061 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28244), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [28ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [30ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [31ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [32ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [74ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [76ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [77ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [77ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [202ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [205ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [205ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [206ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [220ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [241ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [241ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [242ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [242ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [261ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [261ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [266ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [266ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [302ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [302ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [303ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [303ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [342ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [342ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [343ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [343ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [422ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [423ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [423ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [423ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [642ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [643ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [643ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [643ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [820ms] refreshing cache from master, [820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [821ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [822ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [823ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [823ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1700ms] refreshing cache from master, [1700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [1703ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1703ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [3060ms] refreshing cache from master, [3060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [3063ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [3063ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [5180ms] refreshing cache from master, [5180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [5181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [5181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [5182ms] too many traces: truncated at 100 traces, deferred=Deferred@217702827(state=PENDING, result=null, callback=(continuation of Deferred@422102978 after retry RPC after error@642874589) -> (continuation of Deferred@763437900 after retry RPC after error@1849060334) -> (continuation of Deferred@838838077 after retry RPC after error@484807243) -> (continuation of Deferred@945441240 after retry RPC after error@1710111782) -> (continuation of Deferred@694462953 after retry RPC after error@421724484) -> (continuation of Deferred@1943899953 after retry RPC after error@1732674144) -> (continuation of Deferred@1809929344 after retry RPC after error@1783189913) -> (continuation of Deferred@1970466790 after retry RPC after error@653538986) -> (continuation of Deferred@1204827040 after retry RPC after error@1739945818) -> (continuation of Deferred@89827733 after retry RPC after error@35430130) -> (continuation of Deferred@1142419490 after retry RPC after error@148127837) -> (continuation of Deferred@1485985491 after retry RPC after error@1042266173) -> (continuation of Deferred@1173539132 after retry RPC after error@1871626103) -> (continuation of Deferred@627067035 after retry RPC after error@1719517786) -> (continuation of Deferred@890588288 after retry RPC after error@804927570) -> (continuation of Deferred@150575526 after retry RPC after error@10417649) -> (continuation of Deferred@527489070 after retry RPC after error@1630948154) -> (continuation of Deferred@625400339 after retry RPC after error@1375769143) -> (continuation of Deferred@1260945905 after retry RPC after error@412380213) -> (continuation of Deferred@185711478 after retry RPC after error@1574306057) -> (continuation of Deferred@1383998539 after retry RPC after error@1764757493) -> (continuation of Deferred@1870447534 after retry RPC after error@38750465) -> (continuation of Deferred@556820863 after retry RPC after error@1217824011) -> (continuation of Deferred@1107185156 after retry RPC after error@964759675), errback=(continuation of Deferred@422102978 after retry RPC after error@642874589) -> (continuation of Deferred@763437900 after retry RPC after error@1849060334) -> (continuation of Deferred@838838077 after retry RPC after error@484807243) -> (continuation of Deferred@945441240 after retry RPC after error@1710111782) -> (continuation of Deferred@694462953 after retry RPC after error@421724484) -> (continuation of Deferred@1943899953 after retry RPC after error@1732674144) -> (continuation of Deferred@1809929344 after retry RPC after error@1783189913) -> (continuation of Deferred@1970466790 after retry RPC after error@653538986) -> (continuation of Deferred@1204827040 after retry RPC after error@1739945818) -> (continuation of Deferred@89827733 after retry RPC after error@35430130) -> (continuation of Deferred@1142419490 after retry RPC after error@148127837) -> (continuation of Deferred@1485985491 after retry RPC after error@1042266173) -> (continuation of Deferred@1173539132 after retry RPC after error@1871626103) -> (continuation of Deferred@627067035 after retry RPC after error@1719517786) -> (continuation of Deferred@890588288 after retry RPC after error@804927570) -> (continuation of Deferred@150575526 after retry RPC after error@10417649) -> (continuation of Deferred@527489070 after retry RPC after error@1630948154) -> (continuation of Deferred@625400339 after retry RPC after error@1375769143) -> (continuation of Deferred@1260945905 after retry RPC after error@412380213) -> (continuation of Deferred@185711478 after retry RPC after error@1574306057) -> (continuation of Deferred@1383998539 after retry RPC after error@1764757493) -> (continuation of Deferred@1870447534 after retry RPC after error@38750465) -> (continuation of Deferred@556820863 after retry RPC after error@1217824011) -> (continuation of Deferred@1107185156 after retry RPC after error@964759675)))
08:08:57.062 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:57.063 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.063 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.063 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.063 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.070 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:57.070 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:57.070 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:57.071 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:57.071 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:57.071 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:57.071 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:57.071 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:57.072 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:57.072 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:57.072 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:57.072 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:57.072 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:57.072 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:57.072 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:57.072 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:57.072 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.072 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.072 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.073 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.073 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.073 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.073 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.073 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.073 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.074 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.078 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:57.078 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:57.078 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:57.079 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.079 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.079 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.079 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.079 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.079 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.079 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.079 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.080 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.080 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.082 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:57.082 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:57.082 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:57.082 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.082 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.083 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.083 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.083 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.083 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.084 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.084 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.084 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.084 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.086 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:57.087 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:57.087 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:57.087 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.087 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.087 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.087 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.087 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.088 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.088 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.088 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.088 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.088 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.118 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:57.118 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:57.118 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:57.119 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.119 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.119 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.119 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.119 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.119 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.119 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.119 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.119 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.119 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.142 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:57.142 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:57.142 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:57.143 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.143 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.143 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.143 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.143 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.143 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.144 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.144 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.144 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.144 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.198 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:57.198 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:57.198 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:57.199 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.199 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.199 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.199 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.199 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.199 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.199 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.199 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.199 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.199 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.228 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:57.229 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:57.229 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:57.229 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:57.229 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:57.229 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:57.230 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:57.230 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:57.230 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:57.230 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:57.230 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:57.230 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:57.230 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:57.247 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:57.247 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:57.247 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:57.248 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.248 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.248 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.248 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:57.248 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:57.248 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.248 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:57.248 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.248 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.249 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.249 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.249 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.249 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.249 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.249 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.249 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.249 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.249 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.249 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.249 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.250 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.250 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.250 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.250 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28365), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [13ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [20ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [25ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [31ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [125ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [153ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [154ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [159ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [160ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [168ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [169ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [170ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [173ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [189ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [202ms] refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [210ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [210ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [210ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [211ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [215ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [215ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [222ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [222ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [223ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [223ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [242ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [242ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [243ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [243ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [303ms] refreshing cache from master, [303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [304ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [304ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [305ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [305ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [360ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [361ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [362ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [363ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [363ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [522ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [523ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [524ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [524ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [660ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [662ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [663ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [663ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [664ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1301ms] refreshing cache from master, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1304ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [2940ms] refreshing cache from master, [2940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [2941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [2941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [2942ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [2945ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [2945ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [2945ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [4440ms] refreshing cache from master, [4440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [4441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [4441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [4442ms] too many traces: truncated at 100 traces, deferred=Deferred@202842398(state=PENDING, result=null, callback=(continuation of Deferred@405957896 after retry RPC after error@238892857) -> (continuation of Deferred@1482240400 after retry RPC after error@1844704340) -> (continuation of Deferred@1713544911 after retry RPC after error@21096909) -> (continuation of Deferred@268803524 after retry RPC after error@1646697156) -> (continuation of Deferred@276866217 after retry RPC after error@503392501) -> (continuation of Deferred@584478028 after retry RPC after error@1953510248) -> (continuation of Deferred@1639998627 after retry RPC after error@1980874478) -> (continuation of Deferred@1740374381 after retry RPC after error@304256385) -> (continuation of Deferred@1881476634 after retry RPC after error@188233790) -> (continuation of Deferred@201910109 after retry RPC after error@176219584) -> (continuation of Deferred@1376616276 after retry RPC after error@406734051) -> (continuation of Deferred@1405577910 after retry RPC after error@1592011755) -> (continuation of Deferred@1730812092 after retry RPC after error@223953382) -> (continuation of Deferred@1705187361 after retry RPC after error@451398669) -> (continuation of Deferred@767547413 after retry RPC after error@1789848117) -> (continuation of Deferred@389121361 after retry RPC after error@865248286) -> (continuation of Deferred@1623108873 after retry RPC after error@2111577193) -> (continuation of Deferred@1717310862 after retry RPC after error@1078525711) -> (continuation of Deferred@1426838762 after retry RPC after error@1210692982) -> (continuation of Deferred@1314859416 after retry RPC after error@1231554523) -> (continuation of Deferred@1120872088 after retry RPC after error@1195944370) -> (continuation of Deferred@1886149418 after retry RPC after error@2033441827) -> (continuation of Deferred@1123274363 after retry RPC after error@1089796782) -> (continuation of Deferred@1381190801 after retry RPC after error@895897660) -> (continuation of Deferred@1765462269 after retry RPC after error@251426558) -> (continuation of Deferred@1174639732 after retry RPC after error@1097059128), errback=(continuation of Deferred@405957896 after retry RPC after error@238892857) -> (continuation of Deferred@1482240400 after retry RPC after error@1844704340) -> (continuation of Deferred@1713544911 after retry RPC after error@21096909) -> (continuation of Deferred@268803524 after retry RPC after error@1646697156) -> (continuation of Deferred@276866217 after retry RPC after error@503392501) -> (continuation of Deferred@584478028 after retry RPC after error@1953510248) -> (continuation of Deferred@1639998627 after retry RPC after error@1980874478) -> (continuation of Deferred@1740374381 after retry RPC after error@304256385) -> (continuation of Deferred@1881476634 after retry RPC after error@188233790) -> (continuation of Deferred@201910109 after retry RPC after error@176219584) -> (continuation of Deferred@1376616276 after retry RPC after error@406734051) -> (continuation of Deferred@1405577910 after retry RPC after error@1592011755) -> (continuation of Deferred@1730812092 after retry RPC after error@223953382) -> (continuation of Deferred@1705187361 after retry RPC after error@451398669) -> (continuation of Deferred@767547413 after retry RPC after error@1789848117) -> (continuation of Deferred@389121361 after retry RPC after error@865248286) -> (continuation of Deferred@1623108873 after retry RPC after error@2111577193) -> (continuation of Deferred@1717310862 after retry RPC after error@1078525711) -> (continuation of Deferred@1426838762 after retry RPC after error@1210692982) -> (continuation of Deferred@1314859416 after retry RPC after error@1231554523) -> (continuation of Deferred@1120872088 after retry RPC after error@1195944370) -> (continuation of Deferred@1886149418 after retry RPC after error@2033441827) -> (continuation of Deferred@1123274363 after retry RPC after error@1089796782) -> (continuation of Deferred@1381190801 after retry RPC after error@895897660) -> (continuation of Deferred@1765462269 after retry RPC after error@251426558) -> (continuation of Deferred@1174639732 after retry RPC after error@1097059128)))
08:08:57.270 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:57.270 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:57.270 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:57.271 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:57.271 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:57.271 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:57.271 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:57.271 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:57.271 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:57.272 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:57.272 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:57.272 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:57.272 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:57.272 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:57.273 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:57.273 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:57.273 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.273 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.274 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.274 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.274 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.274 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.274 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.274 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.275 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.275 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.282 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:57.282 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:57.283 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:57.283 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.283 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.283 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.283 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.283 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.284 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.284 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.284 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.284 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.284 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.342 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:57.401 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:57.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091737408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:08:57.410 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:57.410 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:57.410 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:57.411 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:57.412 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:57.412 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:57.412 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:57.412 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:57.412 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:57.412 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:57.412 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:57.412 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:57.412 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:57.419 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:57.419 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:57.419 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:57.419 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.419 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.419 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.420 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.420 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.420 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.420 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.420 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.420 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.421 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.426 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
08:08:57.427 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
08:08:57.478 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:57.478 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:57.479 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:57.479 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:57.479 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:57.479 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:57.480 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:57.480 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:57.480 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:57.481 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:57.481 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:57.481 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:57.481 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:57.512 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:57.513 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:57.513 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:57.514 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:57.514 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:57.514 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:57.514 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:57.514 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:57.514 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:57.514 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:57.514 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:57.515 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:57.515 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:57.541 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:57.541 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:57.542 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:57.542 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:57.542 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.542 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.542 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.542 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.543 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.543 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.543 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.543 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.543 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.543 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.561 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:57.598 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:57.599 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:57.599 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:57.599 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.599 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.599 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.599 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.599 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.599 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.599 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.600 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.600 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.600 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.606 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:57.606 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:57.606 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:57.607 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.607 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.607 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.607 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.607 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.607 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.608 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.608 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.608 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.608 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:08:57Z chronyd exiting
08:08:57.732 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:57.733 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:57.733 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:57.733 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.733 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.734 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.734 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.734 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.734 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.734 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.734 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.734 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.734 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.782 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:57.782 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:57.782 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:57.783 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.783 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.783 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.784 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.784 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.784 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.784 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.785 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.785 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.785 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.804 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 2a489752354241eebd5d00f80d2b9347
08:08:57.815 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 0127c24cdb254b3b9444ea5f96a1b0ab for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
08:08:57.815 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet aa8885af14cf410093b0fc307e337db3 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
08:08:57.815 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 5b322ee1784745bfbf45b3b4ff0b9eee for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
08:08:57.815 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 57ec20d798834ab1a9d6bad82e7002fe for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
08:08:57.815 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 76d8c41bbf134c32947c73f9414f7aab for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
08:08:57.815 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 72ad21258ea34269bce6ae4c80b8e589 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
08:08:57.816 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=0127c24cdb254b3b9444ea5f96a1b0ab@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=aa8885af14cf410093b0fc307e337db3@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=5b322ee1784745bfbf45b3b4ff0b9eee@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)[L],ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=57ec20d798834ab1a9d6bad82e7002fe@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=76d8c41bbf134c32947c73f9414f7aab@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)[L],ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=72ad21258ea34269bce6ae4c80b8e589@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)[L],ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
08:08:57.820 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='fda1a7e07d97a147359c7cd59d546d53d55a328eae5bde60383015c0dba76bec'}]
08:08:57.822 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='131500b949d00d30ea7e2440e9a87765f4db34a8ce44fc49aa4ad9acc4aaa9b9'}]
08:08:57.822 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='9846017d350c57126ffd222148f7f241d2c63ab8f4ff20cd0f820291e47c3203'}]
08:08:57.905 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:57.906 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:57.906 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:57.906 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:57.907 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:57.907 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:57.907 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:57.907 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:57.907 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:57.907 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:57.908 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:57.908 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:57.908 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:57.908 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:57.908 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:57.909 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:57.909 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
08:08:57.909 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:57.909 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:57.909 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:57.909 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:57.909 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:57.909 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:57.909 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:57.910 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:57.910 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299998, tablet=0127c24cdb254b3b9444ea5f96a1b0ab@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)[L]]}]
08:08:57.910 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:57.910 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:57.910 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:57.911 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.911 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.911 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:57.911 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:57.911 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:57.911 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.911 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.911 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:57.911 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.911 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.911 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:57.912 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:57.912 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:57.913 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 5
08:08:57.913 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:57.913 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:57.913 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299998, tablet=aa8885af14cf410093b0fc307e337db3@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)[L]]}]
08:08:57.906 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='7ad562d9b9f7350cb3bcc26c8677914a4a621d9a91d96f0f54e3a2fe57e04fd6'}]
08:08:57.914 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:57.915 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:57.915 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 5
08:08:57.915 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091737912 for job 09c2845f1c2e95ee63afce247a128bdd.
08:08:57.915 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:57.916 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299997, tablet=5b322ee1784745bfbf45b3b4ff0b9eee@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}]
08:08:57.916 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
08:08:57.917 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299997, tablet=57ec20d798834ab1a9d6bad82e7002fe@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489),a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)[L]]}]
08:08:57.913 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:57.917 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:57.911 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:57.917 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:57.910 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:57.918 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:57.918 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:57.918 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:57.918 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:57.919 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:57.919 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:57.919 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:57.919 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:58.040 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:58.040 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:58.040 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:58.041 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28278), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [27ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [47ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [61ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [61ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [97ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [105ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [110ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [111ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [145ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [148ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [149ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [152ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [156ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [161ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [162ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [163ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [163ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [183ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [224ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [306ms] refreshing cache from master, [306ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [307ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [307ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [308ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [308ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [310ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [310ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [422ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [422ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [423ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [423ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [523ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [523ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [524ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [524ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [582ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [582ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [582ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [583ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1180ms] refreshing cache from master, [1180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1183ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1641ms] refreshing cache from master, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1643ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1643ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1644ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1644ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [4801ms] refreshing cache from master, [4801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [4802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [4802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [4802ms] too many traces: truncated at 100 traces, deferred=Deferred@2039832387(state=PENDING, result=null, callback=(continuation of Deferred@941766405 after retry RPC after error@1786013039) -> (continuation of Deferred@573028034 after retry RPC after error@1897634434) -> (continuation of Deferred@1487409595 after retry RPC after error@297687260) -> (continuation of Deferred@238054799 after retry RPC after error@592587073) -> (continuation of Deferred@997183833 after retry RPC after error@1492387408) -> (continuation of Deferred@1428505812 after retry RPC after error@1729062672) -> (continuation of Deferred@573540273 after retry RPC after error@1511113506) -> (continuation of Deferred@636305232 after retry RPC after error@960949018) -> (continuation of Deferred@1728766348 after retry RPC after error@861283996) -> (continuation of Deferred@2131597337 after retry RPC after error@1906156249) -> (continuation of Deferred@1093348327 after retry RPC after error@1129027480) -> (continuation of Deferred@1343558328 after retry RPC after error@1275263241) -> (continuation of Deferred@1424918397 after retry RPC after error@1267084591) -> (continuation of Deferred@872310325 after retry RPC after error@1760500722) -> (continuation of Deferred@1209711869 after retry RPC after error@839851908) -> (continuation of Deferred@1912608830 after retry RPC after error@1654701319) -> (continuation of Deferred@2134907130 after retry RPC after error@905567145) -> (continuation of Deferred@1204483264 after retry RPC after error@551887291) -> (continuation of Deferred@1595767445 after retry RPC after error@616748620) -> (continuation of Deferred@876497632 after retry RPC after error@1029655845) -> (continuation of Deferred@161632713 after retry RPC after error@1004574215) -> (continuation of Deferred@2110763729 after retry RPC after error@977202728) -> (continuation of Deferred@554290367 after retry RPC after error@510010935), errback=(continuation of Deferred@941766405 after retry RPC after error@1786013039) -> (continuation of Deferred@573028034 after retry RPC after error@1897634434) -> (continuation of Deferred@1487409595 after retry RPC after error@297687260) -> (continuation of Deferred@238054799 after retry RPC after error@592587073) -> (continuation of Deferred@997183833 after retry RPC after error@1492387408) -> (continuation of Deferred@1428505812 after retry RPC after error@1729062672) -> (continuation of Deferred@573540273 after retry RPC after error@1511113506) -> (continuation of Deferred@636305232 after retry RPC after error@960949018) -> (continuation of Deferred@1728766348 after retry RPC after error@861283996) -> (continuation of Deferred@2131597337 after retry RPC after error@1906156249) -> (continuation of Deferred@1093348327 after retry RPC after error@1129027480) -> (continuation of Deferred@1343558328 after retry RPC after error@1275263241) -> (continuation of Deferred@1424918397 after retry RPC after error@1267084591) -> (continuation of Deferred@872310325 after retry RPC after error@1760500722) -> (continuation of Deferred@1209711869 after retry RPC after error@839851908) -> (continuation of Deferred@1912608830 after retry RPC after error@1654701319) -> (continuation of Deferred@2134907130 after retry RPC after error@905567145) -> (continuation of Deferred@1204483264 after retry RPC after error@551887291) -> (continuation of Deferred@1595767445 after retry RPC after error@616748620) -> (continuation of Deferred@876497632 after retry RPC after error@1029655845) -> (continuation of Deferred@161632713 after retry RPC after error@1004574215) -> (continuation of Deferred@2110763729 after retry RPC after error@977202728) -> (continuation of Deferred@554290367 after retry RPC after error@510010935)))
08:08:58.042 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:58.042 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:58.044 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] connecting to peer
08:08:58.045 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
08:08:58.046 [WARN - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#6 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28278), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [27ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [47ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [61ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [61ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [97ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [105ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [110ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [111ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [145ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [148ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [149ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [152ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [156ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [161ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [162ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [163ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [163ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [183ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [224ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [306ms] refreshing cache from master, [306ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [307ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [307ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [308ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [308ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [310ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [310ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [422ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [422ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [423ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [423ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [523ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [523ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [524ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [524ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [582ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [582ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [582ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [583ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1180ms] refreshing cache from master, [1180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1183ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1641ms] refreshing cache from master, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1643ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1643ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1644ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1644ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [4801ms] refreshing cache from master, [4801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [4802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [4802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [4802ms] too many traces: truncated at 100 traces, deferred=Deferred@2039832387(state=PENDING, result=null, callback=(continuation of Deferred@941766405 after retry RPC after error@1786013039) -> (continuation of Deferred@573028034 after retry RPC after error@1897634434) -> (continuation of Deferred@1487409595 after retry RPC after error@297687260) -> (continuation of Deferred@238054799 after retry RPC after error@592587073) -> (continuation of Deferred@997183833 after retry RPC after error@1492387408) -> (continuation of Deferred@1428505812 after retry RPC after error@1729062672) -> (continuation of Deferred@573540273 after retry RPC after error@1511113506) -> (continuation of Deferred@636305232 after retry RPC after error@960949018) -> (continuation of Deferred@1728766348 after retry RPC after error@861283996) -> (continuation of Deferred@2131597337 after retry RPC after error@1906156249) -> (continuation of Deferred@1093348327 after retry RPC after error@1129027480) -> (continuation of Deferred@1343558328 after retry RPC after error@1275263241) -> (continuation of Deferred@1424918397 after retry RPC after error@1267084591) -> (continuation of Deferred@872310325 after retry RPC after error@1760500722) -> (continuation of Deferred@1209711869 after retry RPC after error@839851908) -> (continuation of Deferred@1912608830 after retry RPC after error@1654701319) -> (continuation of Deferred@2134907130 after retry RPC after error@905567145) -> (continuation of Deferred@1204483264 after retry RPC after error@551887291) -> (continuation of Deferred@1595767445 after retry RPC after error@616748620) -> (continuation of Deferred@876497632 after retry RPC after error@1029655845) -> (continuation of Deferred@161632713 after retry RPC after error@1004574215) -> (continuation of Deferred@2110763729 after retry RPC after error@977202728) -> (continuation of Deferred@554290367 after retry RPC after error@510010935), errback=(continuation of Deferred@941766405 after retry RPC after error@1786013039) -> (continuation of Deferred@573028034 after retry RPC after error@1897634434) -> (continuation of Deferred@1487409595 after retry RPC after error@297687260) -> (continuation of Deferred@238054799 after retry RPC after error@592587073) -> (continuation of Deferred@997183833 after retry RPC after error@1492387408) -> (continuation of Deferred@1428505812 after retry RPC after error@1729062672) -> (continuation of Deferred@573540273 after retry RPC after error@1511113506) -> (continuation of Deferred@636305232 after retry RPC after error@960949018) -> (continuation of Deferred@1728766348 after retry RPC after error@861283996) -> (continuation of Deferred@2131597337 after retry RPC after error@1906156249) -> (continuation of Deferred@1093348327 after retry RPC after error@1129027480) -> (continuation of Deferred@1343558328 after retry RPC after error@1275263241) -> (continuation of Deferred@1424918397 after retry RPC after error@1267084591) -> (continuation of Deferred@872310325 after retry RPC after error@1760500722) -> (continuation of Deferred@1209711869 after retry RPC after error@839851908) -> (continuation of Deferred@1912608830 after retry RPC after error@1654701319) -> (continuation of Deferred@2134907130 after retry RPC after error@905567145) -> (continuation of Deferred@1204483264 after retry RPC after error@551887291) -> (continuation of Deferred@1595767445 after retry RPC after error@616748620) -> (continuation of Deferred@876497632 after retry RPC after error@1029655845) -> (continuation of Deferred@161632713 after retry RPC after error@1004574215) -> (continuation of Deferred@2110763729 after retry RPC after error@977202728) -> (continuation of Deferred@554290367 after retry RPC after error@510010935)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.188:41049
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:58.047 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:58.047 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:58.047 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:58.052 [DEBUG - kudu-nio-0] (Connection.java:757) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] Successfully connected to peer
08:08:58.058 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] connecting to peer
08:08:58.058 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] connecting to peer
08:08:58.058 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:58.059 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] connecting to peer
08:08:58.060 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:58.061 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:58.063 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:58.062 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:58.063 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:58.063 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:58.062 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:58.063 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:58.063 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:58.061 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:58.064 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:58.064 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:58.064 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:58.064 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:58.064 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:58.064 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:58.064 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:58.061 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:58.064 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:58.066 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job 09c2845f1c2e95ee63afce247a128bdd (5104 bytes, checkpointDuration=153 ms, finalizationTime=0 ms).
08:08:58.066 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.193
08:08:58.068 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
08:08:58.073 [DEBUG - kudu-nio-0] (Connection.java:757) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] Successfully connected to peer
08:08:58.073 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#6 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_6).
08:08:58.077 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#6 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_6.
08:08:58.079 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:58.081 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from INITIALIZING to FAILED on 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28278), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [27ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [47ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [61ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [61ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [97ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [105ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [110ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [111ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [145ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [148ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [149ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [152ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [156ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [161ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [162ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [163ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [163ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [183ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [224ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [306ms] refreshing cache from master, [306ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [307ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [307ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [308ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [308ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [310ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [310ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [422ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [422ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [423ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [423ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [523ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [523ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [524ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [524ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [582ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [582ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [582ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [583ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1180ms] refreshing cache from master, [1180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1183ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1641ms] refreshing cache from master, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1643ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1643ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1644ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1644ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [4801ms] refreshing cache from master, [4801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [4802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [4802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [4802ms] too many traces: truncated at 100 traces, deferred=Deferred@2039832387(state=PENDING, result=null, callback=(continuation of Deferred@941766405 after retry RPC after error@1786013039) -> (continuation of Deferred@573028034 after retry RPC after error@1897634434) -> (continuation of Deferred@1487409595 after retry RPC after error@297687260) -> (continuation of Deferred@238054799 after retry RPC after error@592587073) -> (continuation of Deferred@997183833 after retry RPC after error@1492387408) -> (continuation of Deferred@1428505812 after retry RPC after error@1729062672) -> (continuation of Deferred@573540273 after retry RPC after error@1511113506) -> (continuation of Deferred@636305232 after retry RPC after error@960949018) -> (continuation of Deferred@1728766348 after retry RPC after error@861283996) -> (continuation of Deferred@2131597337 after retry RPC after error@1906156249) -> (continuation of Deferred@1093348327 after retry RPC after error@1129027480) -> (continuation of Deferred@1343558328 after retry RPC after error@1275263241) -> (continuation of Deferred@1424918397 after retry RPC after error@1267084591) -> (continuation of Deferred@872310325 after retry RPC after error@1760500722) -> (continuation of Deferred@1209711869 after retry RPC after error@839851908) -> (continuation of Deferred@1912608830 after retry RPC after error@1654701319) -> (continuation of Deferred@2134907130 after retry RPC after error@905567145) -> (continuation of Deferred@1204483264 after retry RPC after error@551887291) -> (continuation of Deferred@1595767445 after retry RPC after error@616748620) -> (continuation of Deferred@876497632 after retry RPC after error@1029655845) -> (continuation of Deferred@161632713 after retry RPC after error@1004574215) -> (continuation of Deferred@2110763729 after retry RPC after error@977202728) -> (continuation of Deferred@554290367 after retry RPC after error@510010935), errback=(continuation of Deferred@941766405 after retry RPC after error@1786013039) -> (continuation of Deferred@573028034 after retry RPC after error@1897634434) -> (continuation of Deferred@1487409595 after retry RPC after error@297687260) -> (continuation of Deferred@238054799 after retry RPC after error@592587073) -> (continuation of Deferred@997183833 after retry RPC after error@1492387408) -> (continuation of Deferred@1428505812 after retry RPC after error@1729062672) -> (continuation of Deferred@573540273 after retry RPC after error@1511113506) -> (continuation of Deferred@636305232 after retry RPC after error@960949018) -> (continuation of Deferred@1728766348 after retry RPC after error@861283996) -> (continuation of Deferred@2131597337 after retry RPC after error@1906156249) -> (continuation of Deferred@1093348327 after retry RPC after error@1129027480) -> (continuation of Deferred@1343558328 after retry RPC after error@1275263241) -> (continuation of Deferred@1424918397 after retry RPC after error@1267084591) -> (continuation of Deferred@872310325 after retry RPC after error@1760500722) -> (continuation of Deferred@1209711869 after retry RPC after error@839851908) -> (continuation of Deferred@1912608830 after retry RPC after error@1654701319) -> (continuation of Deferred@2134907130 after retry RPC after error@905567145) -> (continuation of Deferred@1204483264 after retry RPC after error@551887291) -> (continuation of Deferred@1595767445 after retry RPC after error@616748620) -> (continuation of Deferred@876497632 after retry RPC after error@1029655845) -> (continuation of Deferred@161632713 after retry RPC after error@1004574215) -> (continuation of Deferred@2110763729 after retry RPC after error@977202728) -> (continuation of Deferred@554290367 after retry RPC after error@510010935)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.188:41049
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:58.088 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:08:58.089 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#6) of source Source: KuduSource.
08:08:58.090 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_6.
08:08:58.090 [DEBUG - kudu-nio-0] (Connection.java:757) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] Successfully connected to peer
08:08:58.090 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (e26b904229418d0e047d5d94c5b9f905) switched from state RUNNING to RESTARTING.
08:08:58.095 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa821cbaa, L:/127.0.0.1:55498 - R:/127.1.134.193:41847] using SASL/PLAIN
08:08:58.099 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.193
08:08:58.113 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.193
08:08:58.115 [DEBUG - kudu-nio-0] (Connection.java:757) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] Successfully connected to peer
08:08:58.117 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:58.126 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.193
08:08:58.129 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:58.133 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf25789b2, L:/127.0.0.1:55506 - R:/127.1.134.193:41847] using SASL/PLAIN
08:08:58.143 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:58.143 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:58.143 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:58.143 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:58.144 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:58.144 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb92bfda1, L:/127.0.0.1:55516 - R:/127.1.134.193:41847] using SASL/PLAIN
08:08:58.144 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:58.144 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:58.144 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:58.144 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:58.144 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:58.145 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:58.145 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:58.145 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:58.149 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:58.154 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159757991936001) for scanner KuduScanner(table=replication_test_table, tablet=aa8885af14cf410093b0fc307e337db3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:58.154 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [131500b949d00d30ea7e2440e9a87765f4db34a8ce44fc49aa4ad9acc4aaa9b9]
08:08:58.155 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [131500b949d00d30ea7e2440e9a87765f4db34a8ce44fc49aa4ad9acc4aaa9b9]
08:08:58.156 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 5 because it is idle.
08:08:58.156 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 5
08:08:58.160 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 131500b949d00d30ea7e2440e9a87765f4db34a8ce44fc49aa4ad9acc4aaa9b9 finished by subtask 1; deferring removal (restored in pending)
08:08:58.162 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] disconnecting while in state READY
08:08:58.162 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x1e41bf1e, L:/127.0.0.1:55522 - R:/127.1.134.193:41847] using SASL/PLAIN
08:08:58.162 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='5d9297024851272448f8132ab1ec978e89e8355ace93a7a484dd8ce8b5c54555'}]
08:08:58.166 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:58.168 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 6
08:08:58.169 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299997, tablet=76d8c41bbf134c32947c73f9414f7aab@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}]
08:08:58.173 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:58.173 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:58.173 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:58.173 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:58.174 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:58.174 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:58.174 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159757991936001) for scanner KuduScanner(table=replication_test_table, tablet=0127c24cdb254b3b9444ea5f96a1b0ab, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:58.174 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:58.174 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:58.174 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:58.174 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [fda1a7e07d97a147359c7cd59d546d53d55a328eae5bde60383015c0dba76bec]
08:08:58.174 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:58.174 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [fda1a7e07d97a147359c7cd59d546d53d55a328eae5bde60383015c0dba76bec]
08:08:58.175 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:58.175 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:58.175 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:58.175 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:58.177 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split fda1a7e07d97a147359c7cd59d546d53d55a328eae5bde60383015c0dba76bec finished by subtask 3; deferring removal (restored in pending)
08:08:58.178 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
08:08:58.178 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
08:08:58.179 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='8037985a80d03a8cd5fb2fce7dfdc1ff0327553b800e8b42b60f5edafea40e43'}]
08:08:58.180 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:08:58.181 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 5
08:08:58.181 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299997, tablet=72ad21258ea34269bce6ae4c80b8e589@[1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)[L],a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383),ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)]}]
08:08:58.182 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] disconnecting while in state READY
08:08:58.182 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:58.184 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] connecting to peer
08:08:58.191 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] connecting to peer
08:08:58.217 [DEBUG - kudu-nio-0] (Connection.java:239) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] handling channelInactive
08:08:58.217 [DEBUG - kudu-nio-0] (Connection.java:709) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] cleaning up while in state READY due to: connection closed
08:08:58.217 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:08:58.218 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
08:08:58.229 [DEBUG - kudu-nio-0] (Connection.java:239) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] handling channelInactive
08:08:58.229 [DEBUG - kudu-nio-0] (Connection.java:709) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] cleaning up while in state READY due to: connection closed
08:08:58.230 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
08:08:58.230 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 5 exited.
08:08:58.238 [DEBUG - kudu-nio-0] (Connection.java:757) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] Successfully connected to peer
08:08:58.244 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.193
08:08:58.248 [DEBUG - kudu-nio-0] (Connection.java:757) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] Successfully connected to peer
08:08:58.250 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:58.250 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:58.250 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:58.251 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:58.251 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:58.252 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:58.252 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:58.252 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:58.252 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:58.253 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:58.253 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:58.253 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:58.253 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:58.253 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.134.193
08:08:58.264 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:58.264 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:58.264 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:58.268 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:58.269 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:58.269 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:58.269 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:58.269 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:58.269 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:58.269 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:58.270 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:58.270 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:58.270 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:58.270 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:58.273 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd4e72fdd, L:/127.0.0.1:55530 - R:/127.1.134.193:41847] using SASL/PLAIN
08:08:58.285 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159757991936001) for scanner KuduScanner(table=replication_test_table, tablet=5b322ee1784745bfbf45b3b4ff0b9eee, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:58.292 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [9846017d350c57126ffd222148f7f241d2c63ab8f4ff20cd0f820291e47c3203]
08:08:58.292 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [9846017d350c57126ffd222148f7f241d2c63ab8f4ff20cd0f820291e47c3203]
08:08:58.292 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 5 because it is idle.
08:08:58.292 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 5
08:08:58.294 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 9846017d350c57126ffd222148f7f241d2c63ab8f4ff20cd0f820291e47c3203 finished by subtask 0; deferring removal (restored in pending)
08:08:58.294 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] disconnecting while in state READY
08:08:58.294 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:58.307 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159757991936001) for scanner KuduScanner(table=replication_test_table, tablet=72ad21258ea34269bce6ae4c80b8e589, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:58.308 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [8037985a80d03a8cd5fb2fce7dfdc1ff0327553b800e8b42b60f5edafea40e43]
08:08:58.308 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [8037985a80d03a8cd5fb2fce7dfdc1ff0327553b800e8b42b60f5edafea40e43]
08:08:58.308 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 5 because it is idle.
08:08:58.308 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 5
08:08:58.310 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 8037985a80d03a8cd5fb2fce7dfdc1ff0327553b800e8b42b60f5edafea40e43 finished by subtask 3; deferring removal (restored in pending)
08:08:58.312 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] disconnecting while in state READY
08:08:58.313 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:58.315 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159757991936001) for scanner KuduScanner(table=replication_test_table, tablet=57ec20d798834ab1a9d6bad82e7002fe, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:58.315 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [7ad562d9b9f7350cb3bcc26c8677914a4a621d9a91d96f0f54e3a2fe57e04fd6]
08:08:58.315 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [7ad562d9b9f7350cb3bcc26c8677914a4a621d9a91d96f0f54e3a2fe57e04fd6]
08:08:58.316 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
08:08:58.316 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
08:08:58.317 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] disconnecting while in state READY
08:08:58.317 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 7ad562d9b9f7350cb3bcc26c8677914a4a621d9a91d96f0f54e3a2fe57e04fd6 finished by subtask 2; deferring removal (restored in pending)
08:08:58.318 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:58.331 [DEBUG - kudu-nio-0] (Connection.java:239) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] handling channelInactive
08:08:58.331 [DEBUG - kudu-nio-0] (Connection.java:709) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] cleaning up while in state READY due to: connection closed
08:08:58.332 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
08:08:58.332 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 5 exited.
08:08:58.349 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:58.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:58.356966  2148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.134.195:39383, user_credentials={real_user=slave}} blocked reactor thread for 80390.7us
08:08:58.358 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:58.358 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:58.358 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:58.359 [DEBUG - kudu-nio-0] (Connection.java:239) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] handling channelInactive
08:08:58.359 [DEBUG - kudu-nio-0] (Connection.java:709) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] cleaning up while in state READY due to: connection closed
08:08:58.359 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:58.359 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:58.359 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:58.359 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
08:08:58.359 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
08:08:58.359 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:58.359 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:58.359 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:58.360 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:58.360 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:58.360 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:58.360 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:58.372 [DEBUG - kudu-nio-0] (Connection.java:239) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] handling channelInactive
08:08:58.372 [DEBUG - kudu-nio-0] (Connection.java:709) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] cleaning up while in state READY due to: connection closed
08:08:58.372 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:08:58.372 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 5 exited.
08:08:58.387 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:08:58.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091738408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:08:58.411 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x11d27c47, L:/127.0.0.1:55532 - R:/127.1.134.193:41847] using SASL/PLAIN
08:08:58.418 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job 09c2845f1c2e95ee63afce247a128bdd (5104 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
08:08:58.419 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
08:08:58.420 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 16 complete: removed split fda1a7e07d97a147359c7cd59d546d53d55a328eae5bde60383015c0dba76bec from pending
08:08:58.420 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 16 complete: removed split 131500b949d00d30ea7e2440e9a87765f4db34a8ce44fc49aa4ad9acc4aaa9b9 from pending
08:08:58.420 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 16 complete: removed split 9846017d350c57126ffd222148f7f241d2c63ab8f4ff20cd0f820291e47c3203 from pending
08:08:58.420 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 16 complete: removed split 7ad562d9b9f7350cb3bcc26c8677914a4a621d9a91d96f0f54e3a2fe57e04fd6 from pending
08:08:58.420 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 16 complete: removed split 8037985a80d03a8cd5fb2fce7dfdc1ff0327553b800e8b42b60f5edafea40e43 from pending
08:08:58.420 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 16 complete: removed 5 finished splits from enumerator state
08:08:58.433 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159757991936001) for scanner KuduScanner(table=replication_test_table, tablet=76d8c41bbf134c32947c73f9414f7aab, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:58.438 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [5d9297024851272448f8132ab1ec978e89e8355ace93a7a484dd8ce8b5c54555]
08:08:58.438 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [5d9297024851272448f8132ab1ec978e89e8355ace93a7a484dd8ce8b5c54555]
08:08:58.438 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 6 because it is idle.
08:08:58.439 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 6
08:08:58.439 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] disconnecting while in state READY
08:08:58.439 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 5d9297024851272448f8132ab1ec978e89e8355ace93a7a484dd8ce8b5c54555 finished by subtask 1; deferring removal (restored in pending)
08:08:58.440 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:58.462 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:58.462 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:58.463 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:58.464 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:58.464 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:58.464 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:58.464 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:58.464 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:58.464 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:58.464 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:58.465 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:58.465 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:58.465 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:58.518 [DEBUG - kudu-nio-0] (Connection.java:239) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] handling channelInactive
08:08:58.518 [DEBUG - kudu-nio-0] (Connection.java:709) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] cleaning up while in state READY due to: connection closed
08:08:58.519 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:08:58.519 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 6 exited.
08:08:58.541 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:58.562 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:58.721 [ERROR - main] (RetryRule.java:206) org.apache.kudu.replication.TestReplicationTableInitializer.testHashOnlyPartitioning: failed attempt 1
org.apache.kudu.shaded.org.apache.commons.logging.LogConfigurationException: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl (Caused by java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1158)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory$2.run(LogFactory.java:960)
	at java.base/java.security.AccessController.doPrivileged(AccessController.java:318)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.newFactory(LogFactory.java:957)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getFactory(LogFactory.java:624)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getLog(LogFactory.java:655)
	at org.apache.kudu.shaded.org.apache.http.conn.ssl.DefaultHostnameVerifier.<init>(DefaultHostnameVerifier.java:82)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClientBuilder.build(HttpClientBuilder.java:970)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClients.createDefault(HttpClients.java:56)
	at org.apache.kudu.test.junit.ResultReporter.reportResult(ResultReporter.java:207)
	at org.apache.kudu.test.junit.ResultReporter.tryReportResult(ResultReporter.java:244)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.report(RetryRule.java:165)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:191)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
Caused by: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1020)
	... 42 more
08:08:58.723 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:58.723 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:58.723 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:58.724 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:58.724 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:58.724 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:58.724 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:58.724 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:58.724 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:58.724 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:58.724 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:58.724 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:58.724 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:58.725 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29889), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [8ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [9ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [10ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [10ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [141ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [145ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [150ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [150ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [211ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [212ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [300ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [301ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [301ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [321ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [321ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [321ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [322ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [344ms] refreshing cache from master, [344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [345ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [345ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [346ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [347ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [347ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [347ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [382ms] refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [384ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [384ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [384ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [385ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [385ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [403ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [404ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [404ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [405ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [405ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [523ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [524ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [525ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [525ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [602ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [603ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [603ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [604ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [862ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [863ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [863ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [864ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1881ms] refreshing cache from master, [1881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [1881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [1881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [1882ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [1883ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [1883ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1883ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [2341ms] refreshing cache from master, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [2342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [2343ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [2343ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [2344ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [2344ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [5420ms] refreshing cache from master, [5421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [5421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [5421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [5422ms] too many traces: truncated at 100 traces, deferred=Deferred@203585153(state=PENDING, result=null, callback=(continuation of Deferred@540115884 after retry RPC after error@521508601) -> (continuation of Deferred@1775652141 after retry RPC after error@1994373352) -> (continuation of Deferred@1524595068 after retry RPC after error@1766755968) -> (continuation of Deferred@850008481 after retry RPC after error@960102372) -> (continuation of Deferred@411854118 after retry RPC after error@95146553) -> (continuation of Deferred@1739498556 after retry RPC after error@287224306) -> (continuation of Deferred@1790985122 after retry RPC after error@832663257) -> (continuation of Deferred@591176597 after retry RPC after error@1195972385) -> (continuation of Deferred@805077305 after retry RPC after error@353494457) -> (continuation of Deferred@1408752773 after retry RPC after error@1552431557) -> (continuation of Deferred@389455396 after retry RPC after error@219192662) -> (continuation of Deferred@1626237829 after retry RPC after error@2100637772) -> (continuation of Deferred@1590777456 after retry RPC after error@1461885649) -> (continuation of Deferred@1149465075 after retry RPC after error@274763391) -> (continuation of Deferred@1146497237 after retry RPC after error@123852444) -> (continuation of Deferred@1488073578 after retry RPC after error@1278561653) -> (continuation of Deferred@961598630 after retry RPC after error@814493734) -> (continuation of Deferred@2045541438 after retry RPC after error@525650067) -> (continuation of Deferred@538888763 after retry RPC after error@1900200734) -> (continuation of Deferred@1800752260 after retry RPC after error@1383858477) -> (continuation of Deferred@82138699 after retry RPC after error@1675112442) -> (continuation of Deferred@573075049 after retry RPC after error@284128872), errback=(continuation of Deferred@540115884 after retry RPC after error@521508601) -> (continuation of Deferred@1775652141 after retry RPC after error@1994373352) -> (continuation of Deferred@1524595068 after retry RPC after error@1766755968) -> (continuation of Deferred@850008481 after retry RPC after error@960102372) -> (continuation of Deferred@411854118 after retry RPC after error@95146553) -> (continuation of Deferred@1739498556 after retry RPC after error@287224306) -> (continuation of Deferred@1790985122 after retry RPC after error@832663257) -> (continuation of Deferred@591176597 after retry RPC after error@1195972385) -> (continuation of Deferred@805077305 after retry RPC after error@353494457) -> (continuation of Deferred@1408752773 after retry RPC after error@1552431557) -> (continuation of Deferred@389455396 after retry RPC after error@219192662) -> (continuation of Deferred@1626237829 after retry RPC after error@2100637772) -> (continuation of Deferred@1590777456 after retry RPC after error@1461885649) -> (continuation of Deferred@1149465075 after retry RPC after error@274763391) -> (continuation of Deferred@1146497237 after retry RPC after error@123852444) -> (continuation of Deferred@1488073578 after retry RPC after error@1278561653) -> (continuation of Deferred@961598630 after retry RPC after error@814493734) -> (continuation of Deferred@2045541438 after retry RPC after error@525650067) -> (continuation of Deferred@538888763 after retry RPC after error@1900200734) -> (continuation of Deferred@1800752260 after retry RPC after error@1383858477) -> (continuation of Deferred@82138699 after retry RPC after error@1675112442) -> (continuation of Deferred@573075049 after retry RPC after error@284128872)))
08:08:58.842 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:58.906 [ERROR - main] (RetryRule.java:253) org.apache.kudu.replication.TestReplicationTableInitializer.testHashOnlyPartitioning: giving up after 1 attempts
08:08:58.907 [DEBUG - main] (Connection.java:575) [peer 1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)] disconnecting while in state READY
08:08:58.907 [DEBUG - main] (Connection.java:575) [peer a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)] disconnecting while in state READY
08:08:58.907 [DEBUG - main] (Connection.java:575) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] disconnecting while in state READY
08:08:58.907 [DEBUG - main] (Connection.java:575) [peer master-127.1.134.252:42093(127.1.134.252:42093)] disconnecting while in state READY
08:08:58.907 [DEBUG - main] (Connection.java:575) [peer master-127.1.134.253:41425(127.1.134.253:41425)] disconnecting while in state READY
08:08:58.907 [DEBUG - main] (Connection.java:575) [peer master-127.1.134.254:38449(127.1.134.254:38449)] disconnecting while in state READY
08:08:58.908 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.1.134.254:38449(127.1.134.254:38449)] handling channelInactive
08:08:58.908 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state READY due to: connection closed
08:08:58.908 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.1.134.252:42093(127.1.134.252:42093)] handling channelInactive
08:08:58.908 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state READY due to: connection closed
08:08:58.908 [DEBUG - kudu-nio-5] (Connection.java:239) [peer a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)] handling channelInactive
08:08:58.908 [DEBUG - kudu-nio-5] (Connection.java:709) [peer a8c1971e3b584658ab4174f8d0ac12de(127.1.134.195:39383)] cleaning up while in state READY due to: connection closed
08:08:58.908 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:58.912 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:08:58.912 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:08:58.912 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:08:58.913 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:58.913 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:58.913 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
08:08:58.913 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:08:58.914 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-2
08:08:58.908 [DEBUG - kudu-nio-3] (Connection.java:239) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] handling channelInactive
08:08:58.914 [DEBUG - kudu-nio-3] (Connection.java:709) [peer ad1db063d05747e7970018aed83fc0b5(127.1.134.193:41847)] cleaning up while in state READY due to: connection closed
08:08:58.914 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:58.914 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-3
08:08:58.914 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:58.914 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:08:58.915 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:58.915 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:58.915 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:08:58.915 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:08:58.908 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)] handling channelInactive
08:08:58.915 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 1c9c5ea12af94143abc1d9b757f8a3c2(127.1.134.194:43489)] cleaning up while in state READY due to: connection closed
08:08:58.916 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-4
08:08:58.916 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-5
08:08:58.917 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091738909 for job 09c2845f1c2e95ee63afce247a128bdd.
08:08:58.920 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.1.134.253:41425(127.1.134.253:41425)] handling channelInactive
08:08:58.920 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state READY due to: connection closed
08:08:58.920 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
08:08:58.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:58.921778  1563 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 1987
08:08:58.941 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job 09c2845f1c2e95ee63afce247a128bdd (1654 bytes, checkpointDuration=31 ms, finalizationTime=1 ms).
08:08:58.944 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
08:08:58.944 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 17 complete: removed split 5d9297024851272448f8132ab1ec978e89e8355ace93a7a484dd8ce8b5c54555 from pending
08:08:58.944 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 17 complete: removed 1 finished splits from enumerator state
08:08:59.016 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:59.016 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:59.017 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:59.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:59.017019  1563 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 2129
08:08:59.017 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:59.017 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:59.018 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:59.018 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:59.018 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:59.018 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:59.018 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:59.019 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:59.019 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:59.019 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:59.022 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:59.022 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:59.023 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:59.023 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:59.023 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:59.023 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:59.023 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:59.023 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:59.023 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:59.024 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:59.024 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:59.024 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:59.024 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:59.041 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:59.045 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:08:59.045 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:08:59.046 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:59.046 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:59.046 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:08:59.047 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:08:59.047 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:59.047 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:59.047 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:08:59.050 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:59.050 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:59.050 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:08:59.050 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:08:59.051 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29429), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [27ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [48ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [67ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [67ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [96ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [107ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [144ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [144ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [174ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [178ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [186ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [187ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [189ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [189ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [201ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [201ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [201ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [202ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [222ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [242ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [283ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [283ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [284ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [284ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [384ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [385ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [385ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [389ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [442ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [443ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [443ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [443ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [582ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [583ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [583ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [584ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1081ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1084ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1084ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1440ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1444ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1444ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2761ms] refreshing cache from master, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2762ms] too many traces: truncated at 100 traces, deferred=Deferred@1255254919(state=PENDING, result=null, callback=(continuation of Deferred@609390644 after retry RPC after error@1865460396) -> (continuation of Deferred@1184394149 after retry RPC after error@22179170) -> (continuation of Deferred@825335372 after retry RPC after error@1530803980) -> (continuation of Deferred@1593752205 after retry RPC after error@1289090381) -> (continuation of Deferred@1907081573 after retry RPC after error@1535577611) -> (continuation of Deferred@1879506212 after retry RPC after error@328860148) -> (continuation of Deferred@1016416779 after retry RPC after error@1593965764) -> (continuation of Deferred@405394909 after retry RPC after error@1535107725) -> (continuation of Deferred@1303129851 after retry RPC after error@496700502) -> (continuation of Deferred@1263187205 after retry RPC after error@1862622571) -> (continuation of Deferred@1131576710 after retry RPC after error@105783298) -> (continuation of Deferred@414342995 after retry RPC after error@1561966379) -> (continuation of Deferred@232222531 after retry RPC after error@2062422219) -> (continuation of Deferred@1881968642 after retry RPC after error@1612497347) -> (continuation of Deferred@1443305460 after retry RPC after error@1550134711) -> (continuation of Deferred@1214061241 after retry RPC after error@1321851048) -> (continuation of Deferred@547343922 after retry RPC after error@1432508163) -> (continuation of Deferred@1967790020 after retry RPC after error@1975946589) -> (continuation of Deferred@737551241 after retry RPC after error@1827386299) -> (continuation of Deferred@1228565973 after retry RPC after error@139967946) -> (continuation of Deferred@304561442 after retry RPC after error@601895606) -> (continuation of Deferred@967747546 after retry RPC after error@212006088) -> (continuation of Deferred@667354707 after retry RPC after error@93386143), errback=(continuation of Deferred@609390644 after retry RPC after error@1865460396) -> (continuation of Deferred@1184394149 after retry RPC after error@22179170) -> (continuation of Deferred@825335372 after retry RPC after error@1530803980) -> (continuation of Deferred@1593752205 after retry RPC after error@1289090381) -> (continuation of Deferred@1907081573 after retry RPC after error@1535577611) -> (continuation of Deferred@1879506212 after retry RPC after error@328860148) -> (continuation of Deferred@1016416779 after retry RPC after error@1593965764) -> (continuation of Deferred@405394909 after retry RPC after error@1535107725) -> (continuation of Deferred@1303129851 after retry RPC after error@496700502) -> (continuation of Deferred@1263187205 after retry RPC after error@1862622571) -> (continuation of Deferred@1131576710 after retry RPC after error@105783298) -> (continuation of Deferred@414342995 after retry RPC after error@1561966379) -> (continuation of Deferred@232222531 after retry RPC after error@2062422219) -> (continuation of Deferred@1881968642 after retry RPC after error@1612497347) -> (continuation of Deferred@1443305460 after retry RPC after error@1550134711) -> (continuation of Deferred@1214061241 after retry RPC after error@1321851048) -> (continuation of Deferred@547343922 after retry RPC after error@1432508163) -> (continuation of Deferred@1967790020 after retry RPC after error@1975946589) -> (continuation of Deferred@737551241 after retry RPC after error@1827386299) -> (continuation of Deferred@1228565973 after retry RPC after error@139967946) -> (continuation of Deferred@304561442 after retry RPC after error@601895606) -> (continuation of Deferred@967747546 after retry RPC after error@212006088) -> (continuation of Deferred@667354707 after retry RPC after error@93386143)))
08:08:59.053 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
08:08:59.053 [WARN - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#6 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29429), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [27ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [48ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [67ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [67ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [96ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [107ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [144ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [144ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [174ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [178ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [186ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [187ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [189ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [189ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [201ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [201ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [201ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [202ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [222ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [242ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [283ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [283ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [284ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [284ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [384ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [385ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [385ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [389ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [442ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [443ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [443ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [443ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [582ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [583ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [583ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [584ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1081ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1084ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1084ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1440ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1444ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1444ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2761ms] refreshing cache from master, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2762ms] too many traces: truncated at 100 traces, deferred=Deferred@1255254919(state=PENDING, result=null, callback=(continuation of Deferred@609390644 after retry RPC after error@1865460396) -> (continuation of Deferred@1184394149 after retry RPC after error@22179170) -> (continuation of Deferred@825335372 after retry RPC after error@1530803980) -> (continuation of Deferred@1593752205 after retry RPC after error@1289090381) -> (continuation of Deferred@1907081573 after retry RPC after error@1535577611) -> (continuation of Deferred@1879506212 after retry RPC after error@328860148) -> (continuation of Deferred@1016416779 after retry RPC after error@1593965764) -> (continuation of Deferred@405394909 after retry RPC after error@1535107725) -> (continuation of Deferred@1303129851 after retry RPC after error@496700502) -> (continuation of Deferred@1263187205 after retry RPC after error@1862622571) -> (continuation of Deferred@1131576710 after retry RPC after error@105783298) -> (continuation of Deferred@414342995 after retry RPC after error@1561966379) -> (continuation of Deferred@232222531 after retry RPC after error@2062422219) -> (continuation of Deferred@1881968642 after retry RPC after error@1612497347) -> (continuation of Deferred@1443305460 after retry RPC after error@1550134711) -> (continuation of Deferred@1214061241 after retry RPC after error@1321851048) -> (continuation of Deferred@547343922 after retry RPC after error@1432508163) -> (continuation of Deferred@1967790020 after retry RPC after error@1975946589) -> (continuation of Deferred@737551241 after retry RPC after error@1827386299) -> (continuation of Deferred@1228565973 after retry RPC after error@139967946) -> (continuation of Deferred@304561442 after retry RPC after error@601895606) -> (continuation of Deferred@967747546 after retry RPC after error@212006088) -> (continuation of Deferred@667354707 after retry RPC after error@93386143), errback=(continuation of Deferred@609390644 after retry RPC after error@1865460396) -> (continuation of Deferred@1184394149 after retry RPC after error@22179170) -> (continuation of Deferred@825335372 after retry RPC after error@1530803980) -> (continuation of Deferred@1593752205 after retry RPC after error@1289090381) -> (continuation of Deferred@1907081573 after retry RPC after error@1535577611) -> (continuation of Deferred@1879506212 after retry RPC after error@328860148) -> (continuation of Deferred@1016416779 after retry RPC after error@1593965764) -> (continuation of Deferred@405394909 after retry RPC after error@1535107725) -> (continuation of Deferred@1303129851 after retry RPC after error@496700502) -> (continuation of Deferred@1263187205 after retry RPC after error@1862622571) -> (continuation of Deferred@1131576710 after retry RPC after error@105783298) -> (continuation of Deferred@414342995 after retry RPC after error@1561966379) -> (continuation of Deferred@232222531 after retry RPC after error@2062422219) -> (continuation of Deferred@1881968642 after retry RPC after error@1612497347) -> (continuation of Deferred@1443305460 after retry RPC after error@1550134711) -> (continuation of Deferred@1214061241 after retry RPC after error@1321851048) -> (continuation of Deferred@547343922 after retry RPC after error@1432508163) -> (continuation of Deferred@1967790020 after retry RPC after error@1975946589) -> (continuation of Deferred@737551241 after retry RPC after error@1827386299) -> (continuation of Deferred@1228565973 after retry RPC after error@139967946) -> (continuation of Deferred@304561442 after retry RPC after error@601895606) -> (continuation of Deferred@967747546 after retry RPC after error@212006088) -> (continuation of Deferred@667354707 after retry RPC after error@93386143)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.189:46677
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:59.057 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#6 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_6).
08:08:59.058 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#6 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_6.
08:08:59.061 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from INITIALIZING to FAILED on 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29429), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [27ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [48ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [67ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [67ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [96ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [107ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [144ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [144ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [174ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [178ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [186ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [187ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [189ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [189ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [201ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [201ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [201ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [202ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [222ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [242ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [283ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [283ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [284ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [284ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [384ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [385ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [385ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [389ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [442ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [443ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [443ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [443ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [582ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [583ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [583ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [584ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1081ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1084ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1084ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1440ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1444ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1444ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2761ms] refreshing cache from master, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2762ms] too many traces: truncated at 100 traces, deferred=Deferred@1255254919(state=PENDING, result=null, callback=(continuation of Deferred@609390644 after retry RPC after error@1865460396) -> (continuation of Deferred@1184394149 after retry RPC after error@22179170) -> (continuation of Deferred@825335372 after retry RPC after error@1530803980) -> (continuation of Deferred@1593752205 after retry RPC after error@1289090381) -> (continuation of Deferred@1907081573 after retry RPC after error@1535577611) -> (continuation of Deferred@1879506212 after retry RPC after error@328860148) -> (continuation of Deferred@1016416779 after retry RPC after error@1593965764) -> (continuation of Deferred@405394909 after retry RPC after error@1535107725) -> (continuation of Deferred@1303129851 after retry RPC after error@496700502) -> (continuation of Deferred@1263187205 after retry RPC after error@1862622571) -> (continuation of Deferred@1131576710 after retry RPC after error@105783298) -> (continuation of Deferred@414342995 after retry RPC after error@1561966379) -> (continuation of Deferred@232222531 after retry RPC after error@2062422219) -> (continuation of Deferred@1881968642 after retry RPC after error@1612497347) -> (continuation of Deferred@1443305460 after retry RPC after error@1550134711) -> (continuation of Deferred@1214061241 after retry RPC after error@1321851048) -> (continuation of Deferred@547343922 after retry RPC after error@1432508163) -> (continuation of Deferred@1967790020 after retry RPC after error@1975946589) -> (continuation of Deferred@737551241 after retry RPC after error@1827386299) -> (continuation of Deferred@1228565973 after retry RPC after error@139967946) -> (continuation of Deferred@304561442 after retry RPC after error@601895606) -> (continuation of Deferred@967747546 after retry RPC after error@212006088) -> (continuation of Deferred@667354707 after retry RPC after error@93386143), errback=(continuation of Deferred@609390644 after retry RPC after error@1865460396) -> (continuation of Deferred@1184394149 after retry RPC after error@22179170) -> (continuation of Deferred@825335372 after retry RPC after error@1530803980) -> (continuation of Deferred@1593752205 after retry RPC after error@1289090381) -> (continuation of Deferred@1907081573 after retry RPC after error@1535577611) -> (continuation of Deferred@1879506212 after retry RPC after error@328860148) -> (continuation of Deferred@1016416779 after retry RPC after error@1593965764) -> (continuation of Deferred@405394909 after retry RPC after error@1535107725) -> (continuation of Deferred@1303129851 after retry RPC after error@496700502) -> (continuation of Deferred@1263187205 after retry RPC after error@1862622571) -> (continuation of Deferred@1131576710 after retry RPC after error@105783298) -> (continuation of Deferred@414342995 after retry RPC after error@1561966379) -> (continuation of Deferred@232222531 after retry RPC after error@2062422219) -> (continuation of Deferred@1881968642 after retry RPC after error@1612497347) -> (continuation of Deferred@1443305460 after retry RPC after error@1550134711) -> (continuation of Deferred@1214061241 after retry RPC after error@1321851048) -> (continuation of Deferred@547343922 after retry RPC after error@1432508163) -> (continuation of Deferred@1967790020 after retry RPC after error@1975946589) -> (continuation of Deferred@737551241 after retry RPC after error@1827386299) -> (continuation of Deferred@1228565973 after retry RPC after error@139967946) -> (continuation of Deferred@304561442 after retry RPC after error@601895606) -> (continuation of Deferred@967747546 after retry RPC after error@212006088) -> (continuation of Deferred@667354707 after retry RPC after error@93386143)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.189:46677
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:08:59.062 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:59.065 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:08:59.073 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#6) of source Source: KuduSource.
08:08:59.075 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_6.
08:08:59.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:59.085777  2290 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.134.193:41847: connect: Connection refused (error 111)
08:08:59.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:59.095412  2290 consensus_peers.cc:597] T 72ad21258ea34269bce6ae4c80b8e589 P a8c1971e3b584658ab4174f8d0ac12de -> Peer ad1db063d05747e7970018aed83fc0b5 (127.1.134.193:41847): Couldn't send request to peer ad1db063d05747e7970018aed83fc0b5. Status: Network error: Client connection negotiation failed: client connection to 127.1.134.193:41847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
08:08:59.104 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:08:59.105 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:08:59.105 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:08:59.105 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:59.105 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:59.106 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:08:59.106 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:59.106 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:59.106 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:08:59.106 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:59.106 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:59.106 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:08:59.107 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:08:59.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:59.135921  2288 connection.cc:582] client connection to 127.1.134.194:43489 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:08:59.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:59.143066  4111 negotiation.cc:336] Failed RPC negotiation. Trace:
08:08:59.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 08:08:59.138377 (+     0us) reactor.cc:678] Submitting negotiation task for client connection to 127.1.134.194:43489 (local address 127.1.134.195:47685)
08:08:59.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 08:08:59.139376 (+   999us) negotiation.cc:107] Waiting for socket to connect
08:08:59.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 08:08:59.139436 (+    60us) client_negotiation.cc:175] Beginning negotiation
08:08:59.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 08:08:59.139871 (+   435us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
08:08:59.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 08:08:59.141664 (+  1793us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.134.194:43489: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:08:59.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"client-negotiator.queue_time_us":313}
08:08:59.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:59.144470  2288 consensus_peers.cc:597] T 76d8c41bbf134c32947c73f9414f7aab P a8c1971e3b584658ab4174f8d0ac12de -> Peer 1c9c5ea12af94143abc1d9b757f8a3c2 (127.1.134.194:43489): Couldn't send request to peer 1c9c5ea12af94143abc1d9b757f8a3c2. Status: Network error: Client connection negotiation failed: client connection to 127.1.134.194:43489: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
08:08:59.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:08:59.168149  2290 consensus_peers.cc:597] T 5b322ee1784745bfbf45b3b4ff0b9eee P a8c1971e3b584658ab4174f8d0ac12de -> Peer ad1db063d05747e7970018aed83fc0b5 (127.1.134.193:41847): Couldn't send request to peer ad1db063d05747e7970018aed83fc0b5. Status: Network error: Client connection negotiation failed: client connection to 127.1.134.193:41847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
08:08:59.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:59.170167  1563 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 2268
08:08:59.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:59.229547  1563 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 1575
08:08:59.281 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.1.134.254:38449(127.1.134.254:38449)] handling channelInactive
08:08:59.281 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state READY due to: connection closed
08:08:59.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:59.282609  1563 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 1647
08:08:59.292 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:59.292 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:59.292 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:59.293 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:59.293 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:59.293 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:59.294 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:59.294 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:59.294 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:59.294 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:59.294 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:59.294 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:59.294 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:59.329 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.1.134.253:41425(127.1.134.253:41425)] handling channelInactive
08:08:59.329 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state READY due to: connection closed
08:08:59.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:08:59.332950  1563 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 1731
08:08:59.342 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:59.378 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:59.378 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:59.378 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:59.378 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.1.134.252:42093(127.1.134.252:42093)] handling channelInactive
08:08:59.378 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state READY due to: connection closed
08:08:59.379 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:59.379 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:59.379 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:59.379 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:59.379 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:59.379 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:59.379 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:59.380 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:59.380 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:59.380 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:59.382 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:08:59.383 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:08:59.383 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:08:59.383 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:59.383 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:59.383 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:08:59.383 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:59.383 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:59.384 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:08:59.384 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:59.384 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:59.384 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:08:59.384 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:08:59.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091739408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:08:59.418 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
08:08:59.419 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
08:08:59.446 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:08:59.447 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:08:59.447 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:08:59.447 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:59.447 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:59.447 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:08:59.448 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:59.448 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:59.448 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:08:59.448 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:59.448 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:59.448 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:08:59.448 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:08:59.541 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:59.562 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:59.649 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:59.649 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:59.649 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:59.650 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:59.650 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:59.650 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:59.650 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:59.650 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:59.650 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:59.650 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:59.650 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:59.650 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:59.651 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:59.703 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:08:59.703 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:08:59.704 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:08:59.704 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:59.704 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:59.704 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:59.704 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:08:59.704 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:59.704 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:59.704 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:59.704 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:08:59.704 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:08:59.704 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:08:59.791 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:08:59.793 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:08:59.793 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:08:59.793 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.1.134.252:42093(127.1.134.252:42093) for tablet Kudu Master: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:08:59.806 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:08:59.807 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:08:59.807 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:08:59.807 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:08:59.807 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:08:59.807 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:08:59.807 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:08:59.808 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:08:59.808 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:08:59.808 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:08:59.808 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:08:59.808 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:08:59.809 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:08:59.826 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:08:59.827 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:08:59.828 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:08:59.828 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:08:59.828 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:08:59.829 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:08:59.829 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:08:59.829 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:08:59.829 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:08:59.829 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:08:59.829 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:08:59.829 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:08:59.829 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:08:59.842 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:08:59.846 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:08:59.846 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:08:59.846 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:08:59.846 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:08:59.846 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:08:59.847 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:08:59.846 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:08:59.847 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:08:59.847 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:08:59.847 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:08:59.847 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:08:59.847 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:08:59.847 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:08:59.866 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:08:59.867 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:08:59.867 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:08:59.867 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:08:59.867 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:08:59.867 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:08:59.867 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:08:59.867 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:08:59.867 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:08:59.867 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:08:59.867 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:08:59.867 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:08:59.867 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:08:59.877 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:08:59.878 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:08:59.878 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:08:59.878 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:59.878 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:59.878 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:59.879 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:59.879 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:59.879 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:08:59.879 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:59.879 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:08:59.879 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:08:59.879 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:08:59.906 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:08:59.907 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:08:59.907 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:08:59.907 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:08:59.908 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:08:59.907 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:08:59.908 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:08:59.908 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:08:59.908 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:08:59.908 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:08:59.908 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:08:59.908 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:08:59.908 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:08:59.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091739908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:08:59.920 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
08:08:59.921 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
08:08:59.946 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:08:59.946 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:08:59.947 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:08:59.947 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:08:59.947 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:08:59.947 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:08:59.947 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:08:59.947 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:08:59.947 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:08:59.947 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:08:59.948 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:08:59.948 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:08:59.948 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:00.006 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:00.008 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:00.009 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:00.010 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:00.010 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:00.010 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:00.010 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:00.010 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:00.010 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:00.010 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:00.010 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:00.010 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:00.010 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:00.042 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:00.062 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:00.136 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:00.136 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:00.136 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:00.137 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:00.137 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:00.137 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:00.137 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:00.137 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:00.137 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:00.137 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:00.137 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:00.137 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:00.137 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:00.144 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:00.144 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:00.144 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:00.145 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:00.145 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:00.145 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:00.145 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:00.145 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:00.145 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:00.145 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:00.145 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:00.145 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:00.145 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:00.166 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:00.167 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:00.167 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:00.168 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:00.168 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:00.168 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:00.168 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:00.168 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:00.168 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:00.168 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:00.168 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:00.168 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:00.169 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:00.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:00.376 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:00.376 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:00.376 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:00.377 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:00.377 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:00.377 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:00.377 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:00.377 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:00.377 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:00.377 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:00.377 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:00.377 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:00.377 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:00.408 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091740408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:00.419 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
08:09:00.420 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
08:09:00.489 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:00.489 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:00.489 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:00.490 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:00.490 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:00.490 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:00.490 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:00.490 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:00.490 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:00.490 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:00.490 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:00.490 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:00.490 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:00.541 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:00.561 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:00.582 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:00.582 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:00.583 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:00.583 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:00.583 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:00.583 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:00.583 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:00.583 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:00.583 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:00.583 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:00.583 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:00.583 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:00.583 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:00.586 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:00.586 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:00.586 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:00.586 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:00.586 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:00.586 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:00.586 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:00.586 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:00.586 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:00.586 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:00.586 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:00.586 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:00.586 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:00.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:09:00Z chronyd exiting
08:09:00.778 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:00.779 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:00.779 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:00.779 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:00.779 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:00.779 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:00.779 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:00.779 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:00.779 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:00.779 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:00.780 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:00.780 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:00.780 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:00.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:00.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091740908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:00.918 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
08:09:00.918 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
08:09:01.041 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:01.061 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:01.186 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:01.187 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:01.187 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:01.187 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:01.187 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:01.187 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:01.187 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:01.187 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:01.187 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:01.187 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:01.187 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:01.187 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:01.187 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:01.248 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:01.248 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:01.249 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:01.249 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:01.249 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:01.249 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:01.249 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:01.249 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:01.249 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:01.249 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:01.249 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:01.249 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:01.249 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:01.278 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:01.278 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:01.278 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:01.279 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:01.279 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:01.279 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:01.279 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:01.279 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:01.279 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:01.279 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:01.279 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:01.279 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:01.279 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:01.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:01.367 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:01.368 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:01.368 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:01.368 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:01.368 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:01.368 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:01.368 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:01.368 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:01.368 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:01.368 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:01.368 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:01.368 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:01.368 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:01.393 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:01.393 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:01.393 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:01.393 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:01.394 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:01.393 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:01.393 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:01.394 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:01.394 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:01.394 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:01.394 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:01.394 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:01.394 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:01.406 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:01.406 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:01.406 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:01.406 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:01.406 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:01.406 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:01.406 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:01.406 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:01.406 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:01.406 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:01.406 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:01.406 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:01.406 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:01.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091741408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:01.418 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
08:09:01.419 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
08:09:01.492 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:01.493 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:01.493 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:01.493 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:01.493 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:01.493 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:01.493 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:01.493 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:01.493 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:01.493 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:01.493 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:01.493 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:01.494 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:01.532 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:01.533 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:01.533 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:01.533 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:01.533 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:01.533 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:01.533 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:01.533 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:01.533 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:01.533 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:01.533 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:01.533 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:01.534 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:01.541 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:01.561 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:01.681 [ERROR - main] (RetryRule.java:206) org.apache.kudu.replication.TestReplicationTableInitializer.testHashOnlyPartitioning: failed attempt 1
org.apache.kudu.shaded.org.apache.commons.logging.LogConfigurationException: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl (Caused by java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1158)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory$2.run(LogFactory.java:960)
	at java.base/java.security.AccessController.doPrivileged(AccessController.java:318)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.newFactory(LogFactory.java:957)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getFactory(LogFactory.java:624)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getLog(LogFactory.java:655)
	at org.apache.kudu.shaded.org.apache.http.conn.ssl.DefaultHostnameVerifier.<init>(DefaultHostnameVerifier.java:82)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClientBuilder.build(HttpClientBuilder.java:970)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClients.createDefault(HttpClients.java:56)
	at org.apache.kudu.test.junit.ResultReporter.reportResult(ResultReporter.java:207)
	at org.apache.kudu.test.junit.ResultReporter.tryReportResult(ResultReporter.java:244)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.report(RetryRule.java:165)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:216)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
Caused by: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1020)
	... 42 more
08:09:01.724 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:01.724 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:01.724 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:01.725 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:01.725 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:01.725 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:01.725 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:01.725 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:01.725 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:01.725 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:01.725 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:01.725 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:01.725 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:01.744 [ERROR - main] (RetryRule.java:253) org.apache.kudu.replication.TestReplicationTableInitializer.testHashOnlyPartitioning: giving up after 1 attempts
E.08:09:01.745 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779091741745
08:09:01.745 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779091741745
08:09:01.753 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
08:09:01.760 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
08:09:01.761 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
08:09:01.761 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskk4_r_T/test-tmp
08:09:01.761 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
08:09:01.761 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskk4_r_T/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
08:09:01.767 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

08:09:01.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:01.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091741908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:01.918 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:01.918 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:01.918 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:01.919 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:01.919 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:01.919 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:01.919 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:01.919 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:01.919 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:01.919 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:01.919 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:01.920 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:01.920 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:01.921 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
08:09:01.921 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
08:09:01.964 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:01.964 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:01.964 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:01.965 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:01.965 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:01.965 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:01.965 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:01.965 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:01.965 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:01.965 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:01.965 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:01.965 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:01.965 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:01.983 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:01.983 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:01.983 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:01.983 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:01.983 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:01.983 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:01.983 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:01.983 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:01.983 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:01.984 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:01.984 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:01.984 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:01.984 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:02.040 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:02.062 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:02.130 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:02.130 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:02.130 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:02.131 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:02.131 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:02.131 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:02.131 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:02.131 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:02.131 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:02.131 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:02.131 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:02.131 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:02.131 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:02.158 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:02.158 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:02.158 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:02.159 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:02.159 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:02.159 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:02.159 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:02.159 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:02.159 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:02.159 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:02.159 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:02.159 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:02.159 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:02.196 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:09:02.196 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

08:09:02.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:02.200517  4133 mini_oidc.cc:150] Starting JWKS server
08:09:02.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:02.205040  4133 webserver.cc:533] Webserver started at http://127.0.0.1:39137/ using document root <none> and password file <none>
08:09:02.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:02.205647  4133 mini_oidc.cc:186] Starting OIDC Discovery server
08:09:02.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:02.208071  4133 webserver.cc:533] Webserver started at http://127.0.0.1:45285/ using document root <none> and password file <none>
08:09:02.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:09:02Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
08:09:02.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:09:02Z Disabled control of system clock
08:09:02.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:02.291359  4133 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-0/wal
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-0/data
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-0/logs
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-0/data/info.pb
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.9.126:44985
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.9.126
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.9.84:43373
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.9.126:44985,127.4.9.125:45723,127.4.9.124:41733
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:09:02.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39137/jwks.json with env {}
08:09:02.342 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:02.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091742408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:02.419 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:09:02.420 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
08:09:02.525 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:02.525 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:02.525 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:02.525 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:02.525 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:02.525 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:02.525 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:02.525 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:02.526 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:02.526 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:02.526 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:02.526 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:02.526 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:02.540 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:02.562 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:02.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:02.679716  4145 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:09:02.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:02.680528  4145 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:09:02.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:02.681084  4145 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:09:02.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:02.722296  4145 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:09:02.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:02.722712  4145 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:09:02.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:02.723031  4145 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:09:02.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:02.723294  4145 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:09:02.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:02.723506  4145 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:09:02.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:02.723662  4145 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:39137/jwks.json
08:09:02.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:02.769945  4145 master_runner.cc:387] Master server non-default flags:
08:09:02.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:09:02.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.9.84:43373
08:09:02.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:09:02.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:09:02.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-0/data
08:09:02.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-0/wal
08:09:02.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:09:02.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.9.126:44985,127.4.9.125:45723,127.4.9.124:41733
08:09:02.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:09:02.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:09:02.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:09:02.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.9.126:44985
08:09:02.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:09:02.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:09:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:09:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39137/jwks.json
08:09:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:09:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:09:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-0/data/info.pb
08:09:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.9.126
08:09:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:09:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:09:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:09:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:09:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:09:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:09:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-0/logs
08:09:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:09:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:09:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:09:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:09:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:09:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:09:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:09:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:09:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:09:02.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:09:02.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:02.771872  4145 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:09:02.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:02.773906  4145 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:09:02.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:02.789009  4151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:02.842 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:02.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091742908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:02.919 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
08:09:02.920 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
08:09:02.923 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:02.923 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:02.924 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:02.924 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:02.924 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:02.924 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:02.924 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:02.924 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:02.924 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:02.924 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:02.924 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:02.924 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:02.924 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:03.040 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:03.062 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:03.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:03.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091743408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:03.419 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:09:03.420 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
08:09:03.541 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:03.562 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:03.584 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:03.584 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:03.584 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:03.585 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:03.585 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:03.585 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:03.585 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:03.585 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:03.585 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:03.585 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:03.585 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:03.585 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:03.585 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:03.696 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:03.696 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:03.696 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:03.697 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:03.697 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:03.697 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:03.697 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:03.697 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:03.697 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:03.697 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:03.697 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:03.698 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:03.698 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:03.747 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:03.747 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:03.747 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:03.748 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:03.748 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:03.748 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:03.748 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:03.748 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:03.748 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:03.748 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:03.748 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:03.748 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:03.748 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:03.782 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:03.782 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:03.782 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:03.783 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:03.783 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:03.783 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:03.783 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:03.783 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:03.783 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:03.783 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:03.783 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:03.783 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:03.783 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:03.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:03.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091743907 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:03.916 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
08:09:03.917 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
08:09:04.012 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:04.013 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:04.013 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:04.013 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:04.013 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:04.013 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:04.013 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:04.013 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:04.013 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:04.014 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:04.014 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:04.014 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:04.014 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:04.041 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:04.062 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:04.098 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:04.098 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:04.098 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:04.099 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:04.099 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:04.099 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:04.099 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:04.099 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:04.099 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:04.099 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:04.099 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:04.099 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:04.099 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:04.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:02.790649  4152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:04.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:02.794174  4154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:04.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:02.794468  4145 server_base.cc:1061] running on GCE node
08:09:04.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.112542  4145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:09:04.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.116050  4145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:09:04.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.117452  4145 hybrid_clock.cc:648] HybridClock initialized: now 1779091744117419 us; error 67 us; skew 500 ppm
08:09:04.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.118553  4145 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:09:04.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.126788  4145 webserver.cc:533] Webserver started at http://127.4.9.126:35021/ using document root <none> and password file <none>
08:09:04.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.127980  4145 fs_manager.cc:362] Metadata directory not provided
08:09:04.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.128221  4145 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:09:04.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.128968  4145 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:09:04.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.134624  4145 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-0/data/instance:
08:09:04.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6ba906ce4bb74e3086dbf742a8a6417d"
08:09:04.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:04 on dist-test-slave-1jss"
08:09:04.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.136039  4145 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-0/wal/instance:
08:09:04.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6ba906ce4bb74e3086dbf742a8a6417d"
08:09:04.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:04 on dist-test-slave-1jss"
08:09:04.144 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:04.144 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:04.145 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:04.145 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:04.145 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:04.145 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:04.145 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:04.145 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:04.145 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:04.145 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:04.145 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:04.145 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:04.145 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.145540  4145 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.009s	sys 0.000s
08:09:04.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.153699  4161 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:09:04.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.155146  4145 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.001s
08:09:04.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.155498  4145 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-0/wal
08:09:04.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6ba906ce4bb74e3086dbf742a8a6417d"
08:09:04.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:04 on dist-test-slave-1jss"
08:09:04.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.155925  4145 fs_report.cc:389] FS layout report
08:09:04.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:09:04.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-0/wal
08:09:04.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-0/wal
08:09:04.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-0/data/data
08:09:04.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:09:04.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:09:04.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:09:04.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:09:04.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:09:04.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:09:04.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:09:04.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:09:04.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:09:04.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:09:04.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:09:04.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.236963  4145 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:09:04.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.239145  4145 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:09:04.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.239635  4145 kserver.cc:163] Server-wide thread pool size limit: 3276
08:09:04.252 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:04.253 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:04.253 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:04.253 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:04.253 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:04.253 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:04.253 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:04.254 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:04.254 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:04.254 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:04.254 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:04.254 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:04.254 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:04.346 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:04.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.346016  4145 rpc_server.cc:307] RPC server started. Bound to: 127.4.9.126:44985
08:09:04.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.346153  4212 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.9.126:44985 every 8 connection(s)
08:09:04.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.350425  4145 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-0/data/info.pb
08:09:04.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.355317  4133 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 4145
08:09:04.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.355924  4133 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-0/wal/instance
08:09:04.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.359278  4213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:09:04.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.362205  4133 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:09:04.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:09:04.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-1/wal
08:09:04.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-1/data
08:09:04.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:09:04.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:09:04.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:09:04.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:09:04.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:09:04.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:09:04.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-1/logs
08:09:04.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-1/data/info.pb
08:09:04.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:09:04.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:09:04.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:09:04.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:09:04.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:09:04.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:09:04.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:09:04.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:09:04.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:09:04.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:09:04.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:09:04.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:09:04.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.9.125:45723
08:09:04.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.9.125
08:09:04.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:09:04.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.9.84:43373
08:09:04.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:09:04.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:09:04.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:09:04.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:09:04.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.9.126:44985,127.4.9.125:45723,127.4.9.124:41733
08:09:04.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:09:04.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39137/jwks.json with env {}
08:09:04.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.376765  4213 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.9.126" port: 44985 } has no permanent_uuid. Determining permanent_uuid...
08:09:04.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091744408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:04.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.414710  4213 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } has no permanent_uuid. Determining permanent_uuid...
08:09:04.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:04.421592  4163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.9.125:45723: connect: Connection refused (error 111)
08:09:04.423 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
08:09:04.423 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
08:09:04.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:04.429471  4213 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.9.125:45723: Network error: Client connection negotiation failed: client connection to 127.4.9.125:45723: connect: Connection refused (error 111)
08:09:04.438 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:04.439 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:04.439 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:04.439 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:04.439 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:04.439 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:04.439 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:04.439 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:04.439 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:04.439 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:04.439 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:04.439 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:04.439 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:04.448 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:04.448 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:04.448 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:04.449 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:04.449 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:04.449 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:04.449 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:04.449 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:04.449 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:04.449 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:04.449 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:04.449 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:04.449 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:04.450 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26742), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [6ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [7ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [7ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [30ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [74ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [74ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [75ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [83ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [84ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [85ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [85ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [101ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [101ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [102ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [102ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [121ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [141ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [142ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [142ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [142ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [221ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [221ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [222ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [222ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [282ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [283ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [283ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [284ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [484ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [484ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [486ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [487ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [522ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [523ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [524ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [525ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [642ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [643ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [644ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [644ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1500ms] refreshing cache from master, [1500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1503ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1504ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1506ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1506ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [3280ms] refreshing cache from master, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [3282ms] too many traces: truncated at 100 traces, deferred=Deferred@1615758965(state=PENDING, result=null, callback=(continuation of Deferred@887163772 after retry RPC after error@822737761) -> (continuation of Deferred@371962102 after retry RPC after error@37941608) -> (continuation of Deferred@1044689079 after retry RPC after error@1088984813) -> (continuation of Deferred@193933830 after retry RPC after error@517168046) -> (continuation of Deferred@84513227 after retry RPC after error@22163577) -> (continuation of Deferred@1941908823 after retry RPC after error@1999967909) -> (continuation of Deferred@1056659009 after retry RPC after error@783972383) -> (continuation of Deferred@610610442 after retry RPC after error@2067433245) -> (continuation of Deferred@530030437 after retry RPC after error@1653634568) -> (continuation of Deferred@1863326253 after retry RPC after error@1086159549) -> (continuation of Deferred@1676851576 after retry RPC after error@45331256) -> (continuation of Deferred@1839009841 after retry RPC after error@1189013421) -> (continuation of Deferred@814854007 after retry RPC after error@799338542) -> (continuation of Deferred@708669811 after retry RPC after error@460261398) -> (continuation of Deferred@641267227 after retry RPC after error@773146482) -> (continuation of Deferred@1877085482 after retry RPC after error@212764536) -> (continuation of Deferred@1833382104 after retry RPC after error@1768805589) -> (continuation of Deferred@370745231 after retry RPC after error@1853149043) -> (continuation of Deferred@979493781 after retry RPC after error@1026380656) -> (continuation of Deferred@1662436925 after retry RPC after error@726766203) -> (continuation of Deferred@504996303 after retry RPC after error@1232652207) -> (continuation of Deferred@478861203 after retry RPC after error@1005542451) -> (continuation of Deferred@1747682648 after retry RPC after error@1734439501) -> (continuation of Deferred@756877181 after retry RPC after error@1825753129), errback=(continuation of Deferred@887163772 after retry RPC after error@822737761) -> (continuation of Deferred@371962102 after retry RPC after error@37941608) -> (continuation of Deferred@1044689079 after retry RPC after error@1088984813) -> (continuation of Deferred@193933830 after retry RPC after error@517168046) -> (continuation of Deferred@84513227 after retry RPC after error@22163577) -> (continuation of Deferred@1941908823 after retry RPC after error@1999967909) -> (continuation of Deferred@1056659009 after retry RPC after error@783972383) -> (continuation of Deferred@610610442 after retry RPC after error@2067433245) -> (continuation of Deferred@530030437 after retry RPC after error@1653634568) -> (continuation of Deferred@1863326253 after retry RPC after error@1086159549) -> (continuation of Deferred@1676851576 after retry RPC after error@45331256) -> (continuation of Deferred@1839009841 after retry RPC after error@1189013421) -> (continuation of Deferred@814854007 after retry RPC after error@799338542) -> (continuation of Deferred@708669811 after retry RPC after error@460261398) -> (continuation of Deferred@641267227 after retry RPC after error@773146482) -> (continuation of Deferred@1877085482 after retry RPC after error@212764536) -> (continuation of Deferred@1833382104 after retry RPC after error@1768805589) -> (continuation of Deferred@370745231 after retry RPC after error@1853149043) -> (continuation of Deferred@979493781 after retry RPC after error@1026380656) -> (continuation of Deferred@1662436925 after retry RPC after error@726766203) -> (continuation of Deferred@504996303 after retry RPC after error@1232652207) -> (continuation of Deferred@478861203 after retry RPC after error@1005542451) -> (continuation of Deferred@1747682648 after retry RPC after error@1734439501) -> (continuation of Deferred@756877181 after retry RPC after error@1825753129)))
08:09:04.451 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
08:09:04.451 [WARN - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26742), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [6ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [7ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [7ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [30ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [74ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [74ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [75ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [83ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [84ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [85ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [85ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [101ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [101ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [102ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [102ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [121ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [141ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [142ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [142ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [142ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [221ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [221ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [222ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [222ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [282ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [283ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [283ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [284ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [484ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [484ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [486ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [487ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [522ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [523ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [524ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [525ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [642ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [643ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [644ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [644ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1500ms] refreshing cache from master, [1500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1503ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1504ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1506ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1506ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [3280ms] refreshing cache from master, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [3282ms] too many traces: truncated at 100 traces, deferred=Deferred@1615758965(state=PENDING, result=null, callback=(continuation of Deferred@887163772 after retry RPC after error@822737761) -> (continuation of Deferred@371962102 after retry RPC after error@37941608) -> (continuation of Deferred@1044689079 after retry RPC after error@1088984813) -> (continuation of Deferred@193933830 after retry RPC after error@517168046) -> (continuation of Deferred@84513227 after retry RPC after error@22163577) -> (continuation of Deferred@1941908823 after retry RPC after error@1999967909) -> (continuation of Deferred@1056659009 after retry RPC after error@783972383) -> (continuation of Deferred@610610442 after retry RPC after error@2067433245) -> (continuation of Deferred@530030437 after retry RPC after error@1653634568) -> (continuation of Deferred@1863326253 after retry RPC after error@1086159549) -> (continuation of Deferred@1676851576 after retry RPC after error@45331256) -> (continuation of Deferred@1839009841 after retry RPC after error@1189013421) -> (continuation of Deferred@814854007 after retry RPC after error@799338542) -> (continuation of Deferred@708669811 after retry RPC after error@460261398) -> (continuation of Deferred@641267227 after retry RPC after error@773146482) -> (continuation of Deferred@1877085482 after retry RPC after error@212764536) -> (continuation of Deferred@1833382104 after retry RPC after error@1768805589) -> (continuation of Deferred@370745231 after retry RPC after error@1853149043) -> (continuation of Deferred@979493781 after retry RPC after error@1026380656) -> (continuation of Deferred@1662436925 after retry RPC after error@726766203) -> (continuation of Deferred@504996303 after retry RPC after error@1232652207) -> (continuation of Deferred@478861203 after retry RPC after error@1005542451) -> (continuation of Deferred@1747682648 after retry RPC after error@1734439501) -> (continuation of Deferred@756877181 after retry RPC after error@1825753129), errback=(continuation of Deferred@887163772 after retry RPC after error@822737761) -> (continuation of Deferred@371962102 after retry RPC after error@37941608) -> (continuation of Deferred@1044689079 after retry RPC after error@1088984813) -> (continuation of Deferred@193933830 after retry RPC after error@517168046) -> (continuation of Deferred@84513227 after retry RPC after error@22163577) -> (continuation of Deferred@1941908823 after retry RPC after error@1999967909) -> (continuation of Deferred@1056659009 after retry RPC after error@783972383) -> (continuation of Deferred@610610442 after retry RPC after error@2067433245) -> (continuation of Deferred@530030437 after retry RPC after error@1653634568) -> (continuation of Deferred@1863326253 after retry RPC after error@1086159549) -> (continuation of Deferred@1676851576 after retry RPC after error@45331256) -> (continuation of Deferred@1839009841 after retry RPC after error@1189013421) -> (continuation of Deferred@814854007 after retry RPC after error@799338542) -> (continuation of Deferred@708669811 after retry RPC after error@460261398) -> (continuation of Deferred@641267227 after retry RPC after error@773146482) -> (continuation of Deferred@1877085482 after retry RPC after error@212764536) -> (continuation of Deferred@1833382104 after retry RPC after error@1768805589) -> (continuation of Deferred@370745231 after retry RPC after error@1853149043) -> (continuation of Deferred@979493781 after retry RPC after error@1026380656) -> (continuation of Deferred@1662436925 after retry RPC after error@726766203) -> (continuation of Deferred@504996303 after retry RPC after error@1232652207) -> (continuation of Deferred@478861203 after retry RPC after error@1005542451) -> (continuation of Deferred@1747682648 after retry RPC after error@1734439501) -> (continuation of Deferred@756877181 after retry RPC after error@1825753129)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.29.158.188:39061
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:04.454 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
08:09:04.456 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#3 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_3.
08:09:04.457 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to FAILED on b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26742), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [6ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [7ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [7ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [30ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [74ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [74ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [75ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [83ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [84ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [85ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [85ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [101ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [101ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [102ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [102ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [121ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [141ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [142ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [142ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [142ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [221ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [221ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [222ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [222ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [282ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [283ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [283ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [284ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [484ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [484ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [486ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [487ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [522ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [523ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [524ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [525ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [642ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [643ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [644ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [644ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1500ms] refreshing cache from master, [1500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1503ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1504ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1506ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1506ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [3280ms] refreshing cache from master, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [3282ms] too many traces: truncated at 100 traces, deferred=Deferred@1615758965(state=PENDING, result=null, callback=(continuation of Deferred@887163772 after retry RPC after error@822737761) -> (continuation of Deferred@371962102 after retry RPC after error@37941608) -> (continuation of Deferred@1044689079 after retry RPC after error@1088984813) -> (continuation of Deferred@193933830 after retry RPC after error@517168046) -> (continuation of Deferred@84513227 after retry RPC after error@22163577) -> (continuation of Deferred@1941908823 after retry RPC after error@1999967909) -> (continuation of Deferred@1056659009 after retry RPC after error@783972383) -> (continuation of Deferred@610610442 after retry RPC after error@2067433245) -> (continuation of Deferred@530030437 after retry RPC after error@1653634568) -> (continuation of Deferred@1863326253 after retry RPC after error@1086159549) -> (continuation of Deferred@1676851576 after retry RPC after error@45331256) -> (continuation of Deferred@1839009841 after retry RPC after error@1189013421) -> (continuation of Deferred@814854007 after retry RPC after error@799338542) -> (continuation of Deferred@708669811 after retry RPC after error@460261398) -> (continuation of Deferred@641267227 after retry RPC after error@773146482) -> (continuation of Deferred@1877085482 after retry RPC after error@212764536) -> (continuation of Deferred@1833382104 after retry RPC after error@1768805589) -> (continuation of Deferred@370745231 after retry RPC after error@1853149043) -> (continuation of Deferred@979493781 after retry RPC after error@1026380656) -> (continuation of Deferred@1662436925 after retry RPC after error@726766203) -> (continuation of Deferred@504996303 after retry RPC after error@1232652207) -> (continuation of Deferred@478861203 after retry RPC after error@1005542451) -> (continuation of Deferred@1747682648 after retry RPC after error@1734439501) -> (continuation of Deferred@756877181 after retry RPC after error@1825753129), errback=(continuation of Deferred@887163772 after retry RPC after error@822737761) -> (continuation of Deferred@371962102 after retry RPC after error@37941608) -> (continuation of Deferred@1044689079 after retry RPC after error@1088984813) -> (continuation of Deferred@193933830 after retry RPC after error@517168046) -> (continuation of Deferred@84513227 after retry RPC after error@22163577) -> (continuation of Deferred@1941908823 after retry RPC after error@1999967909) -> (continuation of Deferred@1056659009 after retry RPC after error@783972383) -> (continuation of Deferred@610610442 after retry RPC after error@2067433245) -> (continuation of Deferred@530030437 after retry RPC after error@1653634568) -> (continuation of Deferred@1863326253 after retry RPC after error@1086159549) -> (continuation of Deferred@1676851576 after retry RPC after error@45331256) -> (continuation of Deferred@1839009841 after retry RPC after error@1189013421) -> (continuation of Deferred@814854007 after retry RPC after error@799338542) -> (continuation of Deferred@708669811 after retry RPC after error@460261398) -> (continuation of Deferred@641267227 after retry RPC after error@773146482) -> (continuation of Deferred@1877085482 after retry RPC after error@212764536) -> (continuation of Deferred@1833382104 after retry RPC after error@1768805589) -> (continuation of Deferred@370745231 after retry RPC after error@1853149043) -> (continuation of Deferred@979493781 after retry RPC after error@1026380656) -> (continuation of Deferred@1662436925 after retry RPC after error@726766203) -> (continuation of Deferred@504996303 after retry RPC after error@1232652207) -> (continuation of Deferred@478861203 after retry RPC after error@1005542451) -> (continuation of Deferred@1747682648 after retry RPC after error@1734439501) -> (continuation of Deferred@756877181 after retry RPC after error@1825753129)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.29.158.188:39061
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:04.460 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:09:04.460 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#3) of source Source: KuduSource.
08:09:04.460 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_3.
08:09:04.460 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (a72e6b48022ef36361b5eef11ee7c683) switched from state RUNNING to RESTARTING.
08:09:04.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.479223  4213 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } attempt: 1
08:09:04.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:04.484436  4213 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.9.125:45723: Network error: Client connection negotiation failed: client connection to 127.4.9.125:45723: connect: Connection refused (error 111)
08:09:04.541 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:04.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.553002  4213 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } attempt: 2
08:09:04.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:04.558131  4213 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.9.125:45723: Network error: Client connection negotiation failed: client connection to 127.4.9.125:45723: connect: Connection refused (error 111)
08:09:04.626 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:04.627 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:04.627 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:04.627 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:04.627 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:04.627 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:04.627 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:04.627 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:04.628 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:04.628 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:04.628 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:04.628 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:04.628 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:04.638 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:04.639 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:04.639 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:04.639 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:04.639 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:04.639 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:04.639 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:04.639 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:04.639 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:04.640 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:04.640 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:04.640 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:04.640 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:04.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.649691  4213 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } attempt: 3
08:09:04.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:04.655853  4213 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.9.125:45723: Network error: Client connection negotiation failed: client connection to 127.4.9.125:45723: connect: Connection refused (error 111)
08:09:04.670 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:04.670 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:04.671 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:04.671 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:04.671 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:04.671 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:04.671 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:04.671 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:04.671 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:04.671 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:04.671 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:04.672 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:04.672 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:04.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:04.773895  4215 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:09:04.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:04.774571  4215 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:09:04.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:04.775220  4215 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:09:04.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.799386  4213 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } attempt: 4
08:09:04.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:04.806008  4213 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.9.125:45723: Network error: Client connection negotiation failed: client connection to 127.4.9.125:45723: connect: Connection refused (error 111)
08:09:04.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:04.821444  4215 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:09:04.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:04.821863  4215 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:09:04.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:04.822186  4215 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:09:04.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:04.822479  4215 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:09:04.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:04.822803  4215 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:09:04.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:04.822990  4215 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:39137/jwks.json
08:09:04.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:04.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.870990  4215 master_runner.cc:387] Master server non-default flags:
08:09:04.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:09:04.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.9.84:43373
08:09:04.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:09:04.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:09:04.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-1/data
08:09:04.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-1/wal
08:09:04.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:09:04.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.9.126:44985,127.4.9.125:45723,127.4.9.124:41733
08:09:04.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:09:04.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:09:04.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:09:04.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.9.125:45723
08:09:04.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:09:04.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:09:04.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:09:04.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39137/jwks.json
08:09:04.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:09:04.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:09:04.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-1/data/info.pb
08:09:04.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.9.125
08:09:04.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:09:04.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:09:04.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:09:04.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:09:04.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:09:04.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:09:04.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-1/logs
08:09:04.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:09:04.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:09:04.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:09:04.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:09:04.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:09:04.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:09:04.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:09:04.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:09:04.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:09:04.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:09:04.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.872822  4215 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:09:04.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:04.874845  4215 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:09:04.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:04.888314  4224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:04.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091744908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:04.918 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
08:09:04.921 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
08:09:05.033 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:05.033 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:05.033 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:05.034 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:05.034 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:05.034 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:05.034 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:05.034 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:05.034 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:05.034 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:05.035 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:05.035 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:05.035 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:05.041 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:05.103 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:05.104 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:05.104 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:05.104 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:05.104 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:05.104 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:05.104 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:05.104 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:05.105 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:05.106 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:05.106 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:05.106 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:05.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:05.105572  4213 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } attempt: 5
08:09:05.106 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:05.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:05.113169  4213 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.9.125:45723: Network error: Client connection negotiation failed: client connection to 127.4.9.125:45723: connect: Connection refused (error 111)
08:09:05.233 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:05.233 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:05.233 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:05.234 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:05.234 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:05.234 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:05.234 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:05.234 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:05.234 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:05.235 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:05.235 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:05.235 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:05.235 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:05.284 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:05.285 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:05.285 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:05.285 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:05.285 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:05.286 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:05.286 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:05.286 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:05.285 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:05.286 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:05.286 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:05.286 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:05.286 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:05.307 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:05.307 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:05.308 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:05.308 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:05.308 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:05.308 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:05.308 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:05.309 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:05.309 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:05.309 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:05.309 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:05.309 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:05.310 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:05.325 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:05.325 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:05.325 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:05.326 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:05.326 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:05.326 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:05.327 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:05.327 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:05.327 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:05.327 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:05.327 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:05.327 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:05.328 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:05.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:05.363 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:05.364 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:05.364 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:05.364 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:05.364 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:05.365 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:05.365 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:05.365 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:05.365 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:05.365 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:05.365 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:05.365 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:05.365 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:05.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091745408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:05.421 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
08:09:05.422 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
08:09:05.493 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:05.493 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:05.493 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:05.494 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:05.494 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:05.495 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:05.495 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:05.495 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:05.495 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:05.495 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:05.495 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:05.495 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:05.496 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:05.541 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:05.578 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:05.579 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:05.579 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:05.579 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:05.579 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:05.579 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:05.580 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:05.580 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:05.580 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:05.580 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:05.580 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:05.580 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:05.580 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:05.581 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27884), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [3ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [3ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [4ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [21ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [22ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [23ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [23ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [62ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [83ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [84ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [84ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [101ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [101ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [102ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [102ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [122ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [122ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [141ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [142ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [142ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [142ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [200ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [202ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [202ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [202ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [203ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [260ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [262ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [263ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [263ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [263ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [382ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [382ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [383ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [383ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [704ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [704ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [705ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [705ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1521ms] refreshing cache from master, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1522ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1522ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1523ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2760ms] refreshing cache from master, [2760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [2763ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2763ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [4480ms] refreshing cache from master, [4487ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [4670ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [4670ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [4671ms] too many traces: truncated at 100 traces, deferred=Deferred@595318137(state=PENDING, result=null, callback=(continuation of Deferred@1686022429 after retry RPC after error@653911669) -> (continuation of Deferred@1724885210 after retry RPC after error@467827047) -> (continuation of Deferred@180686151 after retry RPC after error@1676052516) -> (continuation of Deferred@2029282810 after retry RPC after error@1893008066) -> (continuation of Deferred@1381537450 after retry RPC after error@86545261) -> (continuation of Deferred@1579740551 after retry RPC after error@104019858) -> (continuation of Deferred@273157176 after retry RPC after error@1362773671) -> (continuation of Deferred@1214762450 after retry RPC after error@1475869931) -> (continuation of Deferred@126747617 after retry RPC after error@75653833) -> (continuation of Deferred@1920804566 after retry RPC after error@436575446) -> (continuation of Deferred@1835206012 after retry RPC after error@2053154355) -> (continuation of Deferred@1638954047 after retry RPC after error@1466279923) -> (continuation of Deferred@584585350 after retry RPC after error@1576434640) -> (continuation of Deferred@1065741789 after retry RPC after error@1160089569) -> (continuation of Deferred@664529891 after retry RPC after error@1230847035) -> (continuation of Deferred@1504103368 after retry RPC after error@806686106) -> (continuation of Deferred@1210662024 after retry RPC after error@1756724562) -> (continuation of Deferred@128062215 after retry RPC after error@524531636) -> (continuation of Deferred@504305064 after retry RPC after error@1561568470) -> (continuation of Deferred@1245625944 after retry RPC after error@1212309180) -> (continuation of Deferred@780578889 after retry RPC after error@1853064283) -> (continuation of Deferred@1358969779 after retry RPC after error@191703185) -> (continuation of Deferred@284349773 after retry RPC after error@1649527380), errback=(continuation of Deferred@1686022429 after retry RPC after error@653911669) -> (continuation of Deferred@1724885210 after retry RPC after error@467827047) -> (continuation of Deferred@180686151 after retry RPC after error@1676052516) -> (continuation of Deferred@2029282810 after retry RPC after error@1893008066) -> (continuation of Deferred@1381537450 after retry RPC after error@86545261) -> (continuation of Deferred@1579740551 after retry RPC after error@104019858) -> (continuation of Deferred@273157176 after retry RPC after error@1362773671) -> (continuation of Deferred@1214762450 after retry RPC after error@1475869931) -> (continuation of Deferred@126747617 after retry RPC after error@75653833) -> (continuation of Deferred@1920804566 after retry RPC after error@436575446) -> (continuation of Deferred@1835206012 after retry RPC after error@2053154355) -> (continuation of Deferred@1638954047 after retry RPC after error@1466279923) -> (continuation of Deferred@584585350 after retry RPC after error@1576434640) -> (continuation of Deferred@1065741789 after retry RPC after error@1160089569) -> (continuation of Deferred@664529891 after retry RPC after error@1230847035) -> (continuation of Deferred@1504103368 after retry RPC after error@806686106) -> (continuation of Deferred@1210662024 after retry RPC after error@1756724562) -> (continuation of Deferred@128062215 after retry RPC after error@524531636) -> (continuation of Deferred@504305064 after retry RPC after error@1561568470) -> (continuation of Deferred@1245625944 after retry RPC after error@1212309180) -> (continuation of Deferred@780578889 after retry RPC after error@1853064283) -> (continuation of Deferred@1358969779 after retry RPC after error@191703185) -> (continuation of Deferred@284349773 after retry RPC after error@1649527380)))
08:09:05.584 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
08:09:05.584 [WARN - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27884), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [3ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [3ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [4ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [21ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [22ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [23ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [23ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [62ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [83ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [84ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [84ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [101ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [101ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [102ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [102ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [122ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [122ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [141ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [142ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [142ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [142ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [200ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [202ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [202ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [202ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [203ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [260ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [262ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [263ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [263ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [263ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [382ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [382ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [383ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [383ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [704ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [704ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [705ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [705ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1521ms] refreshing cache from master, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1522ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1522ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1523ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2760ms] refreshing cache from master, [2760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [2763ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2763ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [4480ms] refreshing cache from master, [4487ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [4670ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [4670ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [4671ms] too many traces: truncated at 100 traces, deferred=Deferred@595318137(state=PENDING, result=null, callback=(continuation of Deferred@1686022429 after retry RPC after error@653911669) -> (continuation of Deferred@1724885210 after retry RPC after error@467827047) -> (continuation of Deferred@180686151 after retry RPC after error@1676052516) -> (continuation of Deferred@2029282810 after retry RPC after error@1893008066) -> (continuation of Deferred@1381537450 after retry RPC after error@86545261) -> (continuation of Deferred@1579740551 after retry RPC after error@104019858) -> (continuation of Deferred@273157176 after retry RPC after error@1362773671) -> (continuation of Deferred@1214762450 after retry RPC after error@1475869931) -> (continuation of Deferred@126747617 after retry RPC after error@75653833) -> (continuation of Deferred@1920804566 after retry RPC after error@436575446) -> (continuation of Deferred@1835206012 after retry RPC after error@2053154355) -> (continuation of Deferred@1638954047 after retry RPC after error@1466279923) -> (continuation of Deferred@584585350 after retry RPC after error@1576434640) -> (continuation of Deferred@1065741789 after retry RPC after error@1160089569) -> (continuation of Deferred@664529891 after retry RPC after error@1230847035) -> (continuation of Deferred@1504103368 after retry RPC after error@806686106) -> (continuation of Deferred@1210662024 after retry RPC after error@1756724562) -> (continuation of Deferred@128062215 after retry RPC after error@524531636) -> (continuation of Deferred@504305064 after retry RPC after error@1561568470) -> (continuation of Deferred@1245625944 after retry RPC after error@1212309180) -> (continuation of Deferred@780578889 after retry RPC after error@1853064283) -> (continuation of Deferred@1358969779 after retry RPC after error@191703185) -> (continuation of Deferred@284349773 after retry RPC after error@1649527380), errback=(continuation of Deferred@1686022429 after retry RPC after error@653911669) -> (continuation of Deferred@1724885210 after retry RPC after error@467827047) -> (continuation of Deferred@180686151 after retry RPC after error@1676052516) -> (continuation of Deferred@2029282810 after retry RPC after error@1893008066) -> (continuation of Deferred@1381537450 after retry RPC after error@86545261) -> (continuation of Deferred@1579740551 after retry RPC after error@104019858) -> (continuation of Deferred@273157176 after retry RPC after error@1362773671) -> (continuation of Deferred@1214762450 after retry RPC after error@1475869931) -> (continuation of Deferred@126747617 after retry RPC after error@75653833) -> (continuation of Deferred@1920804566 after retry RPC after error@436575446) -> (continuation of Deferred@1835206012 after retry RPC after error@2053154355) -> (continuation of Deferred@1638954047 after retry RPC after error@1466279923) -> (continuation of Deferred@584585350 after retry RPC after error@1576434640) -> (continuation of Deferred@1065741789 after retry RPC after error@1160089569) -> (continuation of Deferred@664529891 after retry RPC after error@1230847035) -> (continuation of Deferred@1504103368 after retry RPC after error@806686106) -> (continuation of Deferred@1210662024 after retry RPC after error@1756724562) -> (continuation of Deferred@128062215 after retry RPC after error@524531636) -> (continuation of Deferred@504305064 after retry RPC after error@1561568470) -> (continuation of Deferred@1245625944 after retry RPC after error@1212309180) -> (continuation of Deferred@780578889 after retry RPC after error@1853064283) -> (continuation of Deferred@1358969779 after retry RPC after error@191703185) -> (continuation of Deferred@284349773 after retry RPC after error@1649527380)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.29.158.188:39061
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:05.588 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
08:09:05.590 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#3 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_3.
08:09:05.593 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to FAILED on b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27884), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [3ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [3ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [4ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [21ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [22ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [23ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [23ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [62ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [83ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [84ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [84ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [101ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [101ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [102ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [102ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [122ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [122ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [141ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [142ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [142ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [142ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [200ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [202ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [202ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [202ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [203ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [260ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [262ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [263ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [263ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [263ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [382ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [382ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [383ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [383ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [704ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [704ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [705ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [705ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1521ms] refreshing cache from master, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1522ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1522ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1523ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2760ms] refreshing cache from master, [2760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [2763ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2763ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [4480ms] refreshing cache from master, [4487ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [4670ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [4670ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [4671ms] too many traces: truncated at 100 traces, deferred=Deferred@595318137(state=PENDING, result=null, callback=(continuation of Deferred@1686022429 after retry RPC after error@653911669) -> (continuation of Deferred@1724885210 after retry RPC after error@467827047) -> (continuation of Deferred@180686151 after retry RPC after error@1676052516) -> (continuation of Deferred@2029282810 after retry RPC after error@1893008066) -> (continuation of Deferred@1381537450 after retry RPC after error@86545261) -> (continuation of Deferred@1579740551 after retry RPC after error@104019858) -> (continuation of Deferred@273157176 after retry RPC after error@1362773671) -> (continuation of Deferred@1214762450 after retry RPC after error@1475869931) -> (continuation of Deferred@126747617 after retry RPC after error@75653833) -> (continuation of Deferred@1920804566 after retry RPC after error@436575446) -> (continuation of Deferred@1835206012 after retry RPC after error@2053154355) -> (continuation of Deferred@1638954047 after retry RPC after error@1466279923) -> (continuation of Deferred@584585350 after retry RPC after error@1576434640) -> (continuation of Deferred@1065741789 after retry RPC after error@1160089569) -> (continuation of Deferred@664529891 after retry RPC after error@1230847035) -> (continuation of Deferred@1504103368 after retry RPC after error@806686106) -> (continuation of Deferred@1210662024 after retry RPC after error@1756724562) -> (continuation of Deferred@128062215 after retry RPC after error@524531636) -> (continuation of Deferred@504305064 after retry RPC after error@1561568470) -> (continuation of Deferred@1245625944 after retry RPC after error@1212309180) -> (continuation of Deferred@780578889 after retry RPC after error@1853064283) -> (continuation of Deferred@1358969779 after retry RPC after error@191703185) -> (continuation of Deferred@284349773 after retry RPC after error@1649527380), errback=(continuation of Deferred@1686022429 after retry RPC after error@653911669) -> (continuation of Deferred@1724885210 after retry RPC after error@467827047) -> (continuation of Deferred@180686151 after retry RPC after error@1676052516) -> (continuation of Deferred@2029282810 after retry RPC after error@1893008066) -> (continuation of Deferred@1381537450 after retry RPC after error@86545261) -> (continuation of Deferred@1579740551 after retry RPC after error@104019858) -> (continuation of Deferred@273157176 after retry RPC after error@1362773671) -> (continuation of Deferred@1214762450 after retry RPC after error@1475869931) -> (continuation of Deferred@126747617 after retry RPC after error@75653833) -> (continuation of Deferred@1920804566 after retry RPC after error@436575446) -> (continuation of Deferred@1835206012 after retry RPC after error@2053154355) -> (continuation of Deferred@1638954047 after retry RPC after error@1466279923) -> (continuation of Deferred@584585350 after retry RPC after error@1576434640) -> (continuation of Deferred@1065741789 after retry RPC after error@1160089569) -> (continuation of Deferred@664529891 after retry RPC after error@1230847035) -> (continuation of Deferred@1504103368 after retry RPC after error@806686106) -> (continuation of Deferred@1210662024 after retry RPC after error@1756724562) -> (continuation of Deferred@128062215 after retry RPC after error@524531636) -> (continuation of Deferred@504305064 after retry RPC after error@1561568470) -> (continuation of Deferred@1245625944 after retry RPC after error@1212309180) -> (continuation of Deferred@780578889 after retry RPC after error@1853064283) -> (continuation of Deferred@1358969779 after retry RPC after error@191703185) -> (continuation of Deferred@284349773 after retry RPC after error@1649527380)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.29.158.188:39061
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:05.598 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:09:05.598 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#3) of source Source: KuduSource.
08:09:05.599 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_3.
08:09:05.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:05.660804  4213 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } attempt: 6
08:09:05.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:05.674830  4213 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.9.125:45723: Network error: Client connection negotiation failed: client connection to 127.4.9.125:45723: connect: Connection refused (error 111)
08:09:05.833 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:05.834 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:05.834 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:05.834 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:05.835 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:05.835 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:05.835 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:05.835 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:05.835 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:05.836 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:05.836 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:05.836 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:05.836 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:05.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:05.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091745908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:05.920 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:09:05.923 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
08:09:05.924 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:05.924 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:05.924 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:05.925 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:05.925 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:05.925 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:05.925 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:05.925 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:05.925 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:05.926 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:05.926 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:05.926 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:05.926 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:05.927 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28224), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [1ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [2ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [3ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [3ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [24ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [34ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [34ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [63ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [82ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [82ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [102ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [141ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [163ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [163ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [203ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [203ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [425ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [425ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [622ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [840ms] refreshing cache from master, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [842ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [844ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [848ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [848ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [2820ms] refreshing cache from master, [2820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [2821ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [2821ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [2822ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [5120ms] refreshing cache from master, [5120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [5120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [5121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [5122ms] too many traces: truncated at 100 traces, deferred=Deferred@1819183518(state=PENDING, result=null, callback=(continuation of Deferred@1490192502 after retry RPC after error@1857687012) -> (continuation of Deferred@1690543992 after retry RPC after error@2096750599) -> (continuation of Deferred@816076502 after retry RPC after error@240101387) -> (continuation of Deferred@2001614557 after retry RPC after error@1149503979) -> (continuation of Deferred@1451550027 after retry RPC after error@637010016) -> (continuation of Deferred@595997404 after retry RPC after error@1202301974) -> (continuation of Deferred@922134293 after retry RPC after error@1399347883) -> (continuation of Deferred@1097503432 after retry RPC after error@1260998639) -> (continuation of Deferred@1214551952 after retry RPC after error@1506287925) -> (continuation of Deferred@1277232150 after retry RPC after error@1307995210) -> (continuation of Deferred@558021235 after retry RPC after error@966518503) -> (continuation of Deferred@2111718518 after retry RPC after error@53801915) -> (continuation of Deferred@923881612 after retry RPC after error@1373316183) -> (continuation of Deferred@1579755502 after retry RPC after error@2057612987) -> (continuation of Deferred@1200358483 after retry RPC after error@1342011753) -> (continuation of Deferred@1492922671 after retry RPC after error@124952061) -> (continuation of Deferred@544976860 after retry RPC after error@82427019) -> (continuation of Deferred@1025867888 after retry RPC after error@774602588) -> (continuation of Deferred@1397960714 after retry RPC after error@437768975) -> (continuation of Deferred@195098173 after retry RPC after error@2114234762) -> (continuation of Deferred@874317088 after retry RPC after error@271984391) -> (continuation of Deferred@480983586 after retry RPC after error@1194887364) -> (continuation of Deferred@466657542 after retry RPC after error@989836132) -> (continuation of Deferred@2143347763 after retry RPC after error@2092776871) -> (continuation of Deferred@1660648359 after retry RPC after error@626561039), errback=(continuation of Deferred@1490192502 after retry RPC after error@1857687012) -> (continuation of Deferred@1690543992 after retry RPC after error@2096750599) -> (continuation of Deferred@816076502 after retry RPC after error@240101387) -> (continuation of Deferred@2001614557 after retry RPC after error@1149503979) -> (continuation of Deferred@1451550027 after retry RPC after error@637010016) -> (continuation of Deferred@595997404 after retry RPC after error@1202301974) -> (continuation of Deferred@922134293 after retry RPC after error@1399347883) -> (continuation of Deferred@1097503432 after retry RPC after error@1260998639) -> (continuation of Deferred@1214551952 after retry RPC after error@1506287925) -> (continuation of Deferred@1277232150 after retry RPC after error@1307995210) -> (continuation of Deferred@558021235 after retry RPC after error@966518503) -> (continuation of Deferred@2111718518 after retry RPC after error@53801915) -> (continuation of Deferred@923881612 after retry RPC after error@1373316183) -> (continuation of Deferred@1579755502 after retry RPC after error@2057612987) -> (continuation of Deferred@1200358483 after retry RPC after error@1342011753) -> (continuation of Deferred@1492922671 after retry RPC after error@124952061) -> (continuation of Deferred@544976860 after retry RPC after error@82427019) -> (continuation of Deferred@1025867888 after retry RPC after error@774602588) -> (continuation of Deferred@1397960714 after retry RPC after error@437768975) -> (continuation of Deferred@195098173 after retry RPC after error@2114234762) -> (continuation of Deferred@874317088 after retry RPC after error@271984391) -> (continuation of Deferred@480983586 after retry RPC after error@1194887364) -> (continuation of Deferred@466657542 after retry RPC after error@989836132) -> (continuation of Deferred@2143347763 after retry RPC after error@2092776871) -> (continuation of Deferred@1660648359 after retry RPC after error@626561039)))
08:09:05.929 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:05.929 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:05.929 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:05.929 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28224), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [1ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [2ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [3ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [3ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [24ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [34ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [34ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [63ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [82ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [82ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [102ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [141ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [163ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [163ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [203ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [203ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [425ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [425ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [622ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [840ms] refreshing cache from master, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [842ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [844ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [848ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [848ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [2820ms] refreshing cache from master, [2820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [2821ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [2821ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [2822ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [5120ms] refreshing cache from master, [5120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [5120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [5121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [5122ms] too many traces: truncated at 100 traces, deferred=Deferred@1819183518(state=PENDING, result=null, callback=(continuation of Deferred@1490192502 after retry RPC after error@1857687012) -> (continuation of Deferred@1690543992 after retry RPC after error@2096750599) -> (continuation of Deferred@816076502 after retry RPC after error@240101387) -> (continuation of Deferred@2001614557 after retry RPC after error@1149503979) -> (continuation of Deferred@1451550027 after retry RPC after error@637010016) -> (continuation of Deferred@595997404 after retry RPC after error@1202301974) -> (continuation of Deferred@922134293 after retry RPC after error@1399347883) -> (continuation of Deferred@1097503432 after retry RPC after error@1260998639) -> (continuation of Deferred@1214551952 after retry RPC after error@1506287925) -> (continuation of Deferred@1277232150 after retry RPC after error@1307995210) -> (continuation of Deferred@558021235 after retry RPC after error@966518503) -> (continuation of Deferred@2111718518 after retry RPC after error@53801915) -> (continuation of Deferred@923881612 after retry RPC after error@1373316183) -> (continuation of Deferred@1579755502 after retry RPC after error@2057612987) -> (continuation of Deferred@1200358483 after retry RPC after error@1342011753) -> (continuation of Deferred@1492922671 after retry RPC after error@124952061) -> (continuation of Deferred@544976860 after retry RPC after error@82427019) -> (continuation of Deferred@1025867888 after retry RPC after error@774602588) -> (continuation of Deferred@1397960714 after retry RPC after error@437768975) -> (continuation of Deferred@195098173 after retry RPC after error@2114234762) -> (continuation of Deferred@874317088 after retry RPC after error@271984391) -> (continuation of Deferred@480983586 after retry RPC after error@1194887364) -> (continuation of Deferred@466657542 after retry RPC after error@989836132) -> (continuation of Deferred@2143347763 after retry RPC after error@2092776871) -> (continuation of Deferred@1660648359 after retry RPC after error@626561039), errback=(continuation of Deferred@1490192502 after retry RPC after error@1857687012) -> (continuation of Deferred@1690543992 after retry RPC after error@2096750599) -> (continuation of Deferred@816076502 after retry RPC after error@240101387) -> (continuation of Deferred@2001614557 after retry RPC after error@1149503979) -> (continuation of Deferred@1451550027 after retry RPC after error@637010016) -> (continuation of Deferred@595997404 after retry RPC after error@1202301974) -> (continuation of Deferred@922134293 after retry RPC after error@1399347883) -> (continuation of Deferred@1097503432 after retry RPC after error@1260998639) -> (continuation of Deferred@1214551952 after retry RPC after error@1506287925) -> (continuation of Deferred@1277232150 after retry RPC after error@1307995210) -> (continuation of Deferred@558021235 after retry RPC after error@966518503) -> (continuation of Deferred@2111718518 after retry RPC after error@53801915) -> (continuation of Deferred@923881612 after retry RPC after error@1373316183) -> (continuation of Deferred@1579755502 after retry RPC after error@2057612987) -> (continuation of Deferred@1200358483 after retry RPC after error@1342011753) -> (continuation of Deferred@1492922671 after retry RPC after error@124952061) -> (continuation of Deferred@544976860 after retry RPC after error@82427019) -> (continuation of Deferred@1025867888 after retry RPC after error@774602588) -> (continuation of Deferred@1397960714 after retry RPC after error@437768975) -> (continuation of Deferred@195098173 after retry RPC after error@2114234762) -> (continuation of Deferred@874317088 after retry RPC after error@271984391) -> (continuation of Deferred@480983586 after retry RPC after error@1194887364) -> (continuation of Deferred@466657542 after retry RPC after error@989836132) -> (continuation of Deferred@2143347763 after retry RPC after error@2092776871) -> (continuation of Deferred@1660648359 after retry RPC after error@626561039)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28224), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [1ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [2ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [3ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [3ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [24ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [34ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [34ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [63ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [82ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [82ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [102ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [141ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [163ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [163ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [203ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [203ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [425ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [425ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [622ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [840ms] refreshing cache from master, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [842ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [844ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [848ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [848ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [2820ms] refreshing cache from master, [2820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [2821ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [2821ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [2822ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [5120ms] refreshing cache from master, [5120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [5120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [5121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [5122ms] too many traces: truncated at 100 traces, deferred=Deferred@1819183518(state=PENDING, result=null, callback=(continuation of Deferred@1490192502 after retry RPC after error@1857687012) -> (continuation of Deferred@1690543992 after retry RPC after error@2096750599) -> (continuation of Deferred@816076502 after retry RPC after error@240101387) -> (continuation of Deferred@2001614557 after retry RPC after error@1149503979) -> (continuation of Deferred@1451550027 after retry RPC after error@637010016) -> (continuation of Deferred@595997404 after retry RPC after error@1202301974) -> (continuation of Deferred@922134293 after retry RPC after error@1399347883) -> (continuation of Deferred@1097503432 after retry RPC after error@1260998639) -> (continuation of Deferred@1214551952 after retry RPC after error@1506287925) -> (continuation of Deferred@1277232150 after retry RPC after error@1307995210) -> (continuation of Deferred@558021235 after retry RPC after error@966518503) -> (continuation of Deferred@2111718518 after retry RPC after error@53801915) -> (continuation of Deferred@923881612 after retry RPC after error@1373316183) -> (continuation of Deferred@1579755502 after retry RPC after error@2057612987) -> (continuation of Deferred@1200358483 after retry RPC after error@1342011753) -> (continuation of Deferred@1492922671 after retry RPC after error@124952061) -> (continuation of Deferred@544976860 after retry RPC after error@82427019) -> (continuation of Deferred@1025867888 after retry RPC after error@774602588) -> (continuation of Deferred@1397960714 after retry RPC after error@437768975) -> (continuation of Deferred@195098173 after retry RPC after error@2114234762) -> (continuation of Deferred@874317088 after retry RPC after error@271984391) -> (continuation of Deferred@480983586 after retry RPC after error@1194887364) -> (continuation of Deferred@466657542 after retry RPC after error@989836132) -> (continuation of Deferred@2143347763 after retry RPC after error@2092776871) -> (continuation of Deferred@1660648359 after retry RPC after error@626561039), errback=(continuation of Deferred@1490192502 after retry RPC after error@1857687012) -> (continuation of Deferred@1690543992 after retry RPC after error@2096750599) -> (continuation of Deferred@816076502 after retry RPC after error@240101387) -> (continuation of Deferred@2001614557 after retry RPC after error@1149503979) -> (continuation of Deferred@1451550027 after retry RPC after error@637010016) -> (continuation of Deferred@595997404 after retry RPC after error@1202301974) -> (continuation of Deferred@922134293 after retry RPC after error@1399347883) -> (continuation of Deferred@1097503432 after retry RPC after error@1260998639) -> (continuation of Deferred@1214551952 after retry RPC after error@1506287925) -> (continuation of Deferred@1277232150 after retry RPC after error@1307995210) -> (continuation of Deferred@558021235 after retry RPC after error@966518503) -> (continuation of Deferred@2111718518 after retry RPC after error@53801915) -> (continuation of Deferred@923881612 after retry RPC after error@1373316183) -> (continuation of Deferred@1579755502 after retry RPC after error@2057612987) -> (continuation of Deferred@1200358483 after retry RPC after error@1342011753) -> (continuation of Deferred@1492922671 after retry RPC after error@124952061) -> (continuation of Deferred@544976860 after retry RPC after error@82427019) -> (continuation of Deferred@1025867888 after retry RPC after error@774602588) -> (continuation of Deferred@1397960714 after retry RPC after error@437768975) -> (continuation of Deferred@195098173 after retry RPC after error@2114234762) -> (continuation of Deferred@874317088 after retry RPC after error@271984391) -> (continuation of Deferred@480983586 after retry RPC after error@1194887364) -> (continuation of Deferred@466657542 after retry RPC after error@989836132) -> (continuation of Deferred@2143347763 after retry RPC after error@2092776871) -> (continuation of Deferred@1660648359 after retry RPC after error@626561039)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.220.252:33543
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:05.930 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:05.930 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:05.930 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:05.930 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:05.931 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:05.932 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:05.932 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:05.932 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:05.932 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:05.932 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:05.941 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28224), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [1ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [2ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [3ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [3ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [24ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [34ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [34ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [63ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [82ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [82ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [102ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [141ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [163ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [163ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [203ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [203ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [425ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [425ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [622ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [840ms] refreshing cache from master, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [842ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [844ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [848ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [848ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [2820ms] refreshing cache from master, [2820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [2821ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [2821ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [2822ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [5120ms] refreshing cache from master, [5120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [5120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [5121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [5122ms] too many traces: truncated at 100 traces, deferred=Deferred@1819183518(state=PENDING, result=null, callback=(continuation of Deferred@1490192502 after retry RPC after error@1857687012) -> (continuation of Deferred@1690543992 after retry RPC after error@2096750599) -> (continuation of Deferred@816076502 after retry RPC after error@240101387) -> (continuation of Deferred@2001614557 after retry RPC after error@1149503979) -> (continuation of Deferred@1451550027 after retry RPC after error@637010016) -> (continuation of Deferred@595997404 after retry RPC after error@1202301974) -> (continuation of Deferred@922134293 after retry RPC after error@1399347883) -> (continuation of Deferred@1097503432 after retry RPC after error@1260998639) -> (continuation of Deferred@1214551952 after retry RPC after error@1506287925) -> (continuation of Deferred@1277232150 after retry RPC after error@1307995210) -> (continuation of Deferred@558021235 after retry RPC after error@966518503) -> (continuation of Deferred@2111718518 after retry RPC after error@53801915) -> (continuation of Deferred@923881612 after retry RPC after error@1373316183) -> (continuation of Deferred@1579755502 after retry RPC after error@2057612987) -> (continuation of Deferred@1200358483 after retry RPC after error@1342011753) -> (continuation of Deferred@1492922671 after retry RPC after error@124952061) -> (continuation of Deferred@544976860 after retry RPC after error@82427019) -> (continuation of Deferred@1025867888 after retry RPC after error@774602588) -> (continuation of Deferred@1397960714 after retry RPC after error@437768975) -> (continuation of Deferred@195098173 after retry RPC after error@2114234762) -> (continuation of Deferred@874317088 after retry RPC after error@271984391) -> (continuation of Deferred@480983586 after retry RPC after error@1194887364) -> (continuation of Deferred@466657542 after retry RPC after error@989836132) -> (continuation of Deferred@2143347763 after retry RPC after error@2092776871) -> (continuation of Deferred@1660648359 after retry RPC after error@626561039), errback=(continuation of Deferred@1490192502 after retry RPC after error@1857687012) -> (continuation of Deferred@1690543992 after retry RPC after error@2096750599) -> (continuation of Deferred@816076502 after retry RPC after error@240101387) -> (continuation of Deferred@2001614557 after retry RPC after error@1149503979) -> (continuation of Deferred@1451550027 after retry RPC after error@637010016) -> (continuation of Deferred@595997404 after retry RPC after error@1202301974) -> (continuation of Deferred@922134293 after retry RPC after error@1399347883) -> (continuation of Deferred@1097503432 after retry RPC after error@1260998639) -> (continuation of Deferred@1214551952 after retry RPC after error@1506287925) -> (continuation of Deferred@1277232150 after retry RPC after error@1307995210) -> (continuation of Deferred@558021235 after retry RPC after error@966518503) -> (continuation of Deferred@2111718518 after retry RPC after error@53801915) -> (continuation of Deferred@923881612 after retry RPC after error@1373316183) -> (continuation of Deferred@1579755502 after retry RPC after error@2057612987) -> (continuation of Deferred@1200358483 after retry RPC after error@1342011753) -> (continuation of Deferred@1492922671 after retry RPC after error@124952061) -> (continuation of Deferred@544976860 after retry RPC after error@82427019) -> (continuation of Deferred@1025867888 after retry RPC after error@774602588) -> (continuation of Deferred@1397960714 after retry RPC after error@437768975) -> (continuation of Deferred@195098173 after retry RPC after error@2114234762) -> (continuation of Deferred@874317088 after retry RPC after error@271984391) -> (continuation of Deferred@480983586 after retry RPC after error@1194887364) -> (continuation of Deferred@466657542 after retry RPC after error@989836132) -> (continuation of Deferred@2143347763 after retry RPC after error@2092776871) -> (continuation of Deferred@1660648359 after retry RPC after error@626561039)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28224), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [1ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [2ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [3ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [3ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [24ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [34ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [34ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [63ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [82ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [82ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [102ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [141ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [163ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [163ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [203ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [203ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [425ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [425ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [622ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [840ms] refreshing cache from master, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [842ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [844ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [848ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [848ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [2820ms] refreshing cache from master, [2820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [2821ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [2821ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [2822ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [5120ms] refreshing cache from master, [5120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [5120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [5121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [5122ms] too many traces: truncated at 100 traces, deferred=Deferred@1819183518(state=PENDING, result=null, callback=(continuation of Deferred@1490192502 after retry RPC after error@1857687012) -> (continuation of Deferred@1690543992 after retry RPC after error@2096750599) -> (continuation of Deferred@816076502 after retry RPC after error@240101387) -> (continuation of Deferred@2001614557 after retry RPC after error@1149503979) -> (continuation of Deferred@1451550027 after retry RPC after error@637010016) -> (continuation of Deferred@595997404 after retry RPC after error@1202301974) -> (continuation of Deferred@922134293 after retry RPC after error@1399347883) -> (continuation of Deferred@1097503432 after retry RPC after error@1260998639) -> (continuation of Deferred@1214551952 after retry RPC after error@1506287925) -> (continuation of Deferred@1277232150 after retry RPC after error@1307995210) -> (continuation of Deferred@558021235 after retry RPC after error@966518503) -> (continuation of Deferred@2111718518 after retry RPC after error@53801915) -> (continuation of Deferred@923881612 after retry RPC after error@1373316183) -> (continuation of Deferred@1579755502 after retry RPC after error@2057612987) -> (continuation of Deferred@1200358483 after retry RPC after error@1342011753) -> (continuation of Deferred@1492922671 after retry RPC after error@124952061) -> (continuation of Deferred@544976860 after retry RPC after error@82427019) -> (continuation of Deferred@1025867888 after retry RPC after error@774602588) -> (continuation of Deferred@1397960714 after retry RPC after error@437768975) -> (continuation of Deferred@195098173 after retry RPC after error@2114234762) -> (continuation of Deferred@874317088 after retry RPC after error@271984391) -> (continuation of Deferred@480983586 after retry RPC after error@1194887364) -> (continuation of Deferred@466657542 after retry RPC after error@989836132) -> (continuation of Deferred@2143347763 after retry RPC after error@2092776871) -> (continuation of Deferred@1660648359 after retry RPC after error@626561039), errback=(continuation of Deferred@1490192502 after retry RPC after error@1857687012) -> (continuation of Deferred@1690543992 after retry RPC after error@2096750599) -> (continuation of Deferred@816076502 after retry RPC after error@240101387) -> (continuation of Deferred@2001614557 after retry RPC after error@1149503979) -> (continuation of Deferred@1451550027 after retry RPC after error@637010016) -> (continuation of Deferred@595997404 after retry RPC after error@1202301974) -> (continuation of Deferred@922134293 after retry RPC after error@1399347883) -> (continuation of Deferred@1097503432 after retry RPC after error@1260998639) -> (continuation of Deferred@1214551952 after retry RPC after error@1506287925) -> (continuation of Deferred@1277232150 after retry RPC after error@1307995210) -> (continuation of Deferred@558021235 after retry RPC after error@966518503) -> (continuation of Deferred@2111718518 after retry RPC after error@53801915) -> (continuation of Deferred@923881612 after retry RPC after error@1373316183) -> (continuation of Deferred@1579755502 after retry RPC after error@2057612987) -> (continuation of Deferred@1200358483 after retry RPC after error@1342011753) -> (continuation of Deferred@1492922671 after retry RPC after error@124952061) -> (continuation of Deferred@544976860 after retry RPC after error@82427019) -> (continuation of Deferred@1025867888 after retry RPC after error@774602588) -> (continuation of Deferred@1397960714 after retry RPC after error@437768975) -> (continuation of Deferred@195098173 after retry RPC after error@2114234762) -> (continuation of Deferred@874317088 after retry RPC after error@271984391) -> (continuation of Deferred@480983586 after retry RPC after error@1194887364) -> (continuation of Deferred@466657542 after retry RPC after error@989836132) -> (continuation of Deferred@2143347763 after retry RPC after error@2092776871) -> (continuation of Deferred@1660648359 after retry RPC after error@626561039)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.220.252:33543
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:05.943 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:05.945 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:05.945 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:05.946 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:05.946 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:05.947 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:05.947 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:05.947 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
08:09:05.947 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:05.948 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:05.948 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#3) of source Source: KuduSource.
08:09:05.948 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:05.948 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:05.948 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to CANCELING.
08:09:05.948 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:05.949 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:05.949 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
08:09:05.950 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to CANCELING.
08:09:05.950 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
08:09:05.951 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#3) of source Source: KuduSource.
08:09:05.951 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to CANCELING.
08:09:05.951 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
08:09:05.951 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CANCELING to CANCELED.
08:09:05.951 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
08:09:05.952 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_3).
08:09:05.952 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to CANCELING.
08:09:05.952 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_3).
08:09:05.954 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
08:09:05.954 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CANCELING to CANCELED.
08:09:05.954 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#3 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_3).
08:09:05.956 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#3 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_3.
08:09:05.956 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#3 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_3.
08:09:05.957 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CANCELING to CANCELED.
08:09:05.958 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:09:05.958 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CANCELING to CANCELED.
08:09:05.959 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:318) Clearing resource requirements of job a72e6b48022ef36361b5eef11ee7c683
08:09:05.962 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:05.963 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:05.963 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:05.963 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:05.963 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:05.963 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:05.964 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:05.964 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:05.964 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:05.963 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:05.964 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:05.964 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:05.964 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:05.978 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:05.978 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:05.978 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:05.980 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:05.980 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:05.980 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:05.981 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:05.981 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:05.981 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:05.982 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:05.982 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:05.982 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:05.982 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:05.986 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:05.986 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:05.986 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:05.986 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:05.987 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:05.987 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:05.988 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:05.988 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:05.988 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:05.988 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:05.988 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:05.988 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:05.988 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:06.003 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:06.003 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:06.003 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:06.004 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:06.004 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:06.004 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:06.004 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:06.004 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:06.004 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:06.004 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:06.004 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:06.005 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:06.005 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:06.023 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:06.024 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:06.024 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:06.025 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:06.025 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:06.025 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:06.025 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:06.025 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:06.025 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:06.025 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:06.025 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:06.025 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:06.026 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:06.040 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:06.041 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:06.041 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:06.042 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:06.042 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:06.042 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:06.042 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:06.042 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:06.043 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:06.043 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:06.043 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:06.042 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:06.043 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:06.043 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:06.062 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:06.063 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:06.063 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:06.063 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:06.063 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:06.063 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:06.064 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:06.064 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:06.064 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:06.064 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:06.064 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:06.064 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:06.064 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:06.143 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:06.143 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:06.143 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:06.144 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:06.144 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:06.144 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:06.144 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:06.144 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:06.144 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:06.144 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:06.144 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:06.144 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:06.144 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:06.262 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:06.263 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:06.263 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:06.263 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:06.263 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:06.263 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:06.264 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:06.263 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:06.264 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:06.264 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:06.264 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:06.265 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:06.265 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:06.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:04.890468  4225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:06.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:06.268043  4226 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1377 milliseconds
08:09:06.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:06.268810  4227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:06.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.268858  4215 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:09:06.272 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:06.272 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:06.273 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:06.273 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:06.273 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:06.273 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:06.273 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:06.273 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:06.273 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:06.273 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:06.273 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:06.273 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:06.273 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:06.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.274900  4215 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:09:06.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.278824  4215 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:09:06.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.280191  4215 hybrid_clock.cc:648] HybridClock initialized: now 1779091746280081 us; error 99 us; skew 500 ppm
08:09:06.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.281199  4215 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:09:06.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.290139  4215 webserver.cc:533] Webserver started at http://127.4.9.125:35969/ using document root <none> and password file <none>
08:09:06.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.291211  4215 fs_manager.cc:362] Metadata directory not provided
08:09:06.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.291414  4215 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:09:06.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.291889  4215 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:09:06.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.297152  4215 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-1/data/instance:
08:09:06.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "45bb0e868faf48e39e13e8b4d59c68d4"
08:09:06.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:06 on dist-test-slave-1jss"
08:09:06.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.298676  4215 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-1/wal/instance:
08:09:06.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "45bb0e868faf48e39e13e8b4d59c68d4"
08:09:06.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:06 on dist-test-slave-1jss"
08:09:06.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.307963  4215 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.000s	sys 0.008s
08:09:06.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.318145  4242 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:09:06.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.319645  4215 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.003s	sys 0.005s
08:09:06.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.320057  4215 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-1/wal
08:09:06.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "45bb0e868faf48e39e13e8b4d59c68d4"
08:09:06.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:06 on dist-test-slave-1jss"
08:09:06.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.320406  4215 fs_report.cc:389] FS layout report
08:09:06.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:09:06.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-1/wal
08:09:06.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-1/wal
08:09:06.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-1/data/data
08:09:06.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:09:06.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:09:06.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:09:06.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:09:06.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:09:06.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:09:06.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:09:06.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:09:06.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:09:06.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:09:06.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:09:06.342 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:06.364 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:06.364 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:06.364 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:06.365 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:06.365 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:06.365 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:06.365 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:06.365 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:06.365 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:06.365 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:06.365 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:06.365 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:06.365 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:06.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.384140  4215 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:09:06.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.386075  4215 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:09:06.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.386561  4215 kserver.cc:163] Server-wide thread pool size limit: 3276
08:09:06.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091746408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:06.415 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:06.415 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:06.415 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:06.416 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:06.416 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:06.416 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:06.416 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:06.417 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:06.417 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:06.417 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:06.417 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:06.417 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:06.417 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:06.419 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:09:06.420 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
08:09:06.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.485977  4215 rpc_server.cc:307] RPC server started. Bound to: 127.4.9.125:45723
08:09:06.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.486069  4293 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.9.125:45723 every 8 connection(s)
08:09:06.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.489493  4215 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-1/data/info.pb
08:09:06.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.496048  4133 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 4215
08:09:06.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.496577  4133 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-1/wal/instance
08:09:06.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.498426  4294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.500181  4133 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-2/wal
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-2/data
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-2/logs
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-2/data/info.pb
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.9.124:41733
08:09:06.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.9.124
08:09:06.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:09:06.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.9.84:43373
08:09:06.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:09:06.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:09:06.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:09:06.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:09:06.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.9.126:44985,127.4.9.125:45723,127.4.9.124:41733
08:09:06.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:09:06.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39137/jwks.json with env {}
08:09:06.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.514784  4294 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.9.126" port: 44985 } has no permanent_uuid. Determining permanent_uuid...
08:09:06.540 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:06.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.548976  4294 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } has no permanent_uuid. Determining permanent_uuid...
08:09:06.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.567534  4294 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } has no permanent_uuid. Determining permanent_uuid...
08:09:06.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:06.570683  4245 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.9.124:41733: connect: Connection refused (error 111)
08:09:06.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:06.575680  4294 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.9.124:41733: Network error: Client connection negotiation failed: client connection to 127.4.9.124:41733: connect: Connection refused (error 111)
08:09:06.586 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:06.586 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:06.586 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:06.587 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:06.587 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:06.587 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:06.587 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:06.587 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:06.587 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:06.587 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:06.587 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:06.587 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:06.587 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:06.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.625263  4294 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } attempt: 1
08:09:06.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:06.630740  4294 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.9.124:41733: Network error: Client connection negotiation failed: client connection to 127.4.9.124:41733: connect: Connection refused (error 111)
08:09:06.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.699231  4294 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } attempt: 2
08:09:06.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:06.704129  4294 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.9.124:41733: Network error: Client connection negotiation failed: client connection to 127.4.9.124:41733: connect: Connection refused (error 111)
08:09:06.706 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:06.706 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:06.707 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:06.707 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:06.707 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:06.707 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:06.707 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:06.707 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:06.707 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:06.707 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:06.707 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:06.707 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:06.707 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:06.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.735504  4213 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } attempt: 7
08:09:06.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.750788  4213 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } has no permanent_uuid. Determining permanent_uuid...
08:09:06.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:06.757822  4213 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.9.124:41733: Network error: Client connection negotiation failed: client connection to 127.4.9.124:41733: connect: Connection refused (error 111)
08:09:06.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.795660  4294 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } attempt: 3
08:09:06.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:06.801241  4294 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.9.124:41733: Network error: Client connection negotiation failed: client connection to 127.4.9.124:41733: connect: Connection refused (error 111)
08:09:06.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.816372  4213 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } attempt: 1
08:09:06.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:06.821399  4213 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.9.124:41733: Network error: Client connection negotiation failed: client connection to 127.4.9.124:41733: connect: Connection refused (error 111)
08:09:06.842 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:06.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:06.898898  4296 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:09:06.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:06.899647  4296 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:09:06.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:06.900265  4296 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:09:06.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.902917  4213 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } attempt: 2
08:09:06.905 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:06.905 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:06.905 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:06.905 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:06.905 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:06.905 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:06.905 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:06.906 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:06.906 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:06.906 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:06.905 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:06.906 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:06.906 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:06.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:06.908295  4213 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.9.124:41733: Network error: Client connection negotiation failed: client connection to 127.4.9.124:41733: connect: Connection refused (error 111)
08:09:06.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091746908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:06.920 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:09:06.921 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
08:09:06.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.944748  4294 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } attempt: 4
08:09:06.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:06.945762  4296 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:09:06.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:06.946244  4296 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:09:06.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:06.946486  4296 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:09:06.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:06.946978  4296 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:09:06.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:06.947369  4296 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:09:06.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:06.947652  4296 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:39137/jwks.json
08:09:06.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:06.950155  4294 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.9.124:41733: Network error: Client connection negotiation failed: client connection to 127.4.9.124:41733: connect: Connection refused (error 111)
08:09:06.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.993706  4213 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } attempt: 3
08:09:06.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.993885  4296 master_runner.cc:387] Master server non-default flags:
08:09:06.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:09:06.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.9.84:43373
08:09:06.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:09:06.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:09:06.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-2/data
08:09:06.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-2/wal
08:09:06.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.9.126:44985,127.4.9.125:45723,127.4.9.124:41733
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.9.124:41733
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39137/jwks.json
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-2/data/info.pb
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.9.124
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-2/logs
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:09:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:09:06.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.995952  4296 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:09:06.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:06.998544  4296 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:09:06.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:06.998652  4213 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.9.124:41733: Network error: Client connection negotiation failed: client connection to 127.4.9.124:41733: connect: Connection refused (error 111)
08:09:07.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:07.013273  4309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:07.041 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:07.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:07.139163  4213 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } attempt: 4
08:09:07.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:07.147931  4213 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.9.124:41733: Network error: Client connection negotiation failed: client connection to 127.4.9.124:41733: connect: Connection refused (error 111)
08:09:07.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:07.249630  4294 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } attempt: 5
08:09:07.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:07.273476  4294 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.9.124:41733: Network error: Client connection negotiation failed: client connection to 127.4.9.124:41733: connect: Connection refused (error 111)
08:09:07.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:07.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091747408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:07.422 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
08:09:07.423 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.424 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.424 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.424 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.424 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.425 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.425 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.425 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.426 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.426 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
08:09:07.424 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.426 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.427 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.427 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.427 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29706), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [12ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [19ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [35ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [35ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [43ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [64ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [66ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [67ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [83ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [99ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [100ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [100ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [122ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [141ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [141ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [141ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [142ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [183ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [183ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [183ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [183ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [241ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [242ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [243ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [243ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [361ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [361ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [362ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [580ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [581ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [581ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [581ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1100ms] refreshing cache from master, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1103ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1103ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1104ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1105ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1280ms] refreshing cache from master, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1284ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1284ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2820ms] refreshing cache from master, [2820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [2821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [2822ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [6320ms] refreshing cache from master, [6320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [6321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [6321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [6322ms] too many traces: truncated at 100 traces, deferred=Deferred@227827361(state=PENDING, result=null, callback=(continuation of Deferred@1172601835 after retry RPC after error@1768439181) -> (continuation of Deferred@349237772 after retry RPC after error@991876961) -> (continuation of Deferred@1564723402 after retry RPC after error@1970213562) -> (continuation of Deferred@1715265161 after retry RPC after error@726972656) -> (continuation of Deferred@1746018504 after retry RPC after error@1701123506) -> (continuation of Deferred@1705858817 after retry RPC after error@1806753916) -> (continuation of Deferred@308124066 after retry RPC after error@1599653598) -> (continuation of Deferred@1354925931 after retry RPC after error@1016933903) -> (continuation of Deferred@1114845367 after retry RPC after error@1535402001) -> (continuation of Deferred@532241877 after retry RPC after error@1250026875) -> (continuation of Deferred@296518164 after retry RPC after error@1775299800) -> (continuation of Deferred@1012028354 after retry RPC after error@2034090766) -> (continuation of Deferred@217334303 after retry RPC after error@1647102325) -> (continuation of Deferred@1280203441 after retry RPC after error@1534903685) -> (continuation of Deferred@1974898767 after retry RPC after error@1901435117) -> (continuation of Deferred@1341181860 after retry RPC after error@1914530610) -> (continuation of Deferred@870889942 after retry RPC after error@1848102326) -> (continuation of Deferred@669233721 after retry RPC after error@1044257036) -> (continuation of Deferred@1223569684 after retry RPC after error@410263490) -> (continuation of Deferred@582751375 after retry RPC after error@1820626861) -> (continuation of Deferred@1432057272 after retry RPC after error@1835657950) -> (continuation of Deferred@791909264 after retry RPC after error@1736607804) -> (continuation of Deferred@1769654209 after retry RPC after error@1265102634) -> (continuation of Deferred@2021350085 after retry RPC after error@197914270) -> (continuation of Deferred@875590889 after retry RPC after error@1079694330) -> (continuation of Deferred@1658127430 after retry RPC after error@918464924) -> (continuation of Deferred@27137182 after retry RPC after error@399364692), errback=(continuation of Deferred@1172601835 after retry RPC after error@1768439181) -> (continuation of Deferred@349237772 after retry RPC after error@991876961) -> (continuation of Deferred@1564723402 after retry RPC after error@1970213562) -> (continuation of Deferred@1715265161 after retry RPC after error@726972656) -> (continuation of Deferred@1746018504 after retry RPC after error@1701123506) -> (continuation of Deferred@1705858817 after retry RPC after error@1806753916) -> (continuation of Deferred@308124066 after retry RPC after error@1599653598) -> (continuation of Deferred@1354925931 after retry RPC after error@1016933903) -> (continuation of Deferred@1114845367 after retry RPC after error@1535402001) -> (continuation of Deferred@532241877 after retry RPC after error@1250026875) -> (continuation of Deferred@296518164 after retry RPC after error@1775299800) -> (continuation of Deferred@1012028354 after retry RPC after error@2034090766) -> (continuation of Deferred@217334303 after retry RPC after error@1647102325) -> (continuation of Deferred@1280203441 after retry RPC after error@1534903685) -> (continuation of Deferred@1974898767 after retry RPC after error@1901435117) -> (continuation of Deferred@1341181860 after retry RPC after error@1914530610) -> (continuation of Deferred@870889942 after retry RPC after error@1848102326) -> (continuation of Deferred@669233721 after retry RPC after error@1044257036) -> (continuation of Deferred@1223569684 after retry RPC after error@410263490) -> (continuation of Deferred@582751375 after retry RPC after error@1820626861) -> (continuation of Deferred@1432057272 after retry RPC after error@1835657950) -> (continuation of Deferred@791909264 after retry RPC after error@1736607804) -> (continuation of Deferred@1769654209 after retry RPC after error@1265102634) -> (continuation of Deferred@2021350085 after retry RPC after error@197914270) -> (continuation of Deferred@875590889 after retry RPC after error@1079694330) -> (continuation of Deferred@1658127430 after retry RPC after error@918464924) -> (continuation of Deferred@27137182 after retry RPC after error@399364692)))
08:09:07.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:07.445425  4213 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } attempt: 5
08:09:07.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:07.453502  4213 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.9.124:41733: Network error: Client connection negotiation failed: client connection to 127.4.9.124:41733: connect: Connection refused (error 111)
08:09:07.456 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.456 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.456 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.456 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.457 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.457 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.457 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.457 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.457 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.458 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.458 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.458 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.458 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.459 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29733), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [9ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [9ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [35ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [36ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [51ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [53ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [54ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [55ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [63ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [64ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [65ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [65ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [82ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [82ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [84ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [84ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [102ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [102ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [103ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [103ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [143ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [143ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [144ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [144ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [202ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [203ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [203ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [203ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [261ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [261ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [261ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [262ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [322ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [322ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [323ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [323ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [362ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [363ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [363ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [363ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [562ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [564ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [566ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [568ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [942ms] refreshing cache from master, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [943ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [943ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [944ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [944ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [946ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [946ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1941ms] refreshing cache from master, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1942ms] too many traces: truncated at 100 traces, deferred=Deferred@1275471184(state=PENDING, result=null, callback=(continuation of Deferred@1511430232 after retry RPC after error@395550489) -> (continuation of Deferred@1635762743 after retry RPC after error@481183725) -> (continuation of Deferred@1922357368 after retry RPC after error@2046093924) -> (continuation of Deferred@1711665431 after retry RPC after error@142234389) -> (continuation of Deferred@1559829882 after retry RPC after error@41970507) -> (continuation of Deferred@1271181125 after retry RPC after error@301772755) -> (continuation of Deferred@100299355 after retry RPC after error@69311388) -> (continuation of Deferred@1785832154 after retry RPC after error@503777904) -> (continuation of Deferred@1220135745 after retry RPC after error@1078744241) -> (continuation of Deferred@659314960 after retry RPC after error@20878083) -> (continuation of Deferred@131834790 after retry RPC after error@630228528) -> (continuation of Deferred@1624366923 after retry RPC after error@352513753) -> (continuation of Deferred@1335798092 after retry RPC after error@1855854473) -> (continuation of Deferred@14399126 after retry RPC after error@36562034) -> (continuation of Deferred@952363442 after retry RPC after error@645890940) -> (continuation of Deferred@2077093411 after retry RPC after error@372149084) -> (continuation of Deferred@822574674 after retry RPC after error@1807314797) -> (continuation of Deferred@2140219599 after retry RPC after error@495396874) -> (continuation of Deferred@402137094 after retry RPC after error@932898707) -> (continuation of Deferred@1094416127 after retry RPC after error@1700319658) -> (continuation of Deferred@863384855 after retry RPC after error@1404107413) -> (continuation of Deferred@1227285138 after retry RPC after error@1783672733) -> (continuation of Deferred@1754067277 after retry RPC after error@1019005595) -> (continuation of Deferred@1114672620 after retry RPC after error@766770808) -> (continuation of Deferred@582640666 after retry RPC after error@2022218436) -> (continuation of Deferred@1053915092 after retry RPC after error@203628104), errback=(continuation of Deferred@1511430232 after retry RPC after error@395550489) -> (continuation of Deferred@1635762743 after retry RPC after error@481183725) -> (continuation of Deferred@1922357368 after retry RPC after error@2046093924) -> (continuation of Deferred@1711665431 after retry RPC after error@142234389) -> (continuation of Deferred@1559829882 after retry RPC after error@41970507) -> (continuation of Deferred@1271181125 after retry RPC after error@301772755) -> (continuation of Deferred@100299355 after retry RPC after error@69311388) -> (continuation of Deferred@1785832154 after retry RPC after error@503777904) -> (continuation of Deferred@1220135745 after retry RPC after error@1078744241) -> (continuation of Deferred@659314960 after retry RPC after error@20878083) -> (continuation of Deferred@131834790 after retry RPC after error@630228528) -> (continuation of Deferred@1624366923 after retry RPC after error@352513753) -> (continuation of Deferred@1335798092 after retry RPC after error@1855854473) -> (continuation of Deferred@14399126 after retry RPC after error@36562034) -> (continuation of Deferred@952363442 after retry RPC after error@645890940) -> (continuation of Deferred@2077093411 after retry RPC after error@372149084) -> (continuation of Deferred@822574674 after retry RPC after error@1807314797) -> (continuation of Deferred@2140219599 after retry RPC after error@495396874) -> (continuation of Deferred@402137094 after retry RPC after error@932898707) -> (continuation of Deferred@1094416127 after retry RPC after error@1700319658) -> (continuation of Deferred@863384855 after retry RPC after error@1404107413) -> (continuation of Deferred@1227285138 after retry RPC after error@1783672733) -> (continuation of Deferred@1754067277 after retry RPC after error@1019005595) -> (continuation of Deferred@1114672620 after retry RPC after error@766770808) -> (continuation of Deferred@582640666 after retry RPC after error@2022218436) -> (continuation of Deferred@1053915092 after retry RPC after error@203628104)))
08:09:07.485 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:07.486 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:07.486 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:07.486 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:07.486 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:07.486 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:07.487 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:07.487 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:07.487 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:07.488 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:07.488 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:07.488 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:07.488 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:07.533 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:07.534 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:07.534 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:07.534 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:07.534 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:07.535 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:07.535 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:07.535 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:07.535 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:07.536 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:07.536 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:07.536 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:07.536 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:07.541 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:07.592 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:07.593 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:07.593 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:07.594 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:07.594 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:07.594 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:07.594 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:07.594 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:07.594 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:07.594 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:07.594 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:07.594 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:07.595 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:07.633 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:07.633 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:07.633 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:07.634 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:07.634 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:07.634 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:07.634 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:07.634 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:07.634 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:07.635 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:07.635 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:07.635 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:07.635 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:07.724 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (a72e6b48022ef36361b5eef11ee7c683) switched from state RESTARTING to RUNNING.
08:09:07.725 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job a72e6b48022ef36361b5eef11ee7c683 from Checkpoint 78 @ 1779091656118 for a72e6b48022ef36361b5eef11ee7c683 located at file:/tmp/junit13140095929423248446/checkpoints/a72e6b48022ef36361b5eef11ee7c683/chk-78.
08:09:07.727 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
08:09:07.727 [INFO - flink-pekko.actor.default-dispatcher-7] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
08:09:07.728 [INFO - Thread-59] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
08:09:07.728 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to SCHEDULED.
08:09:07.728 [DEBUG - Thread-59] (Connection.java:575) [peer master-127.28.220.253:45079(127.28.220.253:45079)] disconnecting while in state TERMINATED
08:09:07.729 [DEBUG - Thread-59] (Connection.java:575) [peer master-127.28.220.254:37365(127.28.220.254:37365)] disconnecting while in state TERMINATED
08:09:07.730 [DEBUG - Thread-59] (Connection.java:575) [peer master-127.28.220.252:33543(127.28.220.252:33543)] disconnecting while in state TERMINATED
08:09:07.730 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from SCHEDULED to DEPLOYING.
08:09:07.730 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #4) with attempt id 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1) with allocation id 68aed56532af9c33564af146c662175d
08:09:07.731 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to SCHEDULED.
08:09:07.731 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:09:07.731 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:09:07.734 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 68aed56532af9c33564af146c662175d.
08:09:07.736 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_4), deploy into slot with allocation id 68aed56532af9c33564af146c662175d.
08:09:07.742 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:09:07.743 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from SCHEDULED to DEPLOYING.
08:09:07.743 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #4) with attempt id 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1) with allocation id 99f4948912648970d945ee4b7d180287
08:09:07.744 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to SCHEDULED.
08:09:07.744 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:09:07.745 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from SCHEDULED to DEPLOYING.
08:09:07.745 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #4) with attempt id 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1) with allocation id 4d91c4a4289e885e1ccd40283ee9eec0
08:09:07.745 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to SCHEDULED.
08:09:07.746 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:09:07.746 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from SCHEDULED to DEPLOYING.
08:09:07.746 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #4) with attempt id 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1) with allocation id 0a17552dd40f187ff1067ce2b4829466
08:09:07.747 [INFO - Thread-59] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
08:09:07.747 [INFO - Thread-59] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
08:09:07.747 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 99f4948912648970d945ee4b7d180287.
08:09:07.749 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_4), deploy into slot with allocation id 99f4948912648970d945ee4b7d180287.
08:09:07.749 [DEBUG - Thread-59] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:07.749 [INFO - Thread-59] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
08:09:07.750 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to DEPLOYING.
08:09:07.750 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_4) [DEPLOYING].
08:09:07.751 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@301b8556
08:09:07.751 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:07.752 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13140095929423248446/checkpoints")
08:09:07.753 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
08:09:07.753 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
08:09:07.754 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 4d91c4a4289e885e1ccd40283ee9eec0.
08:09:07.755 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_4), deploy into slot with allocation id 4d91c4a4289e885e1ccd40283ee9eec0.
08:09:07.755 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to DEPLOYING.
08:09:07.755 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_4) [DEPLOYING].
08:09:07.756 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6e413f31
08:09:07.756 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:07.756 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13140095929423248446/checkpoints")
08:09:07.756 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
08:09:07.757 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
08:09:07.757 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5888d696
08:09:07.758 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4f92a6e0
08:09:07.760 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 0a17552dd40f187ff1067ce2b4829466.
08:09:07.760 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:07.761 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_4), deploy into slot with allocation id 0a17552dd40f187ff1067ce2b4829466.
08:09:07.762 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to DEPLOYING.
08:09:07.763 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_4) [DEPLOYING].
08:09:07.764 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:07.766 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@29c83394
08:09:07.766 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:07.766 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13140095929423248446/checkpoints")
08:09:07.767 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
08:09:07.768 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
08:09:07.773 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@c256d6e
08:09:07.780 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:07.783 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.785 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:09:07.785 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:09:07.785 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:09:07.785 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:09:07.785 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.787 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.787 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.787 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.790 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.798 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to DEPLOYING.
08:09:07.798 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_4) [DEPLOYING].
08:09:07.800 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@39b9d581
08:09:07.800 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:07.800 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13140095929423248446/checkpoints")
08:09:07.800 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
08:09:07.801 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.802 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
08:09:07.808 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4a95c997
08:09:07.810 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.811 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.811 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.811 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.813 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:07.814 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.816 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.816 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:07.817 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.817 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.817 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.818 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.818 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.818 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.819 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.819 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.819 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.819 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.819 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.821 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:07.821193  4294 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } attempt: 6
08:09:07.826 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.827 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.827 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.827 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.834 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.834 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.834 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.834 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.835 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.835 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.835 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.835 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.837 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.837 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.838 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.838 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.838 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.838 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.839 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.839 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.842 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:07.843 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:07.843 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:07.843 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:07.843 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.844 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:07.846 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:07.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:07.846302  4294 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.9.124:41733: Network error: Client connection negotiation failed: client connection to 127.4.9.124:41733: connect: Connection refused (error 111)
08:09:07.848 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:07.848 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:07.848 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:07.849 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.849 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.850 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.850 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.850 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.850 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.850 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.851 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:07.851 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:07.851 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:07.851 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:07.851 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.851 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.851 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.851 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.851 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.852 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.852 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.852 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.853 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.853 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.853 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.853 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.854 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.854 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.855 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:07.858 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.858 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.858 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.858 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.859 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.859 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.860 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.860 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.860 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.861 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.861 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.861 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.861 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.862 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:07.862 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.862 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.862 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.862 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.863 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:07.863 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:07.863 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:07.864 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:07.864 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:07.865 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:07.865 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:07.866 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:07.866 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:07.866 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:07.866 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:07.866 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.867 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.867 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.868 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.870 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.874 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.874 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:07.874 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.875 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.875 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.875 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.876 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.876 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.876 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.876 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.877 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.877 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.877 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.877 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.877 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.877 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.878 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.878 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.878 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.878 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.878 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.879 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.879 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.879 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.879 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.879 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.879 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:07.879 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.879 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.879 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.880 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:07.880 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:07.880 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:07.881 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:07.881 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:07.881 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:07.881 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:07.881 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:07.881 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:07.881 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:07.881 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:07.882 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.883 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.883 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.883 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.883 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.884 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.884 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.884 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.884 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.884 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.884 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.885 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.885 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.885 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.885 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.885 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.885 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.885 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.886 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.886 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.886 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.886 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.887 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.887 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.887 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.887 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.890 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.890 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.890 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.890 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.891 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.891 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.891 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.891 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.891 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.891 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.891 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.891 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.891 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.895 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:07.895 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:07.895 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:07.895 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:07.895 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:07.896 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:07.896 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:07.896 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:07.896 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:07.897 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:07.897 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:07.897 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:07.897 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:07.900 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.900 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.901 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.901 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.901 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.901 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.902 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.902 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.902 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.902 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.902 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.902 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.902 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.902 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.902 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.902 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.902 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.903 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.903 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.903 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.903 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.903 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.903 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.903 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.903 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.903 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.903 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.903 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.903 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.904 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.904 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.904 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.904 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.904 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.903 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.905 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.905 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.905 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.905 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.908 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091747907 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:07.912 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.912 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.912 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.912 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.913 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.913 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.913 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.913 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.913 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.913 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.913 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.913 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.913 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.915 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:07.915 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:07.917 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:07.917 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:07.918 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:07.918 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:07.918 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:07.918 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:07.918 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:07.920 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.920 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.920 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.921 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.921 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.921 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.921 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.921 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.921 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.922 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.922 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.922 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.922 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.923 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.923 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.923 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.923 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.923 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.923 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.923 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.923 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.923 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.923 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.923 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.923 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.923 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.923 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.924 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.924 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.924 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.924 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.924 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.924 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.925 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.925 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.925 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.925 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.925 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:07.925 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:07.925 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:07.925 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:07.923 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.925 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.931 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=23 ms, finalizationTime=1 ms).
08:09:07.932 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.932 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.932 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.933 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.933 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.933 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.933 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.933 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.934 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.934 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.934 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.934 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
08:09:07.935 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.935 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.940 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.940 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.940 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.940 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.940 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.940 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.940 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.940 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.940 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.941 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.941 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.941 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.941 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.942 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.942 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.943 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.943 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.943 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.943 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.943 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.943 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.943 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.943 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.944 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.944 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.944 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.952 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.952 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.952 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.952 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.953 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.953 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.953 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.953 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.953 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.955 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.955 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.955 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.955 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.955 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:07.956 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:07.956 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:07.956 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:07.956 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:07.956 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:07.956 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:07.956 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:07.956 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:07.956 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:07.956 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:07.957 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:07.957 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:07.963 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.963 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.964 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.964 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.964 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.964 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.964 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.964 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.964 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.965 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.965 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.965 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.965 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.979 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:07.980 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:07.980 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:07.980 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.980 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.980 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.980 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.980 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:07.980 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:07.981 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.981 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.981 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:07.982 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:07.987 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:07.987 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:07.987 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:07.987 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:07.988 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:07.988 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:07.988 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:07.988 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:07.988 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:07.988 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:07.988 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:07.989 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:07.989 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:07.999 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:08.000 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:08.000 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:08.000 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.000 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.000 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.001 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.001 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.001 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.002 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.002 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.002 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.002 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:08.003 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:08.003 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:08.003 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:08.004 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.004 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.004 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.004 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.004 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.004 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.004 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.005 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.005 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.005 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:08.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.006213  4213 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } attempt: 6
08:09:08.021 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:08.022 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:08.022 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:08.022 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.022 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.023 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.023 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.023 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.023 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.023 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.023 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.023 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.024 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:08.034 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:08.035 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:08.035 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:08.036 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:08.036 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:08.036 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:08.036 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:08.036 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:08.036 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:08.037 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:08.037 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:08.037 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:08.037 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:08.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:08.035789  4213 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.9.124:41733: Network error: Client connection negotiation failed: client connection to 127.4.9.124:41733: connect: Connection refused (error 111)
08:09:08.039 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:08.039 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:08.040 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:08.040 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.040 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.040 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.041 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.041 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.043 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:08.044 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:08.044 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.044 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:08.045 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.045 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.045 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.045 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.045 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.045 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.045 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.045 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.045 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:08.046 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.046 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.046 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:08.047 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.048 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:08.055 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:08.055 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:08.055 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:08.055 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:08.055 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:08.055 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:08.056 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:08.056 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:08.056 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:08.056 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:08.056 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:08.056 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:08.056 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:08.063 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:08.063 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:08.063 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:08.064 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.064 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.064 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.064 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.064 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.064 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.065 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.065 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.065 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.065 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:08.070 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:08.070 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:08.070 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:08.071 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.071 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.071 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.071 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.071 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.071 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.072 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.072 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.072 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.072 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:08.095 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:08.095 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:08.095 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:08.096 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:08.096 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:08.096 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:08.096 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:08.096 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:08.096 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:08.097 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:08.097 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:08.097 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:08.097 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:08.107 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:08.107 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:08.107 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:08.108 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:08.108 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:08.108 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:08.108 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:08.109 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:08.109 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:08.109 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:08.109 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:08.109 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:08.109 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:08.118 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:08.118 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:08.118 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:08.119 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:08.119 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:08.119 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:08.119 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:08.119 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:08.119 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:08.120 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:08.120 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:08.120 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:08.120 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:08.131 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:08.140 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:08.140 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:08.140 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:08.141 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.141 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.141 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.141 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.141 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.142 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.142 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.142 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.142 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.142 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:08.143 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:08.143 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:08.143 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:08.143 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.143 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.143 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.144 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.144 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.144 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.144 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.144 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.145 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.145 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:08.185 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:08.185 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:08.185 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:08.186 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:08.186 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:08.186 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:08.186 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:08.186 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:08.186 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:08.187 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:08.187 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:08.187 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:08.187 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:08.263 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:08.264 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:08.264 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:08.265 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.265 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.265 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.265 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.266 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.266 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.266 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.266 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.266 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.266 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:08.331 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:08.332 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:08.332 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:08.332 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.332 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.333 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.333 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.333 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.333 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.332 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.333 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.333 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.334 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:08.337 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:08.338 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:08.338 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:08.338 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:08.338 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:08.338 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:08.338 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:08.338 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:08.338 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:08.339 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:08.339 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:08.339 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:08.339 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:08.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:08.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:08.378419  4209 debug-util.cc:398] Leaking SignalData structure 0x7b0800070060 after lost signal to thread 4146
08:09:08.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:08.379894  4209 debug-util.cc:398] Leaking SignalData structure 0x7b08000705e0 after lost signal to thread 4212
08:09:08.408 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091748408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:08.411 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:08.411 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:08.411 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:08.412 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.412 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.412 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.413 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.413 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.413 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.417 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.421 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.421 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.421 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:08.424 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
08:09:08.426 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
08:09:08.435 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:08.435 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:08.435 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:08.435 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:08.435 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:08.436 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:08.436 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:08.436 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:08.436 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:08.436 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:08.436 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:08.436 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:08.437 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:08.441 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:08.442 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:08.442 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:08.442 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.442 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.442 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.443 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.443 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.443 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.443 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.443 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.443 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.443 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:08.451 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:08.451 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:08.451 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:08.452 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.452 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.452 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.452 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.452 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.452 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.453 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.453 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.453 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.453 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:08.483 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:08.484 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:08.484 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:08.485 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.485 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.485 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.485 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.485 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.486 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.486 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.486 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.486 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.486 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:08.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:07.015316  4308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:08.514 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:08.514 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:08.514 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:08.514 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:08.514 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:08.514 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:08.514 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:08.515 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:08.515 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:08.515 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:08.514 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:08.515 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:08.515 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:08.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:07.018534  4311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:08.518658  4310 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1498 milliseconds
08:09:08.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.518774  4296 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:09:08.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.520520  4296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:09:08.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.524631  4296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:09:08.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.526099  4296 hybrid_clock.cc:648] HybridClock initialized: now 1779091748526033 us; error 52 us; skew 500 ppm
08:09:08.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.527160  4296 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:09:08.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.536065  4296 webserver.cc:533] Webserver started at http://127.4.9.124:46783/ using document root <none> and password file <none>
08:09:08.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.537300  4296 fs_manager.cc:362] Metadata directory not provided
08:09:08.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.537607  4296 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:09:08.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.538465  4296 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:09:08.540 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:08.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.544524  4296 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-2/data/instance:
08:09:08.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1701580a3054419da3ce2a134e635d26"
08:09:08.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:08 on dist-test-slave-1jss"
08:09:08.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.546078  4296 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-2/wal/instance:
08:09:08.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1701580a3054419da3ce2a134e635d26"
08:09:08.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:08 on dist-test-slave-1jss"
08:09:08.550 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:08.550 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:08.550 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:08.551 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.551 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.551 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.551 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.551 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.551 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.552 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.552 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.552 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.552 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:08.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.556342  4296 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.005s	sys 0.003s
08:09:08.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.564188  4376 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:09:08.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.565634  4296 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.003s
08:09:08.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.566033  4296 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-2/wal
08:09:08.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1701580a3054419da3ce2a134e635d26"
08:09:08.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:08 on dist-test-slave-1jss"
08:09:08.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.566404  4296 fs_report.cc:389] FS layout report
08:09:08.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:09:08.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-2/wal
08:09:08.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-2/wal
08:09:08.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-2/data/data
08:09:08.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:09:08.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:09:08.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:09:08.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:09:08.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:09:08.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:09:08.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:09:08.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:09:08.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:09:08.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:09:08.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:09:08.619 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:08.620 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:08.620 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:08.620 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.620 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.621 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.621 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.621 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.621 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.621 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.621 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.621 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.622 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:08.630 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:08.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.636894  4296 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:09:08.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.639343  4296 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:09:08.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.639959  4296 kserver.cc:163] Server-wide thread pool size limit: 3276
08:09:08.690 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:08.690 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:08.690 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:08.691 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:08.691 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:08.691 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:08.691 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:08.691 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:08.691 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:08.692 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:08.692 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:08.692 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:08.692 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:08.706 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:08.706 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:08.706 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:08.707 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:08.707 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:08.707 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:08.707 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:08.707 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:08.707 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:08.709 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:08.709 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:08.709 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:08.709 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:08.724 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:08.724 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:08.724 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:08.725 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.725 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.725 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.725 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.725 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.725 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.725 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.726 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.726 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.726 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:08.743 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:08.743 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:08.744 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:08.744 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:08.744 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:08.744 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:08.744 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:08.744 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:08.744 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:08.744 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:08.744 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:08.744 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:08.744 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:08.753 [INFO - flink-pekko.actor.default-dispatcher-10] (CheckpointCoordinator.java:1805) Restoring job e26b904229418d0e047d5d94c5b9f905 from Checkpoint 76 @ 1779091546865 for e26b904229418d0e047d5d94c5b9f905 located at file:/tmp/junit16937918701930502306/checkpoints/e26b904229418d0e047d5d94c5b9f905/chk-76.
08:09:08.754 [INFO - flink-pekko.actor.default-dispatcher-10] (MasterHooks.java:201) No master state to restore
08:09:08.754 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 2 to checkpoint 76 for source Source: KuduSource to checkpoint.
08:09:08.754 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from CREATED to SCHEDULED.
08:09:08.755 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from SCHEDULED to DEPLOYING.
08:09:08.756 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #7) with attempt id 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1) with allocation id 0f1066b174fb1f271b9fbb4939140659
08:09:08.756 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:09:08.756 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 0f1066b174fb1f271b9fbb4939140659.
08:09:08.757 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (e26b904229418d0e047d5d94c5b9f905) switched from state RESTARTING to RUNNING.
08:09:08.757 [INFO - flink-pekko.actor.default-dispatcher-10] (CheckpointCoordinator.java:1805) Restoring job e26b904229418d0e047d5d94c5b9f905 from Checkpoint 76 @ 1779091546865 for e26b904229418d0e047d5d94c5b9f905 located at file:/tmp/junit16937918701930502306/checkpoints/e26b904229418d0e047d5d94c5b9f905/chk-76.
08:09:08.758 [INFO - flink-pekko.actor.default-dispatcher-10] (MasterHooks.java:201) No master state to restore
08:09:08.758 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#7 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_7), deploy into slot with allocation id 0f1066b174fb1f271b9fbb4939140659.
08:09:08.758 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from CREATED to SCHEDULED.
08:09:08.758 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 76 for source Source: KuduSource to checkpoint.
08:09:08.758 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:09:08.759 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from SCHEDULED to DEPLOYING.
08:09:08.759 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #7) with attempt id 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1) with allocation id bc35714883422bae5e4de5056d4b8678
08:09:08.762 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot bc35714883422bae5e4de5056d4b8678.
08:09:08.764 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#7 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_7), deploy into slot with allocation id bc35714883422bae5e4de5056d4b8678.
08:09:08.768 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#7 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from CREATED to DEPLOYING.
08:09:08.769 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#7 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_7) [DEPLOYING].
08:09:08.769 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1032d57
08:09:08.770 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:08.770 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16937918701930502306/checkpoints")
08:09:08.770 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#7 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from DEPLOYING to INITIALIZING.
08:09:08.771 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from DEPLOYING to INITIALIZING.
08:09:08.774 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1dbc3f80
08:09:08.777 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:08.778 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#7 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from CREATED to DEPLOYING.
08:09:08.780 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#7 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_7) [DEPLOYING].
08:09:08.780 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6bf038c
08:09:08.780 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:08.781 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16937918701930502306/checkpoints")
08:09:08.781 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#7 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from DEPLOYING to INITIALIZING.
08:09:08.781 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from DEPLOYING to INITIALIZING.
08:09:08.783 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:08.784 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:08.784 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:08.784 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.784 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.784 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:08.785 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.785 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.785 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:08.785 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.785 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.785 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:08.785 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:08.789 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7cacb6f0
08:09:08.789 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:08.790 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:08.790 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.790 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.790 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.793 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:08.794 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:08.795 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.795 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.795 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.798 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:08.799 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:08.799 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.799 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.799 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.800 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.800 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.800 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.800 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:08.800 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:08.801 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.801 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.801 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.802 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.802 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.802 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.802 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:08.810 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:08.811 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:08.812 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.812 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.812 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.812 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:08.813 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.813 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.813 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.813 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.813 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.813 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.813 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:08.818 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:08.819 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:08.820 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.820 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.820 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:08.820 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.820 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.820 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.820 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.821 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.821 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.821 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.821333  4296 rpc_server.cc:307] RPC server started. Bound to: 127.4.9.124:41733
08:09:08.821 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:08.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.821424  4441 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.9.124:41733 every 8 connection(s)
08:09:08.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.825930  4296 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-2/data/info.pb
08:09:08.830 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:08.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.830308  4133 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 4296
08:09:08.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.830845  4133 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/master-2/wal/instance
08:09:08.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.836488  4444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:09:08.837 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:08.838 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.838 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.838 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.838 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:08.842 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:08.858 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:08.858 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.858 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.858 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:08.859 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.859 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.859 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.859 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.860 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.860 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.860 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.860 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:08.860 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:08.861 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.861 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.861 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.861 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.861 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.861 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.861 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:08.870 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:08.871 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:08.871 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:08.871 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.871 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.871 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.872 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.872 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.872 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.872 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.872 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.872 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.872 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:08.879 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:08.879 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:08.879 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:08.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.875301  4444 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.9.126" port: 44985 } has no permanent_uuid. Determining permanent_uuid...
08:09:08.880 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.880 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.880 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.880 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.880 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.880 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.880 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.880 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.880 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.880 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:08.890 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:08.890 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:08.890 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:08.891 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.891 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.891 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.891 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.891 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.891 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.891 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.891 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.891 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.891 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:08.900 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:08.900 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:08.900 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:08.901 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.901 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.901 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.901 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.901 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.901 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.901 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.902 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.902 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.902 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:08.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.907110  4294 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } attempt: 7
08:09:08.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091748908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:08.910 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:08.910 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:08.910 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:08.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:08.911 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.911 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.911 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.911 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.911 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.911 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.911 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.911 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.911 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.911 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:08.920 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:09:08.920 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
08:09:08.929 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:08.930 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:08.930 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:08.930 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.930 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.930 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.931 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.931 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.931 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.931 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.931 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.931 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.931 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:08.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.934252  4444 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } has no permanent_uuid. Determining permanent_uuid...
08:09:08.938 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:08.938 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:08.938 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:08.938 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:08.938 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:08.938 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:08.939 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:08.939 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:08.939 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:08.939 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:08.939 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:08.939 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:08.939 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:08.939 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:08.939 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:08.939 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.939 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.939 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:08.939 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:08.940 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.940 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.940 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:08.940 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.940 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.940 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:08.940 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:08.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.951761  4444 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } has no permanent_uuid. Determining permanent_uuid...
08:09:08.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.958156  4294 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45bb0e868faf48e39e13e8b4d59c68d4: Bootstrap starting.
08:09:08.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.977351  4294 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45bb0e868faf48e39e13e8b4d59c68d4: Neither blocks nor log segments found. Creating new log.
08:09:08.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.980304  4294 log.cc:826] T 00000000000000000000000000000000 P 45bb0e868faf48e39e13e8b4d59c68d4: Log is configured to *not* fsync() on all Append() calls
08:09:08.981 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:08.982 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:08.982 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:08.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.981353  4444 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26: Bootstrap starting.
08:09:08.982 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:08.982 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:08.982 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:08.983 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:08.983 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:08.983 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:08.983 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:08.984 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:08.984 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:08.984 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.996047  4294 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45bb0e868faf48e39e13e8b4d59c68d4: No bootstrap required, opened a new log
08:09:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.996378  4444 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26: Neither blocks nor log segments found. Creating new log.
08:09:08.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:08.999221  4444 log.cc:826] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26: Log is configured to *not* fsync() on all Append() calls
08:09:09.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.013743  4444 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26: No bootstrap required, opened a new log
08:09:09.019 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:09.019 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:09.020 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:09.020 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:09.020 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:09.020 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:09.020 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:09.020 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:09.020 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:09.021 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:09.021 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:09.021 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:09.021 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:09.030 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:09.030 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:09.030 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:09.030 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:09.030 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:09.030 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:09.030 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:09.030 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:09.030 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:09.031 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:09.031 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:09.031 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:09.031 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:09.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.033768  4294 raft_consensus.cc:359] T 00000000000000000000000000000000 P 45bb0e868faf48e39e13e8b4d59c68d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba906ce4bb74e3086dbf742a8a6417d" member_type: VOTER last_known_addr { host: "127.4.9.126" port: 44985 } } peers { permanent_uuid: "45bb0e868faf48e39e13e8b4d59c68d4" member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } } peers { permanent_uuid: "1701580a3054419da3ce2a134e635d26" member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } }
08:09:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.034828  4294 raft_consensus.cc:385] T 00000000000000000000000000000000 P 45bb0e868faf48e39e13e8b4d59c68d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:09:09.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.035156  4294 raft_consensus.cc:740] T 00000000000000000000000000000000 P 45bb0e868faf48e39e13e8b4d59c68d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45bb0e868faf48e39e13e8b4d59c68d4, State: Initialized, Role: FOLLOWER
08:09:09.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.036422  4294 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45bb0e868faf48e39e13e8b4d59c68d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba906ce4bb74e3086dbf742a8a6417d" member_type: VOTER last_known_addr { host: "127.4.9.126" port: 44985 } } peers { permanent_uuid: "45bb0e868faf48e39e13e8b4d59c68d4" member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } } peers { permanent_uuid: "1701580a3054419da3ce2a134e635d26" member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } }
08:09:09.042 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:09.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.042024  4294 sys_catalog.cc:565] T 00000000000000000000000000000000 P 45bb0e868faf48e39e13e8b4d59c68d4 [sys.catalog]: configured and running, proceeding with master startup.
08:09:09.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.046430  4459 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45bb0e868faf48e39e13e8b4d59c68d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba906ce4bb74e3086dbf742a8a6417d" member_type: VOTER last_known_addr { host: "127.4.9.126" port: 44985 } } peers { permanent_uuid: "45bb0e868faf48e39e13e8b4d59c68d4" member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } } peers { permanent_uuid: "1701580a3054419da3ce2a134e635d26" member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } } }
08:09:09.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.047777  4459 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45bb0e868faf48e39e13e8b4d59c68d4 [sys.catalog]: This master's current role is: FOLLOWER
08:09:09.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.050112  4444 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba906ce4bb74e3086dbf742a8a6417d" member_type: VOTER last_known_addr { host: "127.4.9.126" port: 44985 } } peers { permanent_uuid: "45bb0e868faf48e39e13e8b4d59c68d4" member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } } peers { permanent_uuid: "1701580a3054419da3ce2a134e635d26" member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } }
08:09:09.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.051414  4444 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:09:09.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.051808  4444 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1701580a3054419da3ce2a134e635d26, State: Initialized, Role: FOLLOWER
08:09:09.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.053321  4444 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba906ce4bb74e3086dbf742a8a6417d" member_type: VOTER last_known_addr { host: "127.4.9.126" port: 44985 } } peers { permanent_uuid: "45bb0e868faf48e39e13e8b4d59c68d4" member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } } peers { permanent_uuid: "1701580a3054419da3ce2a134e635d26" member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } }
08:09:09.060 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:09.060 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:09.060 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:09.062 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:09.062 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:09.062 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:09.062 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:09.062 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:09.062 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:09.063 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:09.063 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:09.063 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:09.063 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:09.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.063855  4444 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [sys.catalog]: configured and running, proceeding with master startup.
08:09:09.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.067144  4463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba906ce4bb74e3086dbf742a8a6417d" member_type: VOTER last_known_addr { host: "127.4.9.126" port: 44985 } } peers { permanent_uuid: "45bb0e868faf48e39e13e8b4d59c68d4" member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } } peers { permanent_uuid: "1701580a3054419da3ce2a134e635d26" member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } } }
08:09:09.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.068764  4463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [sys.catalog]: This master's current role is: FOLLOWER
08:09:09.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.069552  4463 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:09:09.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.069466  4213 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } attempt: 7
08:09:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.070428  4463 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba906ce4bb74e3086dbf742a8a6417d" member_type: VOTER last_known_addr { host: "127.4.9.126" port: 44985 } } peers { permanent_uuid: "45bb0e868faf48e39e13e8b4d59c68d4" member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } } peers { permanent_uuid: "1701580a3054419da3ce2a134e635d26" member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } }
08:09:09.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.075266  4463 leader_election.cc:290] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ba906ce4bb74e3086dbf742a8a6417d (127.4.9.126:44985), 45bb0e868faf48e39e13e8b4d59c68d4 (127.4.9.125:45723)
08:09:09.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.076665  4269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1701580a3054419da3ce2a134e635d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45bb0e868faf48e39e13e8b4d59c68d4" is_pre_election: true
08:09:09.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.077942  4269 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 45bb0e868faf48e39e13e8b4d59c68d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1701580a3054419da3ce2a134e635d26 in term 0.
08:09:09.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.082978  4378 leader_election.cc:304] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1701580a3054419da3ce2a134e635d26, 45bb0e868faf48e39e13e8b4d59c68d4; no voters: 
08:09:09.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.084407  4463 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:09:09.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.084822  4463 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:09:09.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.085202  4463 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [term 0 FOLLOWER]: Advancing to term 1
08:09:09.115 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:09.115 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:09.116 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:09.116 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:09.116 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:09.116 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:09.117 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:09.117 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:09.117 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:09.117 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:09.117 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:09.117 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:09.117 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:09.131 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:09.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.128768  4463 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba906ce4bb74e3086dbf742a8a6417d" member_type: VOTER last_known_addr { host: "127.4.9.126" port: 44985 } } peers { permanent_uuid: "45bb0e868faf48e39e13e8b4d59c68d4" member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } } peers { permanent_uuid: "1701580a3054419da3ce2a134e635d26" member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } }
08:09:09.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.136652  4463 leader_election.cc:290] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [CANDIDATE]: Term 1 election: Requested vote from peers 6ba906ce4bb74e3086dbf742a8a6417d (127.4.9.126:44985), 45bb0e868faf48e39e13e8b4d59c68d4 (127.4.9.125:45723)
08:09:09.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.141053  4269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1701580a3054419da3ce2a134e635d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45bb0e868faf48e39e13e8b4d59c68d4"
08:09:09.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.141957  4269 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 45bb0e868faf48e39e13e8b4d59c68d4 [term 0 FOLLOWER]: Advancing to term 1
08:09:09.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:09.148041  4248 tablet.cc:2404] T 00000000000000000000000000000000 P 45bb0e868faf48e39e13e8b4d59c68d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:09:09.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:09.148674  4382 tablet.cc:2404] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:09:09.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.150452  4269 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 45bb0e868faf48e39e13e8b4d59c68d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1701580a3054419da3ce2a134e635d26 in term 1.
08:09:09.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.151707  4378 leader_election.cc:304] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1701580a3054419da3ce2a134e635d26, 45bb0e868faf48e39e13e8b4d59c68d4; no voters: 
08:09:09.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.152709  4463 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [term 1 FOLLOWER]: Leader election won for term 1
08:09:09.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.153205  4463 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [term 1 LEADER]: Becoming Leader. State: Replica: 1701580a3054419da3ce2a134e635d26, State: Running, Role: LEADER
08:09:09.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.153620  4213 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ba906ce4bb74e3086dbf742a8a6417d: Bootstrap starting.
08:09:09.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.154335  4463 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba906ce4bb74e3086dbf742a8a6417d" member_type: VOTER last_known_addr { host: "127.4.9.126" port: 44985 } } peers { permanent_uuid: "45bb0e868faf48e39e13e8b4d59c68d4" member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } } peers { permanent_uuid: "1701580a3054419da3ce2a134e635d26" member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } }
08:09:09.170 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:09.170 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:09.170 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:09.171 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:09.171 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:09.171 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:09.171 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:09.171 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:09.172 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:09.172 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:09.172 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:09.172 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:09.172 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:09.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.179149  4464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1701580a3054419da3ce2a134e635d26. Latest consensus state: current_term: 1 leader_uuid: "1701580a3054419da3ce2a134e635d26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba906ce4bb74e3086dbf742a8a6417d" member_type: VOTER last_known_addr { host: "127.4.9.126" port: 44985 } } peers { permanent_uuid: "45bb0e868faf48e39e13e8b4d59c68d4" member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } } peers { permanent_uuid: "1701580a3054419da3ce2a134e635d26" member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } } }
08:09:09.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.180429  4464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [sys.catalog]: This master's current role is: LEADER
08:09:09.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.177853  4213 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ba906ce4bb74e3086dbf742a8a6417d: Neither blocks nor log segments found. Creating new log.
08:09:09.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.186410  4483 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
08:09:09.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.186501  4213 log.cc:826] T 00000000000000000000000000000000 P 6ba906ce4bb74e3086dbf742a8a6417d: Log is configured to *not* fsync() on all Append() calls
08:09:09.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.209985  4213 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ba906ce4bb74e3086dbf742a8a6417d: No bootstrap required, opened a new log
08:09:09.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.214927  4487 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
08:09:09.240 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:09.240 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:09.240 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:09.241 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:09.241 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:09.241 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:09.241 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:09.241 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:09.241 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:09.241 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:09.241 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:09.241 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:09.242 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:09.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.247413  4213 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6ba906ce4bb74e3086dbf742a8a6417d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba906ce4bb74e3086dbf742a8a6417d" member_type: VOTER last_known_addr { host: "127.4.9.126" port: 44985 } } peers { permanent_uuid: "45bb0e868faf48e39e13e8b4d59c68d4" member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } } peers { permanent_uuid: "1701580a3054419da3ce2a134e635d26" member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } }
08:09:09.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.248462  4213 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6ba906ce4bb74e3086dbf742a8a6417d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:09:09.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.248828  4213 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6ba906ce4bb74e3086dbf742a8a6417d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba906ce4bb74e3086dbf742a8a6417d, State: Initialized, Role: FOLLOWER
08:09:09.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.249831  4213 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ba906ce4bb74e3086dbf742a8a6417d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba906ce4bb74e3086dbf742a8a6417d" member_type: VOTER last_known_addr { host: "127.4.9.126" port: 44985 } } peers { permanent_uuid: "45bb0e868faf48e39e13e8b4d59c68d4" member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } } peers { permanent_uuid: "1701580a3054419da3ce2a134e635d26" member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } }
08:09:09.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.257635  4483 catalog_manager.cc:1519] Initializing Kudu cluster ID...
08:09:09.259 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:09.259 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:09.259 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:09.260 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:09.260 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:09.260 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:09.260 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:09.260 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:09.260 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:09.260 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:09.260 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:09.261 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:09.261 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:09.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.261313  4213 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6ba906ce4bb74e3086dbf742a8a6417d [sys.catalog]: configured and running, proceeding with master startup.
08:09:09.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.258374  4489 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ba906ce4bb74e3086dbf742a8a6417d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba906ce4bb74e3086dbf742a8a6417d" member_type: VOTER last_known_addr { host: "127.4.9.126" port: 44985 } } peers { permanent_uuid: "45bb0e868faf48e39e13e8b4d59c68d4" member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } } peers { permanent_uuid: "1701580a3054419da3ce2a134e635d26" member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } } }
08:09:09.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.263536  4187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1701580a3054419da3ce2a134e635d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba906ce4bb74e3086dbf742a8a6417d"
08:09:09.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.264392  4188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1701580a3054419da3ce2a134e635d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ba906ce4bb74e3086dbf742a8a6417d" is_pre_election: true
08:09:09.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.265651  4188 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6ba906ce4bb74e3086dbf742a8a6417d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1701580a3054419da3ce2a134e635d26 in term 0.
08:09:09.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.263834  4489 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ba906ce4bb74e3086dbf742a8a6417d [sys.catalog]: This master's current role is: FOLLOWER
08:09:09.279 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:09.279 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:09.279 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:09.279 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:09.279 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:09.280 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:09.280 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:09.280 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:09.280 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:09.280 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:09.280 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:09.280 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:09.280 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:09.293 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:09.294 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:09.294 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:09.294 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:09.294 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:09.294 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:09.295 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:09.295 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:09.295 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:09.295 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:09.295 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:09.295 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:09.295 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:09.296 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=26852), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [240ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [256ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [257ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [258ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [258ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [263ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [264ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [265ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [265ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [305ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [305ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [306ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [308ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [308ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [324ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [324ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [325ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [325ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [342ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [343ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [343ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [344ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [344ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [362ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [363ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [363ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [363ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [382ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [382ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [383ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [521ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [523ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [523ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [523ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [580ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [582ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [582ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [583ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [702ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [702ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [702ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [703ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1621ms] refreshing cache from master, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1623ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1623ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1624ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1624ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3601ms] refreshing cache from master, [3601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [3601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [3601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [3602ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [3603ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [3603ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3604ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [4641ms] refreshing cache from master, [4641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [4643ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [4643ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [4643ms] too many traces: truncated at 100 traces, deferred=Deferred@409667732(state=PENDING, result=null, callback=(continuation of Deferred@162383459 after retry RPC after error@853942093) -> (continuation of Deferred@1328508810 after retry RPC after error@255910227) -> (continuation of Deferred@1748606982 after retry RPC after error@1789384251) -> (continuation of Deferred@1589688282 after retry RPC after error@1451396904) -> (continuation of Deferred@1939745902 after retry RPC after error@668744232) -> (continuation of Deferred@2096703342 after retry RPC after error@1044388886) -> (continuation of Deferred@1010809580 after retry RPC after error@2062867001) -> (continuation of Deferred@1334001758 after retry RPC after error@1897747732) -> (continuation of Deferred@817133825 after retry RPC after error@1817008188) -> (continuation of Deferred@957965403 after retry RPC after error@582431641) -> (continuation of Deferred@836250303 after retry RPC after error@928122880) -> (continuation of Deferred@1159436557 after retry RPC after error@1579897292) -> (continuation of Deferred@785782116 after retry RPC after error@165878454) -> (continuation of Deferred@271133046 after retry RPC after error@336113550) -> (continuation of Deferred@174843230 after retry RPC after error@466384911) -> (continuation of Deferred@1115132057 after retry RPC after error@324154246) -> (continuation of Deferred@1179018663 after retry RPC after error@1051877728) -> (continuation of Deferred@1086315895 after retry RPC after error@1123227877) -> (continuation of Deferred@938292801 after retry RPC after error@444201149) -> (continuation of Deferred@613669600 after retry RPC after error@2130565799) -> (continuation of Deferred@545043463 after retry RPC after error@1972702373), errback=(continuation of Deferred@162383459 after retry RPC after error@853942093) -> (continuation of Deferred@1328508810 after retry RPC after error@255910227) -> (continuation of Deferred@1748606982 after retry RPC after error@1789384251) -> (continuation of Deferred@1589688282 after retry RPC after error@1451396904) -> (continuation of Deferred@1939745902 after retry RPC after error@668744232) -> (continuation of Deferred@2096703342 after retry RPC after error@1044388886) -> (continuation of Deferred@1010809580 after retry RPC after error@2062867001) -> (continuation of Deferred@1334001758 after retry RPC after error@1897747732) -> (continuation of Deferred@817133825 after retry RPC after error@1817008188) -> (continuation of Deferred@957965403 after retry RPC after error@582431641) -> (continuation of Deferred@836250303 after retry RPC after error@928122880) -> (continuation of Deferred@1159436557 after retry RPC after error@1579897292) -> (continuation of Deferred@785782116 after retry RPC after error@165878454) -> (continuation of Deferred@271133046 after retry RPC after error@336113550) -> (continuation of Deferred@174843230 after retry RPC after error@466384911) -> (continuation of Deferred@1115132057 after retry RPC after error@324154246) -> (continuation of Deferred@1179018663 after retry RPC after error@1051877728) -> (continuation of Deferred@1086315895 after retry RPC after error@1123227877) -> (continuation of Deferred@938292801 after retry RPC after error@444201149) -> (continuation of Deferred@613669600 after retry RPC after error@2130565799) -> (continuation of Deferred@545043463 after retry RPC after error@1972702373)))
08:09:09.298 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
08:09:09.298 [WARN - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=26852), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [240ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [256ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [257ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [258ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [258ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [263ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [264ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [265ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [265ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [305ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [305ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [306ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [308ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [308ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [324ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [324ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [325ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [325ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [342ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [343ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [343ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [344ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [344ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [362ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [363ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [363ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [363ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [382ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [382ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [383ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [521ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [523ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [523ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [523ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [580ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [582ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [582ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [583ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [702ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [702ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [702ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [703ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1621ms] refreshing cache from master, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1623ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1623ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1624ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1624ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3601ms] refreshing cache from master, [3601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [3601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [3601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [3602ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [3603ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [3603ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3604ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [4641ms] refreshing cache from master, [4641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [4643ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [4643ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [4643ms] too many traces: truncated at 100 traces, deferred=Deferred@409667732(state=PENDING, result=null, callback=(continuation of Deferred@162383459 after retry RPC after error@853942093) -> (continuation of Deferred@1328508810 after retry RPC after error@255910227) -> (continuation of Deferred@1748606982 after retry RPC after error@1789384251) -> (continuation of Deferred@1589688282 after retry RPC after error@1451396904) -> (continuation of Deferred@1939745902 after retry RPC after error@668744232) -> (continuation of Deferred@2096703342 after retry RPC after error@1044388886) -> (continuation of Deferred@1010809580 after retry RPC after error@2062867001) -> (continuation of Deferred@1334001758 after retry RPC after error@1897747732) -> (continuation of Deferred@817133825 after retry RPC after error@1817008188) -> (continuation of Deferred@957965403 after retry RPC after error@582431641) -> (continuation of Deferred@836250303 after retry RPC after error@928122880) -> (continuation of Deferred@1159436557 after retry RPC after error@1579897292) -> (continuation of Deferred@785782116 after retry RPC after error@165878454) -> (continuation of Deferred@271133046 after retry RPC after error@336113550) -> (continuation of Deferred@174843230 after retry RPC after error@466384911) -> (continuation of Deferred@1115132057 after retry RPC after error@324154246) -> (continuation of Deferred@1179018663 after retry RPC after error@1051877728) -> (continuation of Deferred@1086315895 after retry RPC after error@1123227877) -> (continuation of Deferred@938292801 after retry RPC after error@444201149) -> (continuation of Deferred@613669600 after retry RPC after error@2130565799) -> (continuation of Deferred@545043463 after retry RPC after error@1972702373), errback=(continuation of Deferred@162383459 after retry RPC after error@853942093) -> (continuation of Deferred@1328508810 after retry RPC after error@255910227) -> (continuation of Deferred@1748606982 after retry RPC after error@1789384251) -> (continuation of Deferred@1589688282 after retry RPC after error@1451396904) -> (continuation of Deferred@1939745902 after retry RPC after error@668744232) -> (continuation of Deferred@2096703342 after retry RPC after error@1044388886) -> (continuation of Deferred@1010809580 after retry RPC after error@2062867001) -> (continuation of Deferred@1334001758 after retry RPC after error@1897747732) -> (continuation of Deferred@817133825 after retry RPC after error@1817008188) -> (continuation of Deferred@957965403 after retry RPC after error@582431641) -> (continuation of Deferred@836250303 after retry RPC after error@928122880) -> (continuation of Deferred@1159436557 after retry RPC after error@1579897292) -> (continuation of Deferred@785782116 after retry RPC after error@165878454) -> (continuation of Deferred@271133046 after retry RPC after error@336113550) -> (continuation of Deferred@174843230 after retry RPC after error@466384911) -> (continuation of Deferred@1115132057 after retry RPC after error@324154246) -> (continuation of Deferred@1179018663 after retry RPC after error@1051877728) -> (continuation of Deferred@1086315895 after retry RPC after error@1123227877) -> (continuation of Deferred@938292801 after retry RPC after error@444201149) -> (continuation of Deferred@613669600 after retry RPC after error@2130565799) -> (continuation of Deferred@545043463 after retry RPC after error@1972702373)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.200.125:46459
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:09.308 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_5).
08:09:09.315 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#5 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_5.
08:09:09.318 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from INITIALIZING to FAILED on 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=26852), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [240ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [256ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [257ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [258ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [258ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [263ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [264ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [265ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [265ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [305ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [305ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [306ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [308ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [308ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [324ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [324ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [325ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [325ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [342ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [343ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [343ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [344ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [344ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [362ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [363ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [363ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [363ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [382ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [382ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [383ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [521ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [523ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [523ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [523ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [580ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [582ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [582ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [583ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [583ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [702ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [702ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [702ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [703ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1621ms] refreshing cache from master, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1623ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1623ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1624ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1624ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3601ms] refreshing cache from master, [3601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [3601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [3601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [3602ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [3603ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [3603ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3604ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [4641ms] refreshing cache from master, [4641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [4643ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [4643ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [4643ms] too many traces: truncated at 100 traces, deferred=Deferred@409667732(state=PENDING, result=null, callback=(continuation of Deferred@162383459 after retry RPC after error@853942093) -> (continuation of Deferred@1328508810 after retry RPC after error@255910227) -> (continuation of Deferred@1748606982 after retry RPC after error@1789384251) -> (continuation of Deferred@1589688282 after retry RPC after error@1451396904) -> (continuation of Deferred@1939745902 after retry RPC after error@668744232) -> (continuation of Deferred@2096703342 after retry RPC after error@1044388886) -> (continuation of Deferred@1010809580 after retry RPC after error@2062867001) -> (continuation of Deferred@1334001758 after retry RPC after error@1897747732) -> (continuation of Deferred@817133825 after retry RPC after error@1817008188) -> (continuation of Deferred@957965403 after retry RPC after error@582431641) -> (continuation of Deferred@836250303 after retry RPC after error@928122880) -> (continuation of Deferred@1159436557 after retry RPC after error@1579897292) -> (continuation of Deferred@785782116 after retry RPC after error@165878454) -> (continuation of Deferred@271133046 after retry RPC after error@336113550) -> (continuation of Deferred@174843230 after retry RPC after error@466384911) -> (continuation of Deferred@1115132057 after retry RPC after error@324154246) -> (continuation of Deferred@1179018663 after retry RPC after error@1051877728) -> (continuation of Deferred@1086315895 after retry RPC after error@1123227877) -> (continuation of Deferred@938292801 after retry RPC after error@444201149) -> (continuation of Deferred@613669600 after retry RPC after error@2130565799) -> (continuation of Deferred@545043463 after retry RPC after error@1972702373), errback=(continuation of Deferred@162383459 after retry RPC after error@853942093) -> (continuation of Deferred@1328508810 after retry RPC after error@255910227) -> (continuation of Deferred@1748606982 after retry RPC after error@1789384251) -> (continuation of Deferred@1589688282 after retry RPC after error@1451396904) -> (continuation of Deferred@1939745902 after retry RPC after error@668744232) -> (continuation of Deferred@2096703342 after retry RPC after error@1044388886) -> (continuation of Deferred@1010809580 after retry RPC after error@2062867001) -> (continuation of Deferred@1334001758 after retry RPC after error@1897747732) -> (continuation of Deferred@817133825 after retry RPC after error@1817008188) -> (continuation of Deferred@957965403 after retry RPC after error@582431641) -> (continuation of Deferred@836250303 after retry RPC after error@928122880) -> (continuation of Deferred@1159436557 after retry RPC after error@1579897292) -> (continuation of Deferred@785782116 after retry RPC after error@165878454) -> (continuation of Deferred@271133046 after retry RPC after error@336113550) -> (continuation of Deferred@174843230 after retry RPC after error@466384911) -> (continuation of Deferred@1115132057 after retry RPC after error@324154246) -> (continuation of Deferred@1179018663 after retry RPC after error@1051877728) -> (continuation of Deferred@1086315895 after retry RPC after error@1123227877) -> (continuation of Deferred@938292801 after retry RPC after error@444201149) -> (continuation of Deferred@613669600 after retry RPC after error@2130565799) -> (continuation of Deferred@545043463 after retry RPC after error@1972702373)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.200.125:46459
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:09.322 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:09:09.322 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#5) of source Source: KuduSource.
08:09:09.323 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_5.
08:09:09.323 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (0d2ddb76420639a9ec06ca05e894cb50) switched from state RUNNING to RESTARTING.
08:09:09.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.203140  4296 master_runner.cc:187] Error getting master registration for 127.4.9.126:44985: OK, instance_id { permanent_uuid: "6ba906ce4bb74e3086dbf742a8a6417d" instance_seqno: 1779091744318398 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:09:09.342 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:09.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.338161  4296 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:09:09.350 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:09.350 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:09.351 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:09.351 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:09.351 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:09.351 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:09.352 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:09.352 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:09.352 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:09.352 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:09.352 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:09.352 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:09.352 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:09.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:09.352913  4167 tablet.cc:2404] T 00000000000000000000000000000000 P 6ba906ce4bb74e3086dbf742a8a6417d: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:09:09.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.370625  4269 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 45bb0e868faf48e39e13e8b4d59c68d4 [term 1 FOLLOWER]: Refusing update from remote peer 1701580a3054419da3ce2a134e635d26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:09:09.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.373816  4464 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45bb0e868faf48e39e13e8b4d59c68d4" member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:09:09.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.385730  4187 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6ba906ce4bb74e3086dbf742a8a6417d [term 0 FOLLOWER]: Advancing to term 1
08:09:09.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.398298  4187 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 6ba906ce4bb74e3086dbf742a8a6417d [term 1 FOLLOWER]: Refusing update from remote peer 1701580a3054419da3ce2a134e635d26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:09:09.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.224829  4215 master_runner.cc:187] Error getting master registration for 127.4.9.126:44985: OK, instance_id { permanent_uuid: "6ba906ce4bb74e3086dbf742a8a6417d" instance_seqno: 1779091744318398 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:09:09.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.399060  4215 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:09:09.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.400624  4464 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba906ce4bb74e3086dbf742a8a6417d" member_type: VOTER last_known_addr { host: "127.4.9.126" port: 44985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:09:09.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091749408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:09.409 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:09.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.418613  4502 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
08:09:09.421 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
08:09:09.423 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
08:09:09.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.434029  4459 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45bb0e868faf48e39e13e8b4d59c68d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1701580a3054419da3ce2a134e635d26. Latest consensus state: current_term: 1 leader_uuid: "1701580a3054419da3ce2a134e635d26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba906ce4bb74e3086dbf742a8a6417d" member_type: VOTER last_known_addr { host: "127.4.9.126" port: 44985 } } peers { permanent_uuid: "45bb0e868faf48e39e13e8b4d59c68d4" member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } } peers { permanent_uuid: "1701580a3054419da3ce2a134e635d26" member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } } }
08:09:09.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.434754  4459 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45bb0e868faf48e39e13e8b4d59c68d4 [sys.catalog]: This master's current role is: FOLLOWER
08:09:09.442 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:09.443 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:09.443 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:09.443 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:09.443 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:09.443 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:09.444 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:09.444 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:09.444 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:09.443 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:09.444 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:09.444 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:09.444 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:09.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.450326  4489 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ba906ce4bb74e3086dbf742a8a6417d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1701580a3054419da3ce2a134e635d26. Latest consensus state: current_term: 1 leader_uuid: "1701580a3054419da3ce2a134e635d26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba906ce4bb74e3086dbf742a8a6417d" member_type: VOTER last_known_addr { host: "127.4.9.126" port: 44985 } } peers { permanent_uuid: "45bb0e868faf48e39e13e8b4d59c68d4" member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } } peers { permanent_uuid: "1701580a3054419da3ce2a134e635d26" member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } } }
08:09:09.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.451081  4489 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ba906ce4bb74e3086dbf742a8a6417d [sys.catalog]: This master's current role is: FOLLOWER
08:09:09.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.455919  4501 mvcc.cc:204] Tried to move back new op lower bound from 7287159805357445120 to 7287159804547551232. Current Snapshot: MvccSnapshot[applied={T|T < 7287159805357445120}]
08:09:09.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.462239  4504 mvcc.cc:204] Tried to move back new op lower bound from 7287159805357445120 to 7287159804547551232. Current Snapshot: MvccSnapshot[applied={T|T < 7287159805357445120}]
08:09:09.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.468765  4489 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ba906ce4bb74e3086dbf742a8a6417d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1701580a3054419da3ce2a134e635d26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba906ce4bb74e3086dbf742a8a6417d" member_type: VOTER last_known_addr { host: "127.4.9.126" port: 44985 } } peers { permanent_uuid: "45bb0e868faf48e39e13e8b4d59c68d4" member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } } peers { permanent_uuid: "1701580a3054419da3ce2a134e635d26" member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } } }
08:09:09.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.469579  4489 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ba906ce4bb74e3086dbf742a8a6417d [sys.catalog]: This master's current role is: FOLLOWER
08:09:09.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.476117  4464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1701580a3054419da3ce2a134e635d26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba906ce4bb74e3086dbf742a8a6417d" member_type: VOTER last_known_addr { host: "127.4.9.126" port: 44985 } } peers { permanent_uuid: "45bb0e868faf48e39e13e8b4d59c68d4" member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } } peers { permanent_uuid: "1701580a3054419da3ce2a134e635d26" member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } } }
08:09:09.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.476917  4464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [sys.catalog]: This master's current role is: LEADER
08:09:09.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.478070  4483 catalog_manager.cc:1382] Generated new cluster ID: 43357b74fd9040999c6179e51bc6a756
08:09:09.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.478412  4483 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
08:09:09.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.476967  4459 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45bb0e868faf48e39e13e8b4d59c68d4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1701580a3054419da3ce2a134e635d26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba906ce4bb74e3086dbf742a8a6417d" member_type: VOTER last_known_addr { host: "127.4.9.126" port: 44985 } } peers { permanent_uuid: "45bb0e868faf48e39e13e8b4d59c68d4" member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } } peers { permanent_uuid: "1701580a3054419da3ce2a134e635d26" member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } } }
08:09:09.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.479362  4459 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45bb0e868faf48e39e13e8b4d59c68d4 [sys.catalog]: This master's current role is: FOLLOWER
08:09:09.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.481560  4464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1701580a3054419da3ce2a134e635d26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ba906ce4bb74e3086dbf742a8a6417d" member_type: VOTER last_known_addr { host: "127.4.9.126" port: 44985 } } peers { permanent_uuid: "45bb0e868faf48e39e13e8b4d59c68d4" member_type: VOTER last_known_addr { host: "127.4.9.125" port: 45723 } } peers { permanent_uuid: "1701580a3054419da3ce2a134e635d26" member_type: VOTER last_known_addr { host: "127.4.9.124" port: 41733 } } }
08:09:09.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.486315  4464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26 [sys.catalog]: This master's current role is: LEADER
08:09:09.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.538957  4483 catalog_manager.cc:1405] Generated new certificate authority record
08:09:09.539 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:09.539 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:09.540 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:09.542 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:09.542 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:09.542 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:09.542 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:09.542 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:09.542 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:09.543 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:09.543 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:09.543 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:09.543 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:09.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.549551  4483 catalog_manager.cc:1539] Loading token signing keys...
08:09:09.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.597497  4483 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 1701580a3054419da3ce2a134e635d26: Generated new TSK 0
08:09:09.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.598946  4483 catalog_manager.cc:1549] Initializing in-progress tserver states...
08:09:09.619 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:09.619 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:09.619 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:09.620 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:09.620 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:09.620 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:09.620 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:09.620 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:09.620 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:09.621 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:09.621 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:09.621 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:09.621 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:09.630 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:09.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:09.642923  4133 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:09:09.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:09:09.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-0/wal
08:09:09.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-0/data
08:09:09.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:09:09.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:09:09.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:09:09.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:09:09.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:09:09.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:09:09.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-0/logs
08:09:09.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-0/data/info.pb
08:09:09.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:09:09.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:09:09.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:09:09.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:09:09.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:09:09.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:09:09.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:09:09.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:09:09.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:09:09.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:09:09.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.9.65:0
08:09:09.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.9.65
08:09:09.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.9.65
08:09:09.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:09:09.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.9.126:44985,127.4.9.125:45723,127.4.9.124:41733
08:09:09.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.9.84:43373
08:09:09.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:09:09.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:09:09.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:09:09.765 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:09.766 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:09.766 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:09.766 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:09.766 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:09.766 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:09.767 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:09.767 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:09.767 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:09.767 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:09.767 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:09.767 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:09.767 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:09.842 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:09.870 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:09.870 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:09.871 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:09.871 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:09.871 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:09.872 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:09.872 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:09.872 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:09.872 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:09.872 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:09.872 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:09.872 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:09.872 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:09.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091749908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:09.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:09.918 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
08:09:09.919 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
08:09:10.131 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:10.213 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:10.214 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:10.214 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:10.214 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:10.215 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:10.215 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:10.215 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:10.215 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:10.215 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:10.215 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:10.215 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:10.215 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:10.216 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:10.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:10.224238  4487 catalog_manager.cc:1294] Loaded cluster ID: 43357b74fd9040999c6179e51bc6a756
08:09:10.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:10.226899  4487 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 45bb0e868faf48e39e13e8b4d59c68d4: loading cluster ID for follower catalog manager: success
08:09:10.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:10.242175  4487 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 45bb0e868faf48e39e13e8b4d59c68d4: acquiring CA information for follower catalog manager: success
08:09:10.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:10.258383  4487 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 45bb0e868faf48e39e13e8b4d59c68d4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:09:10.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:10.259008  4509 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:09:10.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:10.259779  4509 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:09:10.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:10.260672  4509 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:09:10.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:10.336954  4509 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:09:10.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:10.338634  4509 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.9.65
08:09:10.342 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:10.387 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:10.387 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:10.387 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:10.388 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:10.388 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:10.388 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:10.389 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:10.389 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:10.389 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:10.389 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:10.389 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:10.389 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:10.389 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:10.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091750408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:10.410 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:10.417 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
08:09:10.419 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
08:09:10.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:10.430138  4509 tablet_server_runner.cc:78] Tablet server non-default flags:
08:09:10.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:09:10.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.9.84:43373
08:09:10.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:09:10.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:09:10.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-0/data
08:09:10.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-0/wal
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.9.65:0
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-0/data/info.pb
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.9.65
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.9.126:44985,127.4.9.125:45723,127.4.9.124:41733
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.9.65
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-0/logs
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:09:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:09:10.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:10.432391  4509 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:09:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:10.435074  4509 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:09:10.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:10.460114  4502 catalog_manager.cc:1294] Loaded cluster ID: 43357b74fd9040999c6179e51bc6a756
08:09:10.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:10.460446  4502 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 6ba906ce4bb74e3086dbf742a8a6417d: loading cluster ID for follower catalog manager: success
08:09:10.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:10.471397  4518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:10.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:10.499066  4502 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 6ba906ce4bb74e3086dbf742a8a6417d: acquiring CA information for follower catalog manager: success
08:09:10.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:10.527061  4502 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 6ba906ce4bb74e3086dbf742a8a6417d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:09:10.587 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:10.587 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:10.587 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:10.588 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:10.588 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:10.588 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:10.588 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:10.588 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:10.588 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:10.588 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:10.589 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:10.589 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:10.589 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:10.595 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:10.595 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:10.595 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:10.596 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:10.596 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:10.596 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:10.596 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:10.596 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:10.596 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:10.596 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:10.597 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:10.597 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:10.597 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:10.631 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:10.700 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:10.700 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:10.700 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:10.701 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:10.701 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:10.701 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:10.701 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:10.701 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:10.702 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:10.702 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:10.702 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:10.702 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:10.702 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:10.810 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:10.811 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:10.811 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:10.811 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:10.811 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:10.811 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:10.812 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:10.812 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:10.812 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:10.812 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:10.812 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:10.812 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:10.812 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:10.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:10.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091750908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:10.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:10.916 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
08:09:10.918 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
08:09:11.002 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:11.002 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:11.002 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:11.003 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:11.003 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:11.003 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:11.004 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:11.004 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:11.004 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:11.004 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:11.004 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:11.004 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:11.004 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:11.078 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:11.078 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:11.078 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:11.079 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:11.080 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:11.080 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:11.080 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:11.080 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:11.080 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:11.080 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:11.081 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:11.081 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:11.081 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:11.115 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:11.115 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:11.115 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:11.116 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:11.116 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:11.116 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:11.116 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:11.116 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:11.116 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:11.117 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:11.117 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:11.117 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:11.117 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:11.131 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:11.178 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:11.178 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:11.178 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:11.179 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:11.179 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:11.179 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:11.179 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:11.179 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:11.179 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:11.180 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:11.180 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:11.180 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:11.180 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:11.218 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:11.219 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:11.219 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:11.220 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:11.220 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:11.220 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:11.220 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:11.220 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:11.220 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:11.220 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:11.221 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:11.221 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:11.221 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:11.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:11.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091751408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:11.410 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:11.418 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
08:09:11.419 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
08:09:11.565 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:11.565 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:11.566 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:11.566 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:11.566 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:11.566 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:11.567 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:11.567 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:11.567 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:11.567 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:11.567 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:11.567 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:11.567 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:11.568 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29131), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [76ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [77ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [78ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [78ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [83ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [126ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [127ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [128ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [194ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [195ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [203ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [205ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [205ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [222ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [223ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [223ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [224ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [241ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [242ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [242ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [242ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [263ms] refreshing cache from master, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [264ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [264ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [265ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [265ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [302ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [384ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [442ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [442ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [443ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [443ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [501ms] refreshing cache from master, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [503ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [503ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [507ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [507ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [820ms] refreshing cache from master, [820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [821ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [821ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [822ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [822ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1300ms] refreshing cache from master, [1300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1302ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1304ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [5300ms] refreshing cache from master, [5300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [5301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [5301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [5302ms] too many traces: truncated at 100 traces, deferred=Deferred@851112181(state=PENDING, result=null, callback=(continuation of Deferred@1873019831 after retry RPC after error@1434720034) -> (continuation of Deferred@246394162 after retry RPC after error@1803012426) -> (continuation of Deferred@604100136 after retry RPC after error@1372186765) -> (continuation of Deferred@578554299 after retry RPC after error@1997846823) -> (continuation of Deferred@1569620347 after retry RPC after error@1134401479) -> (continuation of Deferred@32407518 after retry RPC after error@1398874949) -> (continuation of Deferred@2051929355 after retry RPC after error@1438737962) -> (continuation of Deferred@665056195 after retry RPC after error@2105706361) -> (continuation of Deferred@1760739439 after retry RPC after error@912005997) -> (continuation of Deferred@240769934 after retry RPC after error@1737047155) -> (continuation of Deferred@419850581 after retry RPC after error@1339526763) -> (continuation of Deferred@252885428 after retry RPC after error@567699073) -> (continuation of Deferred@187756335 after retry RPC after error@2028440820) -> (continuation of Deferred@1646417221 after retry RPC after error@1884472814) -> (continuation of Deferred@2081887580 after retry RPC after error@945010182) -> (continuation of Deferred@1210799156 after retry RPC after error@783324522) -> (continuation of Deferred@1791608853 after retry RPC after error@1326424268) -> (continuation of Deferred@1570232301 after retry RPC after error@2007368432) -> (continuation of Deferred@1393288561 after retry RPC after error@1630545436) -> (continuation of Deferred@50052456 after retry RPC after error@1158520389) -> (continuation of Deferred@1226951672 after retry RPC after error@700519430) -> (continuation of Deferred@1989082283 after retry RPC after error@1608039305) -> (continuation of Deferred@409064833 after retry RPC after error@958501807) -> (continuation of Deferred@944462724 after retry RPC after error@576039927) -> (continuation of Deferred@881770465 after retry RPC after error@17296948) -> (continuation of Deferred@1676804843 after retry RPC after error@1819744113) -> (continuation of Deferred@759680169 after retry RPC after error@319807867), errback=(continuation of Deferred@1873019831 after retry RPC after error@1434720034) -> (continuation of Deferred@246394162 after retry RPC after error@1803012426) -> (continuation of Deferred@604100136 after retry RPC after error@1372186765) -> (continuation of Deferred@578554299 after retry RPC after error@1997846823) -> (continuation of Deferred@1569620347 after retry RPC after error@1134401479) -> (continuation of Deferred@32407518 after retry RPC after error@1398874949) -> (continuation of Deferred@2051929355 after retry RPC after error@1438737962) -> (continuation of Deferred@665056195 after retry RPC after error@2105706361) -> (continuation of Deferred@1760739439 after retry RPC after error@912005997) -> (continuation of Deferred@240769934 after retry RPC after error@1737047155) -> (continuation of Deferred@419850581 after retry RPC after error@1339526763) -> (continuation of Deferred@252885428 after retry RPC after error@567699073) -> (continuation of Deferred@187756335 after retry RPC after error@2028440820) -> (continuation of Deferred@1646417221 after retry RPC after error@1884472814) -> (continuation of Deferred@2081887580 after retry RPC after error@945010182) -> (continuation of Deferred@1210799156 after retry RPC after error@783324522) -> (continuation of Deferred@1791608853 after retry RPC after error@1326424268) -> (continuation of Deferred@1570232301 after retry RPC after error@2007368432) -> (continuation of Deferred@1393288561 after retry RPC after error@1630545436) -> (continuation of Deferred@50052456 after retry RPC after error@1158520389) -> (continuation of Deferred@1226951672 after retry RPC after error@700519430) -> (continuation of Deferred@1989082283 after retry RPC after error@1608039305) -> (continuation of Deferred@409064833 after retry RPC after error@958501807) -> (continuation of Deferred@944462724 after retry RPC after error@576039927) -> (continuation of Deferred@881770465 after retry RPC after error@17296948) -> (continuation of Deferred@1676804843 after retry RPC after error@1819744113) -> (continuation of Deferred@759680169 after retry RPC after error@319807867)))
08:09:11.570 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
08:09:11.570 [WARN - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29131), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [76ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [77ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [78ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [78ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [83ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [126ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [127ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [128ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [194ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [195ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [203ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [205ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [205ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [222ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [223ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [223ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [224ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [241ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [242ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [242ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [242ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [263ms] refreshing cache from master, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [264ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [264ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [265ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [265ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [302ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [384ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [442ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [442ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [443ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [443ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [501ms] refreshing cache from master, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [503ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [503ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [507ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [507ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [820ms] refreshing cache from master, [820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [821ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [821ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [822ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [822ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1300ms] refreshing cache from master, [1300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1302ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1304ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [5300ms] refreshing cache from master, [5300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [5301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [5301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [5302ms] too many traces: truncated at 100 traces, deferred=Deferred@851112181(state=PENDING, result=null, callback=(continuation of Deferred@1873019831 after retry RPC after error@1434720034) -> (continuation of Deferred@246394162 after retry RPC after error@1803012426) -> (continuation of Deferred@604100136 after retry RPC after error@1372186765) -> (continuation of Deferred@578554299 after retry RPC after error@1997846823) -> (continuation of Deferred@1569620347 after retry RPC after error@1134401479) -> (continuation of Deferred@32407518 after retry RPC after error@1398874949) -> (continuation of Deferred@2051929355 after retry RPC after error@1438737962) -> (continuation of Deferred@665056195 after retry RPC after error@2105706361) -> (continuation of Deferred@1760739439 after retry RPC after error@912005997) -> (continuation of Deferred@240769934 after retry RPC after error@1737047155) -> (continuation of Deferred@419850581 after retry RPC after error@1339526763) -> (continuation of Deferred@252885428 after retry RPC after error@567699073) -> (continuation of Deferred@187756335 after retry RPC after error@2028440820) -> (continuation of Deferred@1646417221 after retry RPC after error@1884472814) -> (continuation of Deferred@2081887580 after retry RPC after error@945010182) -> (continuation of Deferred@1210799156 after retry RPC after error@783324522) -> (continuation of Deferred@1791608853 after retry RPC after error@1326424268) -> (continuation of Deferred@1570232301 after retry RPC after error@2007368432) -> (continuation of Deferred@1393288561 after retry RPC after error@1630545436) -> (continuation of Deferred@50052456 after retry RPC after error@1158520389) -> (continuation of Deferred@1226951672 after retry RPC after error@700519430) -> (continuation of Deferred@1989082283 after retry RPC after error@1608039305) -> (continuation of Deferred@409064833 after retry RPC after error@958501807) -> (continuation of Deferred@944462724 after retry RPC after error@576039927) -> (continuation of Deferred@881770465 after retry RPC after error@17296948) -> (continuation of Deferred@1676804843 after retry RPC after error@1819744113) -> (continuation of Deferred@759680169 after retry RPC after error@319807867), errback=(continuation of Deferred@1873019831 after retry RPC after error@1434720034) -> (continuation of Deferred@246394162 after retry RPC after error@1803012426) -> (continuation of Deferred@604100136 after retry RPC after error@1372186765) -> (continuation of Deferred@578554299 after retry RPC after error@1997846823) -> (continuation of Deferred@1569620347 after retry RPC after error@1134401479) -> (continuation of Deferred@32407518 after retry RPC after error@1398874949) -> (continuation of Deferred@2051929355 after retry RPC after error@1438737962) -> (continuation of Deferred@665056195 after retry RPC after error@2105706361) -> (continuation of Deferred@1760739439 after retry RPC after error@912005997) -> (continuation of Deferred@240769934 after retry RPC after error@1737047155) -> (continuation of Deferred@419850581 after retry RPC after error@1339526763) -> (continuation of Deferred@252885428 after retry RPC after error@567699073) -> (continuation of Deferred@187756335 after retry RPC after error@2028440820) -> (continuation of Deferred@1646417221 after retry RPC after error@1884472814) -> (continuation of Deferred@2081887580 after retry RPC after error@945010182) -> (continuation of Deferred@1210799156 after retry RPC after error@783324522) -> (continuation of Deferred@1791608853 after retry RPC after error@1326424268) -> (continuation of Deferred@1570232301 after retry RPC after error@2007368432) -> (continuation of Deferred@1393288561 after retry RPC after error@1630545436) -> (continuation of Deferred@50052456 after retry RPC after error@1158520389) -> (continuation of Deferred@1226951672 after retry RPC after error@700519430) -> (continuation of Deferred@1989082283 after retry RPC after error@1608039305) -> (continuation of Deferred@409064833 after retry RPC after error@958501807) -> (continuation of Deferred@944462724 after retry RPC after error@576039927) -> (continuation of Deferred@881770465 after retry RPC after error@17296948) -> (continuation of Deferred@1676804843 after retry RPC after error@1819744113) -> (continuation of Deferred@759680169 after retry RPC after error@319807867)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.200.125:46459
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:11.572 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_5).
08:09:11.574 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#5 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_5.
08:09:11.577 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from INITIALIZING to FAILED on 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29131), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [76ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [77ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [78ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [78ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [83ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [126ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [127ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [128ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [194ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [195ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [203ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [205ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [205ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [222ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [223ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [223ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [224ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [241ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [242ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [242ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [242ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [263ms] refreshing cache from master, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [264ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [264ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [265ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [265ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [302ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [384ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [442ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [442ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [443ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [443ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [501ms] refreshing cache from master, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [503ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [503ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [507ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [507ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [820ms] refreshing cache from master, [820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [821ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [821ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [822ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [822ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1300ms] refreshing cache from master, [1300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1302ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1303ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1304ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [5300ms] refreshing cache from master, [5300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [5301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [5301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [5302ms] too many traces: truncated at 100 traces, deferred=Deferred@851112181(state=PENDING, result=null, callback=(continuation of Deferred@1873019831 after retry RPC after error@1434720034) -> (continuation of Deferred@246394162 after retry RPC after error@1803012426) -> (continuation of Deferred@604100136 after retry RPC after error@1372186765) -> (continuation of Deferred@578554299 after retry RPC after error@1997846823) -> (continuation of Deferred@1569620347 after retry RPC after error@1134401479) -> (continuation of Deferred@32407518 after retry RPC after error@1398874949) -> (continuation of Deferred@2051929355 after retry RPC after error@1438737962) -> (continuation of Deferred@665056195 after retry RPC after error@2105706361) -> (continuation of Deferred@1760739439 after retry RPC after error@912005997) -> (continuation of Deferred@240769934 after retry RPC after error@1737047155) -> (continuation of Deferred@419850581 after retry RPC after error@1339526763) -> (continuation of Deferred@252885428 after retry RPC after error@567699073) -> (continuation of Deferred@187756335 after retry RPC after error@2028440820) -> (continuation of Deferred@1646417221 after retry RPC after error@1884472814) -> (continuation of Deferred@2081887580 after retry RPC after error@945010182) -> (continuation of Deferred@1210799156 after retry RPC after error@783324522) -> (continuation of Deferred@1791608853 after retry RPC after error@1326424268) -> (continuation of Deferred@1570232301 after retry RPC after error@2007368432) -> (continuation of Deferred@1393288561 after retry RPC after error@1630545436) -> (continuation of Deferred@50052456 after retry RPC after error@1158520389) -> (continuation of Deferred@1226951672 after retry RPC after error@700519430) -> (continuation of Deferred@1989082283 after retry RPC after error@1608039305) -> (continuation of Deferred@409064833 after retry RPC after error@958501807) -> (continuation of Deferred@944462724 after retry RPC after error@576039927) -> (continuation of Deferred@881770465 after retry RPC after error@17296948) -> (continuation of Deferred@1676804843 after retry RPC after error@1819744113) -> (continuation of Deferred@759680169 after retry RPC after error@319807867), errback=(continuation of Deferred@1873019831 after retry RPC after error@1434720034) -> (continuation of Deferred@246394162 after retry RPC after error@1803012426) -> (continuation of Deferred@604100136 after retry RPC after error@1372186765) -> (continuation of Deferred@578554299 after retry RPC after error@1997846823) -> (continuation of Deferred@1569620347 after retry RPC after error@1134401479) -> (continuation of Deferred@32407518 after retry RPC after error@1398874949) -> (continuation of Deferred@2051929355 after retry RPC after error@1438737962) -> (continuation of Deferred@665056195 after retry RPC after error@2105706361) -> (continuation of Deferred@1760739439 after retry RPC after error@912005997) -> (continuation of Deferred@240769934 after retry RPC after error@1737047155) -> (continuation of Deferred@419850581 after retry RPC after error@1339526763) -> (continuation of Deferred@252885428 after retry RPC after error@567699073) -> (continuation of Deferred@187756335 after retry RPC after error@2028440820) -> (continuation of Deferred@1646417221 after retry RPC after error@1884472814) -> (continuation of Deferred@2081887580 after retry RPC after error@945010182) -> (continuation of Deferred@1210799156 after retry RPC after error@783324522) -> (continuation of Deferred@1791608853 after retry RPC after error@1326424268) -> (continuation of Deferred@1570232301 after retry RPC after error@2007368432) -> (continuation of Deferred@1393288561 after retry RPC after error@1630545436) -> (continuation of Deferred@50052456 after retry RPC after error@1158520389) -> (continuation of Deferred@1226951672 after retry RPC after error@700519430) -> (continuation of Deferred@1989082283 after retry RPC after error@1608039305) -> (continuation of Deferred@409064833 after retry RPC after error@958501807) -> (continuation of Deferred@944462724 after retry RPC after error@576039927) -> (continuation of Deferred@881770465 after retry RPC after error@17296948) -> (continuation of Deferred@1676804843 after retry RPC after error@1819744113) -> (continuation of Deferred@759680169 after retry RPC after error@319807867)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.200.125:46459
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:11.580 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:09:11.582 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#5) of source Source: KuduSource.
08:09:11.583 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_5.
08:09:11.592 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:11.593 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:11.593 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:11.593 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:11.593 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:11.593 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:11.593 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:11.593 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:11.593 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:11.594 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:11.594 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:11.594 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:11.594 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:11.631 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:11.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:11.909 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:11.910 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091751908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:11.923 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
08:09:11.924 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
08:09:11.983 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:11.984 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:11.984 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:11.984 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:11.984 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:11.985 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:11.985 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:11.985 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:11.985 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:11.985 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:11.985 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:11.985 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:11.986 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:11.986 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29388), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [162ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [188ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [188ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [189ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [189ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [227ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [229ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [231ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [232ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [238ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [238ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [254ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [256ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [257ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [258ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [258ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [263ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [264ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [264ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [264ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [283ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [284ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [285ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [285ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [303ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [303ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [342ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [343ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [344ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [345ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [345ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [382ms] refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [384ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [441ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [442ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [442ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [442ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [781ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [782ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [782ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [783ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [901ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [902ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [903ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [903ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2920ms] refreshing cache from master, [2920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2925ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2926ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2927ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2927ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [4000ms] refreshing cache from master, [4000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [4000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [4001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [4002ms] too many traces: truncated at 100 traces, deferred=Deferred@1100714504(state=PENDING, result=null, callback=(continuation of Deferred@514863079 after retry RPC after error@234763311) -> (continuation of Deferred@1776691922 after retry RPC after error@1961946676) -> (continuation of Deferred@1805658202 after retry RPC after error@394475085) -> (continuation of Deferred@1340817109 after retry RPC after error@1008330834) -> (continuation of Deferred@1452402035 after retry RPC after error@1487835314) -> (continuation of Deferred@1311047908 after retry RPC after error@1024272906) -> (continuation of Deferred@1693379237 after retry RPC after error@1214893450) -> (continuation of Deferred@774755907 after retry RPC after error@2049238262) -> (continuation of Deferred@1770816213 after retry RPC after error@1863256051) -> (continuation of Deferred@793795487 after retry RPC after error@1921915351) -> (continuation of Deferred@2140776313 after retry RPC after error@1757288422) -> (continuation of Deferred@1159669197 after retry RPC after error@1197333528) -> (continuation of Deferred@1976371685 after retry RPC after error@1842622877) -> (continuation of Deferred@1373196455 after retry RPC after error@2018372504) -> (continuation of Deferred@1699895125 after retry RPC after error@692509371) -> (continuation of Deferred@838986588 after retry RPC after error@629659567) -> (continuation of Deferred@1385747637 after retry RPC after error@1293176671) -> (continuation of Deferred@1886525098 after retry RPC after error@1809026468) -> (continuation of Deferred@2138755351 after retry RPC after error@284886800) -> (continuation of Deferred@1893504227 after retry RPC after error@118852081) -> (continuation of Deferred@776868461 after retry RPC after error@1724203827) -> (continuation of Deferred@1915398276 after retry RPC after error@1507589425) -> (continuation of Deferred@131612957 after retry RPC after error@1271416334), errback=(continuation of Deferred@514863079 after retry RPC after error@234763311) -> (continuation of Deferred@1776691922 after retry RPC after error@1961946676) -> (continuation of Deferred@1805658202 after retry RPC after error@394475085) -> (continuation of Deferred@1340817109 after retry RPC after error@1008330834) -> (continuation of Deferred@1452402035 after retry RPC after error@1487835314) -> (continuation of Deferred@1311047908 after retry RPC after error@1024272906) -> (continuation of Deferred@1693379237 after retry RPC after error@1214893450) -> (continuation of Deferred@774755907 after retry RPC after error@2049238262) -> (continuation of Deferred@1770816213 after retry RPC after error@1863256051) -> (continuation of Deferred@793795487 after retry RPC after error@1921915351) -> (continuation of Deferred@2140776313 after retry RPC after error@1757288422) -> (continuation of Deferred@1159669197 after retry RPC after error@1197333528) -> (continuation of Deferred@1976371685 after retry RPC after error@1842622877) -> (continuation of Deferred@1373196455 after retry RPC after error@2018372504) -> (continuation of Deferred@1699895125 after retry RPC after error@692509371) -> (continuation of Deferred@838986588 after retry RPC after error@629659567) -> (continuation of Deferred@1385747637 after retry RPC after error@1293176671) -> (continuation of Deferred@1886525098 after retry RPC after error@1809026468) -> (continuation of Deferred@2138755351 after retry RPC after error@284886800) -> (continuation of Deferred@1893504227 after retry RPC after error@118852081) -> (continuation of Deferred@776868461 after retry RPC after error@1724203827) -> (continuation of Deferred@1915398276 after retry RPC after error@1507589425) -> (continuation of Deferred@131612957 after retry RPC after error@1271416334)))
08:09:11.988 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:11.988 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:11.988 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:11.989 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:11.989 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:11.989 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:11.989 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:11.989 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:11.989 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:11.988 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:11.989 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:11.989 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:11.989 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29388), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [162ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [188ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [188ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [189ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [189ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [227ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [229ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [231ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [232ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [238ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [238ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [254ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [256ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [257ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [258ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [258ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [263ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [264ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [264ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [264ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [283ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [284ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [285ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [285ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [303ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [303ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [342ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [343ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [344ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [345ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [345ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [382ms] refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [384ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [441ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [442ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [442ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [442ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [781ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [782ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [782ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [783ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [901ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [902ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [903ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [903ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2920ms] refreshing cache from master, [2920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2925ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2926ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2927ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2927ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [4000ms] refreshing cache from master, [4000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [4000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [4001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [4002ms] too many traces: truncated at 100 traces, deferred=Deferred@1100714504(state=PENDING, result=null, callback=(continuation of Deferred@514863079 after retry RPC after error@234763311) -> (continuation of Deferred@1776691922 after retry RPC after error@1961946676) -> (continuation of Deferred@1805658202 after retry RPC after error@394475085) -> (continuation of Deferred@1340817109 after retry RPC after error@1008330834) -> (continuation of Deferred@1452402035 after retry RPC after error@1487835314) -> (continuation of Deferred@1311047908 after retry RPC after error@1024272906) -> (continuation of Deferred@1693379237 after retry RPC after error@1214893450) -> (continuation of Deferred@774755907 after retry RPC after error@2049238262) -> (continuation of Deferred@1770816213 after retry RPC after error@1863256051) -> (continuation of Deferred@793795487 after retry RPC after error@1921915351) -> (continuation of Deferred@2140776313 after retry RPC after error@1757288422) -> (continuation of Deferred@1159669197 after retry RPC after error@1197333528) -> (continuation of Deferred@1976371685 after retry RPC after error@1842622877) -> (continuation of Deferred@1373196455 after retry RPC after error@2018372504) -> (continuation of Deferred@1699895125 after retry RPC after error@692509371) -> (continuation of Deferred@838986588 after retry RPC after error@629659567) -> (continuation of Deferred@1385747637 after retry RPC after error@1293176671) -> (continuation of Deferred@1886525098 after retry RPC after error@1809026468) -> (continuation of Deferred@2138755351 after retry RPC after error@284886800) -> (continuation of Deferred@1893504227 after retry RPC after error@118852081) -> (continuation of Deferred@776868461 after retry RPC after error@1724203827) -> (continuation of Deferred@1915398276 after retry RPC after error@1507589425) -> (continuation of Deferred@131612957 after retry RPC after error@1271416334), errback=(continuation of Deferred@514863079 after retry RPC after error@234763311) -> (continuation of Deferred@1776691922 after retry RPC after error@1961946676) -> (continuation of Deferred@1805658202 after retry RPC after error@394475085) -> (continuation of Deferred@1340817109 after retry RPC after error@1008330834) -> (continuation of Deferred@1452402035 after retry RPC after error@1487835314) -> (continuation of Deferred@1311047908 after retry RPC after error@1024272906) -> (continuation of Deferred@1693379237 after retry RPC after error@1214893450) -> (continuation of Deferred@774755907 after retry RPC after error@2049238262) -> (continuation of Deferred@1770816213 after retry RPC after error@1863256051) -> (continuation of Deferred@793795487 after retry RPC after error@1921915351) -> (continuation of Deferred@2140776313 after retry RPC after error@1757288422) -> (continuation of Deferred@1159669197 after retry RPC after error@1197333528) -> (continuation of Deferred@1976371685 after retry RPC after error@1842622877) -> (continuation of Deferred@1373196455 after retry RPC after error@2018372504) -> (continuation of Deferred@1699895125 after retry RPC after error@692509371) -> (continuation of Deferred@838986588 after retry RPC after error@629659567) -> (continuation of Deferred@1385747637 after retry RPC after error@1293176671) -> (continuation of Deferred@1886525098 after retry RPC after error@1809026468) -> (continuation of Deferred@2138755351 after retry RPC after error@284886800) -> (continuation of Deferred@1893504227 after retry RPC after error@118852081) -> (continuation of Deferred@776868461 after retry RPC after error@1724203827) -> (continuation of Deferred@1915398276 after retry RPC after error@1507589425) -> (continuation of Deferred@131612957 after retry RPC after error@1271416334)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29388), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [162ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [188ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [188ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [189ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [189ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [227ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [229ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [231ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [232ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [238ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [238ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [254ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [256ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [257ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [258ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [258ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [263ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [264ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [264ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [264ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [283ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [284ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [285ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [285ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [303ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [303ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [342ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [343ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [344ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [345ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [345ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [382ms] refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [384ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [441ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [442ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [442ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [442ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [781ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [782ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [782ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [783ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [901ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [902ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [903ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [903ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2920ms] refreshing cache from master, [2920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2925ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2926ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2927ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2927ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [4000ms] refreshing cache from master, [4000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [4000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [4001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [4002ms] too many traces: truncated at 100 traces, deferred=Deferred@1100714504(state=PENDING, result=null, callback=(continuation of Deferred@514863079 after retry RPC after error@234763311) -> (continuation of Deferred@1776691922 after retry RPC after error@1961946676) -> (continuation of Deferred@1805658202 after retry RPC after error@394475085) -> (continuation of Deferred@1340817109 after retry RPC after error@1008330834) -> (continuation of Deferred@1452402035 after retry RPC after error@1487835314) -> (continuation of Deferred@1311047908 after retry RPC after error@1024272906) -> (continuation of Deferred@1693379237 after retry RPC after error@1214893450) -> (continuation of Deferred@774755907 after retry RPC after error@2049238262) -> (continuation of Deferred@1770816213 after retry RPC after error@1863256051) -> (continuation of Deferred@793795487 after retry RPC after error@1921915351) -> (continuation of Deferred@2140776313 after retry RPC after error@1757288422) -> (continuation of Deferred@1159669197 after retry RPC after error@1197333528) -> (continuation of Deferred@1976371685 after retry RPC after error@1842622877) -> (continuation of Deferred@1373196455 after retry RPC after error@2018372504) -> (continuation of Deferred@1699895125 after retry RPC after error@692509371) -> (continuation of Deferred@838986588 after retry RPC after error@629659567) -> (continuation of Deferred@1385747637 after retry RPC after error@1293176671) -> (continuation of Deferred@1886525098 after retry RPC after error@1809026468) -> (continuation of Deferred@2138755351 after retry RPC after error@284886800) -> (continuation of Deferred@1893504227 after retry RPC after error@118852081) -> (continuation of Deferred@776868461 after retry RPC after error@1724203827) -> (continuation of Deferred@1915398276 after retry RPC after error@1507589425) -> (continuation of Deferred@131612957 after retry RPC after error@1271416334), errback=(continuation of Deferred@514863079 after retry RPC after error@234763311) -> (continuation of Deferred@1776691922 after retry RPC after error@1961946676) -> (continuation of Deferred@1805658202 after retry RPC after error@394475085) -> (continuation of Deferred@1340817109 after retry RPC after error@1008330834) -> (continuation of Deferred@1452402035 after retry RPC after error@1487835314) -> (continuation of Deferred@1311047908 after retry RPC after error@1024272906) -> (continuation of Deferred@1693379237 after retry RPC after error@1214893450) -> (continuation of Deferred@774755907 after retry RPC after error@2049238262) -> (continuation of Deferred@1770816213 after retry RPC after error@1863256051) -> (continuation of Deferred@793795487 after retry RPC after error@1921915351) -> (continuation of Deferred@2140776313 after retry RPC after error@1757288422) -> (continuation of Deferred@1159669197 after retry RPC after error@1197333528) -> (continuation of Deferred@1976371685 after retry RPC after error@1842622877) -> (continuation of Deferred@1373196455 after retry RPC after error@2018372504) -> (continuation of Deferred@1699895125 after retry RPC after error@692509371) -> (continuation of Deferred@838986588 after retry RPC after error@629659567) -> (continuation of Deferred@1385747637 after retry RPC after error@1293176671) -> (continuation of Deferred@1886525098 after retry RPC after error@1809026468) -> (continuation of Deferred@2138755351 after retry RPC after error@284886800) -> (continuation of Deferred@1893504227 after retry RPC after error@118852081) -> (continuation of Deferred@776868461 after retry RPC after error@1724203827) -> (continuation of Deferred@1915398276 after retry RPC after error@1507589425) -> (continuation of Deferred@131612957 after retry RPC after error@1271416334)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.17.253:37621
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:11.989 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:12.001 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29388), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [162ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [188ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [188ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [189ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [189ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [227ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [229ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [231ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [232ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [238ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [238ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [254ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [256ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [257ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [258ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [258ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [263ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [264ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [264ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [264ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [283ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [284ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [285ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [285ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [303ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [303ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [342ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [343ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [344ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [345ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [345ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [382ms] refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [384ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [441ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [442ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [442ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [442ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [781ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [782ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [782ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [783ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [901ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [902ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [903ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [903ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2920ms] refreshing cache from master, [2920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2925ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2926ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2927ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2927ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [4000ms] refreshing cache from master, [4000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [4000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [4001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [4002ms] too many traces: truncated at 100 traces, deferred=Deferred@1100714504(state=PENDING, result=null, callback=(continuation of Deferred@514863079 after retry RPC after error@234763311) -> (continuation of Deferred@1776691922 after retry RPC after error@1961946676) -> (continuation of Deferred@1805658202 after retry RPC after error@394475085) -> (continuation of Deferred@1340817109 after retry RPC after error@1008330834) -> (continuation of Deferred@1452402035 after retry RPC after error@1487835314) -> (continuation of Deferred@1311047908 after retry RPC after error@1024272906) -> (continuation of Deferred@1693379237 after retry RPC after error@1214893450) -> (continuation of Deferred@774755907 after retry RPC after error@2049238262) -> (continuation of Deferred@1770816213 after retry RPC after error@1863256051) -> (continuation of Deferred@793795487 after retry RPC after error@1921915351) -> (continuation of Deferred@2140776313 after retry RPC after error@1757288422) -> (continuation of Deferred@1159669197 after retry RPC after error@1197333528) -> (continuation of Deferred@1976371685 after retry RPC after error@1842622877) -> (continuation of Deferred@1373196455 after retry RPC after error@2018372504) -> (continuation of Deferred@1699895125 after retry RPC after error@692509371) -> (continuation of Deferred@838986588 after retry RPC after error@629659567) -> (continuation of Deferred@1385747637 after retry RPC after error@1293176671) -> (continuation of Deferred@1886525098 after retry RPC after error@1809026468) -> (continuation of Deferred@2138755351 after retry RPC after error@284886800) -> (continuation of Deferred@1893504227 after retry RPC after error@118852081) -> (continuation of Deferred@776868461 after retry RPC after error@1724203827) -> (continuation of Deferred@1915398276 after retry RPC after error@1507589425) -> (continuation of Deferred@131612957 after retry RPC after error@1271416334), errback=(continuation of Deferred@514863079 after retry RPC after error@234763311) -> (continuation of Deferred@1776691922 after retry RPC after error@1961946676) -> (continuation of Deferred@1805658202 after retry RPC after error@394475085) -> (continuation of Deferred@1340817109 after retry RPC after error@1008330834) -> (continuation of Deferred@1452402035 after retry RPC after error@1487835314) -> (continuation of Deferred@1311047908 after retry RPC after error@1024272906) -> (continuation of Deferred@1693379237 after retry RPC after error@1214893450) -> (continuation of Deferred@774755907 after retry RPC after error@2049238262) -> (continuation of Deferred@1770816213 after retry RPC after error@1863256051) -> (continuation of Deferred@793795487 after retry RPC after error@1921915351) -> (continuation of Deferred@2140776313 after retry RPC after error@1757288422) -> (continuation of Deferred@1159669197 after retry RPC after error@1197333528) -> (continuation of Deferred@1976371685 after retry RPC after error@1842622877) -> (continuation of Deferred@1373196455 after retry RPC after error@2018372504) -> (continuation of Deferred@1699895125 after retry RPC after error@692509371) -> (continuation of Deferred@838986588 after retry RPC after error@629659567) -> (continuation of Deferred@1385747637 after retry RPC after error@1293176671) -> (continuation of Deferred@1886525098 after retry RPC after error@1809026468) -> (continuation of Deferred@2138755351 after retry RPC after error@284886800) -> (continuation of Deferred@1893504227 after retry RPC after error@118852081) -> (continuation of Deferred@776868461 after retry RPC after error@1724203827) -> (continuation of Deferred@1915398276 after retry RPC after error@1507589425) -> (continuation of Deferred@131612957 after retry RPC after error@1271416334)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29388), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [162ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [188ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [188ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [189ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [189ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [227ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [229ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [231ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [232ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [238ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [238ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [254ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [256ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [257ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [258ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [258ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [263ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [264ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [264ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [264ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [283ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [284ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [285ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [285ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [302ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [303ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [303ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [342ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [343ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [344ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [345ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [345ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [382ms] refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [384ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [441ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [442ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [442ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [442ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [781ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [782ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [782ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [783ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [901ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [902ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [903ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [903ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2920ms] refreshing cache from master, [2920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [2925ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [2926ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [2927ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [2927ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [4000ms] refreshing cache from master, [4000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [4000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [4001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [4002ms] too many traces: truncated at 100 traces, deferred=Deferred@1100714504(state=PENDING, result=null, callback=(continuation of Deferred@514863079 after retry RPC after error@234763311) -> (continuation of Deferred@1776691922 after retry RPC after error@1961946676) -> (continuation of Deferred@1805658202 after retry RPC after error@394475085) -> (continuation of Deferred@1340817109 after retry RPC after error@1008330834) -> (continuation of Deferred@1452402035 after retry RPC after error@1487835314) -> (continuation of Deferred@1311047908 after retry RPC after error@1024272906) -> (continuation of Deferred@1693379237 after retry RPC after error@1214893450) -> (continuation of Deferred@774755907 after retry RPC after error@2049238262) -> (continuation of Deferred@1770816213 after retry RPC after error@1863256051) -> (continuation of Deferred@793795487 after retry RPC after error@1921915351) -> (continuation of Deferred@2140776313 after retry RPC after error@1757288422) -> (continuation of Deferred@1159669197 after retry RPC after error@1197333528) -> (continuation of Deferred@1976371685 after retry RPC after error@1842622877) -> (continuation of Deferred@1373196455 after retry RPC after error@2018372504) -> (continuation of Deferred@1699895125 after retry RPC after error@692509371) -> (continuation of Deferred@838986588 after retry RPC after error@629659567) -> (continuation of Deferred@1385747637 after retry RPC after error@1293176671) -> (continuation of Deferred@1886525098 after retry RPC after error@1809026468) -> (continuation of Deferred@2138755351 after retry RPC after error@284886800) -> (continuation of Deferred@1893504227 after retry RPC after error@118852081) -> (continuation of Deferred@776868461 after retry RPC after error@1724203827) -> (continuation of Deferred@1915398276 after retry RPC after error@1507589425) -> (continuation of Deferred@131612957 after retry RPC after error@1271416334), errback=(continuation of Deferred@514863079 after retry RPC after error@234763311) -> (continuation of Deferred@1776691922 after retry RPC after error@1961946676) -> (continuation of Deferred@1805658202 after retry RPC after error@394475085) -> (continuation of Deferred@1340817109 after retry RPC after error@1008330834) -> (continuation of Deferred@1452402035 after retry RPC after error@1487835314) -> (continuation of Deferred@1311047908 after retry RPC after error@1024272906) -> (continuation of Deferred@1693379237 after retry RPC after error@1214893450) -> (continuation of Deferred@774755907 after retry RPC after error@2049238262) -> (continuation of Deferred@1770816213 after retry RPC after error@1863256051) -> (continuation of Deferred@793795487 after retry RPC after error@1921915351) -> (continuation of Deferred@2140776313 after retry RPC after error@1757288422) -> (continuation of Deferred@1159669197 after retry RPC after error@1197333528) -> (continuation of Deferred@1976371685 after retry RPC after error@1842622877) -> (continuation of Deferred@1373196455 after retry RPC after error@2018372504) -> (continuation of Deferred@1699895125 after retry RPC after error@692509371) -> (continuation of Deferred@838986588 after retry RPC after error@629659567) -> (continuation of Deferred@1385747637 after retry RPC after error@1293176671) -> (continuation of Deferred@1886525098 after retry RPC after error@1809026468) -> (continuation of Deferred@2138755351 after retry RPC after error@284886800) -> (continuation of Deferred@1893504227 after retry RPC after error@118852081) -> (continuation of Deferred@776868461 after retry RPC after error@1724203827) -> (continuation of Deferred@1915398276 after retry RPC after error@1507589425) -> (continuation of Deferred@131612957 after retry RPC after error@1271416334)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.17.253:37621
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:12.003 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:12.005 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:12.005 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:12.005 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.005 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.005 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.005 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.005 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.005 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.005 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.006 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.006 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.006 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:12.008 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
08:09:12.010 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#5) of source Source: KuduSource.
08:09:12.010 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from INITIALIZING to CANCELING.
08:09:12.011 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_5).
08:09:12.011 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from INITIALIZING to CANCELING.
08:09:12.011 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_5).
08:09:12.012 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#5) of source Source: KuduSource.
08:09:12.012 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from INITIALIZING to CANCELING.
08:09:12.016 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
08:09:12.016 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CANCELING to CANCELED.
08:09:12.016 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_5).
08:09:12.020 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_5).
08:09:12.020 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from INITIALIZING to CANCELING.
08:09:12.020 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_5).
08:09:12.022 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
08:09:12.023 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CANCELING to CANCELED.
08:09:12.023 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#5 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_5).
08:09:12.026 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:12.026 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:12.027 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:12.027 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.027 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.027 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.027 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.027 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.027 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.027 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.027 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.028 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.028 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:12.040 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#5 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_5.
08:09:12.043 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#5 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_5.
08:09:12.043 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:12.043 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:12.043 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:12.043 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CANCELING to CANCELED.
08:09:12.044 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.044 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.044 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.044 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:09:12.044 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CANCELING to CANCELED.
08:09:12.045 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 0d2ddb76420639a9ec06ca05e894cb50
08:09:12.045 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.044 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.045 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.045 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.045 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.046 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.046 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:12.046 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:12.046 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:12.046 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:12.047 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:12.047 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:12.047 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:12.047 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:12.047 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:12.047 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:12.047 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:12.047 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:12.047 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:12.047 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:12.064 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:12.064 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:12.064 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:12.065 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.065 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.065 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.065 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.065 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.065 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.065 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.065 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.065 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.065 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:12.104 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:12.104 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:12.104 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:12.105 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.105 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.105 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.106 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.106 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.106 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.106 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.106 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.106 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.106 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:12.110 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:12.110 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:12.110 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:12.110 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:12.110 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:12.110 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:12.111 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:12.111 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:12.111 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:12.111 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:12.111 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:12.111 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:12.111 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:12.131 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:12.144 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:12.144 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:12.144 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:12.145 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.145 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.145 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.145 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.145 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.146 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.146 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.146 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.146 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.146 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:12.183 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:12.183 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:12.184 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:12.184 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.184 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.184 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.184 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.184 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.184 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.184 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.184 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.184 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.185 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:12.273 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:12.273 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:12.273 [DEBUG - pool-373-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:12.274 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:12.274 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:12.274 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:12.274 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:12.274 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:12.274 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:12.275 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:12.275 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:12.275 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:12.275 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:12.276 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=30, TimeoutTracker(timeout=30000, elapsed=29895), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [6ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [63ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [155ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [158ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [294ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [296ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [317ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [318ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [318ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [350ms] refreshing cache from master, [350ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [401ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [402ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [405ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [406ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [422ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [422ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [422ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [422ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [441ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [441ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [442ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [442ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [481ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [482ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [482ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [482ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [542ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [543ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [543ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [543ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [682ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [683ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [683ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [683ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [780ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [782ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [782ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [782ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [783ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1240ms] refreshing cache from master, [1240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1243ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1541ms] refreshing cache from master, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1543ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2641ms] refreshing cache from master, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2643ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2643ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2643ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2782ms] refreshing cache from master, [2782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2783ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2783ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2784ms] too many traces: truncated at 100 traces, deferred=Deferred@792468710(state=PENDING, result=null, callback=(continuation of Deferred@343040015 after retry RPC after error@1814507938) -> (continuation of Deferred@1771740177 after retry RPC after error@638482152) -> (continuation of Deferred@561711166 after retry RPC after error@1954846610) -> (continuation of Deferred@1237575431 after retry RPC after error@481260001) -> (continuation of Deferred@1710010546 after retry RPC after error@889488282) -> (continuation of Deferred@1663676898 after retry RPC after error@74376223) -> (continuation of Deferred@67611904 after retry RPC after error@361686601) -> (continuation of Deferred@990311355 after retry RPC after error@1211872984) -> (continuation of Deferred@1902996850 after retry RPC after error@322134456) -> (continuation of Deferred@522507086 after retry RPC after error@180108036) -> (continuation of Deferred@270586332 after retry RPC after error@412503233) -> (continuation of Deferred@563167806 after retry RPC after error@1251883283) -> (continuation of Deferred@1546039213 after retry RPC after error@1996230828) -> (continuation of Deferred@1574382847 after retry RPC after error@1715126519) -> (continuation of Deferred@252203098 after retry RPC after error@434591847) -> (continuation of Deferred@2100506480 after retry RPC after error@1304327513) -> (continuation of Deferred@7960116 after retry RPC after error@603861564) -> (continuation of Deferred@1204994460 after retry RPC after error@2037936258) -> (continuation of Deferred@846946639 after retry RPC after error@1615252206) -> (continuation of Deferred@835266907 after retry RPC after error@193962880) -> (continuation of Deferred@1654114983 after retry RPC after error@877686177) -> (continuation of Deferred@1277888897 after retry RPC after error@986591271) -> (continuation of Deferred@1724909355 after retry RPC after error@1373258549) -> (continuation of Deferred@1168719758 after retry RPC after error@246243348) -> (continuation of Deferred@1747109813 after retry RPC after error@1810035311) -> (continuation of Deferred@1731982802 after retry RPC after error@41129185) -> (continuation of Deferred@2090005621 after retry RPC after error@2031618) -> (continuation of Deferred@942858422 after retry RPC after error@653832141) -> (continuation of Deferred@1294124603 after retry RPC after error@893767821), errback=(continuation of Deferred@343040015 after retry RPC after error@1814507938) -> (continuation of Deferred@1771740177 after retry RPC after error@638482152) -> (continuation of Deferred@561711166 after retry RPC after error@1954846610) -> (continuation of Deferred@1237575431 after retry RPC after error@481260001) -> (continuation of Deferred@1710010546 after retry RPC after error@889488282) -> (continuation of Deferred@1663676898 after retry RPC after error@74376223) -> (continuation of Deferred@67611904 after retry RPC after error@361686601) -> (continuation of Deferred@990311355 after retry RPC after error@1211872984) -> (continuation of Deferred@1902996850 after retry RPC after error@322134456) -> (continuation of Deferred@522507086 after retry RPC after error@180108036) -> (continuation of Deferred@270586332 after retry RPC after error@412503233) -> (continuation of Deferred@563167806 after retry RPC after error@1251883283) -> (continuation of Deferred@1546039213 after retry RPC after error@1996230828) -> (continuation of Deferred@1574382847 after retry RPC after error@1715126519) -> (continuation of Deferred@252203098 after retry RPC after error@434591847) -> (continuation of Deferred@2100506480 after retry RPC after error@1304327513) -> (continuation of Deferred@7960116 after retry RPC after error@603861564) -> (continuation of Deferred@1204994460 after retry RPC after error@2037936258) -> (continuation of Deferred@846946639 after retry RPC after error@1615252206) -> (continuation of Deferred@835266907 after retry RPC after error@193962880) -> (continuation of Deferred@1654114983 after retry RPC after error@877686177) -> (continuation of Deferred@1277888897 after retry RPC after error@986591271) -> (continuation of Deferred@1724909355 after retry RPC after error@1373258549) -> (continuation of Deferred@1168719758 after retry RPC after error@246243348) -> (continuation of Deferred@1747109813 after retry RPC after error@1810035311) -> (continuation of Deferred@1731982802 after retry RPC after error@41129185) -> (continuation of Deferred@2090005621 after retry RPC after error@2031618) -> (continuation of Deferred@942858422 after retry RPC after error@653832141) -> (continuation of Deferred@1294124603 after retry RPC after error@893767821)))
08:09:12.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:12.404 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:12.404 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:12.404 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:12.405 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.405 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.405 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.405 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.405 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.405 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.405 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.405 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.405 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.405 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:12.408 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091752408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:12.409 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:12.420 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
08:09:12.422 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
08:09:12.458 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:12.458 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:12.458 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:12.458 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:12.458 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:12.459 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:12.459 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:12.459 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:12.459 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:12.459 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:12.459 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:12.459 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:12.459 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:12.460 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29965), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [8ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [9ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [63ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [64ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [187ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [188ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [189ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [189ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [190ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [190ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [208ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [209ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [220ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [221ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [222ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [242ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [242ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [242ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [242ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [262ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [262ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [262ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [262ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [281ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [282ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [282ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [282ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [341ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [342ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [343ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [382ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [384ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [384ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [503ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [503ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [503ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [503ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [940ms] refreshing cache from master, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [942ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [942ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [943ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [943ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1781ms] refreshing cache from master, [1781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1782ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1782ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1783ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1783ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2581ms] refreshing cache from master, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2582ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2582ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2586ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2586ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [5900ms] refreshing cache from master, [5900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [5901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [5901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [5901ms] too many traces: truncated at 100 traces, deferred=Deferred@1959299554(state=PENDING, result=null, callback=(continuation of Deferred@587360477 after retry RPC after error@620644244) -> (continuation of Deferred@23430622 after retry RPC after error@827497353) -> (continuation of Deferred@19286526 after retry RPC after error@1471315113) -> (continuation of Deferred@2060736756 after retry RPC after error@1602165492) -> (continuation of Deferred@1822806364 after retry RPC after error@683065173) -> (continuation of Deferred@1895649615 after retry RPC after error@1467108638) -> (continuation of Deferred@354376093 after retry RPC after error@147718268) -> (continuation of Deferred@304303875 after retry RPC after error@1476192996) -> (continuation of Deferred@952144439 after retry RPC after error@1089845427) -> (continuation of Deferred@1218882809 after retry RPC after error@2017318083) -> (continuation of Deferred@1146138841 after retry RPC after error@688765120) -> (continuation of Deferred@1412499580 after retry RPC after error@1119639029) -> (continuation of Deferred@53211907 after retry RPC after error@1193574430) -> (continuation of Deferred@462029422 after retry RPC after error@993652503) -> (continuation of Deferred@1742119064 after retry RPC after error@68282380) -> (continuation of Deferred@1338180498 after retry RPC after error@1005984810) -> (continuation of Deferred@1769384364 after retry RPC after error@1655471366) -> (continuation of Deferred@891563346 after retry RPC after error@1052270736) -> (continuation of Deferred@1650431266 after retry RPC after error@1671069730) -> (continuation of Deferred@2000715710 after retry RPC after error@167853350) -> (continuation of Deferred@350834625 after retry RPC after error@600131310) -> (continuation of Deferred@1468817575 after retry RPC after error@1416073085) -> (continuation of Deferred@179197303 after retry RPC after error@64327930) -> (continuation of Deferred@929583487 after retry RPC after error@1595686024) -> (continuation of Deferred@660721649 after retry RPC after error@136104359) -> (continuation of Deferred@2097844850 after retry RPC after error@1137449255), errback=(continuation of Deferred@587360477 after retry RPC after error@620644244) -> (continuation of Deferred@23430622 after retry RPC after error@827497353) -> (continuation of Deferred@19286526 after retry RPC after error@1471315113) -> (continuation of Deferred@2060736756 after retry RPC after error@1602165492) -> (continuation of Deferred@1822806364 after retry RPC after error@683065173) -> (continuation of Deferred@1895649615 after retry RPC after error@1467108638) -> (continuation of Deferred@354376093 after retry RPC after error@147718268) -> (continuation of Deferred@304303875 after retry RPC after error@1476192996) -> (continuation of Deferred@952144439 after retry RPC after error@1089845427) -> (continuation of Deferred@1218882809 after retry RPC after error@2017318083) -> (continuation of Deferred@1146138841 after retry RPC after error@688765120) -> (continuation of Deferred@1412499580 after retry RPC after error@1119639029) -> (continuation of Deferred@53211907 after retry RPC after error@1193574430) -> (continuation of Deferred@462029422 after retry RPC after error@993652503) -> (continuation of Deferred@1742119064 after retry RPC after error@68282380) -> (continuation of Deferred@1338180498 after retry RPC after error@1005984810) -> (continuation of Deferred@1769384364 after retry RPC after error@1655471366) -> (continuation of Deferred@891563346 after retry RPC after error@1052270736) -> (continuation of Deferred@1650431266 after retry RPC after error@1671069730) -> (continuation of Deferred@2000715710 after retry RPC after error@167853350) -> (continuation of Deferred@350834625 after retry RPC after error@600131310) -> (continuation of Deferred@1468817575 after retry RPC after error@1416073085) -> (continuation of Deferred@179197303 after retry RPC after error@64327930) -> (continuation of Deferred@929583487 after retry RPC after error@1595686024) -> (continuation of Deferred@660721649 after retry RPC after error@136104359) -> (continuation of Deferred@2097844850 after retry RPC after error@1137449255)))
08:09:12.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:11.867173  4517 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 4509
08:09:12.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:12.606367  4517 kernel_stack_watchdog.cc:198] Thread 4509 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 390ms:
08:09:12.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:09:12.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:09:12.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:09:12.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:09:12.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:10.476742  4519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:12.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:12.612305  4509 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.138s	user 0.474s	sys 0.868s
08:09:12.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:12.613544  4509 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.138s	user 0.474s	sys 0.868s
08:09:12.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:12.619442  4532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:12.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:12.619984  4509 server_base.cc:1061] running on GCE node
08:09:12.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:12.621783  4509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:09:12.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:12.626017  4509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:09:12.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:12.627715  4509 hybrid_clock.cc:648] HybridClock initialized: now 1779091752627671 us; error 45 us; skew 500 ppm
08:09:12.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:12.629082  4509 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:09:12.630 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:12.650 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:12.651 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:12.651 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:12.651 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:12.651 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:12.652 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:12.652 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:12.652 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:12.652 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:12.652 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:12.652 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:12.652 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:12.653 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:12.658 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:12.658 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:12.658 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:12.658 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:12.658 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:12.658 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:12.659 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:12.659 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:12.659 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:12.659 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:12.659 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:12.659 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:12.659 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:12.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:12.672822  4509 webserver.cc:533] Webserver started at http://127.4.9.65:33515/ using document root <none> and password file <none>
08:09:12.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:12.674851  4509 fs_manager.cc:362] Metadata directory not provided
08:09:12.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:12.675364  4509 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:09:12.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:12.676101  4509 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:09:12.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:12.685227  4509 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-0/data/instance:
08:09:12.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0a7023e11f684b96aa2d4965a85ddaa3"
08:09:12.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:12 on dist-test-slave-1jss"
08:09:12.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:12.687645  4509 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-0/wal/instance:
08:09:12.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0a7023e11f684b96aa2d4965a85ddaa3"
08:09:12.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:12 on dist-test-slave-1jss"
08:09:12.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:12.731326  4509 fs_manager.cc:696] Time spent creating directory manager: real 0.043s	user 0.015s	sys 0.022s
08:09:12.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:12.749091  4538 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:09:12.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:12.751096  4509 fs_manager.cc:730] Time spent opening block manager: real 0.013s	user 0.005s	sys 0.005s
08:09:12.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:12.751806  4509 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-0/wal
08:09:12.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0a7023e11f684b96aa2d4965a85ddaa3"
08:09:12.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:12 on dist-test-slave-1jss"
08:09:12.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:12.752487  4509 fs_report.cc:389] FS layout report
08:09:12.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:09:12.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-0/wal
08:09:12.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-0/wal
08:09:12.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-0/data/data
08:09:12.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:09:12.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:09:12.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:09:12.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:09:12.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:09:12.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:09:12.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:09:12.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:09:12.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:09:12.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:09:12.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:09:12.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:12.846 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:12.847 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:12.847 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:12.848 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:12.848 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:12.848 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:12.848 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:12.848 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:12.848 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:12.849 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:12.849 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:12.849 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:12.849 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:12.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:12.878983  4509 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:09:12.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:12.881820  4509 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:09:12.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:12.882808  4509 kserver.cc:163] Server-wide thread pool size limit: 3276
08:09:12.883 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:12.883 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:12.883 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:12.883 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:12.884 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:12.884 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:12.884 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:12.884 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:12.884 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:12.884 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:12.884 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:12.884 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.884 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.885 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.885 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.885 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.885 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.885 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:12.885 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:12.885 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.885 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.885 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.885 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:12.885 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:12.885 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:12.886 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:12.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:12.896001  4509 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:09:12.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:12.906616  4509 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:09:12.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:12.907013  4509 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
08:09:12.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:12.907505  4509 ts_tablet_manager.cc:616] Registered 0 tablets
08:09:12.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091752908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:12.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:12.907934  4509 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:09:12.914 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:12.925 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
08:09:12.927 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
08:09:12.942 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:12.943 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:12.943 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:12.943 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:12.943 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:12.943 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:12.944 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:12.944 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:12.944 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:12.944 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:12.944 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:12.944 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:12.944 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:12.964 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:12.964 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:12.964 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:12.965 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.965 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.965 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:12.965 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.965 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.965 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:12.966 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.966 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.966 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:12.966 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:12.982 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:12.983 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:12.983 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:12.983 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:12.983 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:12.984 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:12.984 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:12.984 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:12.984 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:12.984 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:12.984 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:12.984 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:12.984 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:13.002 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:13.003 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:13.003 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:13.003 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:13.003 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:13.004 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:13.004 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:13.004 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:13.004 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:13.004 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:13.004 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:13.005 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:13.005 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:13.130 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:13.203 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:13.204 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:13.204 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:13.205 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:13.205 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:13.205 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:13.206 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:13.206 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:13.206 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:13.206 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:13.206 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:13.206 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:13.206 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:13.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:13.310592  4650 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.9.65:39865 every 8 connection(s)
08:09:13.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:13.311214  4509 rpc_server.cc:307] RPC server started. Bound to: 127.4.9.65:39865
08:09:13.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:13.314985  4509 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-0/data/info.pb
08:09:13.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:13.321491  4133 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 4509
08:09:13.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:13.322475  4133 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-0/wal/instance
08:09:13.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:13.344 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:13.344 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:13.344 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:13.345 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:13.345 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:13.345 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:13.346 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:13.346 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:13.346 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:13.346 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:13.346 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:13.346 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:13.346 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:13.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:13.374203  4133 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:09:13.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:09:13.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-1/wal
08:09:13.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-1/data
08:09:13.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:09:13.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:09:13.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:09:13.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:09:13.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:09:13.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:09:13.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-1/logs
08:09:13.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-1/data/info.pb
08:09:13.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:09:13.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:09:13.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:09:13.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:09:13.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:09:13.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:09:13.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:09:13.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:09:13.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:09:13.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:09:13.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.9.66:0
08:09:13.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.9.66
08:09:13.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.9.66
08:09:13.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:09:13.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.9.126:44985,127.4.9.125:45723,127.4.9.124:41733
08:09:13.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.9.84:43373
08:09:13.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:09:13.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:09:13.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:09:13.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091753408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:13.409 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:13.420 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
08:09:13.421 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
08:09:13.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:13.492491  4651 heartbeater.cc:344] Connected to a master server at 127.4.9.124:41733
08:09:13.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:13.493551  4651 heartbeater.cc:461] Registering TS with master...
08:09:13.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:13.495186  4651 heartbeater.cc:507] Master 127.4.9.124:41733 requested a full tablet report, sending...
08:09:13.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:13.499568  4393 ts_manager.cc:194] Registered new tserver with Master: 0a7023e11f684b96aa2d4965a85ddaa3 (127.4.9.65:39865)
08:09:13.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:13.503819  4393 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.9.65:47857
08:09:13.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:13.514277  4652 heartbeater.cc:344] Connected to a master server at 127.4.9.125:45723
08:09:13.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:13.514760  4652 heartbeater.cc:461] Registering TS with master...
08:09:13.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:13.515558  4652 heartbeater.cc:507] Master 127.4.9.125:45723 requested a full tablet report, sending...
08:09:13.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:13.520514  4259 ts_manager.cc:194] Registered new tserver with Master: 0a7023e11f684b96aa2d4965a85ddaa3 (127.4.9.65:39865)
08:09:13.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:13.528455  4658 heartbeater.cc:344] Connected to a master server at 127.4.9.126:44985
08:09:13.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:13.528905  4658 heartbeater.cc:461] Registering TS with master...
08:09:13.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:13.529809  4658 heartbeater.cc:507] Master 127.4.9.126:44985 requested a full tablet report, sending...
08:09:13.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:13.533769  4178 ts_manager.cc:194] Registered new tserver with Master: 0a7023e11f684b96aa2d4965a85ddaa3 (127.4.9.65:39865)
08:09:13.631 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:13.634 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:13.635 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:13.635 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:13.635 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:13.636 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:13.636 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:13.636 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:13.636 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:13.636 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:13.637 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:13.637 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:13.637 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:13.637 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:13.831 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:13.831 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:13.831 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:13.832 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:13.832 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:13.832 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:13.832 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:13.832 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:13.832 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:13.832 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:13.832 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:13.833 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:13.833 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:13.833 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:13.833 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:13.833 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:13.834 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:13.834 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:13.834 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:13.834 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:13.834 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:13.834 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:13.834 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:13.834 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:13.834 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:13.834 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:13.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:13.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091753908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:13.909 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:13.927 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
08:09:13.928 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
08:09:13.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:13.973011  4655 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:09:13.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:13.973580  4655 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:09:13.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:13.974232  4655 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:09:14.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:14.028963  4655 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:09:14.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:14.030155  4655 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.9.66
08:09:14.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:14.083369  4655 tablet_server_runner.cc:78] Tablet server non-default flags:
08:09:14.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:09:14.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.9.84:43373
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-1/data
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-1/wal
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.9.66:0
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-1/data/info.pb
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.9.66
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.9.126:44985,127.4.9.125:45723,127.4.9.124:41733
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.9.66
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-1/logs
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:09:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:09:14.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:14.085258  4655 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:09:14.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:14.087735  4655 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:09:14.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:14.118454  4668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:14.131 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:14.222 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:14.223 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:14.223 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:14.224 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:14.224 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:14.224 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:14.224 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:14.224 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:14.224 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:14.225 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:14.225 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:14.225 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:14.225 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:14.259 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:14.260 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:14.260 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:14.260 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:14.261 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:14.261 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:14.261 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:14.262 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:14.262 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:14.262 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:14.262 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:14.262 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:14.262 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:14.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:14.410 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:14.411 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091754409 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:14.441 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=32 ms, finalizationTime=0 ms).
08:09:14.448 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:14.448 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:14.448 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:14.449 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:14.449 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:14.449 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:14.449 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:14.449 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:14.449 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:14.449 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:14.450 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:14.450 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:14.450 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:14.454 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
08:09:14.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:14.510541  4651 heartbeater.cc:499] Master 127.4.9.124:41733 was elected leader, sending a full tablet report...
08:09:14.631 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:14.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:14.890 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:14.890 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:14.890 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:14.891 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:14.891 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:14.891 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:14.891 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:14.891 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:14.891 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:14.891 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:14.892 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:14.892 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:14.892 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:14.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091754908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:14.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:14.922 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
08:09:14.926 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
08:09:15.099 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:15.099 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:15.099 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:15.100 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:15.100 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:15.100 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:15.100 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:15.100 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:15.101 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:15.101 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:15.101 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:15.101 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:15.101 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:15.131 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:15.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:15.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091755408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:15.410 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:15.420 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
08:09:15.421 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
08:09:15.484 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:15.484 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:15.484 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:15.485 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:15.485 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:15.485 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:15.486 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:15.486 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:15.486 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:15.486 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:15.486 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:15.486 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:15.487 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:15.510 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:15.511 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:15.511 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:15.511 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:15.511 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:15.511 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:15.511 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:15.511 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:15.511 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:15.512 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:15.512 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:15.512 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:15.512 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:15.631 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:15.804 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:15.804 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:15.804 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:15.805 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:15.805 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:15.805 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:15.805 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:15.805 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:15.805 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:15.805 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:15.805 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:15.806 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:15.806 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:15.822 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:15.822 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:15.822 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:15.822 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:15.822 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:15.823 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:15.823 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:15.823 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:15.823 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:15.823 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:15.823 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:15.823 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:15.823 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:15.842 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:15.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091755908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:15.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:15.919 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
08:09:15.922 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
08:09:15.947 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:15.947 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:15.947 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:15.947 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:15.948 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:15.948 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:15.948 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:15.948 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:15.948 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:15.948 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:15.948 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:15.948 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:15.948 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:16.131 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:16.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:15.508850  4666 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 4655
08:09:16.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:14.121327  4667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:16.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:16.177448  4655 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.065s	user 0.691s	sys 1.245s
08:09:16.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:16.177852  4655 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.065s	user 0.691s	sys 1.245s
08:09:16.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:16.187811  4672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:16.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.188028  4655 server_base.cc:1061] running on GCE node
08:09:16.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.189508  4655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:09:16.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.192292  4655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:09:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.193746  4655 hybrid_clock.cc:648] HybridClock initialized: now 1779091756193630 us; error 109 us; skew 500 ppm
08:09:16.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.194880  4655 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:09:16.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.202790  4655 webserver.cc:533] Webserver started at http://127.4.9.66:45069/ using document root <none> and password file <none>
08:09:16.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.203994  4655 fs_manager.cc:362] Metadata directory not provided
08:09:16.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.204317  4655 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:09:16.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.204823  4655 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:09:16.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.210824  4655 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-1/data/instance:
08:09:16.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "17223fa74c2243e899d62a8a629c92ea"
08:09:16.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:16 on dist-test-slave-1jss"
08:09:16.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.212330  4655 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-1/wal/instance:
08:09:16.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "17223fa74c2243e899d62a8a629c92ea"
08:09:16.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:16 on dist-test-slave-1jss"
08:09:16.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.221485  4655 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.009s	sys 0.001s
08:09:16.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.228945  4678 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:09:16.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.230520  4655 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.004s	sys 0.003s
08:09:16.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.230890  4655 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-1/wal
08:09:16.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "17223fa74c2243e899d62a8a629c92ea"
08:09:16.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:16 on dist-test-slave-1jss"
08:09:16.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.231427  4655 fs_report.cc:389] FS layout report
08:09:16.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:09:16.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-1/wal
08:09:16.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-1/wal
08:09:16.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-1/data/data
08:09:16.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:09:16.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:09:16.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:09:16.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:09:16.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:09:16.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:09:16.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:09:16.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:09:16.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:09:16.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:09:16.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:09:16.252 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:16.252 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:16.253 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:16.253 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:16.253 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:16.253 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:16.253 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:16.253 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:16.253 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:16.253 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:16.253 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:16.253 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:16.253 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:16.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.295913  4655 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:09:16.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.297998  4655 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:09:16.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.298524  4655 kserver.cc:163] Server-wide thread pool size limit: 3276
08:09:16.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.302312  4655 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:09:16.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.308557  4655 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:09:16.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.308895  4655 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:09:16.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.309234  4655 ts_tablet_manager.cc:616] Registered 0 tablets
08:09:16.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.309479  4655 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:09:16.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:16.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091756408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:16.409 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:16.419 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
08:09:16.421 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
08:09:16.518 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:16.519 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:16.519 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:16.520 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:16.520 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:16.520 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:16.520 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:16.520 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:16.520 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:16.521 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:16.521 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:16.521 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:16.521 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:16.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.525174  4655 rpc_server.cc:307] RPC server started. Bound to: 127.4.9.66:45705
08:09:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.525393  4790 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.9.66:45705 every 8 connection(s)
08:09:16.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.529052  4655 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-1/data/info.pb
08:09:16.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.532886  4133 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 4655
08:09:16.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.533576  4133 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-1/wal/instance
08:09:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.552723  4133 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:09:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:09:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-2/wal
08:09:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-2/data
08:09:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:09:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:09:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:09:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:09:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:09:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:09:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-2/logs
08:09:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-2/data/info.pb
08:09:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:09:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:09:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:09:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:09:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:09:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:09:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:09:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:09:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:09:16.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:09:16.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.9.67:0
08:09:16.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.9.67
08:09:16.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.9.67
08:09:16.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:09:16.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.9.126:44985,127.4.9.125:45723,127.4.9.124:41733
08:09:16.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.9.84:43373
08:09:16.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:09:16.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:09:16.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:09:16.555 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (0d2ddb76420639a9ec06ca05e894cb50) switched from state RESTARTING to RUNNING.
08:09:16.556 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job 0d2ddb76420639a9ec06ca05e894cb50 from Checkpoint 69 @ 1779091595847 for 0d2ddb76420639a9ec06ca05e894cb50 located at file:/tmp/junit4405728108231754423/checkpoints/0d2ddb76420639a9ec06ca05e894cb50/chk-69.
08:09:16.556 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
08:09:16.556 [INFO - flink-pekko.actor.default-dispatcher-7] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
08:09:16.557 [INFO - Thread-60] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
08:09:16.557 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from CREATED to SCHEDULED.
08:09:16.558 [DEBUG - Thread-60] (Connection.java:575) [peer master-127.27.17.253:37621(127.27.17.253:37621)] disconnecting while in state TERMINATED
08:09:16.558 [DEBUG - Thread-60] (Connection.java:575) [peer master-127.27.17.252:43595(127.27.17.252:43595)] disconnecting while in state TERMINATED
08:09:16.558 [DEBUG - Thread-60] (Connection.java:575) [peer master-127.27.17.254:45447(127.27.17.254:45447)] disconnecting while in state TERMINATED
08:09:16.558 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:09:16.559 [DEBUG - Thread-60] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:09:16.563 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from SCHEDULED to DEPLOYING.
08:09:16.563 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #6) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id 23d75c1cae20f6d786d6e473edbc6825
08:09:16.563 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 23d75c1cae20f6d786d6e473edbc6825.
08:09:16.566 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CREATED to SCHEDULED.
08:09:16.567 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from SCHEDULED to DEPLOYING.
08:09:16.567 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #6) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id 562b84b71b659c92bf587d4c4d45167a
08:09:16.569 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:09:16.570 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_6), deploy into slot with allocation id 23d75c1cae20f6d786d6e473edbc6825.
08:09:16.571 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from CREATED to SCHEDULED.
08:09:16.571 [INFO - Thread-60] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
08:09:16.571 [INFO - Thread-60] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
08:09:16.572 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:09:16.573 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from SCHEDULED to DEPLOYING.
08:09:16.573 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #6) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id 51ba13794eaa695dfcc17a66fc9521a4
08:09:16.574 [DEBUG - Thread-60] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:16.574 [INFO - Thread-60] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
08:09:16.574 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from CREATED to SCHEDULED.
08:09:16.576 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:09:16.576 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from SCHEDULED to DEPLOYING.
08:09:16.576 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #6) with attempt id bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1) with allocation id e7235da53f93c0af3219c2857bfb1cae
08:09:16.578 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 562b84b71b659c92bf587d4c4d45167a.
08:09:16.579 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_6), deploy into slot with allocation id 562b84b71b659c92bf587d4c4d45167a.
08:09:16.580 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from CREATED to DEPLOYING.
08:09:16.580 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_6) [DEPLOYING].
08:09:16.581 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@63224567
08:09:16.581 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:16.581 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:09:16.583 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from DEPLOYING to INITIALIZING.
08:09:16.583 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from DEPLOYING to INITIALIZING.
08:09:16.585 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 51ba13794eaa695dfcc17a66fc9521a4.
08:09:16.588 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_6), deploy into slot with allocation id 51ba13794eaa695dfcc17a66fc9521a4.
08:09:16.589 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CREATED to DEPLOYING.
08:09:16.589 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_6) [DEPLOYING].
08:09:16.590 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@778e2611
08:09:16.590 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:16.590 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:09:16.590 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from DEPLOYING to INITIALIZING.
08:09:16.590 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2b0d1c4f
08:09:16.590 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from DEPLOYING to INITIALIZING.
08:09:16.593 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot e7235da53f93c0af3219c2857bfb1cae.
08:09:16.594 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from CREATED to DEPLOYING.
08:09:16.594 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_6) [DEPLOYING].
08:09:16.595 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_6), deploy into slot with allocation id e7235da53f93c0af3219c2857bfb1cae.
08:09:16.595 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@73d5ff00
08:09:16.595 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:16.595 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:09:16.600 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:16.600 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from DEPLOYING to INITIALIZING.
08:09:16.601 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from DEPLOYING to INITIALIZING.
08:09:16.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.600665  4792 heartbeater.cc:344] Connected to a master server at 127.4.9.125:45723
08:09:16.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.601291  4792 heartbeater.cc:461] Registering TS with master...
08:09:16.602 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7de0ec97
08:09:16.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.603000  4792 heartbeater.cc:507] Master 127.4.9.125:45723 requested a full tablet report, sending...
08:09:16.604 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3ed4c29f
08:09:16.604 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:16.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.607090  4259 ts_manager.cc:194] Registered new tserver with Master: 17223fa74c2243e899d62a8a629c92ea (127.4.9.66:45705)
08:09:16.609 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:16.613 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:09:16.613 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:09:16.613 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:09:16.613 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:09:16.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:16.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.615773  4793 heartbeater.cc:344] Connected to a master server at 127.4.9.126:44985
08:09:16.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.616217  4793 heartbeater.cc:461] Registering TS with master...
08:09:16.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.617302  4793 heartbeater.cc:507] Master 127.4.9.126:44985 requested a full tablet report, sending...
08:09:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.620396  4791 heartbeater.cc:344] Connected to a master server at 127.4.9.124:41733
08:09:16.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.620743  4791 heartbeater.cc:461] Registering TS with master...
08:09:16.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.621250  4178 ts_manager.cc:194] Registered new tserver with Master: 17223fa74c2243e899d62a8a629c92ea (127.4.9.66:45705)
08:09:16.621 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:16.622 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:16.622 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:16.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.621719  4791 heartbeater.cc:507] Master 127.4.9.124:41733 requested a full tablet report, sending...
08:09:16.622 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:16.622 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:16.622 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:16.622 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:16.622 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:16.623 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:16.623 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:16.623 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:16.623 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:16.623 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:16.623 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from CREATED to DEPLOYING.
08:09:16.623 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_6) [DEPLOYING].
08:09:16.624 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.624 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6323c299
08:09:16.624 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:16.624 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4405728108231754423/checkpoints")
08:09:16.625 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from DEPLOYING to INITIALIZING.
08:09:16.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.625468  4393 ts_manager.cc:194] Registered new tserver with Master: 17223fa74c2243e899d62a8a629c92ea (127.4.9.66:45705)
08:09:16.627 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1397a7f6
08:09:16.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:16.627415  4393 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.9.66:54821
08:09:16.628 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from DEPLOYING to INITIALIZING.
08:09:16.629 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:16.630 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:16.631 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.632 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.633 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:16.634 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.634 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.634 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.635 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.635 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.635 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.635 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.635 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.635 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.635 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.635 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.636 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.636 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.636 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:16.637 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.637 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.637 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.637 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.637 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.637 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.637 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.637 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.638 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.638 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.638 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.638 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.638 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.639 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.639 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.639 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:16.639 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.639 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.639 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.640 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.640 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.640 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.640 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.640 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.640 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.641 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.641 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.641 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.641 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.641 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.641 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.641 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.642 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.642 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.642 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.642 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.642 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.642 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.642 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.642 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.642 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.642 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.642 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.643 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.643 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.643 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.643 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:16.644 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.645 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.645 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.645 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.645 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.645 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.645 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.646 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.646 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.646 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.646 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.646 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.646 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.651 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.651 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.651 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.651 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.651 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.652 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.652 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.652 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.653 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.653 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.653 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.653 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.653 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.653 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.653 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.653 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:16.654 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.654 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.654 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.654 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.655 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.655 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.655 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.655 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.655 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:16.656 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.656 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.656 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.656 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.656 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.656 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.656 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.657 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.657 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.657 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.657 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.657 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:16.658 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.658 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.658 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.664 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.670 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.670 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.670 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.670 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.670 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.671 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.671 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.671 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.671 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.672 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.672 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.672 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.672 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:16.672 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.673 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.673 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.673 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.673 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.673 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.673 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.674 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:16.674 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.674 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.674 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.674 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.674 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.674 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.674 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.674 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.674 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.674 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.675 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.675 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.675 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.675 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.675 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.675 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.675 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.675 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.676 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.676 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.676 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.676 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.676 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:16.676 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.676 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.677 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.677 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.677 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.677 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.677 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.677 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.677 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.677 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.678 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.678 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:16.678 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.678 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.678 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.678 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.678 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.678 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.678 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:16.684 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.685 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.685 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.685 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.685 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.685 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.686 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.686 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.686 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.686 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.686 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.686 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.686 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.691 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.691 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.692 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.692 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.692 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.692 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.692 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.692 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.692 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.692 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.692 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.692 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.692 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.693 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.693 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.693 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.693 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.693 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.694 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.694 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.694 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.694 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.694 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.694 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.694 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.694 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:16.694 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.694 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.694 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:16.694 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:16.694 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.694 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.694 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.694 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.695 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.695 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.695 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.695 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.695 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.695 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.695 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.695 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.694 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.695 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.695 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.695 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:16.695 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.695 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.696 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.696 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.696 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.696 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.704 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.704 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.705 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.705 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.705 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.705 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.705 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.705 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.705 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.705 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.705 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.705 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.705 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.711 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.711 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.711 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.711 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.711 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.711 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.711 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.711 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.711 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.711 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.711 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.712 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.712 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.713 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.713 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.713 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.713 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.713 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.713 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.713 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.713 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.714 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.714 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.714 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.714 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:16.714 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.714 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.714 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.714 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:16.714 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.714 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.714 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.714 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.714 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.714 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.714 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.713 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.714 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.715 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.715 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.715 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.715 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.715 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.715 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.715 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:16.715 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.715 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.715 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.715 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.715 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.715 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.715 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:16.724 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.724 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.724 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.724 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.724 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.724 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.724 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.724 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.724 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.724 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.724 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.725 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.725 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.730 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.731 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.731 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.731 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.731 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.731 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.731 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.731 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.731 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.731 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.731 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.731 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.731 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.733 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.733 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.733 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.733 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.733 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.733 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.733 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.733 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.733 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.733 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.733 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.733 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.733 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.734 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.734 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.734 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.734 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.734 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.734 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.734 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.734 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.734 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.734 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.734 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:16.734 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.734 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.734 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.734 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:16.735 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.735 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:16.735 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.735 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.735 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.735 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.735 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.735 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.735 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.735 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.735 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:16.745 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.745 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.745 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.745 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.745 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.745 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.745 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.745 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.745 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.745 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.745 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.745 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.746 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.753 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.753 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.754 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.754 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.754 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.754 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.754 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.754 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.754 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.754 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:16.754 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.754 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.754 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.754 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.754 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:16.754 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.754 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:16.754 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.755 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.755 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.755 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.755 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.755 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.755 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.755 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.755 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:16.771 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.772 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.772 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.772 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.772 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.772 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.772 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.772 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.772 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.772 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.773 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.773 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.773 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.783 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:16.784 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:16.784 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:16.784 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:16.784 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:16.784 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:16.784 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:16.784 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:16.784 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:16.784 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:16.784 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:16.784 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:16.785 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:16.792 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.793 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.793 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.793 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.793 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.793 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.793 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.793 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.794 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.794 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.794 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.794 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.794 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:16.794 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.794 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:16.794 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:16.794 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.794 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.794 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.794 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.794 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.794 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.794 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.794 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.794 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.795 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:16.812 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.813 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.813 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.813 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.813 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.813 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.813 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.813 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.813 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.813 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.813 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.814 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.814 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.814 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.814 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.814 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.814 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.814 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.814 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.814 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.814 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.814 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.814 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.814 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.815 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.815 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.831 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.832 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.832 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.832 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.832 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.832 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.832 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.832 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.832 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.833 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.833 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.833 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.833 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:16.844 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.844 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.844 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.844 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.845 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.845 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.845 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.845 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.845 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.846 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.846 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.846 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.846 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.884 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:16.884 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:16.884 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:16.884 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:16.884 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:16.884 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:16.884 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:16.884 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:16.884 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:16.885 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:16.885 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:16.885 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:16.885 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:16.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091756908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:16.909 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:16.911 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.911 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.912 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.912 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.912 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.913 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.913 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.913 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.913 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.913 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.913 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.913 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.913 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.917 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
08:09:16.917 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
08:09:16.933 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.933 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.933 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.933 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.933 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.933 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.933 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.933 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.933 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.934 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:16.934 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:16.934 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.934 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.934 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.934 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.934 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.934 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.934 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:16.934 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.934 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:16.934 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.934 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.934 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.934 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:16.934 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:16.934 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:16.954 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:16.954 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:16.954 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:16.954 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.954 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.954 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.954 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.954 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:16.954 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:16.954 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.955 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.955 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:16.955 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:17.024 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:17.025 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:17.025 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:17.025 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.025 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.025 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.025 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.025 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.025 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.025 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.025 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.025 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.025 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:17.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:17.033139  4800 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:09:17.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:17.033752  4800 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:09:17.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:17.034345  4800 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:09:17.050 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:17.050 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:17.050 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:17.050 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:17.050 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:17.050 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:17.050 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:17.050 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:17.052 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:17.052 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:17.052 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:17.052 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:17.052 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:17.075 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:17.075 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:17.075 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:17.076 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:17.076 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:17.076 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:17.076 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:17.076 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:17.076 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:17.076 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:17.076 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:17.076 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:17.076 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:17.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:17.079386  4800 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:09:17.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:17.080421  4800 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.9.67
08:09:17.113 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:17.114 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:17.114 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:17.114 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.114 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.114 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.114 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.114 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.114 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.115 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.115 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.116 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.116 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:17.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:17.130 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:17.131582  4800 tablet_server_runner.cc:78] Tablet server non-default flags:
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.9.84:43373
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-2/data
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-2/wal
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.9.67:0
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-2/data/info.pb
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.9.67
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.9.126:44985,127.4.9.125:45723,127.4.9.124:41733
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.9.67
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-2/logs
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:09:17.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:09:17.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:17.133574  4800 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:09:17.134 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:17.134 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:17.134 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:17.134 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.134 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.134 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.135 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.135 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.135 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.135 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.135 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.135 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.135 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:17.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:17.135986  4800 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:09:17.152 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:17.152 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:17.152 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:17.153 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.153 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.153 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.153 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.154 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.154 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.154 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.154 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.155 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.155 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:17.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:17.154904  4862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:17.314 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:17.314 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:17.315 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:17.315 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.315 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.315 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.316 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.316 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.316 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.316 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.316 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.317 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.317 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:17.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:17.365 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:17.365 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:17.365 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:17.366 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:17.366 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:17.366 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:17.366 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:17.366 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:17.366 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:17.366 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:17.366 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:17.366 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:17.367 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:17.409 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:17.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091757408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:17.420 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:09:17.425 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
08:09:17.434 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:17.434 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:17.435 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:17.436 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:17.436 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:17.436 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:17.436 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:17.436 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:17.436 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:17.437 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:17.437 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:17.437 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:17.437 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:17.464 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:17.465 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:17.465 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:17.466 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.466 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.466 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.466 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.467 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.467 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.467 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.467 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.467 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.467 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:17.511 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:17.512 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:17.512 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:17.513 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.513 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.513 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.514 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.514 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.514 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.514 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.514 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.514 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.514 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:17.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:17.631 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:17.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:17.633544  4791 heartbeater.cc:499] Master 127.4.9.124:41733 was elected leader, sending a full tablet report...
08:09:17.653 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:17.654 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:17.654 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:17.654 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.655 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.655 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.655 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.655 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.655 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.654 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.655 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.655 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.656 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:17.844 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:17.850 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:17.851 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:17.851 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:17.852 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:17.852 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:17.852 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:17.852 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:17.852 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:17.852 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:17.853 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:17.853 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:17.853 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:17.853 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:17.878 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:17.878 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:17.879 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:17.879 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:17.879 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:17.879 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:17.880 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:17.880 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:17.880 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:17.880 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:17.880 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:17.881 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:17.881 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:17.904 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:17.904 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:17.904 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:17.905 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.905 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.905 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.906 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.906 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.906 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.906 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.906 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.906 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.906 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:17.909 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:17.910 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091757908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:17.924 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
08:09:17.926 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
08:09:17.926 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:17.927 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:17.927 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:17.927 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:17.927 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:17.927 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:17.927 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:17.927 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:17.928 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:17.928 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:17.928 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:17.928 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:17.928 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:17.973 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:17.973 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:17.974 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:17.974 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.974 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.975 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:17.975 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.975 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.976 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:17.976 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.976 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.976 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:17.976 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:17.977 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:17.977 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:17.977 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:17.977 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:17.977 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:17.977 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:17.977 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:17.978 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:17.978 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:17.978 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:17.978 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:17.978 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:17.978 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:18.054 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:18.054 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:18.054 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:18.055 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:18.055 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:18.055 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:18.056 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:18.056 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:18.056 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:18.056 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:18.056 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:18.056 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:18.056 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:18.059 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:18.060 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:18.060 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:18.060 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:18.060 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:18.060 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:18.060 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:18.060 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:18.060 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:18.061 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:18.061 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:18.061 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:18.061 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:18.066 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:18.066 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:18.066 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:18.067 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:18.067 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:18.067 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:18.067 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:18.067 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:18.067 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:18.067 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:18.067 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:18.068 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:18.068 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:18.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:18.131 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:18.162 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:18.162 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:18.162 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:18.162 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:18.163 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:18.163 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:18.163 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:18.163 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:18.163 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:18.162 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:18.163 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:18.163 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:18.163 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:18.174 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:18.174 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:18.174 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:18.175 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:18.175 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:18.175 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:18.176 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:18.176 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:18.176 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:18.177 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:18.177 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:18.177 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:18.177 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:18.198 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:18.199 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:18.199 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:18.199 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:18.199 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:18.199 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:18.199 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:18.200 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:18.200 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:18.200 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:18.200 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:18.200 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:18.201 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:18.210 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:18.210 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:18.210 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:18.210 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:18.211 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:18.211 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:18.211 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:18.211 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:18.211 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:18.211 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:18.211 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:18.211 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:18.211 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:18.230 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:18.231 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:18.231 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:18.231 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:18.231 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:18.231 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:18.231 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:18.231 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:18.232 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:18.232 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:18.232 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:18.232 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:18.232 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:18.233 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:18.233 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:18.233 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:18.233 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:18.233 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:18.233 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:18.234 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:18.234 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:18.234 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:18.234 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:18.234 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:18.234 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:18.234 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:18.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:18.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091758408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:18.410 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:18.420 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:09:18.421 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
08:09:18.474 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:18.474 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:18.475 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:18.475 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:18.475 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:18.475 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:18.475 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:18.476 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:18.476 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:18.476 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:18.476 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:18.476 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:18.476 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:18.616 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:18.632 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:18.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:17.160436  4864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:18.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:17.156965  4861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:18.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:18.649165  4863 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1489 milliseconds
08:09:18.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:18.649292  4800 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:09:18.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:18.651078  4800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:09:18.653 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:18.653 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:18.654 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:18.654 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:18.654 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:18.654 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:18.654 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:18.654 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:18.654 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:18.655 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:18.655 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:18.655 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:18.655 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:18.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:18.656541  4800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:09:18.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:18.657927  4800 hybrid_clock.cc:648] HybridClock initialized: now 1779091758657879 us; error 34 us; skew 500 ppm
08:09:18.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:18.658836  4800 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:09:18.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:18.667519  4800 webserver.cc:533] Webserver started at http://127.4.9.67:37353/ using document root <none> and password file <none>
08:09:18.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:18.668649  4800 fs_manager.cc:362] Metadata directory not provided
08:09:18.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:18.669099  4800 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:09:18.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:18.669589  4800 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:09:18.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:18.675329  4800 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-2/data/instance:
08:09:18.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f4307e383fdb4861a47655fcaa08be4e"
08:09:18.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:18 on dist-test-slave-1jss"
08:09:18.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:18.676755  4800 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-2/wal/instance:
08:09:18.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f4307e383fdb4861a47655fcaa08be4e"
08:09:18.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:18 on dist-test-slave-1jss"
08:09:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:18.686112  4800 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.010s	sys 0.001s
08:09:18.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:18.693069  4871 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:09:18.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:18.694409  4800 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.000s
08:09:18.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:18.694734  4800 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-2/wal
08:09:18.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f4307e383fdb4861a47655fcaa08be4e"
08:09:18.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:18 on dist-test-slave-1jss"
08:09:18.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:18.695079  4800 fs_report.cc:389] FS layout report
08:09:18.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:09:18.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-2/wal
08:09:18.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-2/wal
08:09:18.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-2/data/data
08:09:18.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:09:18.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:09:18.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:09:18.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:09:18.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:09:18.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:09:18.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:09:18.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:09:18.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:09:18.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:09:18.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:09:18.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:18.755194  4800 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:09:18.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:18.756888  4800 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:09:18.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:18.757539  4800 kserver.cc:163] Server-wide thread pool size limit: 3276
08:09:18.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:18.760974  4800 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:09:18.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:18.766609  4800 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:09:18.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:18.766919  4800 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:09:18.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:18.767218  4800 ts_tablet_manager.cc:616] Registered 0 tablets
08:09:18.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:18.767396  4800 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:09:18.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:18.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091758908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:18.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:18.918 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
08:09:18.919 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
08:09:19.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:19.005383  4800 rpc_server.cc:307] RPC server started. Bound to: 127.4.9.67:37907
08:09:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:19.007788  4983 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.9.67:37907 every 8 connection(s)
08:09:19.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:19.010242  4800 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-2/data/info.pb
08:09:19.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:19.018497  4133 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 4800
08:09:19.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:19.019227  4133 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster12760886389424865906/ts-2/wal/instance
08:09:19.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:19.072813  4985 heartbeater.cc:344] Connected to a master server at 127.4.9.125:45723
08:09:19.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:19.073345  4985 heartbeater.cc:461] Registering TS with master...
08:09:19.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:19.074827  4985 heartbeater.cc:507] Master 127.4.9.125:45723 requested a full tablet report, sending...
08:09:19.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:19.077510  4987 heartbeater.cc:344] Connected to a master server at 127.4.9.126:44985
08:09:19.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:19.077752  4984 heartbeater.cc:344] Connected to a master server at 127.4.9.124:41733
08:09:19.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:19.077972  4987 heartbeater.cc:461] Registering TS with master...
08:09:19.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:19.078112  4984 heartbeater.cc:461] Registering TS with master...
08:09:19.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:19.078859  4259 ts_manager.cc:194] Registered new tserver with Master: f4307e383fdb4861a47655fcaa08be4e (127.4.9.67:37907)
08:09:19.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:19.078982  4987 heartbeater.cc:507] Master 127.4.9.126:44985 requested a full tablet report, sending...
08:09:19.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:19.079046  4984 heartbeater.cc:507] Master 127.4.9.124:41733 requested a full tablet report, sending...
08:09:19.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:19.082466  4393 ts_manager.cc:194] Registered new tserver with Master: f4307e383fdb4861a47655fcaa08be4e (127.4.9.67:37907)
08:09:19.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:19.082861  4178 ts_manager.cc:194] Registered new tserver with Master: f4307e383fdb4861a47655fcaa08be4e (127.4.9.67:37907)
08:09:19.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:19.084591  4393 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.9.67:44303
08:09:19.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:19.094789  4133 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
08:09:19.110 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:09:19.110 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

08:09:19.111 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.4.9.126"
      port: 44985
    }
    bound_http_address {
      host: "127.4.9.126"
      port: 35021
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.4.9.125"
      port: 45723
    }
    bound_http_address {
      host: "127.4.9.125"
      port: 35969
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.4.9.124"
      port: 41733
    }
    bound_http_address {
      host: "127.4.9.124"
      port: 46783
    }
  }
}

08:09:19.112 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

08:09:19.113 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.4.9.65"
      port: 39865
    }
    bound_http_address {
      host: "127.4.9.65"
      port: 33515
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.4.9.66"
      port: 45705
    }
    bound_http_address {
      host: "127.4.9.66"
      port: 45069
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.4.9.67"
      port: 37907
    }
    bound_http_address {
      host: "127.4.9.67"
      port: 37353
    }
  }
}

08:09:19.113 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
08:09:19.114 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:19.115 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
08:09:19.115 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskk4_r_T/test-tmp
08:09:19.115 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
08:09:19.116 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskk4_r_T/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
08:09:19.116 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:19.122 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

08:09:19.124 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:19.124 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:19.124 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:19.125 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:19.125 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:19.125 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:19.125 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:19.125 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:19.125 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:19.125 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:19.125 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:19.125 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:19.125 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:19.130 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:19.299 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:19.299 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:19.299 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:19.300 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:19.300 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:19.300 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:19.300 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:19.300 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:19.300 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:19.300 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:19.306 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:19.306 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:19.306 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:19.342 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:19.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091759408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:19.410 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:19.419 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:09:19.421 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
08:09:19.570 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:09:19.570 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

08:09:19.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:19.576329  4994 mini_oidc.cc:150] Starting JWKS server
08:09:19.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:19.580972  4994 webserver.cc:533] Webserver started at http://127.0.0.1:43831/ using document root <none> and password file <none>
08:09:19.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:19.581501  4994 mini_oidc.cc:186] Starting OIDC Discovery server
08:09:19.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:19.583866  4994 webserver.cc:533] Webserver started at http://127.0.0.1:46099/ using document root <none> and password file <none>
08:09:19.616 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:19.631 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:19.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:09:19Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
08:09:19.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:09:19Z Disabled control of system clock
08:09:19.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:19.662307  4994 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:09:19.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:09:19.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-0/wal
08:09:19.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-0/data
08:09:19.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-0/logs
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-0/data/info.pb
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.224.190:36787
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.224.190
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.224.148:40383
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.224.190:36787,127.4.224.189:45505,127.4.224.188:40437
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:09:19.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43831/jwks.json with env {}
08:09:19.802 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:19.802 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:19.803 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:19.803 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:19.803 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:19.803 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:19.803 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:19.803 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:19.803 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:19.803 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:19.803 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:19.804 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:19.804 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:19.812 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:19.813 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:19.813 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:19.813 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:19.813 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:19.813 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:19.813 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:19.813 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:19.813 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:19.813 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:19.813 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:19.813 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:19.814 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:19.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:19.871 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:19.871 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:19.871 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:19.871 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:19.871 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:19.871 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:19.872 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:19.872 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:19.872 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:19.872 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:19.872 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:19.872 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:19.872 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:19.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091759908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:19.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:19.918 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
08:09:19.918 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
08:09:19.966 [DEBUG - pool-388-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30012), Traces: [0ms] sending RPC to server master-127.1.134.252:42093, [28ms] received response from server master-127.1.134.252:42093: OK, deferred=null) with no deferred attached!
08:09:20.014 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:20.014 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:20.014 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:20.015 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:20.015 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:20.016 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:20.016 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:20.016 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:20.016 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:20.016 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:20.017 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:20.017 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:20.017 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:20.066 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:20.066 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:20.066 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:20.066 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:20.067 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:20.067 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:20.066 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:20.066 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:20.067 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:20.067 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:20.067 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:20.067 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:20.067 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:20.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:20.068991  5006 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:09:20.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:20.069892  5006 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:09:20.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:20.070593  5006 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:09:20.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:20.089078  4984 heartbeater.cc:499] Master 127.4.9.124:41733 was elected leader, sending a full tablet report...
08:09:20.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:20.114226  5006 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:09:20.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:20.114656  5006 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:09:20.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:20.115059  5006 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:09:20.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:20.115437  5006 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:09:20.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:20.115756  5006 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:09:20.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:20.116014  5006 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:43831/jwks.json
08:09:20.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:20.131 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:20.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:20.164162  5006 master_runner.cc:387] Master server non-default flags:
08:09:20.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:09:20.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.224.148:40383
08:09:20.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:09:20.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:09:20.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-0/data
08:09:20.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-0/wal
08:09:20.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:09:20.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.224.190:36787,127.4.224.189:45505,127.4.224.188:40437
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.224.190:36787
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43831/jwks.json
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-0/data/info.pb
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.224.190
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-0/logs
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:09:20.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:09:20.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:09:20.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:09:20.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:09:20.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:20.166333  5006 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:09:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:20.168603  5006 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:09:20.178 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:20.178 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:20.179 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:20.179 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:20.179 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:20.179 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:20.179 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:20.179 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:20.179 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:20.179 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:20.179 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:20.179 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:20.179 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:20.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:20.183233  5012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:20.199 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job b42812d69c586178cf7556c3c92998f3 from Checkpoint 65 @ 1779091487380 for b42812d69c586178cf7556c3c92998f3 located at file:/tmp/junit1738461414297871817/checkpoints/b42812d69c586178cf7556c3c92998f3/chk-65.
08:09:20.200 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
08:09:20.201 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_8) switched from CREATED to SCHEDULED.
08:09:20.202 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 3 to checkpoint 65 for source Source: KuduSource to checkpoint.
08:09:20.202 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:09:20.204 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_8) switched from SCHEDULED to DEPLOYING.
08:09:20.204 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #8) with attempt id 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_8 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1) with allocation id 2f9a5ebd231a465571d2109e36591407
08:09:20.204 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (b42812d69c586178cf7556c3c92998f3) switched from state RESTARTING to RUNNING.
08:09:20.205 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 2f9a5ebd231a465571d2109e36591407.
08:09:20.206 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#8 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_8), deploy into slot with allocation id 2f9a5ebd231a465571d2109e36591407.
08:09:20.208 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job b42812d69c586178cf7556c3c92998f3 from Checkpoint 65 @ 1779091487380 for b42812d69c586178cf7556c3c92998f3 located at file:/tmp/junit1738461414297871817/checkpoints/b42812d69c586178cf7556c3c92998f3/chk-65.
08:09:20.210 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#8 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_8) switched from CREATED to DEPLOYING.
08:09:20.210 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
08:09:20.210 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 0 to checkpoint 65 for source Source: KuduSource to checkpoint.
08:09:20.210 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#8 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_8) [DEPLOYING].
08:09:20.210 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_8) switched from CREATED to SCHEDULED.
08:09:20.211 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:09:20.212 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_8) switched from SCHEDULED to DEPLOYING.
08:09:20.212 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #8) with attempt id 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_8 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1) with allocation id 4c78869737ef27e21dadfe7d1a23010d
08:09:20.212 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@38774cc8
08:09:20.212 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:20.212 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 4c78869737ef27e21dadfe7d1a23010d.
08:09:20.212 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit1738461414297871817/checkpoints")
08:09:20.213 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#8 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_8) switched from DEPLOYING to INITIALIZING.
08:09:20.213 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#8 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_8), deploy into slot with allocation id 4c78869737ef27e21dadfe7d1a23010d.
08:09:20.213 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_8) switched from DEPLOYING to INITIALIZING.
08:09:20.219 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#8 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_8) switched from CREATED to DEPLOYING.
08:09:20.219 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#8 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_8) [DEPLOYING].
08:09:20.220 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4331d563
08:09:20.220 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:20.220 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3eaa0a07
08:09:20.220 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit1738461414297871817/checkpoints")
08:09:20.220 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#8 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_8) switched from DEPLOYING to INITIALIZING.
08:09:20.220 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_8) switched from DEPLOYING to INITIALIZING.
08:09:20.226 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:20.227 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1cad685b
08:09:20.229 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#8] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:20.230 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#8] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:20.231 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.232 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.233 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.233 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#8] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:20.233 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:20.234 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.234 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.234 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.237 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.237 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#8] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:20.238 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.238 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.238 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:20.238 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#8] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:20.249 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:20.256 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.257 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.257 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.262 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#8] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:20.263 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.263 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.263 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.264 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:20.267 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:20.269 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.269 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.270 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.274 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.274 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.274 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.274 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:20.274 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.274 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.274 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.278 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:20.279 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.279 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.279 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.279 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:20.283 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:20.285 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.285 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.285 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.289 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:20.290 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:20.291 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.291 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.291 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.297 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.297 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.298 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.298 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:20.306 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:20.307 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:20.307 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:20.307 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:20.308 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:20.308 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:20.308 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:20.308 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:20.308 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:20.309 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:20.309 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:20.309 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:20.309 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:20.317 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:20.320 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:20.323 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.323 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.323 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.329 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:20.329 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.329 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.329 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.329 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.329 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.329 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.329 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:20.338 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:20.340 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.340 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.340 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.342 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:20.344 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:20.344 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:20.344 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:20.344 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:20.344 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:20.344 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:20.344 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:20.345 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:20.345 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:20.345 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:20.345 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:20.345 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:20.345 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:20.349 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:20.349 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.349 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.349 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.349 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:20.350 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:20.350 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.350 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.350 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.350 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:20.350 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.350 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.350 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.351 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.351 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.351 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.351 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:20.351 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:20.351 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:20.351 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:20.351 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:20.351 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:20.351 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:20.352 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:20.352 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:20.352 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:20.352 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:20.352 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:20.352 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:20.352 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:20.350 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.354 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.354 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.355 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:20.369 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:20.370 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:20.370 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:20.370 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.370 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.370 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.370 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.370 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.370 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.370 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.370 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.370 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.371 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:20.378 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:20.378 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:20.379 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:20.379 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.379 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.379 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.379 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.379 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.380 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.380 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.380 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.380 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.380 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:20.399 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:20.400 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:20.400 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:20.401 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.401 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.401 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.402 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.402 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.402 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.402 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.402 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.402 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.402 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:20.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091760408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:20.409 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:20.409 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:20.409 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:20.410 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.410 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.410 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.410 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.410 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.410 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:20.410 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.410 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.410 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.410 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.410 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:20.420 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
08:09:20.421 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
08:09:20.431 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:20.431 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:20.431 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:20.432 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:20.432 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:20.432 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:20.432 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:20.432 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:20.432 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:20.432 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:20.432 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:20.432 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:20.432 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:20.437 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:20.438 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:20.438 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:20.438 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.439 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.439 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.439 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.439 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.439 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.439 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.440 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.440 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.440 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:20.469 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:20.469 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:20.469 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:20.470 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.470 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.470 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.470 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.470 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.470 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.471 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.471 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.471 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.471 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:20.478 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:20.478 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:20.478 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:20.479 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.479 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.479 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.479 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.479 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.479 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.480 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.480 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.480 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.480 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:20.490 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:20.491 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:20.491 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:20.491 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:20.491 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:20.492 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:20.491 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:20.491 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:20.492 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:20.492 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:20.492 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:20.493 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:20.493 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:20.509 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:20.509 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:20.510 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:20.510 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.510 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.511 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.511 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.511 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.511 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.512 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.512 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.512 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.512 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:20.538 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:20.538 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:20.538 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:20.538 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.538 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.539 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.539 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.539 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.539 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.539 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.539 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.539 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.539 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:20.552 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:20.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:20.631 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:20.710 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:20.710 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:20.710 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:20.711 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.711 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.711 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.712 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.712 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.713 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.713 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.713 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.713 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.718 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:20.718 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:20.718 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:20.719 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.719 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.719 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:20.719 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.719 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.719 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:20.720 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.720 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.720 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:20.720 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:20.723 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:20.834 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:20.834 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:20.834 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:20.837 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:20.837 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:20.837 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:20.838 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:20.838 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:20.838 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:20.838 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:20.838 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:20.839 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:20.839 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:20.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:20.909 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:20.910 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091760908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:20.923 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
08:09:20.925 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
08:09:20.996 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:20.996 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:20.997 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:20.998 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:20.998 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:20.998 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:20.999 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:20.999 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:20.999 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:20.999 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:20.999 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:20.999 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:20.999 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:21.039 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:21.039 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:21.039 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:21.040 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:21.040 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:21.040 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:21.040 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:21.041 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:21.041 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:21.041 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:21.041 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:21.041 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:21.041 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:21.048 [DEBUG - pool-390-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30014), Traces: [0ms] sending RPC to server master-127.2.90.188:42457, [11ms] received response from server master-127.2.90.188:42457: OK, deferred=null) with no deferred attached!
08:09:21.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:21.077 [DEBUG - pool-394-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30012), Traces: [0ms] sending RPC to server master-127.2.90.188:42457, [20ms] received response from server master-127.2.90.188:42457: OK, deferred=null) with no deferred attached!
08:09:21.107 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:21.108 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:21.108 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:21.109 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:21.109 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:21.110 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:21.111 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:21.111 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:21.111 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:21.111 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:21.112 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:21.112 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:21.112 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:21.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:21.130 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:21.130 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:21.130 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:21.131 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:21.131 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:21.131 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:21.132 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:21.132 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:21.132 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:21.133 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:21.133 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:21.133 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:21.133 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:21.134 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:21.251 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:21.251 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:21.251 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:21.252 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:21.252 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:21.252 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:21.252 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:21.253 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:21.253 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:21.253 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:21.253 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:21.253 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:21.253 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:21.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:21.401 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:21.401 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:21.401 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:21.402 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:21.402 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:21.403 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:21.403 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:21.403 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:21.404 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:21.404 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:21.404 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:21.404 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:21.404 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:21.409 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:21.410 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091761408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:21.410 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:21.410 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:21.411 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:21.411 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:21.411 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:21.411 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:21.412 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:21.412 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:21.412 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:21.413 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:21.413 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:21.413 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:21.413 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:21.420 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:09:21.421 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
08:09:21.462 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:21.462 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:21.463 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:21.464 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:21.464 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:21.464 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:21.464 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:21.464 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:21.465 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:21.465 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:21.466 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:21.466 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:21.466 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:21.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:21.602 [DEBUG - pool-396-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30013), Traces: [0ms] sending RPC to server master-127.2.90.188:42457, [10ms] received response from server master-127.2.90.188:42457: OK, deferred=null) with no deferred attached!
08:09:21.602 [DEBUG - pool-396-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30011), Traces: [0ms] sending RPC to server master-127.2.90.188:42457, [17ms] received response from server master-127.2.90.188:42457: OK, deferred=null) with no deferred attached!
08:09:21.602 [DEBUG - pool-396-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30010), Traces: [0ms] sending RPC to server master-127.2.90.188:42457, [12ms] received response from server master-127.2.90.188:42457: OK, deferred=null) with no deferred attached!
08:09:21.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:21.631 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:21.639 [DEBUG - pool-392-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30017), Traces: [0ms] sending RPC to server master-127.2.90.188:42457, [11ms] received response from server master-127.2.90.188:42457: OK, deferred=null) with no deferred attached!
08:09:21.639 [DEBUG - pool-392-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30017), Traces: [0ms] sending RPC to server master-127.2.90.188:42457, [9ms] received response from server master-127.2.90.188:42457: OK, deferred=null) with no deferred attached!
08:09:21.750 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:21.751 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:21.751 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:21.751 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:21.751 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:21.751 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:21.751 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:21.751 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:21.752 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:21.752 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:21.752 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:21.752 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:21.752 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:21.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:21.803701  4980 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad140 after lost signal to thread 4856
08:09:21.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:21.805050  4980 debug-util.cc:398] Leaking SignalData structure 0x7b08000b3640 after lost signal to thread 4983
08:09:21.820 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:21.820 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:21.820 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:21.821 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:21.821 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:21.821 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:21.822 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:21.822 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:21.822 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:21.823 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:21.823 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:21.823 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:21.823 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:21.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:21.849 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:21.850 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:21.850 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:21.850 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:21.850 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:21.850 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:21.851 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:21.851 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:21.851 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:21.851 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:21.851 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:21.851 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:21.851 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:21.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091761908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:21.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:21.920 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
08:09:21.921 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
08:09:22.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:22.079 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:22.079 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:22.079 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:22.079 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:22.079 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:22.079 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:22.080 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:22.080 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:22.080 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:22.080 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:22.080 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:22.080 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:22.080 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:22.119 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:22.130 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:22.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:21.588769  5011 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 5006
08:09:22.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:22.134887  5011 kernel_stack_watchdog.cc:198] Thread 5006 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 400ms:
08:09:22.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:09:22.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:09:22.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:09:22.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:09:22.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:20.183748  5013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:22.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:22.135066  5006 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.951s	user 0.676s	sys 1.104s
08:09:22.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:22.136878  5006 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.953s	user 0.677s	sys 1.104s
08:09:22.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:22.138275  5015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:22.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:22.142202  5014 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1952 milliseconds
08:09:22.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.142297  5006 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:09:22.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.144088  5006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:09:22.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.147701  5006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:09:22.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.149226  5006 hybrid_clock.cc:648] HybridClock initialized: now 1779091762149056 us; error 150 us; skew 500 ppm
08:09:22.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.150339  5006 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:09:22.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.158242  5006 webserver.cc:533] Webserver started at http://127.4.224.190:33301/ using document root <none> and password file <none>
08:09:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.159523  5006 fs_manager.cc:362] Metadata directory not provided
08:09:22.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.159864  5006 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:09:22.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.160421  5006 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:09:22.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.166082  5006 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-0/data/instance:
08:09:22.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1b5e3c2d43314e728701a7bfa1344ed5"
08:09:22.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:22 on dist-test-slave-1jss"
08:09:22.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.167552  5006 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-0/wal/instance:
08:09:22.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1b5e3c2d43314e728701a7bfa1344ed5"
08:09:22.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:22 on dist-test-slave-1jss"
08:09:22.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.177686  5006 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.009s	sys 0.001s
08:09:22.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.186885  5046 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:09:22.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.188632  5006 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.002s
08:09:22.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.189085  5006 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-0/wal
08:09:22.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1b5e3c2d43314e728701a7bfa1344ed5"
08:09:22.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:22 on dist-test-slave-1jss"
08:09:22.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.189472  5006 fs_report.cc:389] FS layout report
08:09:22.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:09:22.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-0/wal
08:09:22.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-0/wal
08:09:22.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-0/data/data
08:09:22.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:09:22.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:09:22.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:09:22.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:09:22.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:09:22.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:09:22.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:09:22.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:09:22.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:09:22.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:09:22.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:09:22.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.248451  5006 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:09:22.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.250623  5006 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:09:22.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.251302  5006 kserver.cc:163] Server-wide thread pool size limit: 3276
08:09:22.284 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:22.284 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:22.285 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:22.286 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:22.286 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:22.286 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:22.286 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:22.286 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:22.286 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:22.286 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:22.286 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:22.286 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:22.286 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:22.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:22.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.382731  5006 rpc_server.cc:307] RPC server started. Bound to: 127.4.224.190:36787
08:09:22.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.383565  5097 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.224.190:36787 every 8 connection(s)
08:09:22.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.386917  5006 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-0/data/info.pb
08:09:22.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.396176  4994 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 5006
08:09:22.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.396894  4994 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-0/wal/instance
08:09:22.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091762408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:22.410 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:22.423 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
08:09:22.424 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
08:09:22.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.427170  4994 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:09:22.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:09:22.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-1/wal
08:09:22.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-1/data
08:09:22.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:09:22.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:09:22.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:09:22.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:09:22.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:09:22.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:09:22.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-1/logs
08:09:22.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-1/data/info.pb
08:09:22.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:09:22.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:09:22.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:09:22.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:09:22.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:09:22.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:09:22.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:09:22.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:09:22.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:09:22.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:09:22.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:09:22.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:09:22.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.224.189:45505
08:09:22.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.224.189
08:09:22.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:09:22.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.224.148:40383
08:09:22.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:09:22.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:09:22.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:09:22.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:09:22.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.224.190:36787,127.4.224.189:45505,127.4.224.188:40437
08:09:22.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:09:22.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43831/jwks.json with env {}
08:09:22.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.437767  5098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:09:22.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.462432  5098 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.224.190" port: 36787 } has no permanent_uuid. Determining permanent_uuid...
08:09:22.513 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:22.513 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:22.513 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:22.514 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:22.514 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:22.514 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:22.514 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:22.514 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:22.514 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:22.515 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:22.515 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:22.515 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:22.515 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:22.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.528740  5098 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } has no permanent_uuid. Determining permanent_uuid...
08:09:22.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:22.532536  5050 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.224.189:45505: connect: Connection refused (error 111)
08:09:22.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:22.545142  5098 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.224.189:45505: Network error: Client connection negotiation failed: client connection to 127.4.224.189:45505: connect: Connection refused (error 111)
08:09:22.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:22.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.594820  5098 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } attempt: 1
08:09:22.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:22.601276  5098 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.224.189:45505: Network error: Client connection negotiation failed: client connection to 127.4.224.189:45505: connect: Connection refused (error 111)
08:09:22.616 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:22.631 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:22.670 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:22.670 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:22.670 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:22.671 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:22.671 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:22.671 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:22.672 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:22.672 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:22.672 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:22.672 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:22.673 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:22.673 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:22.673 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:22.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.669813  5098 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } attempt: 2
08:09:22.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:22.676388  5098 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.224.189:45505: Network error: Client connection negotiation failed: client connection to 127.4.224.189:45505: connect: Connection refused (error 111)
08:09:22.731 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:22.731 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:22.731 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:22.731 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:22.731 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:22.731 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:22.732 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:22.732 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:22.732 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:22.732 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:22.731 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:22.733 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:22.734 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:22.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.767904  5098 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } attempt: 3
08:09:22.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:22.773948  5098 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.224.189:45505: Network error: Client connection negotiation failed: client connection to 127.4.224.189:45505: connect: Connection refused (error 111)
08:09:22.832 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:22.832 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:22.832 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:22.833 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:22.833 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:22.833 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:22.833 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:22.833 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:22.833 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:22.834 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:22.834 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:22.834 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:22.834 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:22.843 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:22.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091762908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:22.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:22.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:22.917459  5098 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } attempt: 4
08:09:22.921 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
08:09:22.922 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
08:09:22.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:22.923890  5098 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.224.189:45505: Network error: Client connection negotiation failed: client connection to 127.4.224.189:45505: connect: Connection refused (error 111)
08:09:22.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:22.924527  5100 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:09:22.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:22.925364  5100 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:09:22.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:22.926141  5100 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:09:22.930 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:22.930 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:22.930 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:22.931 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:22.931 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:22.931 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:22.931 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:22.931 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:22.931 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:22.931 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:22.932 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:22.932 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:22.932 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:22.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:22.973471  5100 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:09:22.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:22.974025  5100 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:09:22.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:22.974550  5100 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:09:22.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:22.974984  5100 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:09:22.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:22.975333  5100 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:09:22.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:22.975510  5100 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:43831/jwks.json
08:09:22.987 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:22.988 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:22.988 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:22.988 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:22.988 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:22.988 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:22.988 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:22.988 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:22.989 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:22.989 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:22.989 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:22.988 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:22.990 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:23.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:23.027283  5100 master_runner.cc:387] Master server non-default flags:
08:09:23.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:09:23.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.224.148:40383
08:09:23.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:09:23.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:09:23.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-1/data
08:09:23.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-1/wal
08:09:23.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:09:23.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.224.190:36787,127.4.224.189:45505,127.4.224.188:40437
08:09:23.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:09:23.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:09:23.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:09:23.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.224.189:45505
08:09:23.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:09:23.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:09:23.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:09:23.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43831/jwks.json
08:09:23.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:09:23.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:09:23.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-1/data/info.pb
08:09:23.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.224.189
08:09:23.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:09:23.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:09:23.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:09:23.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:09:23.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:09:23.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:09:23.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-1/logs
08:09:23.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:09:23.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:09:23.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:09:23.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:09:23.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:09:23.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:09:23.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:09:23.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:09:23.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:09:23.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:09:23.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:23.029495  5100 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:09:23.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:23.032157  5100 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:09:23.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:23.047574  5110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:23.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:23.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:23.131 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:23.131 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:23.131 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:23.132 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:23.132 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:23.132 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:23.133 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:23.133 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:23.133 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:23.134 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:23.134 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:23.133 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:23.134 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:23.134 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:23.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:23.223378  5098 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } attempt: 5
08:09:23.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:23.234804  5098 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.224.189:45505: Network error: Client connection negotiation failed: client connection to 127.4.224.189:45505: connect: Connection refused (error 111)
08:09:23.274 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:23.274 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:23.274 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:23.275 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:23.275 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:23.275 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:23.276 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:23.276 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:23.276 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:23.276 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:23.276 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:23.276 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:23.276 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:23.297 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:23.298 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:23.298 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:23.298 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:23.298 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:23.299 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:23.300 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:23.300 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:23.300 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:23.300 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:23.300 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:23.300 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:23.300 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:23.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:23.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 66 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091763408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:23.412 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:23.427 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 66 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
08:09:23.428 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 66 as completed for source Source: KuduSource.
08:09:23.494 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:23.494 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:23.494 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:23.495 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:23.495 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:23.495 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:23.496 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:23.496 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:23.496 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:23.496 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:23.496 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:23.496 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:23.497 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:23.506 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:23.507 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:23.507 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:23.507 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:23.507 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:23.507 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:23.507 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:23.507 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:23.507 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:23.508 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:23.508 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:23.508 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:23.508 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:23.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:23.569 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:23.569 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:23.569 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:23.570 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:23.570 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:23.570 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:23.571 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:23.571 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:23.571 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:23.571 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:23.571 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:23.571 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:23.571 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:23.575 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:23.575 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:23.575 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:23.575 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:23.575 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:23.576 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:23.576 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:23.576 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:23.576 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:23.577 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:23.577 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:23.577 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:23.577 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:23.579 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:23.579 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:23.579 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:23.579 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:23.579 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:23.580 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:23.581 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:23.581 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:23.581 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:23.581 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:23.581 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:23.581 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:23.581 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:23.591 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:23.591 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:23.591 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:23.592 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:23.592 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:23.592 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:23.592 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:23.592 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:23.592 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:23.592 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:23.592 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:23.593 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:23.593 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:23.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:23.631 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:23.719 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:23.720 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:23.720 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:23.720 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:23.720 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:23.721 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:23.721 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:23.721 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:23.721 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:23.721 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:23.721 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:23.721 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:23.722 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:23.742 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:23.742 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:23.742 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:23.743 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:23.743 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:23.743 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:23.743 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:23.743 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:23.743 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:23.744 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:23.744 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:23.744 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:23.744 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:23.745 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=27199), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [326ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [328ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [335ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [336ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [342ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [344ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [376ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [378ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [383ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [388ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [388ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [408ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [411ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [412ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [413ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [413ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [413ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [422ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [422ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [422ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [423ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [442ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [443ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [443ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [443ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [482ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [482ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [483ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [483ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [540ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [542ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [542ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [543ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [543ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [682ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [683ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [683ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [683ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [940ms] refreshing cache from master, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [941ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [942ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [942ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [943ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1181ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [1184ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1184ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1309ms] refreshing cache from master, [1309ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [1309ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [1309ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [1310ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [1310ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [1310ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1317ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [1861ms] refreshing cache from master, [1861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [1861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [1862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [1863ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [1863ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [1864ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1864ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [3981ms] refreshing cache from master, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [3982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [3982ms] too many traces: truncated at 100 traces, deferred=Deferred@22381086(state=PENDING, result=null, callback=(continuation of Deferred@1782557991 after retry RPC after error@1020472746) -> (continuation of Deferred@1024081915 after retry RPC after error@283254582) -> (continuation of Deferred@128179864 after retry RPC after error@574102971) -> (continuation of Deferred@1310788576 after retry RPC after error@1312466621) -> (continuation of Deferred@1467283196 after retry RPC after error@893647980) -> (continuation of Deferred@1945866031 after retry RPC after error@1760546979) -> (continuation of Deferred@408688724 after retry RPC after error@852899759) -> (continuation of Deferred@494621741 after retry RPC after error@193455593) -> (continuation of Deferred@1935786613 after retry RPC after error@1879697657) -> (continuation of Deferred@932446441 after retry RPC after error@50856799) -> (continuation of Deferred@2114394913 after retry RPC after error@1098283576) -> (continuation of Deferred@1450355127 after retry RPC after error@354638557) -> (continuation of Deferred@1404798283 after retry RPC after error@569279166) -> (continuation of Deferred@1653778469 after retry RPC after error@1843979032) -> (continuation of Deferred@1651946035 after retry RPC after error@936912817) -> (continuation of Deferred@1090282223 after retry RPC after error@1789311435) -> (continuation of Deferred@1024878982 after retry RPC after error@1267020858) -> (continuation of Deferred@1758321855 after retry RPC after error@930764940) -> (continuation of Deferred@959335868 after retry RPC after error@1541970503) -> (continuation of Deferred@1573297569 after retry RPC after error@941428909), errback=(continuation of Deferred@1782557991 after retry RPC after error@1020472746) -> (continuation of Deferred@1024081915 after retry RPC after error@283254582) -> (continuation of Deferred@128179864 after retry RPC after error@574102971) -> (continuation of Deferred@1310788576 after retry RPC after error@1312466621) -> (continuation of Deferred@1467283196 after retry RPC after error@893647980) -> (continuation of Deferred@1945866031 after retry RPC after error@1760546979) -> (continuation of Deferred@408688724 after retry RPC after error@852899759) -> (continuation of Deferred@494621741 after retry RPC after error@193455593) -> (continuation of Deferred@1935786613 after retry RPC after error@1879697657) -> (continuation of Deferred@932446441 after retry RPC after error@50856799) -> (continuation of Deferred@2114394913 after retry RPC after error@1098283576) -> (continuation of Deferred@1450355127 after retry RPC after error@354638557) -> (continuation of Deferred@1404798283 after retry RPC after error@569279166) -> (continuation of Deferred@1653778469 after retry RPC after error@1843979032) -> (continuation of Deferred@1651946035 after retry RPC after error@936912817) -> (continuation of Deferred@1090282223 after retry RPC after error@1789311435) -> (continuation of Deferred@1024878982 after retry RPC after error@1267020858) -> (continuation of Deferred@1758321855 after retry RPC after error@930764940) -> (continuation of Deferred@959335868 after retry RPC after error@1541970503) -> (continuation of Deferred@1573297569 after retry RPC after error@941428909)))
08:09:23.748 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
08:09:23.748 [WARN - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=27199), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [326ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [328ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [335ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [336ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [342ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [344ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [376ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [378ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [383ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [388ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [388ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [408ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [411ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [412ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [413ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [413ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [413ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [422ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [422ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [422ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [423ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [442ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [443ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [443ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [443ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [482ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [482ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [483ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [483ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [540ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [542ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [542ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [543ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [543ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [682ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [683ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [683ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [683ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [940ms] refreshing cache from master, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [941ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [942ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [942ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [943ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1181ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [1184ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1184ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1309ms] refreshing cache from master, [1309ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [1309ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [1309ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [1310ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [1310ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [1310ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1317ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [1861ms] refreshing cache from master, [1861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [1861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [1862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [1863ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [1863ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [1864ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1864ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [3981ms] refreshing cache from master, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [3982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [3982ms] too many traces: truncated at 100 traces, deferred=Deferred@22381086(state=PENDING, result=null, callback=(continuation of Deferred@1782557991 after retry RPC after error@1020472746) -> (continuation of Deferred@1024081915 after retry RPC after error@283254582) -> (continuation of Deferred@128179864 after retry RPC after error@574102971) -> (continuation of Deferred@1310788576 after retry RPC after error@1312466621) -> (continuation of Deferred@1467283196 after retry RPC after error@893647980) -> (continuation of Deferred@1945866031 after retry RPC after error@1760546979) -> (continuation of Deferred@408688724 after retry RPC after error@852899759) -> (continuation of Deferred@494621741 after retry RPC after error@193455593) -> (continuation of Deferred@1935786613 after retry RPC after error@1879697657) -> (continuation of Deferred@932446441 after retry RPC after error@50856799) -> (continuation of Deferred@2114394913 after retry RPC after error@1098283576) -> (continuation of Deferred@1450355127 after retry RPC after error@354638557) -> (continuation of Deferred@1404798283 after retry RPC after error@569279166) -> (continuation of Deferred@1653778469 after retry RPC after error@1843979032) -> (continuation of Deferred@1651946035 after retry RPC after error@936912817) -> (continuation of Deferred@1090282223 after retry RPC after error@1789311435) -> (continuation of Deferred@1024878982 after retry RPC after error@1267020858) -> (continuation of Deferred@1758321855 after retry RPC after error@930764940) -> (continuation of Deferred@959335868 after retry RPC after error@1541970503) -> (continuation of Deferred@1573297569 after retry RPC after error@941428909), errback=(continuation of Deferred@1782557991 after retry RPC after error@1020472746) -> (continuation of Deferred@1024081915 after retry RPC after error@283254582) -> (continuation of Deferred@128179864 after retry RPC after error@574102971) -> (continuation of Deferred@1310788576 after retry RPC after error@1312466621) -> (continuation of Deferred@1467283196 after retry RPC after error@893647980) -> (continuation of Deferred@1945866031 after retry RPC after error@1760546979) -> (continuation of Deferred@408688724 after retry RPC after error@852899759) -> (continuation of Deferred@494621741 after retry RPC after error@193455593) -> (continuation of Deferred@1935786613 after retry RPC after error@1879697657) -> (continuation of Deferred@932446441 after retry RPC after error@50856799) -> (continuation of Deferred@2114394913 after retry RPC after error@1098283576) -> (continuation of Deferred@1450355127 after retry RPC after error@354638557) -> (continuation of Deferred@1404798283 after retry RPC after error@569279166) -> (continuation of Deferred@1653778469 after retry RPC after error@1843979032) -> (continuation of Deferred@1651946035 after retry RPC after error@936912817) -> (continuation of Deferred@1090282223 after retry RPC after error@1789311435) -> (continuation of Deferred@1024878982 after retry RPC after error@1267020858) -> (continuation of Deferred@1758321855 after retry RPC after error@930764940) -> (continuation of Deferred@959335868 after retry RPC after error@1541970503) -> (continuation of Deferred@1573297569 after retry RPC after error@941428909)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.31.233.252:36101
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:23.753 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
08:09:23.756 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#2 baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_2.
08:09:23.758 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to FAILED on c1befdc5-4ac6-48c0-985f-201fc5cdc5a6 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=27199), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [326ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [328ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [335ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [336ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [342ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [344ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [376ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [378ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [383ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [388ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [388ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [408ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [411ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [412ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [413ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [413ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [413ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [422ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [422ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [422ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [423ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [442ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [443ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [443ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [443ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [482ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [482ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [483ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [483ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [540ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [542ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [542ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [543ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [543ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [682ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [683ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [683ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [683ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [940ms] refreshing cache from master, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [941ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [942ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [942ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [943ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1181ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [1184ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1184ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1309ms] refreshing cache from master, [1309ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [1309ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [1309ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [1310ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [1310ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [1310ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1317ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [1861ms] refreshing cache from master, [1861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [1861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [1862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [1863ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [1863ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [1864ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1864ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [3981ms] refreshing cache from master, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [3981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [3982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [3982ms] too many traces: truncated at 100 traces, deferred=Deferred@22381086(state=PENDING, result=null, callback=(continuation of Deferred@1782557991 after retry RPC after error@1020472746) -> (continuation of Deferred@1024081915 after retry RPC after error@283254582) -> (continuation of Deferred@128179864 after retry RPC after error@574102971) -> (continuation of Deferred@1310788576 after retry RPC after error@1312466621) -> (continuation of Deferred@1467283196 after retry RPC after error@893647980) -> (continuation of Deferred@1945866031 after retry RPC after error@1760546979) -> (continuation of Deferred@408688724 after retry RPC after error@852899759) -> (continuation of Deferred@494621741 after retry RPC after error@193455593) -> (continuation of Deferred@1935786613 after retry RPC after error@1879697657) -> (continuation of Deferred@932446441 after retry RPC after error@50856799) -> (continuation of Deferred@2114394913 after retry RPC after error@1098283576) -> (continuation of Deferred@1450355127 after retry RPC after error@354638557) -> (continuation of Deferred@1404798283 after retry RPC after error@569279166) -> (continuation of Deferred@1653778469 after retry RPC after error@1843979032) -> (continuation of Deferred@1651946035 after retry RPC after error@936912817) -> (continuation of Deferred@1090282223 after retry RPC after error@1789311435) -> (continuation of Deferred@1024878982 after retry RPC after error@1267020858) -> (continuation of Deferred@1758321855 after retry RPC after error@930764940) -> (continuation of Deferred@959335868 after retry RPC after error@1541970503) -> (continuation of Deferred@1573297569 after retry RPC after error@941428909), errback=(continuation of Deferred@1782557991 after retry RPC after error@1020472746) -> (continuation of Deferred@1024081915 after retry RPC after error@283254582) -> (continuation of Deferred@128179864 after retry RPC after error@574102971) -> (continuation of Deferred@1310788576 after retry RPC after error@1312466621) -> (continuation of Deferred@1467283196 after retry RPC after error@893647980) -> (continuation of Deferred@1945866031 after retry RPC after error@1760546979) -> (continuation of Deferred@408688724 after retry RPC after error@852899759) -> (continuation of Deferred@494621741 after retry RPC after error@193455593) -> (continuation of Deferred@1935786613 after retry RPC after error@1879697657) -> (continuation of Deferred@932446441 after retry RPC after error@50856799) -> (continuation of Deferred@2114394913 after retry RPC after error@1098283576) -> (continuation of Deferred@1450355127 after retry RPC after error@354638557) -> (continuation of Deferred@1404798283 after retry RPC after error@569279166) -> (continuation of Deferred@1653778469 after retry RPC after error@1843979032) -> (continuation of Deferred@1651946035 after retry RPC after error@936912817) -> (continuation of Deferred@1090282223 after retry RPC after error@1789311435) -> (continuation of Deferred@1024878982 after retry RPC after error@1267020858) -> (continuation of Deferred@1758321855 after retry RPC after error@930764940) -> (continuation of Deferred@959335868 after retry RPC after error@1541970503) -> (continuation of Deferred@1573297569 after retry RPC after error@941428909)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.31.233.252:36101
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:23.764 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job da74ffd3de6ba1563e412fcb34de5c51: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:09:23.765 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#2) of source Source: KuduSource.
08:09:23.766 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_2.
08:09:23.766 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (da74ffd3de6ba1563e412fcb34de5c51) switched from state RUNNING to RESTARTING.
08:09:23.767 [WARN - flink-pekko.actor.default-dispatcher-8] (TaskManagerLocation.java:276) No hostname could be resolved for the IP address 127.0.0.1, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted.
08:09:23.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:23.782418  5098 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } attempt: 6
08:09:23.807 [DEBUG - pool-388-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30009), Traces: [0ms] sending RPC to server master-127.1.134.252:42093, [5ms] received response from server master-127.1.134.252:42093: OK, deferred=null) with no deferred attached!
08:09:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:23.807191  5098 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.224.189:45505: Network error: Client connection negotiation failed: client connection to 127.4.224.189:45505: connect: Connection refused (error 111)
08:09:23.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 67 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091763908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:23.911 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:23.922 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 67 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
08:09:23.924 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 67 as completed for source Source: KuduSource.
08:09:23.954 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:23.955 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:23.955 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:23.955 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:23.955 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:23.955 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:23.956 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:23.956 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:23.956 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:23.956 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:23.956 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:23.956 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:23.956 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:24.034 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:24.035 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:24.035 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:24.036 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:24.036 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:24.036 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:24.036 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:24.036 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:24.036 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:24.037 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:24.037 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:24.037 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:24.037 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:24.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:24.058 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:24.058 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:24.058 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:24.058 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:24.058 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:24.058 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:24.059 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:24.059 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:24.059 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:24.059 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:24.059 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:24.059 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:24.059 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:24.059 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:24.060 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:24.060 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:24.060 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:24.061 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:24.061 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:24.061 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:24.061 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:24.061 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:24.061 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:24.061 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:24.061 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:24.061 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:24.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:24.131 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:24.263 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:24.264 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:24.264 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:24.264 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:24.265 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:24.265 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:24.265 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:24.265 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:24.265 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:24.264 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:24.265 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:24.265 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:24.265 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:24.335 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:24.335 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:24.335 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:24.336 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:24.336 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:24.337 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:24.337 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:24.337 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:24.337 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:24.338 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:24.338 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:24.338 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:24.338 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:24.389 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:24.390 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:24.390 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:24.390 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.390 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.391 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.391 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.391 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.391 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.391 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.391 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.391 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.391 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:24.392 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27885), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [65ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [86ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [91ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [91ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [166ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [167ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [168ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [171ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [171ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [253ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [253ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [259ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [259ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [259ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [281ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [282ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [282ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [283ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [302ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [302ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [302ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [302ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [322ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [322ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [322ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [322ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [382ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [382ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [383ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [383ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [522ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [522ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [523ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [523ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [722ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [722ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [723ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [723ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [860ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [863ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [863ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [863ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [863ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [1703ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [1703ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1704ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1704ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [2363ms] refreshing cache from master, [2363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [2363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [2363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [2364ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [2365ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [2366ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [2366ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [5580ms] refreshing cache from master, [5580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [5581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [5581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [5582ms] too many traces: truncated at 100 traces, deferred=Deferred@1802194565(state=PENDING, result=null, callback=(continuation of Deferred@289552456 after retry RPC after error@1228096051) -> (continuation of Deferred@1799566118 after retry RPC after error@1517115309) -> (continuation of Deferred@1525527760 after retry RPC after error@152852324) -> (continuation of Deferred@2067042146 after retry RPC after error@1263828886) -> (continuation of Deferred@2091387160 after retry RPC after error@400869022) -> (continuation of Deferred@1223955615 after retry RPC after error@548698840) -> (continuation of Deferred@484984607 after retry RPC after error@755606058) -> (continuation of Deferred@1169234936 after retry RPC after error@1188092716) -> (continuation of Deferred@408857686 after retry RPC after error@2015778181) -> (continuation of Deferred@889585570 after retry RPC after error@1967938453) -> (continuation of Deferred@404579702 after retry RPC after error@1381859725) -> (continuation of Deferred@1212128395 after retry RPC after error@1597564650) -> (continuation of Deferred@746393262 after retry RPC after error@311604037) -> (continuation of Deferred@645774936 after retry RPC after error@1055527883) -> (continuation of Deferred@2049336006 after retry RPC after error@2099899996) -> (continuation of Deferred@921501919 after retry RPC after error@1492593026) -> (continuation of Deferred@286150664 after retry RPC after error@602343291) -> (continuation of Deferred@2110914592 after retry RPC after error@470322465) -> (continuation of Deferred@2145718456 after retry RPC after error@1688345824) -> (continuation of Deferred@161272660 after retry RPC after error@1369781955) -> (continuation of Deferred@110267551 after retry RPC after error@1914951089) -> (continuation of Deferred@499826386 after retry RPC after error@1705083014) -> (continuation of Deferred@2009403097 after retry RPC after error@463979469) -> (continuation of Deferred@1406390853 after retry RPC after error@975162633), errback=(continuation of Deferred@289552456 after retry RPC after error@1228096051) -> (continuation of Deferred@1799566118 after retry RPC after error@1517115309) -> (continuation of Deferred@1525527760 after retry RPC after error@152852324) -> (continuation of Deferred@2067042146 after retry RPC after error@1263828886) -> (continuation of Deferred@2091387160 after retry RPC after error@400869022) -> (continuation of Deferred@1223955615 after retry RPC after error@548698840) -> (continuation of Deferred@484984607 after retry RPC after error@755606058) -> (continuation of Deferred@1169234936 after retry RPC after error@1188092716) -> (continuation of Deferred@408857686 after retry RPC after error@2015778181) -> (continuation of Deferred@889585570 after retry RPC after error@1967938453) -> (continuation of Deferred@404579702 after retry RPC after error@1381859725) -> (continuation of Deferred@1212128395 after retry RPC after error@1597564650) -> (continuation of Deferred@746393262 after retry RPC after error@311604037) -> (continuation of Deferred@645774936 after retry RPC after error@1055527883) -> (continuation of Deferred@2049336006 after retry RPC after error@2099899996) -> (continuation of Deferred@921501919 after retry RPC after error@1492593026) -> (continuation of Deferred@286150664 after retry RPC after error@602343291) -> (continuation of Deferred@2110914592 after retry RPC after error@470322465) -> (continuation of Deferred@2145718456 after retry RPC after error@1688345824) -> (continuation of Deferred@161272660 after retry RPC after error@1369781955) -> (continuation of Deferred@110267551 after retry RPC after error@1914951089) -> (continuation of Deferred@499826386 after retry RPC after error@1705083014) -> (continuation of Deferred@2009403097 after retry RPC after error@463979469) -> (continuation of Deferred@1406390853 after retry RPC after error@975162633)))
08:09:24.394 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:24.394 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:24.394 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:24.394 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:24.394 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:24.394 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:24.394 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:24.394 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:24.394 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:24.394 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:24.394 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:24.394 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:24.394 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:24.395 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:24.395 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:24.395 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:24.395 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:24.396 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:24.396 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:24.396 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:24.396 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:24.396 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:24.396 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:24.396 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:24.396 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:24.396 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:24.396 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:24.396 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:24.396 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:24.396 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27885), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [65ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [86ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [91ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [91ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [166ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [167ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [168ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [171ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [171ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [253ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [253ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [259ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [259ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [259ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [281ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [282ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [282ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [283ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [302ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [302ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [302ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [302ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [322ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [322ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [322ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [322ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [382ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [382ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [383ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [383ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [522ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [522ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [523ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [523ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [722ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [722ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [723ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [723ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [860ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [863ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [863ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [863ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [863ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [1703ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [1703ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1704ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1704ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [2363ms] refreshing cache from master, [2363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [2363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [2363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [2364ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [2365ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [2366ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [2366ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [5580ms] refreshing cache from master, [5580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [5581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [5581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [5582ms] too many traces: truncated at 100 traces, deferred=Deferred@1802194565(state=PENDING, result=null, callback=(continuation of Deferred@289552456 after retry RPC after error@1228096051) -> (continuation of Deferred@1799566118 after retry RPC after error@1517115309) -> (continuation of Deferred@1525527760 after retry RPC after error@152852324) -> (continuation of Deferred@2067042146 after retry RPC after error@1263828886) -> (continuation of Deferred@2091387160 after retry RPC after error@400869022) -> (continuation of Deferred@1223955615 after retry RPC after error@548698840) -> (continuation of Deferred@484984607 after retry RPC after error@755606058) -> (continuation of Deferred@1169234936 after retry RPC after error@1188092716) -> (continuation of Deferred@408857686 after retry RPC after error@2015778181) -> (continuation of Deferred@889585570 after retry RPC after error@1967938453) -> (continuation of Deferred@404579702 after retry RPC after error@1381859725) -> (continuation of Deferred@1212128395 after retry RPC after error@1597564650) -> (continuation of Deferred@746393262 after retry RPC after error@311604037) -> (continuation of Deferred@645774936 after retry RPC after error@1055527883) -> (continuation of Deferred@2049336006 after retry RPC after error@2099899996) -> (continuation of Deferred@921501919 after retry RPC after error@1492593026) -> (continuation of Deferred@286150664 after retry RPC after error@602343291) -> (continuation of Deferred@2110914592 after retry RPC after error@470322465) -> (continuation of Deferred@2145718456 after retry RPC after error@1688345824) -> (continuation of Deferred@161272660 after retry RPC after error@1369781955) -> (continuation of Deferred@110267551 after retry RPC after error@1914951089) -> (continuation of Deferred@499826386 after retry RPC after error@1705083014) -> (continuation of Deferred@2009403097 after retry RPC after error@463979469) -> (continuation of Deferred@1406390853 after retry RPC after error@975162633), errback=(continuation of Deferred@289552456 after retry RPC after error@1228096051) -> (continuation of Deferred@1799566118 after retry RPC after error@1517115309) -> (continuation of Deferred@1525527760 after retry RPC after error@152852324) -> (continuation of Deferred@2067042146 after retry RPC after error@1263828886) -> (continuation of Deferred@2091387160 after retry RPC after error@400869022) -> (continuation of Deferred@1223955615 after retry RPC after error@548698840) -> (continuation of Deferred@484984607 after retry RPC after error@755606058) -> (continuation of Deferred@1169234936 after retry RPC after error@1188092716) -> (continuation of Deferred@408857686 after retry RPC after error@2015778181) -> (continuation of Deferred@889585570 after retry RPC after error@1967938453) -> (continuation of Deferred@404579702 after retry RPC after error@1381859725) -> (continuation of Deferred@1212128395 after retry RPC after error@1597564650) -> (continuation of Deferred@746393262 after retry RPC after error@311604037) -> (continuation of Deferred@645774936 after retry RPC after error@1055527883) -> (continuation of Deferred@2049336006 after retry RPC after error@2099899996) -> (continuation of Deferred@921501919 after retry RPC after error@1492593026) -> (continuation of Deferred@286150664 after retry RPC after error@602343291) -> (continuation of Deferred@2110914592 after retry RPC after error@470322465) -> (continuation of Deferred@2145718456 after retry RPC after error@1688345824) -> (continuation of Deferred@161272660 after retry RPC after error@1369781955) -> (continuation of Deferred@110267551 after retry RPC after error@1914951089) -> (continuation of Deferred@499826386 after retry RPC after error@1705083014) -> (continuation of Deferred@2009403097 after retry RPC after error@463979469) -> (continuation of Deferred@1406390853 after retry RPC after error@975162633)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27885), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [65ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [86ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [91ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [91ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [166ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [167ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [168ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [171ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [171ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [253ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [253ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [259ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [259ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [259ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [281ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [282ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [282ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [283ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [302ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [302ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [302ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [302ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [322ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [322ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [322ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [322ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [382ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [382ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [383ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [383ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [522ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [522ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [523ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [523ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [722ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [722ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [723ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [723ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [860ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [863ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [863ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [863ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [863ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [1703ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [1703ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1704ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1704ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [2363ms] refreshing cache from master, [2363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [2363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [2363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [2364ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [2365ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [2366ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [2366ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [5580ms] refreshing cache from master, [5580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [5581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [5581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [5582ms] too many traces: truncated at 100 traces, deferred=Deferred@1802194565(state=PENDING, result=null, callback=(continuation of Deferred@289552456 after retry RPC after error@1228096051) -> (continuation of Deferred@1799566118 after retry RPC after error@1517115309) -> (continuation of Deferred@1525527760 after retry RPC after error@152852324) -> (continuation of Deferred@2067042146 after retry RPC after error@1263828886) -> (continuation of Deferred@2091387160 after retry RPC after error@400869022) -> (continuation of Deferred@1223955615 after retry RPC after error@548698840) -> (continuation of Deferred@484984607 after retry RPC after error@755606058) -> (continuation of Deferred@1169234936 after retry RPC after error@1188092716) -> (continuation of Deferred@408857686 after retry RPC after error@2015778181) -> (continuation of Deferred@889585570 after retry RPC after error@1967938453) -> (continuation of Deferred@404579702 after retry RPC after error@1381859725) -> (continuation of Deferred@1212128395 after retry RPC after error@1597564650) -> (continuation of Deferred@746393262 after retry RPC after error@311604037) -> (continuation of Deferred@645774936 after retry RPC after error@1055527883) -> (continuation of Deferred@2049336006 after retry RPC after error@2099899996) -> (continuation of Deferred@921501919 after retry RPC after error@1492593026) -> (continuation of Deferred@286150664 after retry RPC after error@602343291) -> (continuation of Deferred@2110914592 after retry RPC after error@470322465) -> (continuation of Deferred@2145718456 after retry RPC after error@1688345824) -> (continuation of Deferred@161272660 after retry RPC after error@1369781955) -> (continuation of Deferred@110267551 after retry RPC after error@1914951089) -> (continuation of Deferred@499826386 after retry RPC after error@1705083014) -> (continuation of Deferred@2009403097 after retry RPC after error@463979469) -> (continuation of Deferred@1406390853 after retry RPC after error@975162633), errback=(continuation of Deferred@289552456 after retry RPC after error@1228096051) -> (continuation of Deferred@1799566118 after retry RPC after error@1517115309) -> (continuation of Deferred@1525527760 after retry RPC after error@152852324) -> (continuation of Deferred@2067042146 after retry RPC after error@1263828886) -> (continuation of Deferred@2091387160 after retry RPC after error@400869022) -> (continuation of Deferred@1223955615 after retry RPC after error@548698840) -> (continuation of Deferred@484984607 after retry RPC after error@755606058) -> (continuation of Deferred@1169234936 after retry RPC after error@1188092716) -> (continuation of Deferred@408857686 after retry RPC after error@2015778181) -> (continuation of Deferred@889585570 after retry RPC after error@1967938453) -> (continuation of Deferred@404579702 after retry RPC after error@1381859725) -> (continuation of Deferred@1212128395 after retry RPC after error@1597564650) -> (continuation of Deferred@746393262 after retry RPC after error@311604037) -> (continuation of Deferred@645774936 after retry RPC after error@1055527883) -> (continuation of Deferred@2049336006 after retry RPC after error@2099899996) -> (continuation of Deferred@921501919 after retry RPC after error@1492593026) -> (continuation of Deferred@286150664 after retry RPC after error@602343291) -> (continuation of Deferred@2110914592 after retry RPC after error@470322465) -> (continuation of Deferred@2145718456 after retry RPC after error@1688345824) -> (continuation of Deferred@161272660 after retry RPC after error@1369781955) -> (continuation of Deferred@110267551 after retry RPC after error@1914951089) -> (continuation of Deferred@499826386 after retry RPC after error@1705083014) -> (continuation of Deferred@2009403097 after retry RPC after error@463979469) -> (continuation of Deferred@1406390853 after retry RPC after error@975162633)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.31.46.252:40541
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:24.397 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.397 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.397 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.402 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.402 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.402 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.402 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.402 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.402 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.402 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:24.408 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27885), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [65ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [86ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [91ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [91ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [166ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [167ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [168ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [171ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [171ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [253ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [253ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [259ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [259ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [259ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [281ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [282ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [282ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [283ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [302ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [302ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [302ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [302ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [322ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [322ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [322ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [322ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [382ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [382ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [383ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [383ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [522ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [522ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [523ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [523ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [722ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [722ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [723ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [723ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [860ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [863ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [863ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [863ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [863ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [1703ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [1703ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1704ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1704ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [2363ms] refreshing cache from master, [2363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [2363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [2363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [2364ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [2365ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [2366ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [2366ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [5580ms] refreshing cache from master, [5580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [5581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [5581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [5582ms] too many traces: truncated at 100 traces, deferred=Deferred@1802194565(state=PENDING, result=null, callback=(continuation of Deferred@289552456 after retry RPC after error@1228096051) -> (continuation of Deferred@1799566118 after retry RPC after error@1517115309) -> (continuation of Deferred@1525527760 after retry RPC after error@152852324) -> (continuation of Deferred@2067042146 after retry RPC after error@1263828886) -> (continuation of Deferred@2091387160 after retry RPC after error@400869022) -> (continuation of Deferred@1223955615 after retry RPC after error@548698840) -> (continuation of Deferred@484984607 after retry RPC after error@755606058) -> (continuation of Deferred@1169234936 after retry RPC after error@1188092716) -> (continuation of Deferred@408857686 after retry RPC after error@2015778181) -> (continuation of Deferred@889585570 after retry RPC after error@1967938453) -> (continuation of Deferred@404579702 after retry RPC after error@1381859725) -> (continuation of Deferred@1212128395 after retry RPC after error@1597564650) -> (continuation of Deferred@746393262 after retry RPC after error@311604037) -> (continuation of Deferred@645774936 after retry RPC after error@1055527883) -> (continuation of Deferred@2049336006 after retry RPC after error@2099899996) -> (continuation of Deferred@921501919 after retry RPC after error@1492593026) -> (continuation of Deferred@286150664 after retry RPC after error@602343291) -> (continuation of Deferred@2110914592 after retry RPC after error@470322465) -> (continuation of Deferred@2145718456 after retry RPC after error@1688345824) -> (continuation of Deferred@161272660 after retry RPC after error@1369781955) -> (continuation of Deferred@110267551 after retry RPC after error@1914951089) -> (continuation of Deferred@499826386 after retry RPC after error@1705083014) -> (continuation of Deferred@2009403097 after retry RPC after error@463979469) -> (continuation of Deferred@1406390853 after retry RPC after error@975162633), errback=(continuation of Deferred@289552456 after retry RPC after error@1228096051) -> (continuation of Deferred@1799566118 after retry RPC after error@1517115309) -> (continuation of Deferred@1525527760 after retry RPC after error@152852324) -> (continuation of Deferred@2067042146 after retry RPC after error@1263828886) -> (continuation of Deferred@2091387160 after retry RPC after error@400869022) -> (continuation of Deferred@1223955615 after retry RPC after error@548698840) -> (continuation of Deferred@484984607 after retry RPC after error@755606058) -> (continuation of Deferred@1169234936 after retry RPC after error@1188092716) -> (continuation of Deferred@408857686 after retry RPC after error@2015778181) -> (continuation of Deferred@889585570 after retry RPC after error@1967938453) -> (continuation of Deferred@404579702 after retry RPC after error@1381859725) -> (continuation of Deferred@1212128395 after retry RPC after error@1597564650) -> (continuation of Deferred@746393262 after retry RPC after error@311604037) -> (continuation of Deferred@645774936 after retry RPC after error@1055527883) -> (continuation of Deferred@2049336006 after retry RPC after error@2099899996) -> (continuation of Deferred@921501919 after retry RPC after error@1492593026) -> (continuation of Deferred@286150664 after retry RPC after error@602343291) -> (continuation of Deferred@2110914592 after retry RPC after error@470322465) -> (continuation of Deferred@2145718456 after retry RPC after error@1688345824) -> (continuation of Deferred@161272660 after retry RPC after error@1369781955) -> (continuation of Deferred@110267551 after retry RPC after error@1914951089) -> (continuation of Deferred@499826386 after retry RPC after error@1705083014) -> (continuation of Deferred@2009403097 after retry RPC after error@463979469) -> (continuation of Deferred@1406390853 after retry RPC after error@975162633)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27885), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [65ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [86ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [91ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [91ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [166ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [167ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [168ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [171ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [171ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [253ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [253ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [259ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [259ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [259ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [281ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [282ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [282ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [283ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [302ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [302ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [302ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [302ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [322ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [322ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [322ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [322ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [382ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [382ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [383ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [383ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [522ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [522ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [523ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [523ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [722ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [722ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [723ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [723ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [860ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [863ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [863ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [863ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [863ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [1703ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [1703ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [1704ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [1704ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [2363ms] refreshing cache from master, [2363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [2363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [2363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [2364ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.254:45015: Network error: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015, [2365ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.252:40541: Network error: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541, [2366ms] Sub RPC ConnectToMaster: received response from server master-127.31.46.253:46697: Network error: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [2366ms] delaying RPC due to: Service unavailable: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697, [5580ms] refreshing cache from master, [5580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.254:45015, [5581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.253:46697, [5581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.46.252:40541, [5582ms] too many traces: truncated at 100 traces, deferred=Deferred@1802194565(state=PENDING, result=null, callback=(continuation of Deferred@289552456 after retry RPC after error@1228096051) -> (continuation of Deferred@1799566118 after retry RPC after error@1517115309) -> (continuation of Deferred@1525527760 after retry RPC after error@152852324) -> (continuation of Deferred@2067042146 after retry RPC after error@1263828886) -> (continuation of Deferred@2091387160 after retry RPC after error@400869022) -> (continuation of Deferred@1223955615 after retry RPC after error@548698840) -> (continuation of Deferred@484984607 after retry RPC after error@755606058) -> (continuation of Deferred@1169234936 after retry RPC after error@1188092716) -> (continuation of Deferred@408857686 after retry RPC after error@2015778181) -> (continuation of Deferred@889585570 after retry RPC after error@1967938453) -> (continuation of Deferred@404579702 after retry RPC after error@1381859725) -> (continuation of Deferred@1212128395 after retry RPC after error@1597564650) -> (continuation of Deferred@746393262 after retry RPC after error@311604037) -> (continuation of Deferred@645774936 after retry RPC after error@1055527883) -> (continuation of Deferred@2049336006 after retry RPC after error@2099899996) -> (continuation of Deferred@921501919 after retry RPC after error@1492593026) -> (continuation of Deferred@286150664 after retry RPC after error@602343291) -> (continuation of Deferred@2110914592 after retry RPC after error@470322465) -> (continuation of Deferred@2145718456 after retry RPC after error@1688345824) -> (continuation of Deferred@161272660 after retry RPC after error@1369781955) -> (continuation of Deferred@110267551 after retry RPC after error@1914951089) -> (continuation of Deferred@499826386 after retry RPC after error@1705083014) -> (continuation of Deferred@2009403097 after retry RPC after error@463979469) -> (continuation of Deferred@1406390853 after retry RPC after error@975162633), errback=(continuation of Deferred@289552456 after retry RPC after error@1228096051) -> (continuation of Deferred@1799566118 after retry RPC after error@1517115309) -> (continuation of Deferred@1525527760 after retry RPC after error@152852324) -> (continuation of Deferred@2067042146 after retry RPC after error@1263828886) -> (continuation of Deferred@2091387160 after retry RPC after error@400869022) -> (continuation of Deferred@1223955615 after retry RPC after error@548698840) -> (continuation of Deferred@484984607 after retry RPC after error@755606058) -> (continuation of Deferred@1169234936 after retry RPC after error@1188092716) -> (continuation of Deferred@408857686 after retry RPC after error@2015778181) -> (continuation of Deferred@889585570 after retry RPC after error@1967938453) -> (continuation of Deferred@404579702 after retry RPC after error@1381859725) -> (continuation of Deferred@1212128395 after retry RPC after error@1597564650) -> (continuation of Deferred@746393262 after retry RPC after error@311604037) -> (continuation of Deferred@645774936 after retry RPC after error@1055527883) -> (continuation of Deferred@2049336006 after retry RPC after error@2099899996) -> (continuation of Deferred@921501919 after retry RPC after error@1492593026) -> (continuation of Deferred@286150664 after retry RPC after error@602343291) -> (continuation of Deferred@2110914592 after retry RPC after error@470322465) -> (continuation of Deferred@2145718456 after retry RPC after error@1688345824) -> (continuation of Deferred@161272660 after retry RPC after error@1369781955) -> (continuation of Deferred@110267551 after retry RPC after error@1914951089) -> (continuation of Deferred@499826386 after retry RPC after error@1705083014) -> (continuation of Deferred@2009403097 after retry RPC after error@463979469) -> (continuation of Deferred@1406390853 after retry RPC after error@975162633)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.31.46.252:40541
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:24.409 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:24.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 68 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091764408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:24.410 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:24.411 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:24.411 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:24.412 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.412 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.412 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.412 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.412 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.412 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.412 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.412 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.413 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.413 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:24.419 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 68 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
08:09:24.421 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 68 as completed for source Source: KuduSource.
08:09:24.430 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:24.430 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:24.430 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:24.430 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.431 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.431 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.431 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.431 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.431 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.431 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.431 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.432 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.432 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:24.432 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
08:09:24.433 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#2) of source Source: KuduSource.
08:09:24.433 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to CANCELING.
08:09:24.434 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
08:09:24.434 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to CANCELING.
08:09:24.434 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
08:09:24.434 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#2) of source Source: KuduSource.
08:09:24.435 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to CANCELING.
08:09:24.435 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#2) of source Source: KuduSource.
08:09:24.435 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to CANCELING.
08:09:24.447 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
08:09:24.447 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
08:09:24.447 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to CANCELING.
08:09:24.447 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CANCELING to CANCELED.
08:09:24.447 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
08:09:24.447 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
08:09:24.450 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:24.450 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:24.451 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:24.451 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.451 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.451 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.451 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.451 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.451 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.451 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.451 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.451 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.452 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:24.463 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
08:09:24.463 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CANCELING to CANCELED.
08:09:24.463 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
08:09:24.470 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:24.470 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:24.470 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:24.471 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.471 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.471 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.471 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.471 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.471 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.472 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.472 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.472 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.472 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:24.474 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
08:09:24.474 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to CANCELING.
08:09:24.474 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
08:09:24.487 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
08:09:24.487 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CANCELING to CANCELED.
08:09:24.488 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#2 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
08:09:24.502 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#2 baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_2.
08:09:24.502 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#2 baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
08:09:24.503 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#2 baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_2.
08:09:24.503 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CANCELING to CANCELED.
08:09:24.505 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CANCELING to CANCELED.
08:09:24.505 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CANCELING to CANCELED.
08:09:24.506 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job da74ffd3de6ba1563e412fcb34de5c51: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:09:24.506 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job da74ffd3de6ba1563e412fcb34de5c51: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:09:24.509 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:318) Clearing resource requirements of job da74ffd3de6ba1563e412fcb34de5c51
08:09:24.510 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:24.510 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:24.510 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:24.511 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.511 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.511 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.511 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.511 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.511 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.511 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.511 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.511 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.511 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:24.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:24.590 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:24.590 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:24.590 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:24.591 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.591 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.591 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.592 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.592 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.592 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.592 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.592 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.592 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.592 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:24.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:24.631 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:24.650 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:24.650 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:24.650 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:24.652 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.652 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.652 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.652 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.652 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.653 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.653 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.653 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.653 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.653 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:24.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:24.868868  5098 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } attempt: 7
08:09:24.890 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:24.890 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:24.890 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:24.891 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.891 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.891 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:24.891 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.891 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.891 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:24.892 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.892 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.892 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:24.892 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:24.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:24.899618  5098 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.224.189:45505: Network error: Client connection negotiation failed: client connection to 127.4.224.189:45505: connect: Connection refused (error 111)
08:09:24.904 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:24.904 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:24.904 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:24.905 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:24.906 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:24.906 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:24.906 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:24.906 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:24.906 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:24.906 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:24.906 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:24.907 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:24.907 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:24.909 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:24.910 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 69 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091764908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:24.920 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 69 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
08:09:24.922 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 69 as completed for source Source: KuduSource.
08:09:25.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:25.074 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:25.074 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:25.075 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:25.075 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:25.075 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:25.075 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:25.075 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:25.075 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:25.075 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:25.075 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:25.075 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:25.075 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:25.076 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:25.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:25.131 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:25.310 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:25.310 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:25.311 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:25.311 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:25.311 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:25.311 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:25.311 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:25.311 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:25.311 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:25.312 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:25.312 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:25.312 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:25.312 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:25.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:23.050120  5111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:25.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:24.451140  5109 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 5100
08:09:25.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:25.322860  5100 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.274s	user 0.573s	sys 1.083s
08:09:25.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:25.323658  5100 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.275s	user 0.574s	sys 1.083s
08:09:25.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:25.326100  5113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:25.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:25.328951  5112 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2273 milliseconds
08:09:25.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.328944  5100 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:09:25.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.330746  5100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:09:25.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.333905  5100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:09:25.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.335310  5100 hybrid_clock.cc:648] HybridClock initialized: now 1779091765335274 us; error 65 us; skew 500 ppm
08:09:25.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.336340  5100 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:09:25.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.344384  5100 webserver.cc:533] Webserver started at http://127.4.224.189:45701/ using document root <none> and password file <none>
08:09:25.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.345456  5100 fs_manager.cc:362] Metadata directory not provided
08:09:25.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.345772  5100 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:09:25.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.346414  5100 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:09:25.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.352638  5100 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-1/data/instance:
08:09:25.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e605137b3e4e4895922c11fe34cb66d1"
08:09:25.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:25 on dist-test-slave-1jss"
08:09:25.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.354178  5100 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-1/wal/instance:
08:09:25.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e605137b3e4e4895922c11fe34cb66d1"
08:09:25.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:25 on dist-test-slave-1jss"
08:09:25.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.363723  5100 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.007s	sys 0.001s
08:09:25.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.370975  5135 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:09:25.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.372321  5100 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.002s
08:09:25.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.372747  5100 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-1/wal
08:09:25.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e605137b3e4e4895922c11fe34cb66d1"
08:09:25.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:25 on dist-test-slave-1jss"
08:09:25.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.373150  5100 fs_report.cc:389] FS layout report
08:09:25.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:09:25.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-1/wal
08:09:25.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-1/wal
08:09:25.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-1/data/data
08:09:25.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:09:25.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:09:25.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:09:25.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:09:25.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:09:25.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:09:25.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:09:25.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:09:25.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:09:25.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:09:25.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:09:25.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 70 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091765408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:25.410 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:25.417 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 70 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
08:09:25.419 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 70 as completed for source Source: KuduSource.
08:09:25.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.440855  5100 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:09:25.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.442924  5100 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:09:25.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.443594  5100 kserver.cc:163] Server-wide thread pool size limit: 3276
08:09:25.472 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:25.472 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:25.472 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:25.473 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:25.473 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:25.473 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:25.474 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:25.474 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:25.474 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:25.474 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:25.474 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:25.474 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:25.474 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:25.475 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28935), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [103ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [106ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [123ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [123ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [143ms] refreshing cache from master, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [211ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [213ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [215ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [217ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [223ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [223ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [291ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [292ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [302ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [305ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [306ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [322ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [323ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [323ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [323ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [342ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [342ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [342ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [343ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [382ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [383ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [383ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [383ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [402ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [402ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [403ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [403ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [501ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [502ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [502ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [503ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [702ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [703ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [703ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [704ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1161ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [1162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [1162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1163ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1602ms] refreshing cache from master, [1602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [1602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [1602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [1603ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [1603ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [1604ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1604ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [2721ms] refreshing cache from master, [2721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [2721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [2721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [2722ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [2723ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [2723ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [2723ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [4961ms] refreshing cache from master, [4961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [4962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [4962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [4962ms] too many traces: truncated at 100 traces, deferred=Deferred@200456061(state=PENDING, result=null, callback=(continuation of Deferred@726490844 after retry RPC after error@588179630) -> (continuation of Deferred@840109285 after retry RPC after error@742657157) -> (continuation of Deferred@1841175663 after retry RPC after error@958517998) -> (continuation of Deferred@327124235 after retry RPC after error@533955525) -> (continuation of Deferred@43231540 after retry RPC after error@890416426) -> (continuation of Deferred@1521103198 after retry RPC after error@1499749477) -> (continuation of Deferred@1184990324 after retry RPC after error@1727662711) -> (continuation of Deferred@1842472759 after retry RPC after error@372054428) -> (continuation of Deferred@1558560009 after retry RPC after error@1794813264) -> (continuation of Deferred@149948263 after retry RPC after error@1986993692) -> (continuation of Deferred@118745133 after retry RPC after error@951866802) -> (continuation of Deferred@822060797 after retry RPC after error@1047449856) -> (continuation of Deferred@648287328 after retry RPC after error@2087699651) -> (continuation of Deferred@837443069 after retry RPC after error@2042919953) -> (continuation of Deferred@2143641693 after retry RPC after error@2098133690) -> (continuation of Deferred@518542675 after retry RPC after error@1150715499) -> (continuation of Deferred@268812588 after retry RPC after error@441725628) -> (continuation of Deferred@1179299432 after retry RPC after error@908053780) -> (continuation of Deferred@137193050 after retry RPC after error@869758001) -> (continuation of Deferred@545105357 after retry RPC after error@1757588411) -> (continuation of Deferred@197005135 after retry RPC after error@54559989) -> (continuation of Deferred@1314785949 after retry RPC after error@868024222) -> (continuation of Deferred@1216568017 after retry RPC after error@1331894296), errback=(continuation of Deferred@726490844 after retry RPC after error@588179630) -> (continuation of Deferred@840109285 after retry RPC after error@742657157) -> (continuation of Deferred@1841175663 after retry RPC after error@958517998) -> (continuation of Deferred@327124235 after retry RPC after error@533955525) -> (continuation of Deferred@43231540 after retry RPC after error@890416426) -> (continuation of Deferred@1521103198 after retry RPC after error@1499749477) -> (continuation of Deferred@1184990324 after retry RPC after error@1727662711) -> (continuation of Deferred@1842472759 after retry RPC after error@372054428) -> (continuation of Deferred@1558560009 after retry RPC after error@1794813264) -> (continuation of Deferred@149948263 after retry RPC after error@1986993692) -> (continuation of Deferred@118745133 after retry RPC after error@951866802) -> (continuation of Deferred@822060797 after retry RPC after error@1047449856) -> (continuation of Deferred@648287328 after retry RPC after error@2087699651) -> (continuation of Deferred@837443069 after retry RPC after error@2042919953) -> (continuation of Deferred@2143641693 after retry RPC after error@2098133690) -> (continuation of Deferred@518542675 after retry RPC after error@1150715499) -> (continuation of Deferred@268812588 after retry RPC after error@441725628) -> (continuation of Deferred@1179299432 after retry RPC after error@908053780) -> (continuation of Deferred@137193050 after retry RPC after error@869758001) -> (continuation of Deferred@545105357 after retry RPC after error@1757588411) -> (continuation of Deferred@197005135 after retry RPC after error@54559989) -> (continuation of Deferred@1314785949 after retry RPC after error@868024222) -> (continuation of Deferred@1216568017 after retry RPC after error@1331894296)))
08:09:25.502 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:25.502 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:25.502 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:25.502 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:25.502 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:25.502 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:25.502 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:25.502 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:25.503 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:25.503 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:25.503 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:25.503 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:25.503 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:25.518 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:25.518 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:25.518 [DEBUG - pool-442-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:25.522 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:25.522 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:25.522 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:25.522 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:25.522 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:25.522 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:25.523 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:25.523 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:25.523 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:25.523 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:25.524 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28964), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [29ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [38ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [44ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [45ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [79ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [80ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [96ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [96ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [119ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [120ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [122ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [123ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [123ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [142ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [142ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [142ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [162ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [162ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [162ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [162ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [181ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [182ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [186ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [186ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [202ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [202ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [202ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [203ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [242ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [242ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [242ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [242ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [322ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [322ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [322ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [323ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [542ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [543ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [543ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [544ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [722ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [722ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [723ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [723ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [2501ms] refreshing cache from master, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [2503ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [2503ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [3901ms] refreshing cache from master, [3901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [3902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [3902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [3902ms] too many traces: truncated at 100 traces, deferred=Deferred@611865211(state=PENDING, result=null, callback=(continuation of Deferred@1729300157 after retry RPC after error@584206929) -> (continuation of Deferred@1817512018 after retry RPC after error@181953577) -> (continuation of Deferred@1971432737 after retry RPC after error@1169285378) -> (continuation of Deferred@23230078 after retry RPC after error@1213375319) -> (continuation of Deferred@818083801 after retry RPC after error@2050074930) -> (continuation of Deferred@1760747916 after retry RPC after error@904376286) -> (continuation of Deferred@305986180 after retry RPC after error@1697888712) -> (continuation of Deferred@447924835 after retry RPC after error@312676276) -> (continuation of Deferred@1740517310 after retry RPC after error@532359032) -> (continuation of Deferred@332793662 after retry RPC after error@427979871) -> (continuation of Deferred@265779982 after retry RPC after error@1225858411) -> (continuation of Deferred@1784482944 after retry RPC after error@1626848536) -> (continuation of Deferred@1414313219 after retry RPC after error@360124580) -> (continuation of Deferred@390866822 after retry RPC after error@1250838282) -> (continuation of Deferred@2077956085 after retry RPC after error@1451547162) -> (continuation of Deferred@545433435 after retry RPC after error@411832918) -> (continuation of Deferred@994822669 after retry RPC after error@1273987956) -> (continuation of Deferred@2128760109 after retry RPC after error@109374981) -> (continuation of Deferred@1668958074 after retry RPC after error@1421450306) -> (continuation of Deferred@954087645 after retry RPC after error@428547333) -> (continuation of Deferred@679200985 after retry RPC after error@817367576) -> (continuation of Deferred@2045363202 after retry RPC after error@952868111), errback=(continuation of Deferred@1729300157 after retry RPC after error@584206929) -> (continuation of Deferred@1817512018 after retry RPC after error@181953577) -> (continuation of Deferred@1971432737 after retry RPC after error@1169285378) -> (continuation of Deferred@23230078 after retry RPC after error@1213375319) -> (continuation of Deferred@818083801 after retry RPC after error@2050074930) -> (continuation of Deferred@1760747916 after retry RPC after error@904376286) -> (continuation of Deferred@305986180 after retry RPC after error@1697888712) -> (continuation of Deferred@447924835 after retry RPC after error@312676276) -> (continuation of Deferred@1740517310 after retry RPC after error@532359032) -> (continuation of Deferred@332793662 after retry RPC after error@427979871) -> (continuation of Deferred@265779982 after retry RPC after error@1225858411) -> (continuation of Deferred@1784482944 after retry RPC after error@1626848536) -> (continuation of Deferred@1414313219 after retry RPC after error@360124580) -> (continuation of Deferred@390866822 after retry RPC after error@1250838282) -> (continuation of Deferred@2077956085 after retry RPC after error@1451547162) -> (continuation of Deferred@545433435 after retry RPC after error@411832918) -> (continuation of Deferred@994822669 after retry RPC after error@1273987956) -> (continuation of Deferred@2128760109 after retry RPC after error@109374981) -> (continuation of Deferred@1668958074 after retry RPC after error@1421450306) -> (continuation of Deferred@954087645 after retry RPC after error@428547333) -> (continuation of Deferred@679200985 after retry RPC after error@817367576) -> (continuation of Deferred@2045363202 after retry RPC after error@952868111)))
08:09:25.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:25.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.563776  5100 rpc_server.cc:307] RPC server started. Bound to: 127.4.224.189:45505
08:09:25.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.563884  5186 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.224.189:45505 every 8 connection(s)
08:09:25.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.567128  5100 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-1/data/info.pb
08:09:25.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.575577  5187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:09:25.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.577392  4994 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 5100
08:09:25.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.577996  4994 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-1/wal/instance
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.580861  4994 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-2/wal
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-2/data
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-2/logs
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-2/data/info.pb
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.224.188:40437
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.224.188
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.224.148:40383
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:09:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:09:25.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:09:25.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:09:25.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.224.190:36787,127.4.224.189:45505,127.4.224.188:40437
08:09:25.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:09:25.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43831/jwks.json with env {}
08:09:25.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.590021  5187 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.224.190" port: 36787 } has no permanent_uuid. Determining permanent_uuid...
08:09:25.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:25.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.628980  5187 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } has no permanent_uuid. Determining permanent_uuid...
08:09:25.633 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:25.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.646829  5187 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } has no permanent_uuid. Determining permanent_uuid...
08:09:25.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:25.650076  5136 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.224.188:40437: connect: Connection refused (error 111)
08:09:25.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:25.654830  5187 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.224.188:40437: Network error: Client connection negotiation failed: client connection to 127.4.224.188:40437: connect: Connection refused (error 111)
08:09:25.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.704452  5187 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } attempt: 1
08:09:25.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:25.709996  5187 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.224.188:40437: Network error: Client connection negotiation failed: client connection to 127.4.224.188:40437: connect: Connection refused (error 111)
08:09:25.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.778527  5187 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } attempt: 2
08:09:25.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:25.783538  5187 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.224.188:40437: Network error: Client connection negotiation failed: client connection to 127.4.224.188:40437: connect: Connection refused (error 111)
08:09:25.806 [DEBUG - pool-388-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30007), Traces: [0ms] sending RPC to server master-127.1.134.252:42093, [5ms] received response from server master-127.1.134.252:42093: OK, deferred=null) with no deferred attached!
08:09:25.866 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:25.867 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:25.867 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:25.867 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:25.867 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:25.867 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:25.867 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:25.867 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:25.868 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:25.868 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:25.868 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:25.868 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:25.868 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:25.868 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29329), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [131ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [132ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [160ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [202ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [202ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [251ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [252ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [259ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [264ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [267ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [326ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [330ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [330ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [331ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [332ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [341ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [341ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [342ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [342ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [361ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [362ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [363ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [363ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [381ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [381ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [382ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [382ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [421ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [422ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [422ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [422ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [521ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [522ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [522ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [522ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [680ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [682ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [682ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [683ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [683ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1040ms] refreshing cache from master, [1040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [1040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [1040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [1041ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [1041ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1042ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1492ms] refreshing cache from master, [1492ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [1496ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [1497ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [1497ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [1498ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [1498ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [1498ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [2880ms] refreshing cache from master, [2880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [2881ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.254:35197: Network error: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197, [2882ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.252:36101: Network error: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101, [2882ms] Sub RPC ConnectToMaster: received response from server master-127.31.233.253:33393: Network error: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [2882ms] delaying RPC due to: Service unavailable: Master config (127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393, [4801ms] refreshing cache from master, [4801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.254:35197, [4802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.253:33393, [4802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.233.252:36101, [4802ms] too many traces: truncated at 100 traces, deferred=Deferred@2058971468(state=PENDING, result=null, callback=(continuation of Deferred@1725254911 after retry RPC after error@1882463782) -> (continuation of Deferred@278250706 after retry RPC after error@559365253) -> (continuation of Deferred@1839808228 after retry RPC after error@1035786329) -> (continuation of Deferred@61941864 after retry RPC after error@463114127) -> (continuation of Deferred@1071700998 after retry RPC after error@1690674611) -> (continuation of Deferred@1857889067 after retry RPC after error@554975108) -> (continuation of Deferred@414046028 after retry RPC after error@1368134103) -> (continuation of Deferred@1454359734 after retry RPC after error@1455892984) -> (continuation of Deferred@539395035 after retry RPC after error@286604449) -> (continuation of Deferred@959959105 after retry RPC after error@1456518774) -> (continuation of Deferred@1115479852 after retry RPC after error@2058617846) -> (continuation of Deferred@2105962809 after retry RPC after error@775298041) -> (continuation of Deferred@177681580 after retry RPC after error@1348877755) -> (continuation of Deferred@505909559 after retry RPC after error@13678809) -> (continuation of Deferred@869387835 after retry RPC after error@1388033567) -> (continuation of Deferred@1891056470 after retry RPC after error@1973699561) -> (continuation of Deferred@1211755376 after retry RPC after error@1203615526) -> (continuation of Deferred@244930828 after retry RPC after error@1509287997) -> (continuation of Deferred@1586559512 after retry RPC after error@1950245483) -> (continuation of Deferred@816514265 after retry RPC after error@1181329137) -> (continuation of Deferred@527483934 after retry RPC after error@416989345) -> (continuation of Deferred@1891599023 after retry RPC after error@2070604903) -> (continuation of Deferred@1646495520 after retry RPC after error@741514253) -> (continuation of Deferred@546626014 after retry RPC after error@212930687), errback=(continuation of Deferred@1725254911 after retry RPC after error@1882463782) -> (continuation of Deferred@278250706 after retry RPC after error@559365253) -> (continuation of Deferred@1839808228 after retry RPC after error@1035786329) -> (continuation of Deferred@61941864 after retry RPC after error@463114127) -> (continuation of Deferred@1071700998 after retry RPC after error@1690674611) -> (continuation of Deferred@1857889067 after retry RPC after error@554975108) -> (continuation of Deferred@414046028 after retry RPC after error@1368134103) -> (continuation of Deferred@1454359734 after retry RPC after error@1455892984) -> (continuation of Deferred@539395035 after retry RPC after error@286604449) -> (continuation of Deferred@959959105 after retry RPC after error@1456518774) -> (continuation of Deferred@1115479852 after retry RPC after error@2058617846) -> (continuation of Deferred@2105962809 after retry RPC after error@775298041) -> (continuation of Deferred@177681580 after retry RPC after error@1348877755) -> (continuation of Deferred@505909559 after retry RPC after error@13678809) -> (continuation of Deferred@869387835 after retry RPC after error@1388033567) -> (continuation of Deferred@1891056470 after retry RPC after error@1973699561) -> (continuation of Deferred@1211755376 after retry RPC after error@1203615526) -> (continuation of Deferred@244930828 after retry RPC after error@1509287997) -> (continuation of Deferred@1586559512 after retry RPC after error@1950245483) -> (continuation of Deferred@816514265 after retry RPC after error@1181329137) -> (continuation of Deferred@527483934 after retry RPC after error@416989345) -> (continuation of Deferred@1891599023 after retry RPC after error@2070604903) -> (continuation of Deferred@1646495520 after retry RPC after error@741514253) -> (continuation of Deferred@546626014 after retry RPC after error@212930687)))
08:09:25.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:25.875676  5187 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } attempt: 3
08:09:25.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:25.880707  5187 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.224.188:40437: Network error: Client connection negotiation failed: client connection to 127.4.224.188:40437: connect: Connection refused (error 111)
08:09:25.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 71 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091765908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:25.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:25.917 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 71 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
08:09:25.918 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 71 as completed for source Source: KuduSource.
08:09:25.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:25.988118  5189 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:09:25.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:25.988997  5189 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:09:25.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:25.989569  5189 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:09:26.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:26.024286  5187 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } attempt: 4
08:09:26.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:26.029531  5187 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.224.188:40437: Network error: Client connection negotiation failed: client connection to 127.4.224.188:40437: connect: Connection refused (error 111)
08:09:26.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:26.032894  5189 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:09:26.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:26.033190  5189 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:09:26.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:26.033403  5189 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:09:26.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:26.033684  5189 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:09:26.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:26.033962  5189 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:09:26.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:26.034137  5189 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:43831/jwks.json
08:09:26.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:26.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:26.081578  5189 master_runner.cc:387] Master server non-default flags:
08:09:26.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:09:26.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.224.148:40383
08:09:26.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:09:26.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:09:26.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-2/data
08:09:26.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-2/wal
08:09:26.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:09:26.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.224.190:36787,127.4.224.189:45505,127.4.224.188:40437
08:09:26.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:09:26.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:09:26.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:09:26.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.224.188:40437
08:09:26.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:09:26.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:09:26.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:09:26.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43831/jwks.json
08:09:26.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:09:26.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:09:26.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-2/data/info.pb
08:09:26.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.224.188
08:09:26.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:09:26.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:09:26.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:09:26.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:09:26.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:09:26.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:09:26.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-2/logs
08:09:26.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:09:26.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:09:26.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:09:26.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:09:26.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:09:26.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:09:26.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:09:26.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:09:26.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:09:26.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:09:26.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:26.083427  5189 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:09:26.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:26.085501  5189 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:09:26.098 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (da74ffd3de6ba1563e412fcb34de5c51) switched from state RESTARTING to RUNNING.
08:09:26.099 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job da74ffd3de6ba1563e412fcb34de5c51 from Checkpoint 68 @ 1779091707149 for da74ffd3de6ba1563e412fcb34de5c51 located at file:/tmp/junit5660276855152915670/checkpoints/da74ffd3de6ba1563e412fcb34de5c51/chk-68.
08:09:26.100 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
08:09:26.100 [INFO - flink-pekko.actor.default-dispatcher-7] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
08:09:26.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:26.100358  5199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:26.110 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to SCHEDULED.
08:09:26.112 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from SCHEDULED to DEPLOYING.
08:09:26.112 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #3) with attempt id baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to c1befdc5-4ac6-48c0-985f-201fc5cdc5a6 @ 127.0.0.1 (dataPort=-1) with allocation id 9b941a5fbbbdb04dacdc14d5e09c626f
08:09:26.112 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to SCHEDULED.
08:09:26.113 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 9b941a5fbbbdb04dacdc14d5e09c626f.
08:09:26.114 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#3 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_3), deploy into slot with allocation id 9b941a5fbbbdb04dacdc14d5e09c626f.
08:09:26.115 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job da74ffd3de6ba1563e412fcb34de5c51: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:09:26.116 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:26.117 [INFO - Thread-62] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
08:09:26.117 [DEBUG - Thread-62] (Connection.java:575) [peer master-127.31.46.252:40541(127.31.46.252:40541)] disconnecting while in state TERMINATED
08:09:26.118 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job da74ffd3de6ba1563e412fcb34de5c51: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:09:26.119 [DEBUG - Thread-62] (Connection.java:575) [peer master-127.31.46.253:46697(127.31.46.253:46697)] disconnecting while in state TERMINATED
08:09:26.119 [DEBUG - Thread-62] (Connection.java:575) [peer master-127.31.46.254:45015(127.31.46.254:45015)] disconnecting while in state TERMINATED
08:09:26.120 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from SCHEDULED to DEPLOYING.
08:09:26.120 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:09:26.120 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #3) with attempt id baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to c1befdc5-4ac6-48c0-985f-201fc5cdc5a6 @ 127.0.0.1 (dataPort=-1) with allocation id a7a5d41ebc10c1cb065f8992e3a1fcb8
08:09:26.121 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot a7a5d41ebc10c1cb065f8992e3a1fcb8.
08:09:26.122 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#3 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_3), deploy into slot with allocation id a7a5d41ebc10c1cb065f8992e3a1fcb8.
08:09:26.122 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to SCHEDULED.
08:09:26.123 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job da74ffd3de6ba1563e412fcb34de5c51: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:09:26.124 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to DEPLOYING.
08:09:26.124 [INFO - Thread-62] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
08:09:26.124 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from SCHEDULED to DEPLOYING.
08:09:26.125 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #3) with attempt id baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to c1befdc5-4ac6-48c0-985f-201fc5cdc5a6 @ 127.0.0.1 (dataPort=-1) with allocation id fc644b3daf65704dd575ddb1e126a17f
08:09:26.125 [INFO - Thread-62] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
08:09:26.125 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to SCHEDULED.
08:09:26.125 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job da74ffd3de6ba1563e412fcb34de5c51: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:09:26.125 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from SCHEDULED to DEPLOYING.
08:09:26.125 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #3) with attempt id baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to c1befdc5-4ac6-48c0-985f-201fc5cdc5a6 @ 127.0.0.1 (dataPort=-1) with allocation id e0ded49cc18cf9d68a3f4d967ddb5165
08:09:26.126 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot fc644b3daf65704dd575ddb1e126a17f.
08:09:26.125 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#3 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_3) [DEPLOYING].
08:09:26.126 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3e345017
08:09:26.126 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:26.127 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5660276855152915670/checkpoints")
08:09:26.127 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#3 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_3), deploy into slot with allocation id fc644b3daf65704dd575ddb1e126a17f.
08:09:26.127 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
08:09:26.127 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
08:09:26.127 [DEBUG - Thread-62] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:26.128 [INFO - Thread-62] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
08:09:26.129 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to DEPLOYING.
08:09:26.129 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#3 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_3) [DEPLOYING].
08:09:26.129 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@540199bb
08:09:26.129 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:26.129 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5660276855152915670/checkpoints")
08:09:26.129 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@747a60e2
08:09:26.130 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
08:09:26.130 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
08:09:26.131 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:26.131 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot e0ded49cc18cf9d68a3f4d967ddb5165.
08:09:26.132 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:26.133 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#3 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_3), deploy into slot with allocation id e0ded49cc18cf9d68a3f4d967ddb5165.
08:09:26.134 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to DEPLOYING.
08:09:26.134 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#3 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_3) [DEPLOYING].
08:09:26.134 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6650e395
08:09:26.134 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@32e1a66e
08:09:26.135 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:26.135 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5660276855152915670/checkpoints")
08:09:26.135 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
08:09:26.136 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
08:09:26.138 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:09:26.138 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:09:26.138 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:09:26.138 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:09:26.139 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6b3f36f
08:09:26.141 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:26.142 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:26.149 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.150 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to DEPLOYING.
08:09:26.150 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#3 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_3) [DEPLOYING].
08:09:26.151 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@37bdbdc5
08:09:26.151 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:26.152 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5660276855152915670/checkpoints")
08:09:26.152 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
08:09:26.152 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (baaac68dc5a1babc7c9d5ca51e5178bb_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
08:09:26.156 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@697a2dae
08:09:26.163 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.165 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:26.165 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:26.166 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:26.166 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:26.166 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:26.166 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:26.166 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:26.166 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:26.166 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:26.166 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:26.166 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:26.167 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:26.167 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:26.167 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:26.170 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.180 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.181 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:26.181 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.182 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.182 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.182 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.183 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.183 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.183 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.183 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.184 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.184 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.185 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.185 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.194 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.194 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:26.195 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.195 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.195 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.195 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.195 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.195 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.195 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.195 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.195 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.195 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.202 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.202 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.202 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.202 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.203 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.203 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.204 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.204 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.204 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.205 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.205 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:26.205 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.205 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.206 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.206 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.207 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.209 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.212 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.212 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.212 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.212 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:26.213 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.214 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.214 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.214 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.214 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.215 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.215 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.215 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.215 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.215 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.215 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.215 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.217 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.217 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.217 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.218 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.218 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.218 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.218 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.219 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.221 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:26.222 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.223 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.224 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.224 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.224 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.225 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.226 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.226 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.226 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.226 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.227 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:26.228 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.229 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.229 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.229 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:26.230 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.230 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.230 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.231 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.231 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.232 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.232 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.233 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.233 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:26.233 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.234 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.234 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.234 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.235 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.236 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.236 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.236 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.237 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.237 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.237 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.237 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.238 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.239 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.239 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.239 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.239 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.240 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:26.240 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:26.240 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:26.240 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:26.240 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:26.241 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:26.241 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:26.241 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:26.241 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:26.241 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:26.241 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:26.241 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:26.242 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:26.242 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:26.242 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.242 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.242 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.244 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.247 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.247 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.247 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.247 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.248 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.249 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.249 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.250 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.250 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.250 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.250 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.250 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.250 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.250 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.251 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.251 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.251 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.254 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:26.255 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.255 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.255 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.258 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:26.258 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.259 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.259 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.260 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.260 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.260 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.260 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:26.261 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.262 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.262 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.262 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.266 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.267 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.268 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.268 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.269 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.270 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.270 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.270 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.270 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.271 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.271 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.271 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.271 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.271 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.271 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.271 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.271 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.272 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.273 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.273 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.273 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.273 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.275 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.275 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.275 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.278 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.278 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.279 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.279 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.280 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.280 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.280 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.280 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.280 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.281 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:26.281 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:26.281 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:26.282 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.282 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.282 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.282 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.282 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.283 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.283 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.283 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.283 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.283 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:26.284 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.284 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.285 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.285 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.285 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.285 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.286 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.286 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.286 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.287 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.287 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.287 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.287 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.288 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.288 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.288 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.289 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.289 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.289 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.289 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.290 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.290 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.290 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.290 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.290 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.290 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.291 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.291 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.291 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.291 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.291 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.291 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.291 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.292 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.292 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.292 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.292 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.292 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.292 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.292 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.292 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.293 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.293 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.293 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.293 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.293 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.293 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.293 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.293 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.293 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.302 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:26.302 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:26.302 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:26.303 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.303 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.303 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.303 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.303 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.304 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.304 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.304 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.304 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.304 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:26.305 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.305 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.305 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.305 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.305 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.305 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.305 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.306 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.306 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.306 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.306 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.306 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.306 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.306 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.306 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.306 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.306 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.306 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.307 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.307 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.305 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.310 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.311 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.311 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.311 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.311 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.311 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.312 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.312 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.312 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.312 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.313 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.313 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.313 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.313 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.306 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.317 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.306 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.319 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.322 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:26.323 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.323 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.323 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.323 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:26.323 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:26.323 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.323 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.323 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.323 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.323 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.324 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.324 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:26.324 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.324 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.324 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.324 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.324 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.324 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.324 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.325 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.325 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.325 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.325 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.325 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.325 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.329 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:26.329152  5187 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } attempt: 5
08:09:26.329 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.329 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.330 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.330 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.330 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.330 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.330 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.330 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.331 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.331 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.331 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.331 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.331 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.331 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.331 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.331 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.332 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.332 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.332 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.332 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.332 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.330 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.333 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.333 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.333 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:26.336920  5187 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.224.188:40437: Network error: Client connection negotiation failed: client connection to 127.4.224.188:40437: connect: Connection refused (error 111)
08:09:26.344 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.344 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.344 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.344 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.344 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.344 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.344 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.345 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.345 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.345 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.345 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.345 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.345 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.346 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.346 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.346 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.346 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.346 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.346 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.346 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.344 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.346 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.346 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.344 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.346 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.346 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.361 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:26.362 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:26.362 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:26.363 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.363 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.363 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.364 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.364 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.364 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.364 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.364 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.365 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.365 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:26.370 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.370 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.370 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.372 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.372 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.373 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.371 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.373 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.374 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.374 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.374 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.371 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.371 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.374 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.374 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.374 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.374 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.374 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.374 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.375 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.375 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.375 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.375 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.375 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.375 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.375 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.383 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.384 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.384 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.384 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.384 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.384 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.384 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.384 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.384 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.384 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.384 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.384 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.384 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.385 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.385 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.385 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.385 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.385 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.386 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.386 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.386 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.386 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.386 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.386 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.386 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.386 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 72 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091766408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:26.410 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:26.410 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.410 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.410 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.410 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.411 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.411 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.411 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.411 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.411 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.411 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.411 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.411 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.411 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.423 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 72 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
08:09:26.424 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.424 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.424 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.424 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.425 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.425 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.425 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.425 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.425 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.426 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 72 as completed for source Source: KuduSource.
08:09:26.426 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.426 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.426 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.426 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.424 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.427 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.427 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.427 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.427 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.428 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.428 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.428 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.428 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.429 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.429 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.429 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.429 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.451 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.451 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.451 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.452 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.452 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.452 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.452 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.452 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.452 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.453 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.453 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.453 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.453 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.469 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:26.469 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:26.469 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:26.470 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:26.470 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:26.470 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:26.470 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:26.470 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:26.470 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:26.470 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:26.470 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:26.471 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:26.471 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:26.484 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.484 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.484 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.485 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.485 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.485 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.486 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.486 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.486 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.486 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.486 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.486 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.486 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.502 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:26.502 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:26.502 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:26.503 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.503 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.503 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.504 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.504 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.504 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.504 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.504 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.504 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.504 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:26.543 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.543 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.543 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.544 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.544 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.544 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.545 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.545 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.545 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.545 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.545 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.545 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.545 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:26.553 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:26.553 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:26.554 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:26.554 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:26.554 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:26.554 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:26.554 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:26.554 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:26.554 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:26.555 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:26.555 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:26.555 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:26.555 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:26.556 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:26.570 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:26.570 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:26.570 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:26.571 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:26.571 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:26.571 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:26.571 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:26.571 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:26.571 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:26.572 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:26.572 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:26.572 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:26.572 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:26.605 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:26.605 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:26.605 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:26.606 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:26.606 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:26.606 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:26.606 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:26.606 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:26.606 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:26.606 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:26.606 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:26.606 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:26.608 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:26.609 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.610 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.610 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.610 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.610 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.610 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.611 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.611 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.611 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.611 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.611 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.611 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.611 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.612 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.612 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.612 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.612 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.612 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.612 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.613 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.613 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.613 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.613 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.613 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.613 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.614 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.616 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:26.630 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:26.684 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:26.684 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:26.685 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:26.685 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:26.685 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:26.685 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:26.685 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:26.685 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:26.685 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:26.686 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:26.686 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:26.686 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:26.686 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:26.695 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:26.695 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:26.695 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:26.695 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:26.695 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:26.696 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:26.696 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:26.696 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:26.696 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:26.696 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:26.696 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:26.696 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:26.696 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:26.725 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.725 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.725 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.726 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.726 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.726 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.726 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.726 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.726 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.726 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.726 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.727 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.727 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.732 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.733 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.733 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.733 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.734 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.734 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.734 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.734 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.734 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.734 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.734 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.734 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.735 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.762 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:26.762 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:26.762 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:26.762 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.762 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.763 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.763 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.763 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.763 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:26.763 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.764 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:26.763 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:26.764 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:26.814 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:26.814 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:26.814 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:26.814 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:26.814 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:26.815 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:26.815 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:26.815 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:26.815 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:26.817 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:26.817 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:26.817 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:26.817 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:26.871 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.871 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.871 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.872 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.872 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.872 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.872 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.872 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.873 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.873 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.873 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.873 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.873 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:26.884428  5187 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } attempt: 6
08:09:26.904 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.904 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.904 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.905 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.905 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.905 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.906 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.906 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.906 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.906 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.906 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.906 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.907 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 73 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091766908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:26.913 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:26.918 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 73 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
08:09:26.920 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 73 as completed for source Source: KuduSource.
08:09:26.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:26.926052  5187 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.224.188:40437: Network error: Client connection negotiation failed: client connection to 127.4.224.188:40437: connect: Connection refused (error 111)
08:09:26.944 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:26.944 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:26.944 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:26.944 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.944 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.944 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:26.945 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.945 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.945 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:26.945 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.945 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.945 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:26.945 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:26.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:26.990301  5098 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } attempt: 8
08:09:26.995 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:26.995 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:26.995 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:26.995 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:26.995 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:26.995 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:26.996 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:26.996 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:26.996 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:26.996 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:26.996 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:26.996 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:26.997 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:27.039 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:27.039 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:27.040 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:27.040 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:27.040 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:27.041 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:27.041 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:27.041 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:27.041 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:27.041 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:27.042 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:27.042 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:27.042 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:27.060 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:27.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.059789  5098 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } has no permanent_uuid. Determining permanent_uuid...
08:09:27.065 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:27.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:27.088763  5098 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.224.188:40437: Network error: Client connection negotiation failed: client connection to 127.4.224.188:40437: connect: Connection refused (error 111)
08:09:27.109 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:27.110 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:27.110 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:27.111 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:27.111 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:27.111 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:27.111 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:27.111 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:27.111 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:27.112 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:27.112 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:27.112 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:27.112 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:27.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:27.131 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:27.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.154517  5098 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } attempt: 1
08:09:27.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:27.181497  5098 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.224.188:40437: Network error: Client connection negotiation failed: client connection to 127.4.224.188:40437: connect: Connection refused (error 111)
08:09:27.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.235157  5098 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } attempt: 2
08:09:27.242 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:27.243 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:27.243 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:27.243 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:27.243 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:27.243 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:27.244 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:27.244 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:27.244 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:27.244 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:27.244 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:27.244 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:27.244 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:27.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:27.246052  5098 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.224.188:40437: Network error: Client connection negotiation failed: client connection to 127.4.224.188:40437: connect: Connection refused (error 111)
08:09:27.291 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:27.291 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:27.291 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:27.292 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:27.292 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:27.292 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:27.292 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:27.292 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:27.292 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:27.292 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:27.292 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:27.292 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:27.292 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:27.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.322846  5098 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } attempt: 3
08:09:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:27.335052  5098 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.224.188:40437: Network error: Client connection negotiation failed: client connection to 127.4.224.188:40437: connect: Connection refused (error 111)
08:09:27.410 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:27.411 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 74 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091767408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:27.422 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:27.422 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:27.422 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:27.422 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:27.422 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:27.422 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:27.423 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:27.423 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:27.423 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:27.423 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:27.424 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:27.424 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:27.424 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:27.427 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 74 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=19 ms, finalizationTime=0 ms).
08:09:27.429 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 74 as completed for source Source: KuduSource.
08:09:27.437 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:27.438 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:27.438 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:27.438 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:27.438 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:27.439 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:27.439 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:27.439 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:27.439 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:27.439 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:27.439 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:27.439 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:27.439 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:27.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.490792  5098 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } attempt: 4
08:09:27.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:27.499962  5098 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.224.188:40437: Network error: Client connection negotiation failed: client connection to 127.4.224.188:40437: connect: Connection refused (error 111)
08:09:27.513 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:27.513 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:27.514 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:27.514 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:27.514 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:27.514 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:27.514 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:27.514 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:27.514 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:27.515 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:27.515 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:27.515 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:27.515 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:27.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:27.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:27.562 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:27.562 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:27.563 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:27.563 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:27.563 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:27.564 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:27.564 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:27.564 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:27.564 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:27.564 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:27.564 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:27.564 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:27.565 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:27.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:27.631 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:27.724 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:27.725 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:27.725 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:27.725 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:27.725 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:27.726 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:27.726 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:27.726 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:27.726 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:27.726 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:27.726 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:27.726 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:27.727 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:27.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.796527  5098 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } attempt: 5
08:09:27.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:26.100615  5200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:27.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:27.503753  5198 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 5189
08:09:27.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:27.799571  5047 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.224.188:40437: connect: Connection refused (error 111) [suppressed 12 similar messages]
08:09:27.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:27.798089  5189 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.700s	user 0.600s	sys 1.029s
08:09:27.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:27.802220  5189 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.704s	user 0.601s	sys 1.029s
08:09:27.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:27.803745  5098 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.224.188:40437: Network error: Client connection negotiation failed: client connection to 127.4.224.188:40437: connect: Connection refused (error 111)
08:09:27.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:27.809903  5267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:27.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.810002  5189 server_base.cc:1061] running on GCE node
08:09:27.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.811883  5189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:09:27.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.815367  5189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:09:27.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.816736  5189 hybrid_clock.cc:648] HybridClock initialized: now 1779091767816688 us; error 68 us; skew 500 ppm
08:09:27.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.817767  5189 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:09:27.826 [DEBUG - pool-388-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30020), Traces: [0ms] sending RPC to server master-127.1.134.252:42093, [9ms] received response from server master-127.1.134.252:42093: OK, deferred=null) with no deferred attached!
08:09:27.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.830205  5189 webserver.cc:533] Webserver started at http://127.4.224.188:46803/ using document root <none> and password file <none>
08:09:27.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.831492  5189 fs_manager.cc:362] Metadata directory not provided
08:09:27.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.831807  5189 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:09:27.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.832409  5189 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:09:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.838619  5189 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-2/data/instance:
08:09:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b0553a11722241c7ae72a9688d4ecfd3"
08:09:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:27 on dist-test-slave-1jss"
08:09:27.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.840232  5189 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-2/wal/instance:
08:09:27.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b0553a11722241c7ae72a9688d4ecfd3"
08:09:27.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:27 on dist-test-slave-1jss"
08:09:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.851377  5189 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.004s	sys 0.004s
08:09:27.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.859723  5272 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:09:27.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.861447  5189 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.004s	sys 0.001s
08:09:27.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.862152  5189 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-2/wal
08:09:27.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b0553a11722241c7ae72a9688d4ecfd3"
08:09:27.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:27 on dist-test-slave-1jss"
08:09:27.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.862572  5189 fs_report.cc:389] FS layout report
08:09:27.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:09:27.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-2/wal
08:09:27.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-2/wal
08:09:27.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-2/data/data
08:09:27.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:09:27.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:09:27.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:09:27.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:09:27.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:09:27.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:09:27.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:09:27.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:09:27.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:09:27.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:09:27.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:09:27.902 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:27.903 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:27.903 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:27.903 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:27.903 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:27.903 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:27.903 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:27.903 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:27.903 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:27.903 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:27.903 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:27.904 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:27.904 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:27.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 75 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091767908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:27.909 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:27.922 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 75 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
08:09:27.923 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 75 as completed for source Source: KuduSource.
08:09:27.924 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:27.924 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:27.924 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:27.924 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:27.925 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:27.925 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:27.925 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:27.925 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:27.925 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:27.925 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:27.925 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:27.925 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:27.925 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:27.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.954618  5189 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:09:27.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.956629  5189 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:09:27.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.957226  5189 kserver.cc:163] Server-wide thread pool size limit: 3276
08:09:27.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:27.986712  5187 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } attempt: 7
08:09:27.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:27.996563  5187 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.224.188:40437: Network error: Client connection negotiation failed: client connection to 127.4.224.188:40437: connect: Connection refused (error 111)
08:09:28.030 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:28.030 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:28.031 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:28.031 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:28.031 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:28.031 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:28.032 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:28.033 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:28.033 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:28.033 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:28.033 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:28.033 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:28.033 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:28.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:28.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:28.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.069861  5189 rpc_server.cc:307] RPC server started. Bound to: 127.4.224.188:40437
08:09:28.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.069936  5325 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.224.188:40437 every 8 connection(s)
08:09:28.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.073576  5189 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-2/data/info.pb
08:09:28.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.081776  4994 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 5189
08:09:28.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.082083  5326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:09:28.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.082412  4994 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/master-2/wal/instance
08:09:28.091 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:28.091 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:28.091 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:28.091 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:28.092 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:28.092 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:28.092 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:28.092 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:28.092 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:28.092 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:28.093 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:28.093 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:28.093 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:28.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.103302  5326 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.224.190" port: 36787 } has no permanent_uuid. Determining permanent_uuid...
08:09:28.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:28.131 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:28.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.142722  5326 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } has no permanent_uuid. Determining permanent_uuid...
08:09:28.150 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:28.150 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:28.150 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:28.150 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:28.150 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:28.151 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:28.151 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:28.151 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:28.151 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:28.151 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:28.151 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:28.152 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:28.152 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:28.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.156904  5326 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } has no permanent_uuid. Determining permanent_uuid...
08:09:28.174 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:28.174 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:28.174 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:28.175 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:28.175 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:28.175 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:28.175 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:28.175 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:28.175 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:28.175 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:28.176 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:28.176 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:28.176 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:28.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.184845  5326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3: Bootstrap starting.
08:09:28.190 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:28.190 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:28.191 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:28.191 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:28.191 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:28.191 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:28.191 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:28.191 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:28.191 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:28.191 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:28.191 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:28.191 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:28.191 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:28.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.193670  5326 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3: Neither blocks nor log segments found. Creating new log.
08:09:28.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.195988  5326 log.cc:826] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3: Log is configured to *not* fsync() on all Append() calls
08:09:28.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.202859  5326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3: No bootstrap required, opened a new log
08:09:28.211 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:28.211 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:28.211 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:28.212 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:28.212 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:28.212 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:28.212 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:28.212 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:28.212 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:28.212 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:28.212 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:28.212 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:28.213 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:28.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.227509  5326 raft_consensus.cc:359] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5e3c2d43314e728701a7bfa1344ed5" member_type: VOTER last_known_addr { host: "127.4.224.190" port: 36787 } } peers { permanent_uuid: "e605137b3e4e4895922c11fe34cb66d1" member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } } peers { permanent_uuid: "b0553a11722241c7ae72a9688d4ecfd3" member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } }
08:09:28.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.228477  5326 raft_consensus.cc:385] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:09:28.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.228856  5326 raft_consensus.cc:740] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0553a11722241c7ae72a9688d4ecfd3, State: Initialized, Role: FOLLOWER
08:09:28.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.229985  5326 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5e3c2d43314e728701a7bfa1344ed5" member_type: VOTER last_known_addr { host: "127.4.224.190" port: 36787 } } peers { permanent_uuid: "e605137b3e4e4895922c11fe34cb66d1" member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } } peers { permanent_uuid: "b0553a11722241c7ae72a9688d4ecfd3" member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } }
08:09:28.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.233649  5335 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5e3c2d43314e728701a7bfa1344ed5" member_type: VOTER last_known_addr { host: "127.4.224.190" port: 36787 } } peers { permanent_uuid: "e605137b3e4e4895922c11fe34cb66d1" member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } } peers { permanent_uuid: "b0553a11722241c7ae72a9688d4ecfd3" member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } } }
08:09:28.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.234995  5335 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [sys.catalog]: This master's current role is: FOLLOWER
08:09:28.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.236088  5326 sys_catalog.cc:565] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [sys.catalog]: configured and running, proceeding with master startup.
08:09:28.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:28.274031  5346 catalog_manager.cc:1593] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:09:28.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:28.274919  5346 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:09:28.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.266757  5189 master_runner.cc:187] Error getting master registration for 127.4.224.190:36787: OK, instance_id { permanent_uuid: "1b5e3c2d43314e728701a7bfa1344ed5" instance_seqno: 1779091762350026 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:09:28.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.293967  5189 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:09:28.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.325346  5098 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } attempt: 6
08:09:28.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.352015  5335 raft_consensus.cc:493] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:09:28.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.352700  5335 raft_consensus.cc:515] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5e3c2d43314e728701a7bfa1344ed5" member_type: VOTER last_known_addr { host: "127.4.224.190" port: 36787 } } peers { permanent_uuid: "e605137b3e4e4895922c11fe34cb66d1" member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } } peers { permanent_uuid: "b0553a11722241c7ae72a9688d4ecfd3" member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } }
08:09:28.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.353729  5098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b5e3c2d43314e728701a7bfa1344ed5: Bootstrap starting.
08:09:28.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.355680  5335 leader_election.cc:290] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b5e3c2d43314e728701a7bfa1344ed5 (127.4.224.190:36787), e605137b3e4e4895922c11fe34cb66d1 (127.4.224.189:45505)
08:09:28.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.363667  5098 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b5e3c2d43314e728701a7bfa1344ed5: Neither blocks nor log segments found. Creating new log.
08:09:28.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.366798  5098 log.cc:826] T 00000000000000000000000000000000 P 1b5e3c2d43314e728701a7bfa1344ed5: Log is configured to *not* fsync() on all Append() calls
08:09:28.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.373481  5098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b5e3c2d43314e728701a7bfa1344ed5: No bootstrap required, opened a new log
08:09:28.409 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 76 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091768408 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:28.409 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:28.430 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 76 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=21 ms, finalizationTime=1 ms).
08:09:28.431 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 76 as completed for source Source: KuduSource.
08:09:28.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.439997  5098 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1b5e3c2d43314e728701a7bfa1344ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5e3c2d43314e728701a7bfa1344ed5" member_type: VOTER last_known_addr { host: "127.4.224.190" port: 36787 } } peers { permanent_uuid: "e605137b3e4e4895922c11fe34cb66d1" member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } } peers { permanent_uuid: "b0553a11722241c7ae72a9688d4ecfd3" member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } }
08:09:28.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.443342  5098 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1b5e3c2d43314e728701a7bfa1344ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:09:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.444660  5098 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1b5e3c2d43314e728701a7bfa1344ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b5e3c2d43314e728701a7bfa1344ed5, State: Initialized, Role: FOLLOWER
08:09:28.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.450865  5098 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b5e3c2d43314e728701a7bfa1344ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5e3c2d43314e728701a7bfa1344ed5" member_type: VOTER last_known_addr { host: "127.4.224.190" port: 36787 } } peers { permanent_uuid: "e605137b3e4e4895922c11fe34cb66d1" member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } } peers { permanent_uuid: "b0553a11722241c7ae72a9688d4ecfd3" member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } }
08:09:28.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.459638  5350 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b5e3c2d43314e728701a7bfa1344ed5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5e3c2d43314e728701a7bfa1344ed5" member_type: VOTER last_known_addr { host: "127.4.224.190" port: 36787 } } peers { permanent_uuid: "e605137b3e4e4895922c11fe34cb66d1" member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } } peers { permanent_uuid: "b0553a11722241c7ae72a9688d4ecfd3" member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } } }
08:09:28.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.460763  5350 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b5e3c2d43314e728701a7bfa1344ed5 [sys.catalog]: This master's current role is: FOLLOWER
08:09:28.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.464365  5098 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1b5e3c2d43314e728701a7bfa1344ed5 [sys.catalog]: configured and running, proceeding with master startup.
08:09:28.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.464591  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b0553a11722241c7ae72a9688d4ecfd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b5e3c2d43314e728701a7bfa1344ed5" is_pre_election: true
08:09:28.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:28.465629  5278 tablet.cc:2404] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:09:28.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.465616  5073 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1b5e3c2d43314e728701a7bfa1344ed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0553a11722241c7ae72a9688d4ecfd3 in term 0.
08:09:28.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.468010  5275 leader_election.cc:304] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b5e3c2d43314e728701a7bfa1344ed5, b0553a11722241c7ae72a9688d4ecfd3; no voters: 
08:09:28.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.469103  5335 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:09:28.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.469491  5335 raft_consensus.cc:493] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:09:28.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.469842  5335 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [term 0 FOLLOWER]: Advancing to term 1
08:09:28.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.480016  5335 raft_consensus.cc:515] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5e3c2d43314e728701a7bfa1344ed5" member_type: VOTER last_known_addr { host: "127.4.224.190" port: 36787 } } peers { permanent_uuid: "e605137b3e4e4895922c11fe34cb66d1" member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } } peers { permanent_uuid: "b0553a11722241c7ae72a9688d4ecfd3" member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } }
08:09:28.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.493639  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b0553a11722241c7ae72a9688d4ecfd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b5e3c2d43314e728701a7bfa1344ed5"
08:09:28.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.494320  5073 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1b5e3c2d43314e728701a7bfa1344ed5 [term 0 FOLLOWER]: Advancing to term 1
08:09:28.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.503279  5073 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1b5e3c2d43314e728701a7bfa1344ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0553a11722241c7ae72a9688d4ecfd3 in term 1.
08:09:28.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.504629  5275 leader_election.cc:304] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b5e3c2d43314e728701a7bfa1344ed5, b0553a11722241c7ae72a9688d4ecfd3; no voters: 
08:09:28.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.510608  5353 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [term 1 FOLLOWER]: Leader election won for term 1
08:09:28.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.510670  5335 leader_election.cc:290] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [CANDIDATE]: Term 1 election: Requested vote from peers 1b5e3c2d43314e728701a7bfa1344ed5 (127.4.224.190:36787), e605137b3e4e4895922c11fe34cb66d1 (127.4.224.189:45505)
08:09:28.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:28.522367  5052 tablet.cc:2404] T 00000000000000000000000000000000 P 1b5e3c2d43314e728701a7bfa1344ed5: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:09:28.544 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:28.544 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:28.544 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:28.545 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:28.545 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:28.545 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:28.545 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:28.546 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:28.546 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:28.546 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:28.546 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:28.546 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:28.546 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:28.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.547969  5353 raft_consensus.cc:697] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [term 1 LEADER]: Becoming Leader. State: Replica: b0553a11722241c7ae72a9688d4ecfd3, State: Running, Role: LEADER
08:09:28.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.549443  5353 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5e3c2d43314e728701a7bfa1344ed5" member_type: VOTER last_known_addr { host: "127.4.224.190" port: 36787 } } peers { permanent_uuid: "e605137b3e4e4895922c11fe34cb66d1" member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } } peers { permanent_uuid: "b0553a11722241c7ae72a9688d4ecfd3" member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } }
08:09:28.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:28.554 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:28.554 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:28.554 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:28.554 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:28.555 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:28.555 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:28.555 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:28.555 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:28.555 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:28.555 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:28.555 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:28.555 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:28.555 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:28.555 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:28.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.571334  5335 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0553a11722241c7ae72a9688d4ecfd3. Latest consensus state: current_term: 1 leader_uuid: "b0553a11722241c7ae72a9688d4ecfd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5e3c2d43314e728701a7bfa1344ed5" member_type: VOTER last_known_addr { host: "127.4.224.190" port: 36787 } } peers { permanent_uuid: "e605137b3e4e4895922c11fe34cb66d1" member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } } peers { permanent_uuid: "b0553a11722241c7ae72a9688d4ecfd3" member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } } }
08:09:28.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.576576  5335 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [sys.catalog]: This master's current role is: LEADER
08:09:28.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.590624  5358 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
08:09:28.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.626922  5358 catalog_manager.cc:1519] Initializing Kudu cluster ID...
08:09:28.631 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:28.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:28.663965  5365 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 1b5e3c2d43314e728701a7bfa1344ed5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:09:28.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:28.664474  5365 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:09:28.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.665202  5073 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 1b5e3c2d43314e728701a7bfa1344ed5 [term 1 FOLLOWER]: Refusing update from remote peer b0553a11722241c7ae72a9688d4ecfd3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:09:28.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.672215  5353 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b5e3c2d43314e728701a7bfa1344ed5" member_type: VOTER last_known_addr { host: "127.4.224.190" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:09:28.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.656103  5006 master_runner.cc:187] Error getting master registration for 127.4.224.189:45505: OK, instance_id { permanent_uuid: "e605137b3e4e4895922c11fe34cb66d1" instance_seqno: 1779091765536752 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:09:28.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.701411  5006 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:09:28.731 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:28.732 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:28.732 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:28.732 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:28.732 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:28.732 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:28.732 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:28.732 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:28.733 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:28.733 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:28.733 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:28.733 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:28.733 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:28.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.743530  5366 mvcc.cc:204] Tried to move back new op lower bound from 7287159884422889472 to 7287159884011077632. Current Snapshot: MvccSnapshot[applied={T|T < 7287159884422889472}]
08:09:28.753 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:28.754 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:28.754 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:28.755 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:28.755 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:28.755 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:28.755 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:28.755 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:28.755 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:28.755 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:28.756 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:28.756 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:28.756 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:28.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.759526  5368 mvcc.cc:204] Tried to move back new op lower bound from 7287159884422889472 to 7287159884011077632. Current Snapshot: MvccSnapshot[applied={T|T < 7287159884422889472}]
08:09:28.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.759891  5350 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b5e3c2d43314e728701a7bfa1344ed5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0553a11722241c7ae72a9688d4ecfd3. Latest consensus state: current_term: 1 leader_uuid: "b0553a11722241c7ae72a9688d4ecfd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5e3c2d43314e728701a7bfa1344ed5" member_type: VOTER last_known_addr { host: "127.4.224.190" port: 36787 } } peers { permanent_uuid: "e605137b3e4e4895922c11fe34cb66d1" member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } } peers { permanent_uuid: "b0553a11722241c7ae72a9688d4ecfd3" member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } } }
08:09:28.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.764560  5355 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b0553a11722241c7ae72a9688d4ecfd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5e3c2d43314e728701a7bfa1344ed5" member_type: VOTER last_known_addr { host: "127.4.224.190" port: 36787 } } peers { permanent_uuid: "e605137b3e4e4895922c11fe34cb66d1" member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } } peers { permanent_uuid: "b0553a11722241c7ae72a9688d4ecfd3" member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } } }
08:09:28.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.765398  5355 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [sys.catalog]: This master's current role is: LEADER
08:09:28.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.765141  5350 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b5e3c2d43314e728701a7bfa1344ed5 [sys.catalog]: This master's current role is: FOLLOWER
08:09:28.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.769500  5371 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b5e3c2d43314e728701a7bfa1344ed5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b0553a11722241c7ae72a9688d4ecfd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5e3c2d43314e728701a7bfa1344ed5" member_type: VOTER last_known_addr { host: "127.4.224.190" port: 36787 } } peers { permanent_uuid: "e605137b3e4e4895922c11fe34cb66d1" member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } } peers { permanent_uuid: "b0553a11722241c7ae72a9688d4ecfd3" member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } } }
08:09:28.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.770432  5371 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b5e3c2d43314e728701a7bfa1344ed5 [sys.catalog]: This master's current role is: FOLLOWER
08:09:28.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.780246  5358 catalog_manager.cc:1382] Generated new cluster ID: 261bfcefd0244b1b9c6c0467806f92d5
08:09:28.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.780591  5358 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
08:09:28.835 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:28.835 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:28.835 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:28.836 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:28.836 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:28.836 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:28.836 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:28.836 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:28.836 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:28.837 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:28.837 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:28.837 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:28.837 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:28.840 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:28.840 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:28.840 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:28.840 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:28.840 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:28.840 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:28.840 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:28.840 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:28.840 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:28.840 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:28.840 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:28.841 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:28.841 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:28.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.843283  5358 catalog_manager.cc:1405] Generated new certificate authority record
08:09:28.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.850317  5358 catalog_manager.cc:1539] Loading token signing keys...
08:09:28.858 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:28.858 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:28.858 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:28.859 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:28.859 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:28.859 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:28.859 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:28.859 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:28.859 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:28.860 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:28.860 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:28.860 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:28.860 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:28.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 77 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091768908 for job 09c2845f1c2e95ee63afce247a128bdd.
08:09:28.913 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:28.921 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 77 for job 09c2845f1c2e95ee63afce247a128bdd (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
08:09:28.923 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 77 as completed for source Source: KuduSource.
08:09:28.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.930863  5358 catalog_manager.cc:6069] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3: Generated new TSK 0
08:09:28.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.932526  5358 catalog_manager.cc:1549] Initializing in-progress tserver states...
08:09:28.978 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:28.979 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:28.979 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:28.979 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:28.979 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:28.979 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:28.980 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:28.980 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:28.980 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:28.981 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:28.981 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:28.981 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:28.981 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:28.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:28.983086  4994 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:09:28.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:09:28.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-0/wal
08:09:28.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-0/data
08:09:28.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:09:28.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:09:28.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:09:28.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:09:28.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:09:28.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:09:28.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-0/logs
08:09:28.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-0/data/info.pb
08:09:28.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:09:28.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:09:28.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:09:28.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:09:28.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:09:28.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:09:28.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:09:28.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:09:28.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:09:28.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:09:28.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.224.129:0
08:09:28.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.224.129
08:09:28.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.224.129
08:09:28.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:09:28.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.224.190:36787,127.4.224.189:45505,127.4.224.188:40437
08:09:28.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.224.148:40383
08:09:28.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:09:28.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:09:28.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:09:29.026 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:29.026 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:29.026 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:29.027 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.027 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.027 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.027 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.027 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.027 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.027 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.028 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.028 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.028 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:29.029 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=23, TimeoutTracker(timeout=30000, elapsed=29237), Traces: [0ms] sending RPC to server master-127.1.134.252:42093, [2ms] received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [14ms] refreshing cache from master, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [16ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [17ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [17ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [18ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [35ms] refreshing cache from master, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [38ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [38ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [38ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [38ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [54ms] refreshing cache from master, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [56ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [56ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [56ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [56ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [75ms] refreshing cache from master, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [76ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [76ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [76ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [77ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [115ms] refreshing cache from master, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [117ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [117ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [117ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [117ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [155ms] refreshing cache from master, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [156ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [156ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [156ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [157ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [157ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [214ms] refreshing cache from master, [215ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [218ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [219ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [219ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [219ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [219ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [375ms] refreshing cache from master, [375ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [376ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [376ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [377ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [377ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [377ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [378ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [794ms] refreshing cache from master, [795ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [795ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [795ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [795ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [795ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [795ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [795ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [1395ms] refreshing cache from master, [1395ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [1396ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [1396ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [1396ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [1396ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [1396ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [1397ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [1614ms] refreshing cache from master, [1614ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [1615ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [1615ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [1615ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [1615ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [1615ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [1615ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [4835ms] refreshing cache from master, [4835ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [4836ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [4836ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [4836ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [4837ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [4837ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [4837ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [6915ms] refreshing cache from master, [6915ms] too many traces: truncated at 100 traces, deferred=Deferred@1698772067(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$232/0x00007f7544330000@597bddde -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1076258278 after retry RPC after error@1947137162) -> (continuation of Deferred@402666564 after retry RPC after error@529702839) -> (continuation of Deferred@1827197174 after retry RPC after error@1866580805) -> (continuation of Deferred@1987733757 after retry RPC after error@2099130018) -> (continuation of Deferred@1473982103 after retry RPC after error@912360642) -> (continuation of Deferred@335101811 after retry RPC after error@522090640) -> (continuation of Deferred@297747058 after retry RPC after error@734171923) -> (continuation of Deferred@1905931199 after retry RPC after error@497819620) -> (continuation of Deferred@1995141873 after retry RPC after error@1234054452) -> (continuation of Deferred@1764354161 after retry RPC after error@344430991) -> (continuation of Deferred@970333460 after retry RPC after error@17395863) -> (continuation of Deferred@667253415 after retry RPC after error@262587441) -> (continuation of Deferred@101799532 after retry RPC after error@1289098225) -> (continuation of Deferred@1078610062 after retry RPC after error@2037685242) -> (continuation of Deferred@1968832654 after retry RPC after error@166710351) -> (continuation of Deferred@460585924 after retry RPC after error@1174734875) -> (continuation of Deferred@1669213733 after retry RPC after error@344202161) -> (continuation of Deferred@271413054 after retry RPC after error@2114386160) -> (continuation of Deferred@1822162451 after retry RPC after error@1492527522) -> (continuation of Deferred@601487645 after retry RPC after error@1783715054) -> (continuation of Deferred@1493779665 after retry RPC after error@819715435), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1076258278 after retry RPC after error@1947137162) -> (continuation of Deferred@402666564 after retry RPC after error@529702839) -> (continuation of Deferred@1827197174 after retry RPC after error@1866580805) -> (continuation of Deferred@1987733757 after retry RPC after error@2099130018) -> (continuation of Deferred@1473982103 after retry RPC after error@912360642) -> (continuation of Deferred@335101811 after retry RPC after error@522090640) -> (continuation of Deferred@297747058 after retry RPC after error@734171923) -> (continuation of Deferred@1905931199 after retry RPC after error@497819620) -> (continuation of Deferred@1995141873 after retry RPC after error@1234054452) -> (continuation of Deferred@1764354161 after retry RPC after error@344430991) -> (continuation of Deferred@970333460 after retry RPC after error@17395863) -> (continuation of Deferred@667253415 after retry RPC after error@262587441) -> (continuation of Deferred@101799532 after retry RPC after error@1289098225) -> (continuation of Deferred@1078610062 after retry RPC after error@2037685242) -> (continuation of Deferred@1968832654 after retry RPC after error@166710351) -> (continuation of Deferred@460585924 after retry RPC after error@1174734875) -> (continuation of Deferred@1669213733 after retry RPC after error@344202161) -> (continuation of Deferred@271413054 after retry RPC after error@2114386160) -> (continuation of Deferred@1822162451 after retry RPC after error@1492527522) -> (continuation of Deferred@601487645 after retry RPC after error@1783715054) -> (continuation of Deferred@1493779665 after retry RPC after error@819715435)))
08:09:29.031 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=23, TimeoutTracker(timeout=30000, elapsed=29237), Traces: [0ms] sending RPC to server master-127.1.134.252:42093, [2ms] received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [14ms] refreshing cache from master, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [16ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [17ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [17ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [18ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [35ms] refreshing cache from master, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [38ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [38ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [38ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [38ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [54ms] refreshing cache from master, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [56ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [56ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [56ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [56ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [75ms] refreshing cache from master, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [76ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [76ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [76ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [77ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [115ms] refreshing cache from master, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [117ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [117ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [117ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [117ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [155ms] refreshing cache from master, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [156ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [156ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [156ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [157ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [157ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [214ms] refreshing cache from master, [215ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [218ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [219ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [219ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [219ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [219ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [375ms] refreshing cache from master, [375ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [376ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [376ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [377ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [377ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [377ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [378ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [794ms] refreshing cache from master, [795ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [795ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [795ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [795ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [795ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [795ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [795ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [1395ms] refreshing cache from master, [1395ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [1396ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [1396ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [1396ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [1396ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [1396ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [1397ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [1614ms] refreshing cache from master, [1614ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [1615ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [1615ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [1615ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [1615ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [1615ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [1615ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [4835ms] refreshing cache from master, [4835ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [4836ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [4836ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [4836ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [4837ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [4837ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [4837ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [6915ms] refreshing cache from master, [6915ms] too many traces: truncated at 100 traces, deferred=Deferred@1698772067(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$232/0x00007f7544330000@597bddde -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1076258278 after retry RPC after error@1947137162) -> (continuation of Deferred@402666564 after retry RPC after error@529702839) -> (continuation of Deferred@1827197174 after retry RPC after error@1866580805) -> (continuation of Deferred@1987733757 after retry RPC after error@2099130018) -> (continuation of Deferred@1473982103 after retry RPC after error@912360642) -> (continuation of Deferred@335101811 after retry RPC after error@522090640) -> (continuation of Deferred@297747058 after retry RPC after error@734171923) -> (continuation of Deferred@1905931199 after retry RPC after error@497819620) -> (continuation of Deferred@1995141873 after retry RPC after error@1234054452) -> (continuation of Deferred@1764354161 after retry RPC after error@344430991) -> (continuation of Deferred@970333460 after retry RPC after error@17395863) -> (continuation of Deferred@667253415 after retry RPC after error@262587441) -> (continuation of Deferred@101799532 after retry RPC after error@1289098225) -> (continuation of Deferred@1078610062 after retry RPC after error@2037685242) -> (continuation of Deferred@1968832654 after retry RPC after error@166710351) -> (continuation of Deferred@460585924 after retry RPC after error@1174734875) -> (continuation of Deferred@1669213733 after retry RPC after error@344202161) -> (continuation of Deferred@271413054 after retry RPC after error@2114386160) -> (continuation of Deferred@1822162451 after retry RPC after error@1492527522) -> (continuation of Deferred@601487645 after retry RPC after error@1783715054) -> (continuation of Deferred@1493779665 after retry RPC after error@819715435), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1076258278 after retry RPC after error@1947137162) -> (continuation of Deferred@402666564 after retry RPC after error@529702839) -> (continuation of Deferred@1827197174 after retry RPC after error@1866580805) -> (continuation of Deferred@1987733757 after retry RPC after error@2099130018) -> (continuation of Deferred@1473982103 after retry RPC after error@912360642) -> (continuation of Deferred@335101811 after retry RPC after error@522090640) -> (continuation of Deferred@297747058 after retry RPC after error@734171923) -> (continuation of Deferred@1905931199 after retry RPC after error@497819620) -> (continuation of Deferred@1995141873 after retry RPC after error@1234054452) -> (continuation of Deferred@1764354161 after retry RPC after error@344430991) -> (continuation of Deferred@970333460 after retry RPC after error@17395863) -> (continuation of Deferred@667253415 after retry RPC after error@262587441) -> (continuation of Deferred@101799532 after retry RPC after error@1289098225) -> (continuation of Deferred@1078610062 after retry RPC after error@2037685242) -> (continuation of Deferred@1968832654 after retry RPC after error@166710351) -> (continuation of Deferred@460585924 after retry RPC after error@1174734875) -> (continuation of Deferred@1669213733 after retry RPC after error@344202161) -> (continuation of Deferred@271413054 after retry RPC after error@2114386160) -> (continuation of Deferred@1822162451 after retry RPC after error@1492527522) -> (continuation of Deferred@601487645 after retry RPC after error@1783715054) -> (continuation of Deferred@1493779665 after retry RPC after error@819715435)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=23, TimeoutTracker(timeout=30000, elapsed=29237), Traces: [0ms] sending RPC to server master-127.1.134.252:42093, [2ms] received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [14ms] refreshing cache from master, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [16ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [17ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [17ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [18ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [35ms] refreshing cache from master, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [38ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [38ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [38ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [38ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [54ms] refreshing cache from master, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [56ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [56ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [56ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [56ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [75ms] refreshing cache from master, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [76ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [76ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [76ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [77ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [115ms] refreshing cache from master, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [117ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [117ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [117ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [117ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [155ms] refreshing cache from master, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [156ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [156ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [156ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [157ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [157ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [214ms] refreshing cache from master, [215ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [218ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [219ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [219ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [219ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [219ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [375ms] refreshing cache from master, [375ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [376ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [376ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [377ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [377ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [377ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [378ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [794ms] refreshing cache from master, [795ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [795ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [795ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [795ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [795ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [795ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [795ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [1395ms] refreshing cache from master, [1395ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [1396ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [1396ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [1396ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [1396ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [1396ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [1397ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [1614ms] refreshing cache from master, [1614ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [1615ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [1615ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [1615ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [1615ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [1615ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [1615ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [4835ms] refreshing cache from master, [4835ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [4836ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [4836ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [4836ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [4837ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [4837ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [4837ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [6915ms] refreshing cache from master, [6915ms] too many traces: truncated at 100 traces, deferred=Deferred@1698772067(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$232/0x00007f7544330000@597bddde -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1076258278 after retry RPC after error@1947137162) -> (continuation of Deferred@402666564 after retry RPC after error@529702839) -> (continuation of Deferred@1827197174 after retry RPC after error@1866580805) -> (continuation of Deferred@1987733757 after retry RPC after error@2099130018) -> (continuation of Deferred@1473982103 after retry RPC after error@912360642) -> (continuation of Deferred@335101811 after retry RPC after error@522090640) -> (continuation of Deferred@297747058 after retry RPC after error@734171923) -> (continuation of Deferred@1905931199 after retry RPC after error@497819620) -> (continuation of Deferred@1995141873 after retry RPC after error@1234054452) -> (continuation of Deferred@1764354161 after retry RPC after error@344430991) -> (continuation of Deferred@970333460 after retry RPC after error@17395863) -> (continuation of Deferred@667253415 after retry RPC after error@262587441) -> (continuation of Deferred@101799532 after retry RPC after error@1289098225) -> (continuation of Deferred@1078610062 after retry RPC after error@2037685242) -> (continuation of Deferred@1968832654 after retry RPC after error@166710351) -> (continuation of Deferred@460585924 after retry RPC after error@1174734875) -> (continuation of Deferred@1669213733 after retry RPC after error@344202161) -> (continuation of Deferred@271413054 after retry RPC after error@2114386160) -> (continuation of Deferred@1822162451 after retry RPC after error@1492527522) -> (continuation of Deferred@601487645 after retry RPC after error@1783715054) -> (continuation of Deferred@1493779665 after retry RPC after error@819715435), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1076258278 after retry RPC after error@1947137162) -> (continuation of Deferred@402666564 after retry RPC after error@529702839) -> (continuation of Deferred@1827197174 after retry RPC after error@1866580805) -> (continuation of Deferred@1987733757 after retry RPC after error@2099130018) -> (continuation of Deferred@1473982103 after retry RPC after error@912360642) -> (continuation of Deferred@335101811 after retry RPC after error@522090640) -> (continuation of Deferred@297747058 after retry RPC after error@734171923) -> (continuation of Deferred@1905931199 after retry RPC after error@497819620) -> (continuation of Deferred@1995141873 after retry RPC after error@1234054452) -> (continuation of Deferred@1764354161 after retry RPC after error@344430991) -> (continuation of Deferred@970333460 after retry RPC after error@17395863) -> (continuation of Deferred@667253415 after retry RPC after error@262587441) -> (continuation of Deferred@101799532 after retry RPC after error@1289098225) -> (continuation of Deferred@1078610062 after retry RPC after error@2037685242) -> (continuation of Deferred@1968832654 after retry RPC after error@166710351) -> (continuation of Deferred@460585924 after retry RPC after error@1174734875) -> (continuation of Deferred@1669213733 after retry RPC after error@344202161) -> (continuation of Deferred@271413054 after retry RPC after error@2114386160) -> (continuation of Deferred@1822162451 after retry RPC after error@1492527522) -> (continuation of Deferred@601487645 after retry RPC after error@1783715054) -> (continuation of Deferred@1493779665 after retry RPC after error@819715435)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.134.254:38449
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:29.032 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:29.033 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:29.033 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:29.033 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.033 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.034 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.034 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.035 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.035 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.037 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.037 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.037 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.037 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:29.046 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:29.046 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:29.047 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:29.047 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.047 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.047 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.047 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.047 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.047 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.047 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.048 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.048 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.048 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:29.051 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=23, TimeoutTracker(timeout=30000, elapsed=29237), Traces: [0ms] sending RPC to server master-127.1.134.252:42093, [2ms] received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [14ms] refreshing cache from master, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [16ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [17ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [17ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [18ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [35ms] refreshing cache from master, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [38ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [38ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [38ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [38ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [54ms] refreshing cache from master, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [56ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [56ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [56ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [56ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [75ms] refreshing cache from master, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [76ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [76ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [76ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [77ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [115ms] refreshing cache from master, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [117ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [117ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [117ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [117ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [155ms] refreshing cache from master, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [156ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [156ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [156ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [157ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [157ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [214ms] refreshing cache from master, [215ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [218ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [219ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [219ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [219ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [219ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [375ms] refreshing cache from master, [375ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [376ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [376ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [377ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [377ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [377ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [378ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [794ms] refreshing cache from master, [795ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [795ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [795ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [795ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [795ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [795ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [795ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [1395ms] refreshing cache from master, [1395ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [1396ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [1396ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [1396ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [1396ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [1396ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [1397ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [1614ms] refreshing cache from master, [1614ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [1615ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [1615ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [1615ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [1615ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [1615ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [1615ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [4835ms] refreshing cache from master, [4835ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [4836ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [4836ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [4836ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [4837ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [4837ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [4837ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [6915ms] refreshing cache from master, [6915ms] too many traces: truncated at 100 traces, deferred=Deferred@1698772067(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$232/0x00007f7544330000@597bddde -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1076258278 after retry RPC after error@1947137162) -> (continuation of Deferred@402666564 after retry RPC after error@529702839) -> (continuation of Deferred@1827197174 after retry RPC after error@1866580805) -> (continuation of Deferred@1987733757 after retry RPC after error@2099130018) -> (continuation of Deferred@1473982103 after retry RPC after error@912360642) -> (continuation of Deferred@335101811 after retry RPC after error@522090640) -> (continuation of Deferred@297747058 after retry RPC after error@734171923) -> (continuation of Deferred@1905931199 after retry RPC after error@497819620) -> (continuation of Deferred@1995141873 after retry RPC after error@1234054452) -> (continuation of Deferred@1764354161 after retry RPC after error@344430991) -> (continuation of Deferred@970333460 after retry RPC after error@17395863) -> (continuation of Deferred@667253415 after retry RPC after error@262587441) -> (continuation of Deferred@101799532 after retry RPC after error@1289098225) -> (continuation of Deferred@1078610062 after retry RPC after error@2037685242) -> (continuation of Deferred@1968832654 after retry RPC after error@166710351) -> (continuation of Deferred@460585924 after retry RPC after error@1174734875) -> (continuation of Deferred@1669213733 after retry RPC after error@344202161) -> (continuation of Deferred@271413054 after retry RPC after error@2114386160) -> (continuation of Deferred@1822162451 after retry RPC after error@1492527522) -> (continuation of Deferred@601487645 after retry RPC after error@1783715054) -> (continuation of Deferred@1493779665 after retry RPC after error@819715435), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1076258278 after retry RPC after error@1947137162) -> (continuation of Deferred@402666564 after retry RPC after error@529702839) -> (continuation of Deferred@1827197174 after retry RPC after error@1866580805) -> (continuation of Deferred@1987733757 after retry RPC after error@2099130018) -> (continuation of Deferred@1473982103 after retry RPC after error@912360642) -> (continuation of Deferred@335101811 after retry RPC after error@522090640) -> (continuation of Deferred@297747058 after retry RPC after error@734171923) -> (continuation of Deferred@1905931199 after retry RPC after error@497819620) -> (continuation of Deferred@1995141873 after retry RPC after error@1234054452) -> (continuation of Deferred@1764354161 after retry RPC after error@344430991) -> (continuation of Deferred@970333460 after retry RPC after error@17395863) -> (continuation of Deferred@667253415 after retry RPC after error@262587441) -> (continuation of Deferred@101799532 after retry RPC after error@1289098225) -> (continuation of Deferred@1078610062 after retry RPC after error@2037685242) -> (continuation of Deferred@1968832654 after retry RPC after error@166710351) -> (continuation of Deferred@460585924 after retry RPC after error@1174734875) -> (continuation of Deferred@1669213733 after retry RPC after error@344202161) -> (continuation of Deferred@271413054 after retry RPC after error@2114386160) -> (continuation of Deferred@1822162451 after retry RPC after error@1492527522) -> (continuation of Deferred@601487645 after retry RPC after error@1783715054) -> (continuation of Deferred@1493779665 after retry RPC after error@819715435)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=23, TimeoutTracker(timeout=30000, elapsed=29237), Traces: [0ms] sending RPC to server master-127.1.134.252:42093, [2ms] received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [14ms] refreshing cache from master, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [16ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [17ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [17ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [18ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [35ms] refreshing cache from master, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [38ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [38ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [38ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [38ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [54ms] refreshing cache from master, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [56ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [56ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [56ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [56ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [75ms] refreshing cache from master, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [76ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [76ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [76ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [77ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [115ms] refreshing cache from master, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [117ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [117ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [117ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [117ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [155ms] refreshing cache from master, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [156ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [156ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [156ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [157ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [157ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [214ms] refreshing cache from master, [215ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [218ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [219ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [219ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [219ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [219ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [375ms] refreshing cache from master, [375ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [376ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [376ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [377ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [377ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [377ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [378ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [794ms] refreshing cache from master, [795ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [795ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [795ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [795ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [795ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [795ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [795ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [1395ms] refreshing cache from master, [1395ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [1396ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [1396ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [1396ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [1396ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [1396ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [1397ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [1614ms] refreshing cache from master, [1614ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [1615ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [1615ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [1615ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [1615ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [1615ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [1615ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [4835ms] refreshing cache from master, [4835ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.254:38449, [4836ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.253:41425, [4836ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.134.252:42093, [4836ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.254:38449: Network error: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449, [4837ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.253:41425: Network error: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425, [4837ms] Sub RPC ConnectToMaster: received response from server master-127.1.134.252:42093: Network error: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [4837ms] delaying RPC due to: Service unavailable: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093, [6915ms] refreshing cache from master, [6915ms] too many traces: truncated at 100 traces, deferred=Deferred@1698772067(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$232/0x00007f7544330000@597bddde -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1076258278 after retry RPC after error@1947137162) -> (continuation of Deferred@402666564 after retry RPC after error@529702839) -> (continuation of Deferred@1827197174 after retry RPC after error@1866580805) -> (continuation of Deferred@1987733757 after retry RPC after error@2099130018) -> (continuation of Deferred@1473982103 after retry RPC after error@912360642) -> (continuation of Deferred@335101811 after retry RPC after error@522090640) -> (continuation of Deferred@297747058 after retry RPC after error@734171923) -> (continuation of Deferred@1905931199 after retry RPC after error@497819620) -> (continuation of Deferred@1995141873 after retry RPC after error@1234054452) -> (continuation of Deferred@1764354161 after retry RPC after error@344430991) -> (continuation of Deferred@970333460 after retry RPC after error@17395863) -> (continuation of Deferred@667253415 after retry RPC after error@262587441) -> (continuation of Deferred@101799532 after retry RPC after error@1289098225) -> (continuation of Deferred@1078610062 after retry RPC after error@2037685242) -> (continuation of Deferred@1968832654 after retry RPC after error@166710351) -> (continuation of Deferred@460585924 after retry RPC after error@1174734875) -> (continuation of Deferred@1669213733 after retry RPC after error@344202161) -> (continuation of Deferred@271413054 after retry RPC after error@2114386160) -> (continuation of Deferred@1822162451 after retry RPC after error@1492527522) -> (continuation of Deferred@601487645 after retry RPC after error@1783715054) -> (continuation of Deferred@1493779665 after retry RPC after error@819715435), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1076258278 after retry RPC after error@1947137162) -> (continuation of Deferred@402666564 after retry RPC after error@529702839) -> (continuation of Deferred@1827197174 after retry RPC after error@1866580805) -> (continuation of Deferred@1987733757 after retry RPC after error@2099130018) -> (continuation of Deferred@1473982103 after retry RPC after error@912360642) -> (continuation of Deferred@335101811 after retry RPC after error@522090640) -> (continuation of Deferred@297747058 after retry RPC after error@734171923) -> (continuation of Deferred@1905931199 after retry RPC after error@497819620) -> (continuation of Deferred@1995141873 after retry RPC after error@1234054452) -> (continuation of Deferred@1764354161 after retry RPC after error@344430991) -> (continuation of Deferred@970333460 after retry RPC after error@17395863) -> (continuation of Deferred@667253415 after retry RPC after error@262587441) -> (continuation of Deferred@101799532 after retry RPC after error@1289098225) -> (continuation of Deferred@1078610062 after retry RPC after error@2037685242) -> (continuation of Deferred@1968832654 after retry RPC after error@166710351) -> (continuation of Deferred@460585924 after retry RPC after error@1174734875) -> (continuation of Deferred@1669213733 after retry RPC after error@344202161) -> (continuation of Deferred@271413054 after retry RPC after error@2114386160) -> (continuation of Deferred@1822162451 after retry RPC after error@1492527522) -> (continuation of Deferred@601487645 after retry RPC after error@1783715054) -> (continuation of Deferred@1493779665 after retry RPC after error@819715435)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.134.254:38449
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:29.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:29.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:29.063 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
08:09:29.063 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (09c2845f1c2e95ee63afce247a128bdd) switched from state RUNNING to RESTARTING.
08:09:29.064 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
08:09:29.064 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
08:09:29.068 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#0) of source Source: KuduSource.
08:09:29.068 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#0) of source Source: KuduSource.
08:09:29.069 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
08:09:29.069 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
08:09:29.069 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
08:09:29.070 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:29.070 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:29.070 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:29.071 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.071 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.071 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.072 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.072 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.072 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.072 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.072 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.072 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.073 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:29.075 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.2.90.189:41065(127.2.90.189:41065)] disconnecting while in state TERMINATED
08:09:29.075 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.2.90.190:42265(127.2.90.190:42265)] disconnecting while in state TERMINATED
08:09:29.075 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.2.90.188:42457(127.2.90.188:42457)] disconnecting while in state TERMINATED
08:09:29.075 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)] disconnecting while in state TERMINATED
08:09:29.075 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:09:29.076 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
08:09:29.076 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-1
08:09:29.076 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-2
08:09:29.077 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
08:09:29.077 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
08:09:29.079 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
08:09:29.079 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
08:09:29.086 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
08:09:29.086 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
08:09:29.086 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
08:09:29.087 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:29.087 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:29.087 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:29.087 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.087 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.087 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.088 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.088 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.088 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.088 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.088 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.088 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.088 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:29.109 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:29.109 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:29.109 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:29.110 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.110 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.110 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.111 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.111 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.111 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.111 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.111 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.111 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.112 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:29.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:29.120 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.2.90.189:41065(127.2.90.189:41065)] disconnecting while in state TERMINATED
08:09:29.120 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.2.90.190:42265(127.2.90.190:42265)] disconnecting while in state TERMINATED
08:09:29.120 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.2.90.188:42457(127.2.90.188:42457)] disconnecting while in state TERMINATED
08:09:29.120 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)] disconnecting while in state TERMINATED
08:09:29.121 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:09:29.122 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:09:29.123 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
08:09:29.123 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-1
08:09:29.126 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:29.126 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:29.126 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:29.126 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.126 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.126 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.127 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.127 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.127 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.127 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.127 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.127 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.127 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:29.128 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
08:09:29.129 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
08:09:29.129 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
08:09:29.131 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:29.150 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-3
08:09:29.150 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
08:09:29.152 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
08:09:29.152 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
08:09:29.160 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
08:09:29.160 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
08:09:29.160 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
08:09:29.161 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
08:09:29.165 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.2.90.189:41065(127.2.90.189:41065)] disconnecting while in state TERMINATED
08:09:29.165 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.2.90.190:42265(127.2.90.190:42265)] disconnecting while in state TERMINATED
08:09:29.165 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.2.90.188:42457(127.2.90.188:42457)] disconnecting while in state TERMINATED
08:09:29.165 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)] disconnecting while in state TERMINATED
08:09:29.165 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:09:29.166 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
08:09:29.166 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-1
08:09:29.166 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
08:09:29.179 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
08:09:29.180 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
08:09:29.180 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
08:09:29.194 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.2.90.189:41065(127.2.90.189:41065)] disconnecting while in state TERMINATED
08:09:29.194 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer fecbf6c21a40400fac9aa6a557be405c(127.2.90.131:33107)] disconnecting while in state TERMINATED
08:09:29.194 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.2.90.190:42265(127.2.90.190:42265)] disconnecting while in state TERMINATED
08:09:29.194 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.2.90.188:42457(127.2.90.188:42457)] disconnecting while in state TERMINATED
08:09:29.194 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 5e3589ebfaf94fe5849b6322dc8e0be0(127.2.90.130:34617)] disconnecting while in state TERMINATED
08:09:29.195 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:09:29.196 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
08:09:29.196 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-3
08:09:29.196 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-1
08:09:29.196 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:09:29.200 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#0 c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_0.
08:09:29.200 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#0 c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
08:09:29.201 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
08:09:29.202 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
08:09:29.203 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 09c2845f1c2e95ee63afce247a128bdd: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:09:29.203 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 09c2845f1c2e95ee63afce247a128bdd: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:09:29.204 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:29.205 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:29.205 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:29.205 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:29.205 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:29.205 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:29.205 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:29.205 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:29.205 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:29.205 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:29.205 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:29.206 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:29.206 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:29.206 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:29.206 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.206 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.206 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.207 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.207 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.207 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.207 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.207 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.207 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.208 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:29.205 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:29.210 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:29.213 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-4
08:09:29.213 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
08:09:29.214 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
08:09:29.214 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
08:09:29.215 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
08:09:29.215 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
08:09:29.216 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 09c2845f1c2e95ee63afce247a128bdd: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:09:29.230 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
08:09:29.231 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
08:09:29.232 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
08:09:29.234 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
08:09:29.235 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-3
08:09:29.235 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
08:09:29.236 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 09c2845f1c2e95ee63afce247a128bdd
08:09:29.245 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:29.246 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:29.246 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:29.247 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.247 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.247 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.248 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.248 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.248 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.249 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.249 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.249 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.249 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:29.264 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:29.264 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:29.264 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:29.264 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:29.265 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:29.265 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:29.265 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:29.265 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:29.265 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:29.265 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:29.265 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:29.266 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:29.266 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:29.349 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:29.350 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:29.350 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:29.350 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:29.350 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:29.350 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:29.350 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:29.350 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:29.351 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:29.351 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:29.351 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:29.351 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:29.351 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:29.386 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:29.387 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:29.387 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:29.387 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.388 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.388 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.388 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.388 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.388 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.388 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.388 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.388 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.388 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:29.410 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:29.490 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:29.490 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:29.490 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:29.490 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:29.491 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:29.491 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:29.491 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:29.491 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:29.491 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:29.491 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:29.491 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:29.491 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:29.491 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:29.552 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:29.554 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:29.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:29.630 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:29.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:29.675320  5365 catalog_manager.cc:1294] Loaded cluster ID: 261bfcefd0244b1b9c6c0467806f92d5
08:09:29.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:29.676362  5365 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 1b5e3c2d43314e728701a7bfa1344ed5: loading cluster ID for follower catalog manager: success
08:09:29.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:29.714648  5365 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 1b5e3c2d43314e728701a7bfa1344ed5: acquiring CA information for follower catalog manager: success
08:09:29.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:29.750492  5365 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 1b5e3c2d43314e728701a7bfa1344ed5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:09:29.898 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:29.898 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:29.898 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:29.899 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:29.899 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:29.899 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:29.900 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:29.900 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:29.900 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:29.900 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:29.900 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:29.900 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:29.900 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:29.906 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:29.906 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:29.906 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:29.907 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.907 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.907 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:29.907 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.907 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.907 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:29.908 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.908 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.908 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:29.908 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:29.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:29.938 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:29.938 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:29.938 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:29.939 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:29.939 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:29.939 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:29.940 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:29.940 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:29.940 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:29.940 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:29.940 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:29.940 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:29.940 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:29.960 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:29.960 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:29.960 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:29.961 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:29.961 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:29.961 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:29.961 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:29.961 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:29.961 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:29.961 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:29.961 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:29.961 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:29.961 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:29.963 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:29.963 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:29.963 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:29.964 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:29.964 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:29.964 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:29.964 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:29.964 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:29.964 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:29.964 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:29.964 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:29.964 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:29.964 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:30.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:29.997517  4437 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7ac0 after lost signal to thread 4303
08:09:30.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:29.998543  4437 debug-util.cc:398] Leaking SignalData structure 0x7b080009b320 after lost signal to thread 4441
08:09:30.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:30.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:30.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.087064  5187 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } attempt: 8
08:09:30.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:30.095296  5373 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:09:30.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:30.096055  5373 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:09:30.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:30.096875  5373 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:09:30.116 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:30.130 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:30.149 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (09c2845f1c2e95ee63afce247a128bdd) switched from state RESTARTING to RUNNING.
08:09:30.150 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job 09c2845f1c2e95ee63afce247a128bdd from Checkpoint 77 @ 1779091768908 for 09c2845f1c2e95ee63afce247a128bdd located at file:/tmp/junit5480530168178470707/checkpoints/09c2845f1c2e95ee63afce247a128bdd/chk-77.
08:09:30.151 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
08:09:30.151 [INFO - flink-pekko.actor.default-dispatcher-7] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
08:09:30.159 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to SCHEDULED.
08:09:30.160 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 09c2845f1c2e95ee63afce247a128bdd: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:09:30.160 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING.
08:09:30.160 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #1) with attempt id c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 3f9ef920-d0fb-4b4e-a9c9-7b0ceae74c90 @ 127.0.0.1 (dataPort=-1) with allocation id a4ed639f2cd0d766fcccf42665eb4955
08:09:30.160 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
08:09:30.161 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
08:09:30.161 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 3f9ef920-d0fb-4b4e-a9c9-7b0ceae74c90 @ 127.0.0.1 (dataPort=-1) with allocation id 75f01cd50c930be6f1c0818f09080115
08:09:30.161 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to SCHEDULED.
08:09:30.161 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from SCHEDULED to DEPLOYING.
08:09:30.161 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #1) with attempt id c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 3f9ef920-d0fb-4b4e-a9c9-7b0ceae74c90 @ 127.0.0.1 (dataPort=-1) with allocation id b35f1e1089e429f924b5ed576b0b012d
08:09:30.161 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:30.162 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:30.162 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:30.162 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:30.162 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:30.162 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:30.163 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot a4ed639f2cd0d766fcccf42665eb4955.
08:09:30.163 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:30.163 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:30.163 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:30.163 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:30.164 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:30.164 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:30.164 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:30.164 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#1 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id a4ed639f2cd0d766fcccf42665eb4955.
08:09:30.164 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 09c2845f1c2e95ee63afce247a128bdd: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:09:30.165 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 09c2845f1c2e95ee63afce247a128bdd: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:09:30.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:30.164264  5373 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:09:30.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:30.166254  5373 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.224.129
08:09:30.166 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to SCHEDULED.
08:09:30.167 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 09c2845f1c2e95ee63afce247a128bdd: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:09:30.167 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from SCHEDULED to DEPLOYING.
08:09:30.167 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #1) with attempt id c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 3f9ef920-d0fb-4b4e-a9c9-7b0ceae74c90 @ 127.0.0.1 (dataPort=-1) with allocation id c4c60e69048e64b8e7b04281803d47ab
08:09:30.168 [INFO - Thread-63] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
08:09:30.168 [DEBUG - Thread-63] (Connection.java:575) [peer master-127.1.134.252:42093(127.1.134.252:42093)] disconnecting while in state TERMINATED
08:09:30.168 [DEBUG - Thread-63] (Connection.java:575) [peer master-127.1.134.253:41425(127.1.134.253:41425)] disconnecting while in state TERMINATED
08:09:30.168 [DEBUG - Thread-63] (Connection.java:575) [peer master-127.1.134.254:38449(127.1.134.254:38449)] disconnecting while in state TERMINATED
08:09:30.168 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:09:30.169 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
08:09:30.169 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:09:30.170 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 75f01cd50c930be6f1c0818f09080115.
08:09:30.170 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-2
08:09:30.171 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id 75f01cd50c930be6f1c0818f09080115.
08:09:30.171 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
08:09:30.171 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#1 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
08:09:30.173 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5f52d781
08:09:30.173 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:30.173 [INFO - Thread-63] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
08:09:30.173 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5480530168178470707/checkpoints")
08:09:30.173 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
08:09:30.173 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
08:09:30.173 [INFO - Thread-63] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
08:09:30.175 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot b35f1e1089e429f924b5ed576b0b012d.
08:09:30.176 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
08:09:30.176 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#1 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_1), deploy into slot with allocation id b35f1e1089e429f924b5ed576b0b012d.
08:09:30.176 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
08:09:30.178 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@c360025
08:09:30.178 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:30.179 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5480530168178470707/checkpoints")
08:09:30.179 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
08:09:30.179 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
08:09:30.180 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@37cf6bfe
08:09:30.184 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3b2ee256
08:09:30.187 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:30.188 [DEBUG - Thread-63] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:30.189 [INFO - Thread-63] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
08:09:30.189 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:30.190 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot c4c60e69048e64b8e7b04281803d47ab.
08:09:30.191 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#1 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_1), deploy into slot with allocation id c4c60e69048e64b8e7b04281803d47ab.
08:09:30.194 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to DEPLOYING.
08:09:30.194 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#1 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_1) [DEPLOYING].
08:09:30.195 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1f85deed
08:09:30.195 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:30.195 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5480530168178470707/checkpoints")
08:09:30.196 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
08:09:30.196 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
08:09:30.198 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@af46162
08:09:30.200 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:30.246 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.249677  5187 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e605137b3e4e4895922c11fe34cb66d1: Bootstrap starting.
08:09:30.259 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:09:30.259 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:09:30.259 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:09:30.259 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:09:30.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.268322  5187 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e605137b3e4e4895922c11fe34cb66d1: Neither blocks nor log segments found. Creating new log.
08:09:30.270 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to DEPLOYING.
08:09:30.270 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#1 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_1) [DEPLOYING].
08:09:30.278 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.283208  5187 log.cc:826] T 00000000000000000000000000000000 P e605137b3e4e4895922c11fe34cb66d1: Log is configured to *not* fsync() on all Append() calls
08:09:30.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.346098  5187 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e605137b3e4e4895922c11fe34cb66d1: No bootstrap required, opened a new log
08:09:30.363 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:30.363 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:30.363 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:30.364 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@533b1ad4
08:09:30.364 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.364 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:30.364 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5480530168178470707/checkpoints")
08:09:30.365 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
08:09:30.365 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:30.365 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:30.366 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:30.366 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (NetUtil.java:139) Resolved '127.2.90.188' into [/127.2.90.188] in 91803093ns
08:09:30.366 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:30.366 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:30.367 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:30.367 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:30.367 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (c0551ef584b55b7ad165726b2ceeec4e_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
08:09:30.367 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:30.368 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:30.368 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.368 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:30.364 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.369 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.369 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.372 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:30.372 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5c1379aa
08:09:30.375 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:30.377 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.378 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.378 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.378 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.383 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.383 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.383 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.383 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.386 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.387 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.388 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.388 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.388 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.391928  5373 tablet_server_runner.cc:78] Tablet server non-default flags:
08:09:30.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:09:30.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.224.148:40383
08:09:30.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:09:30.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:09:30.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-0/data
08:09:30.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-0/wal
08:09:30.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:09:30.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:09:30.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.224.129:0
08:09:30.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:09:30.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:09:30.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:09:30.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-0/data/info.pb
08:09:30.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.224.129
08:09:30.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:09:30.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.224.190:36787,127.4.224.189:45505,127.4.224.188:40437
08:09:30.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:09:30.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:09:30.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:09:30.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:09:30.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:09:30.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.224.129
08:09:30.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-0/logs
08:09:30.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:09:30.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:09:30.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:09:30.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:09:30.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:09:30.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:09:30.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:09:30.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:09:30.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:09:30.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:09:30.397 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.397483  5373 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:09:30.398 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.398 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.398 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.410 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:30.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.412418  5373 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:09:30.420 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.422 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.423 [DEBUG - pool-464-thread-1] (NetUtil.java:139) Resolved '127.29.158.189' into [/127.29.158.189] in 1117949ns
08:09:30.423 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:30.423 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:30.424 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:30.424 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:30.424 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.424 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.424 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:30.424 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:30.425 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:30.425 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:30.425 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:30.425 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:30.425 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:30.425 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:30.425 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:30.433 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.434 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.434 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.434 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.434 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.449 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.451 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:30.449556  5276 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.224.189:45505 timed out after 2.092s (SENT)
08:09:30.451 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.451 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.460 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.460 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.460 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.460 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.463 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.465 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.472164  5187 raft_consensus.cc:359] T 00000000000000000000000000000000 P e605137b3e4e4895922c11fe34cb66d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5e3c2d43314e728701a7bfa1344ed5" member_type: VOTER last_known_addr { host: "127.4.224.190" port: 36787 } } peers { permanent_uuid: "e605137b3e4e4895922c11fe34cb66d1" member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } } peers { permanent_uuid: "b0553a11722241c7ae72a9688d4ecfd3" member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } }
08:09:30.474 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.475 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.475 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.475 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.475641  5187 raft_consensus.cc:385] T 00000000000000000000000000000000 P e605137b3e4e4895922c11fe34cb66d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:09:30.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.476181  5187 raft_consensus.cc:740] T 00000000000000000000000000000000 P e605137b3e4e4895922c11fe34cb66d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e605137b3e4e4895922c11fe34cb66d1, State: Initialized, Role: FOLLOWER
08:09:30.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.477644  5187 consensus_queue.cc:260] T 00000000000000000000000000000000 P e605137b3e4e4895922c11fe34cb66d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5e3c2d43314e728701a7bfa1344ed5" member_type: VOTER last_known_addr { host: "127.4.224.190" port: 36787 } } peers { permanent_uuid: "e605137b3e4e4895922c11fe34cb66d1" member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } } peers { permanent_uuid: "b0553a11722241c7ae72a9688d4ecfd3" member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } }
08:09:30.485 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.495827  5187 sys_catalog.cc:565] T 00000000000000000000000000000000 P e605137b3e4e4895922c11fe34cb66d1 [sys.catalog]: configured and running, proceeding with master startup.
08:09:30.501 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.502 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.502 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.496011  5162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b0553a11722241c7ae72a9688d4ecfd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e605137b3e4e4895922c11fe34cb66d1" is_pre_election: true
08:09:30.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.496873  5161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b0553a11722241c7ae72a9688d4ecfd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e605137b3e4e4895922c11fe34cb66d1"
08:09:30.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.497462  5159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b0553a11722241c7ae72a9688d4ecfd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e605137b3e4e4895922c11fe34cb66d1" is_pre_election: true
08:09:30.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:30.502293  5162 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42220 (request call id 1) took 2145 ms (client timeout 2092 ms). Trace:
08:09:30.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:30.502687  5162 rpcz_store.cc:269] 0518 08:09:28.356759 (+     0us) service_pool.cc:167] Inserting onto call queue
08:09:30.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 08:09:28.356946 (+   187us) service_pool.cc:224] Handling call
08:09:30.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 08:09:30.502176 (+2145230us) inbound_call.cc:177] Queueing success response
08:09:30.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
08:09:30.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.498577  5160 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e605137b3e4e4895922c11fe34cb66d1 [term 0 FOLLOWER]: Advancing to term 1
08:09:30.508 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:30.509423  5161 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42220 (request call id 2) took 1998 ms (client timeout 2088 ms). Trace:
08:09:30.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:30.509879  5161 rpcz_store.cc:269] 0518 08:09:28.511506 (+     0us) service_pool.cc:167] Inserting onto call queue
08:09:30.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 08:09:28.511712 (+   206us) service_pool.cc:224] Handling call
08:09:30.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 08:09:30.509351 (+1997639us) inbound_call.cc:177] Queueing success response
08:09:30.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
08:09:30.510 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.510 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.515 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.517645  5160 raft_consensus.cc:1275] T 00000000000000000000000000000000 P e605137b3e4e4895922c11fe34cb66d1 [term 1 FOLLOWER]: Refusing update from remote peer b0553a11722241c7ae72a9688d4ecfd3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:09:30.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.518891  5160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42220 (request call id 3) took 1850 ms. Trace:
08:09:30.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.519343  5160 rpcz_store.cc:276] 0518 08:09:28.668217 (+     0us) service_pool.cc:167] Inserting onto call queue
08:09:30.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 08:09:28.668404 (+   187us) service_pool.cc:224] Handling call
08:09:30.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 08:09:30.498256 (+1829852us) raft_consensus.cc:1471] Updating replica for 0 ops
08:09:30.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 08:09:30.518296 (+ 20040us) raft_consensus.cc:1697] Filling consensus response to leader.
08:09:30.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 08:09:30.518806 (+   510us) inbound_call.cc:177] Queueing success response
08:09:30.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
08:09:30.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.521435  5400 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e605137b3e4e4895922c11fe34cb66d1" member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:09:30.522 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.522 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.522 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.522 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.527 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:30.530 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.534 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.535 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.536 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.536 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:30.540835  5433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:30.545 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.546 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.546 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.546 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.547 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.548 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.548 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.548 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:30.554 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:30.557 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.558 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.558 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.558 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.558 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.559 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.559 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.559 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.563 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.564 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.564 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.564 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.565 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.577 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:30.578 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:30.578 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:30.578 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:30.578 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:30.579 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:30.579 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:30.579 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:30.580 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:30.580 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:30.580 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:30.580 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:30.584 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.586 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.587 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.587 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.587 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.592 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:30.597 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.597 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.598 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.598 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.598 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.598 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.598 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.598 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.599 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.599 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.599 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.599 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.600 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.600 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.600 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.600 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.604 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.605 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.605 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.605 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.601 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.605 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.605 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.605 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.605 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.605 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.605 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.605 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.605 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.607 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.607 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.607 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.607 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.614 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.614 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.614 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.615 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.615 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.615 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.615 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.615 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.615 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.615 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.615 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.615 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.616 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.616 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.616 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.616 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.616 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:30.616 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.617 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.617 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.617 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.618 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.621 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:30.622 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:30.622 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:30.622 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:30.622 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:30.622 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:30.622 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:30.622 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:30.622 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:30.623 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:30.623 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:30.623 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:30.623 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:30.625 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.625 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.625 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.625 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.626 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.626 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.626 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.626 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.626 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.626 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.626 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.626 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.626 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.627 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.627 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.628 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.628 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.628 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.628 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.629 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.629 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.629 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.630 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:30.635 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.635 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.635 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.635 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.635 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.635 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.635 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.636 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.636 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.636 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.636 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.636 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.636 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.636 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.636 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.636 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.636 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.637 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:30.638 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:30.638 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:30.638 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:30.644 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.644 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:30.644 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.645 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.645 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.645 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.645 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.645 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.645 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.645 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.645 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.646 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.646 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.646 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.646 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.646 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:30.646 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:30.646 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:30.650 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:30.650 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:30.650 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:30.650 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:30.654 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.654 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.654 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.655 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.655 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.655 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.655 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.655 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.655 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.656 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.656 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.656 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.656 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.656 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.657 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.657 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.657 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.662 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.662 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.662 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.663 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.663 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.663 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.663 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.663 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.667 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.667 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.667 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.668 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.672 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:30.672 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.672 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.673 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.673 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.673 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.673 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.673 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.673 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.652094  5430 sys_catalog.cc:455] T 00000000000000000000000000000000 P e605137b3e4e4895922c11fe34cb66d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b0553a11722241c7ae72a9688d4ecfd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5e3c2d43314e728701a7bfa1344ed5" member_type: VOTER last_known_addr { host: "127.4.224.190" port: 36787 } } peers { permanent_uuid: "e605137b3e4e4895922c11fe34cb66d1" member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } } peers { permanent_uuid: "b0553a11722241c7ae72a9688d4ecfd3" member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } } }
08:09:30.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.664647  5438 sys_catalog.cc:455] T 00000000000000000000000000000000 P e605137b3e4e4895922c11fe34cb66d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0553a11722241c7ae72a9688d4ecfd3. Latest consensus state: current_term: 1 leader_uuid: "b0553a11722241c7ae72a9688d4ecfd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5e3c2d43314e728701a7bfa1344ed5" member_type: VOTER last_known_addr { host: "127.4.224.190" port: 36787 } } peers { permanent_uuid: "e605137b3e4e4895922c11fe34cb66d1" member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } } peers { permanent_uuid: "b0553a11722241c7ae72a9688d4ecfd3" member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } } }
08:09:30.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.676781  5438 sys_catalog.cc:458] T 00000000000000000000000000000000 P e605137b3e4e4895922c11fe34cb66d1 [sys.catalog]: This master's current role is: FOLLOWER
08:09:30.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.674320  5473 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
08:09:30.678 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:30.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.672173  5457 sys_catalog.cc:455] T 00000000000000000000000000000000 P e605137b3e4e4895922c11fe34cb66d1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b0553a11722241c7ae72a9688d4ecfd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5e3c2d43314e728701a7bfa1344ed5" member_type: VOTER last_known_addr { host: "127.4.224.190" port: 36787 } } peers { permanent_uuid: "e605137b3e4e4895922c11fe34cb66d1" member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } } peers { permanent_uuid: "b0553a11722241c7ae72a9688d4ecfd3" member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } } }
08:09:30.679 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:30.679 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:30.679 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:30.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.676823  5430 sys_catalog.cc:458] T 00000000000000000000000000000000 P e605137b3e4e4895922c11fe34cb66d1 [sys.catalog]: This master's current role is: FOLLOWER
08:09:30.683 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.684 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.684 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.684 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.684 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.684 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.684 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.685 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.685 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.685 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.685 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.685 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.685 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.685 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.686 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.686 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.686 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.686 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.686 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.686 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.686 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.686 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.687 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.687 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.687 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.687 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.688397  5457 sys_catalog.cc:458] T 00000000000000000000000000000000 P e605137b3e4e4895922c11fe34cb66d1 [sys.catalog]: This master's current role is: FOLLOWER
08:09:30.689 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:30.689 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:30.690 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:30.690 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:30.690 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:30.690 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:30.690 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:30.690 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:30.704 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.704 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.704 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.705 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.705 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.705 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.705 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.705 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.705 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.706 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.706 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.706 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.706 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.706 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.706 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.706 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.706 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.707 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.707 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.707 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.707 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.707 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.707 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.707 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.707 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.707 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.707 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.707 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.708 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.708 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.708 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.708 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.708 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.708 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.708 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.709 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.709 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.709 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.709 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.712 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:30.713 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:30.713 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:30.713 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:30.713 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:30.713 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:30.713 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:30.713 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:30.713 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:30.714 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:30.714 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:30.714 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:30.714 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:30.714 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.714 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.714 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.714 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.714 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.714 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.714 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.714 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.714 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.715 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.715 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.715 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.715 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.724 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.724 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.724 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.725 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.725 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.725 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.725 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.726 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.726 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.725 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.726 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.726 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.726 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.726 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.726 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.727 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.727 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.727 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.727 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.727 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.727 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.727 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.727 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.727 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.727 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.728 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.732 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:30.732 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:30.732 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:30.732 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:30.732 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:30.733 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:30.733 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:30.733 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:30.732 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:30.733 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:30.733 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:30.733 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:30.733 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:30.746 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.746 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.746 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.747 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.747 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.747 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.747 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.747 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.747 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.748 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.748 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.748 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.748 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.764 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.764 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.764 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.765 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.765 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.765 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.765 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.765 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.765 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.765 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.766 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.766 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.766 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.772 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:30.772 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:30.773 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:30.773 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:30.773 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:30.773 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:30.773 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:30.773 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:30.773 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:30.773 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:30.773 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:30.773 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:30.773 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:30.784 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.784 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.784 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.784 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.784 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.784 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.785 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.785 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.785 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.785 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.785 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.785 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.786 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.825 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.825 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.826 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.826 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.826 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.827 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.827 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.827 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.827 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.827 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.827 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.827 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.827 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.832 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:30.832 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:30.832 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:30.832 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:30.833 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:30.833 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:30.833 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:30.833 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:30.833 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:30.833 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:30.833 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:30.833 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:30.833 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:30.834 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.834 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.834 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.834 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.834 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.834 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.834 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.834 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.834 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.835 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.835 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.835 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.835 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.853 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:30.853 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:30.854 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:30.854 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:30.854 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:30.854 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:30.854 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:30.854 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:30.855 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:30.855 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:30.855 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:30.855 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:30.855 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:30.863 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.864 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.864 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.865 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.865 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.865 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.865 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.865 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.865 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.866 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.866 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.866 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.866 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.866 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.866 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.866 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.867 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.867 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.867 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.867 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.867 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.867 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.867 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.867 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.867 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.867 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.872 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:30.872 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:30.872 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:30.872 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:30.872 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:30.872 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:30.873 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:30.873 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:30.873 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:30.873 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:30.873 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:30.873 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:30.873 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:30.874 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.875 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.875 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.875 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.875 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.875 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.875 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.875 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.875 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.876 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.876 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.876 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.876 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.886 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:30.886 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:30.886 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:30.886 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.886 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.886 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:30.887 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.887 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.887 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:30.887 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.887 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.887 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:30.887 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:30.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:30.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.961411  5400 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b0553a11722241c7ae72a9688d4ecfd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5e3c2d43314e728701a7bfa1344ed5" member_type: VOTER last_known_addr { host: "127.4.224.190" port: 36787 } } peers { permanent_uuid: "e605137b3e4e4895922c11fe34cb66d1" member_type: VOTER last_known_addr { host: "127.4.224.189" port: 45505 } } peers { permanent_uuid: "b0553a11722241c7ae72a9688d4ecfd3" member_type: VOTER last_known_addr { host: "127.4.224.188" port: 40437 } } }
08:09:30.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:30.962759  5400 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0553a11722241c7ae72a9688d4ecfd3 [sys.catalog]: This master's current role is: LEADER
08:09:31.028 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:31.043 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:31.044 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:31.044 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:31.044 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:31.044 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:31.044 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:31.044 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:31.044 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:31.045 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:31.045 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:31.045 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:31.045 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:31.045 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:31.045 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:31.045 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:31.046 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:31.046 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:31.046 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:31.046 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:31.046 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:31.046 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:31.046 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:31.046 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:31.047 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:31.047 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:31.047 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:31.047 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:31.047 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:31.047 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:31.047 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:31.047 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:31.047 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:31.048 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:31.048 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:31.048 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:31.048 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:31.048 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:31.048 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:31.049 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:31.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:31.054 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:31.055 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:31.055 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:31.055 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:31.056 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:31.056 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:31.056 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:31.056 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:31.056 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:31.056 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:31.056 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:31.056 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:31.056 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:31.056 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:31.109 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:31.109 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:31.110 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:31.110 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:31.110 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:31.110 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:31.110 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:31.110 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:31.110 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:31.110 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:31.111 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:31.111 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:31.111 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:31.116 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:31.131 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:31.133 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:31.133 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:31.133 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:31.134 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:31.134 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:31.134 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:31.134 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:31.135 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:31.135 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:31.135 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:31.135 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:31.135 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:31.135 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:31.150 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:31.150 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:31.150 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:31.151 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:31.151 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:31.151 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:31.151 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:31.151 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:31.151 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:31.152 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:31.152 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:31.152 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:31.152 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:31.164 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:31.164 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:31.165 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:31.165 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:31.165 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:31.165 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:31.165 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:31.165 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:31.165 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:31.166 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:31.166 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:31.166 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:31.166 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:31.180 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:31.180 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:31.180 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:31.180 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:31.180 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:31.180 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:31.181 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:31.181 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:31.181 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:31.181 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:31.181 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:31.181 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:31.184 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:31.184 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:31.184 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:31.185 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:31.185 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:31.185 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:31.186 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:31.186 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:31.186 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:31.186 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:31.186 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:31.186 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:31.186 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:31.187 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:31.205 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:31.206 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:31.206 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:31.206 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:31.206 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:31.206 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:31.207 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:31.207 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:31.207 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:31.207 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:31.207 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:31.207 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:31.207 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:31.345 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:31.345 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:31.345 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:31.346 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:31.346 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:31.346 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:31.346 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:31.346 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:31.346 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:31.347 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:31.347 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:31.347 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:31.347 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:31.352 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:31.352 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:31.352 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:31.353 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:31.353 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:31.353 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:31.353 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:31.353 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:31.353 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:31.354 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:31.354 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:31.354 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:31.354 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:31.393 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:31.393 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:31.393 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:31.394 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:31.394 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:31.394 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:31.394 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:31.394 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:31.394 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:31.394 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:31.394 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:31.394 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:31.394 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:31.403 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:31.403 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:31.403 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:31.404 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:31.404 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:31.404 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:31.404 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:31.404 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:31.404 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:31.405 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:31.405 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:31.405 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:31.405 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:31.410 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:31.451 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:31.451 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:31.452 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:31.452 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:31.453 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:31.453 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:31.454 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:31.454 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:31.454 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:31.454 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:31.454 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:31.455 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:31.455 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:31.493 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:31.494 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:31.494 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:31.494 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:31.494 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:31.495 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:31.495 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:31.495 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:31.495 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:31.495 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:31.495 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:31.495 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:31.495 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:31.528 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:31.552 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:31.554 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:31.574 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:31.575 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:31.575 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:31.575 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:31.575 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:31.575 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:31.575 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:31.575 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:31.576 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:31.576 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:31.575 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:31.576 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:31.576 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:31.598 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:31.598 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:31.599 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:31.599 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:31.599 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:31.599 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:31.599 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:31.599 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:31.600 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:31.600 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:31.600 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:31.600 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:31.600 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:31.616 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:31.626 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:31.626 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:31.626 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:31.626 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:31.626 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:31.626 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:31.626 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:31.626 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:31.626 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:31.627 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:31.627 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:31.627 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:31.627 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:31.632 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:31.632 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:31.632 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:31.632 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:31.632 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:31.633 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:31.633 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:31.633 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:31.633 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:31.633 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:31.634 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:31.634 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:31.634 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:31.634 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:31.684 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:31.684 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:31.684 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:31.685 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:31.685 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:31.685 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:31.685 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:31.685 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:31.685 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:31.685 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:31.686 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:31.686 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:31.686 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:31.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:31.735659  5473 catalog_manager.cc:1294] Loaded cluster ID: 261bfcefd0244b1b9c6c0467806f92d5
08:09:31.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:31.736094  5473 catalog_manager.cc:1587] T 00000000000000000000000000000000 P e605137b3e4e4895922c11fe34cb66d1: loading cluster ID for follower catalog manager: success
08:09:31.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:31.802145  5473 catalog_manager.cc:1609] T 00000000000000000000000000000000 P e605137b3e4e4895922c11fe34cb66d1: acquiring CA information for follower catalog manager: success
08:09:31.805 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:31.806 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:31.806 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:31.806 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:31.806 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:31.806 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:31.807 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:31.807 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:31.807 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:31.807 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:31.807 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:31.807 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:31.807 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:31.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:31.853711  5473 catalog_manager.cc:1637] T 00000000000000000000000000000000 P e605137b3e4e4895922c11fe34cb66d1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:09:31.875 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:31.875 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:31.875 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:31.876 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:31.876 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:31.876 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:31.876 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:31.876 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:31.877 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:31.877 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:31.877 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:31.877 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:31.877 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:31.909 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:31.990 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:31.990 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:31.990 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:31.990 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:31.990 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:31.991 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:31.991 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:31.991 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:31.991 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:31.991 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:31.991 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:31.991 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:31.991 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:32.011 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:32.011 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:32.012 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:32.012 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:32.012 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:32.012 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:32.012 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:32.012 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:32.012 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:32.013 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:32.013 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:32.013 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:32.013 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:32.028 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:32.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:32.054 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:32.086 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:32.086 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:32.086 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:32.087 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:32.087 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:32.087 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:32.087 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:32.087 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:32.087 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:32.088 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:32.088 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:32.088 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:32.088 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:32.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:32.130 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:32.131 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:32.131 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:32.131 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:32.132 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:32.132 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:32.132 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:32.132 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:32.132 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:32.132 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:32.133 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:32.133 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:32.133 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:32.133 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:32.178 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:32.179 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:32.179 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:32.179 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:32.179 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:32.179 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:32.179 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:32.180 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:32.180 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:32.180 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:32.180 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:32.180 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:32.181 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:32.194 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:32.194 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:32.195 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:32.195 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:32.195 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:32.195 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:32.196 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:32.196 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:32.196 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:32.196 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:32.196 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:32.196 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:32.196 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:32.270 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:32.271 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:32.271 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:32.271 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:32.271 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:32.271 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:32.272 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:32.272 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:32.272 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:32.271 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:32.272 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:32.272 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:32.272 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:32.409 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:32.414 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:32.414 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:32.414 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:32.415 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:32.415 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:32.415 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:32.416 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:32.416 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:32.416 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:32.416 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:32.416 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:32.416 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:32.416 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:32.470 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:32.470 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:32.470 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:32.470 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:32.470 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:32.470 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:32.470 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:32.470 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:32.471 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:32.471 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:32.471 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:32.471 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:32.471 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:32.523 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:32.523 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:32.523 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:32.524 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:32.524 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:32.524 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:32.525 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:32.525 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:32.525 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:32.525 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:32.525 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:32.525 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:32.525 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:32.526 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:32.526 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:32.526 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:32.526 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:32.526 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:32.526 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:32.526 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:32.526 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:32.527 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:32.527 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:32.527 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:32.527 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:32.527 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:32.528 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:32.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:32.554 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:32.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:32.634 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:32.639 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:32.639 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:32.639 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:32.640 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:32.640 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:32.640 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:32.640 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:32.640 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:32.641 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:32.641 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:32.641 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:32.641 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:32.641 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:32.752 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:32.753 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:32.753 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:32.754 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:32.754 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:32.754 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:32.755 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:32.755 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:32.756 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:32.756 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:32.756 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:32.756 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:32.756 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:32.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:32.954 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:32.954 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:32.954 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:32.955 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:32.955 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:32.955 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:32.955 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:32.955 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:32.955 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:32.955 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:32.955 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:32.955 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:32.955 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:33.028 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:33.045 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:33.046 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:33.046 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:33.047 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:33.047 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:33.047 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:33.047 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:33.047 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:33.047 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:33.048 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:33.048 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:33.048 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:33.048 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:33.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:33.054 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:33.064 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:33.065 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:33.065 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:33.066 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:33.066 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:33.066 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:33.066 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:33.066 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:33.066 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:33.067 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:33.067 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:33.067 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:33.067 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:33.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:33.132 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:33.330 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:33.330 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:33.330 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:33.331 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:33.331 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:33.331 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:33.331 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:33.332 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:33.332 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:33.332 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:33.332 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:33.332 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:33.332 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:33.410 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:33.414 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:33.414 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:33.414 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:33.415 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:33.415 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:33.415 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:33.415 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:33.415 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:33.415 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:33.415 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:33.415 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:33.416 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:33.416 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:33.453 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:33.454 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:33.454 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:33.454 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:33.454 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:33.454 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:33.454 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:33.454 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:33.455 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:33.455 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:33.455 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:33.455 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:33.455 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:33.528 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:33.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:33.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:33.611 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:33.611 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:33.611 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:33.612 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:33.612 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:33.612 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:33.612 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:33.612 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:33.612 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:33.612 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:33.612 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:33.612 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:33.612 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:33.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:33.631 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:33.679 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:33.680 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:33.680 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:33.680 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:33.680 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:33.681 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:33.681 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:33.681 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:33.681 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:33.682 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:33.682 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:33.682 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:33.682 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:33.826 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:33.826 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:33.826 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:33.827 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:33.827 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:33.827 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:33.828 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:33.828 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:33.828 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:33.828 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:33.828 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:33.828 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:33.828 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:33.879 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:33.879 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:33.879 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:33.880 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:33.880 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:33.880 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:33.880 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:33.880 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:33.880 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:33.880 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:33.881 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:33.881 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:33.881 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:33.901 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:33.902 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:33.902 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:33.902 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:33.902 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:33.903 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:33.903 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:33.903 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:33.903 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:33.903 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:33.904 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:33.904 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:33.904 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:33.909 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:34.027 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:34.043 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:34.044 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:34.044 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:34.047 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:34.047 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:34.047 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:34.047 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:34.047 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:34.047 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:34.050 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:34.050 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:34.050 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:34.050 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:34.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:34.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:34.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:34.131 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:34.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:31.886045  5428 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 5373
08:09:34.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:34.204404  5428 kernel_stack_watchdog.cc:198] Thread 5373 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 374ms:
08:09:34.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:09:34.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:09:34.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:09:34.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:09:34.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:30.552052  5431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:34.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:34.210500  5373 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 3.701s	user 1.115s	sys 1.937s
08:09:34.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:34.211527  5373 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 3.702s	user 1.115s	sys 1.937s
08:09:34.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:34.218873  5373 server_base.cc:1061] running on GCE node
08:09:34.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:34.220867  5490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:34.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:34.222720  5373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:09:34.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:34.227582  5373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:09:34.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:34.229218  5373 hybrid_clock.cc:648] HybridClock initialized: now 1779091774229168 us; error 51 us; skew 500 ppm
08:09:34.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:34.230456  5373 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:09:34.233 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:34.234 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:34.234 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:34.234 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:34.234 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:34.234 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:34.234 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:34.234 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:34.234 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:34.235 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:34.235 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:34.235 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:34.235 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:34.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:34.240681  5373 webserver.cc:533] Webserver started at http://127.4.224.129:35613/ using document root <none> and password file <none>
08:09:34.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:34.242254  5373 fs_manager.cc:362] Metadata directory not provided
08:09:34.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:34.242563  5373 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:09:34.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:34.243181  5373 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:09:34.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:34.249270  5373 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-0/data/instance:
08:09:34.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0fedadaec47b41689759821a31ad4da5"
08:09:34.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:34 on dist-test-slave-1jss"
08:09:34.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:34.250980  5373 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-0/wal/instance:
08:09:34.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0fedadaec47b41689759821a31ad4da5"
08:09:34.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:34 on dist-test-slave-1jss"
08:09:34.269 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:34.269 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:34.270 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:34.270 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:34.270 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:34.270 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:34.270 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:34.270 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:34.270 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:34.271 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:34.271 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:34.271 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:34.271 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:34.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:34.275413  5373 fs_manager.cc:696] Time spent creating directory manager: real 0.024s	user 0.004s	sys 0.018s
08:09:34.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:34.291014  5495 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:09:34.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:34.293046  5373 fs_manager.cc:730] Time spent opening block manager: real 0.012s	user 0.000s	sys 0.009s
08:09:34.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:34.293552  5373 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-0/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-0/wal
08:09:34.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0fedadaec47b41689759821a31ad4da5"
08:09:34.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:34 on dist-test-slave-1jss"
08:09:34.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:34.294147  5373 fs_report.cc:389] FS layout report
08:09:34.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:09:34.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-0/wal
08:09:34.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-0/wal
08:09:34.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-0/data/data
08:09:34.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:09:34.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:09:34.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:09:34.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:09:34.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:09:34.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:09:34.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:09:34.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:09:34.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:09:34.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:09:34.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:09:34.375 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:34.375 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:34.375 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:34.375 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:34.375 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:34.375 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:34.376 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:34.376 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:34.376 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:34.376 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:34.376 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:34.376 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:34.376 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:34.399 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:34.399 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:34.399 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:34.400 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:34.400 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:34.400 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:34.400 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:34.400 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:34.400 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:34.400 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:34.400 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:34.400 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:34.401 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:34.410 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:34.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:34.483922  5373 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:09:34.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:34.487337  5373 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:09:34.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:34.487957  5373 kserver.cc:163] Server-wide thread pool size limit: 3276
08:09:34.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:34.498463  5373 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:09:34.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:34.512410  5373 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:09:34.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:34.512763  5373 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
08:09:34.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:34.513087  5373 ts_tablet_manager.cc:616] Registered 0 tablets
08:09:34.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:34.513296  5373 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:09:34.527 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:34.529 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:34.530 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:34.530 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:34.530 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:34.530 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:34.531 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:34.531 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:34.531 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:34.531 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:34.531 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:34.531 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:34.531 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:34.531 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:34.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:34.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:34.616 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:34.621 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:34.622 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:34.622 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:34.622 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:34.622 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:34.623 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:34.623 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:34.623 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:34.623 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:34.623 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:34.623 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:34.623 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:34.623 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:34.634 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:34.650 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:34.651 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:34.651 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:34.651 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:34.652 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:34.652 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:34.652 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:34.652 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:34.652 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:34.653 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:34.653 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:34.653 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:34.653 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:34.731 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:34.731 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:34.731 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:34.732 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:34.732 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:34.732 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:34.732 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:34.732 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:34.732 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:34.732 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:34.733 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:34.733 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:34.733 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:34.798 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:34.798 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:34.798 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:34.799 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:34.799 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:34.799 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:34.799 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:34.799 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:34.799 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:34.800 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:34.800 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:34.800 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:34.800 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:34.870 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:34.871 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:34.871 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:34.872 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:34.872 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:34.872 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:34.873 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:34.873 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:34.873 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:34.873 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:34.874 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:34.874 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:34.874 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:34.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:34.959 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:34.959 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:34.959 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:34.960 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:34.960 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:34.960 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:34.960 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:34.960 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:34.960 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:34.960 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:34.961 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:34.961 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:34.961 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:34.962 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27147), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [31ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [33ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [35ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [35ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [57ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [59ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [60ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [60ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [82ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [83ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [84ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [84ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [102ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [102ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [103ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [103ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [122ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [122ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [161ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [161ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [162ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [163ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [181ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [182ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [183ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [183ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [221ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [222ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [227ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [229ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [322ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [322ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [323ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [323ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [800ms] refreshing cache from master, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [802ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [802ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [802ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [803ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1420ms] refreshing cache from master, [1420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1423ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1720ms] refreshing cache from master, [1720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1723ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1723ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1724ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1724ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2880ms] refreshing cache from master, [2880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2882ms] too many traces: truncated at 100 traces, deferred=Deferred@749318220(state=PENDING, result=null, callback=(continuation of Deferred@67950976 after retry RPC after error@517091426) -> (continuation of Deferred@1313291235 after retry RPC after error@797821367) -> (continuation of Deferred@1294976287 after retry RPC after error@1123134968) -> (continuation of Deferred@891166310 after retry RPC after error@1948231939) -> (continuation of Deferred@1202425250 after retry RPC after error@150632130) -> (continuation of Deferred@1305650325 after retry RPC after error@1150045085) -> (continuation of Deferred@1599150131 after retry RPC after error@71711101) -> (continuation of Deferred@1550369644 after retry RPC after error@2057219039) -> (continuation of Deferred@769238079 after retry RPC after error@409074984) -> (continuation of Deferred@42479339 after retry RPC after error@222801206) -> (continuation of Deferred@1834948861 after retry RPC after error@2059411651) -> (continuation of Deferred@972858886 after retry RPC after error@157450770) -> (continuation of Deferred@477096755 after retry RPC after error@1741817413) -> (continuation of Deferred@994197551 after retry RPC after error@640497479) -> (continuation of Deferred@1173907138 after retry RPC after error@846176278) -> (continuation of Deferred@461757772 after retry RPC after error@1423791732) -> (continuation of Deferred@1385555035 after retry RPC after error@498434319) -> (continuation of Deferred@678379592 after retry RPC after error@381672903) -> (continuation of Deferred@1802847351 after retry RPC after error@1526275567) -> (continuation of Deferred@147221496 after retry RPC after error@1627377346) -> (continuation of Deferred@568883286 after retry RPC after error@871112673) -> (continuation of Deferred@147733455 after retry RPC after error@374959562), errback=(continuation of Deferred@67950976 after retry RPC after error@517091426) -> (continuation of Deferred@1313291235 after retry RPC after error@797821367) -> (continuation of Deferred@1294976287 after retry RPC after error@1123134968) -> (continuation of Deferred@891166310 after retry RPC after error@1948231939) -> (continuation of Deferred@1202425250 after retry RPC after error@150632130) -> (continuation of Deferred@1305650325 after retry RPC after error@1150045085) -> (continuation of Deferred@1599150131 after retry RPC after error@71711101) -> (continuation of Deferred@1550369644 after retry RPC after error@2057219039) -> (continuation of Deferred@769238079 after retry RPC after error@409074984) -> (continuation of Deferred@42479339 after retry RPC after error@222801206) -> (continuation of Deferred@1834948861 after retry RPC after error@2059411651) -> (continuation of Deferred@972858886 after retry RPC after error@157450770) -> (continuation of Deferred@477096755 after retry RPC after error@1741817413) -> (continuation of Deferred@994197551 after retry RPC after error@640497479) -> (continuation of Deferred@1173907138 after retry RPC after error@846176278) -> (continuation of Deferred@461757772 after retry RPC after error@1423791732) -> (continuation of Deferred@1385555035 after retry RPC after error@498434319) -> (continuation of Deferred@678379592 after retry RPC after error@381672903) -> (continuation of Deferred@1802847351 after retry RPC after error@1526275567) -> (continuation of Deferred@147221496 after retry RPC after error@1627377346) -> (continuation of Deferred@568883286 after retry RPC after error@871112673) -> (continuation of Deferred@147733455 after retry RPC after error@374959562)))
08:09:34.966 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
08:09:34.967 [WARN - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27147), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [31ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [33ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [35ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [35ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [57ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [59ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [60ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [60ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [82ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [83ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [84ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [84ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [102ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [102ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [103ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [103ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [122ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [122ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [161ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [161ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [162ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [163ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [181ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [182ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [183ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [183ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [221ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [222ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [227ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [229ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [322ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [322ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [323ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [323ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [800ms] refreshing cache from master, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [802ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [802ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [802ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [803ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1420ms] refreshing cache from master, [1420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1423ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1720ms] refreshing cache from master, [1720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1723ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1723ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1724ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1724ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2880ms] refreshing cache from master, [2880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2882ms] too many traces: truncated at 100 traces, deferred=Deferred@749318220(state=PENDING, result=null, callback=(continuation of Deferred@67950976 after retry RPC after error@517091426) -> (continuation of Deferred@1313291235 after retry RPC after error@797821367) -> (continuation of Deferred@1294976287 after retry RPC after error@1123134968) -> (continuation of Deferred@891166310 after retry RPC after error@1948231939) -> (continuation of Deferred@1202425250 after retry RPC after error@150632130) -> (continuation of Deferred@1305650325 after retry RPC after error@1150045085) -> (continuation of Deferred@1599150131 after retry RPC after error@71711101) -> (continuation of Deferred@1550369644 after retry RPC after error@2057219039) -> (continuation of Deferred@769238079 after retry RPC after error@409074984) -> (continuation of Deferred@42479339 after retry RPC after error@222801206) -> (continuation of Deferred@1834948861 after retry RPC after error@2059411651) -> (continuation of Deferred@972858886 after retry RPC after error@157450770) -> (continuation of Deferred@477096755 after retry RPC after error@1741817413) -> (continuation of Deferred@994197551 after retry RPC after error@640497479) -> (continuation of Deferred@1173907138 after retry RPC after error@846176278) -> (continuation of Deferred@461757772 after retry RPC after error@1423791732) -> (continuation of Deferred@1385555035 after retry RPC after error@498434319) -> (continuation of Deferred@678379592 after retry RPC after error@381672903) -> (continuation of Deferred@1802847351 after retry RPC after error@1526275567) -> (continuation of Deferred@147221496 after retry RPC after error@1627377346) -> (continuation of Deferred@568883286 after retry RPC after error@871112673) -> (continuation of Deferred@147733455 after retry RPC after error@374959562), errback=(continuation of Deferred@67950976 after retry RPC after error@517091426) -> (continuation of Deferred@1313291235 after retry RPC after error@797821367) -> (continuation of Deferred@1294976287 after retry RPC after error@1123134968) -> (continuation of Deferred@891166310 after retry RPC after error@1948231939) -> (continuation of Deferred@1202425250 after retry RPC after error@150632130) -> (continuation of Deferred@1305650325 after retry RPC after error@1150045085) -> (continuation of Deferred@1599150131 after retry RPC after error@71711101) -> (continuation of Deferred@1550369644 after retry RPC after error@2057219039) -> (continuation of Deferred@769238079 after retry RPC after error@409074984) -> (continuation of Deferred@42479339 after retry RPC after error@222801206) -> (continuation of Deferred@1834948861 after retry RPC after error@2059411651) -> (continuation of Deferred@972858886 after retry RPC after error@157450770) -> (continuation of Deferred@477096755 after retry RPC after error@1741817413) -> (continuation of Deferred@994197551 after retry RPC after error@640497479) -> (continuation of Deferred@1173907138 after retry RPC after error@846176278) -> (continuation of Deferred@461757772 after retry RPC after error@1423791732) -> (continuation of Deferred@1385555035 after retry RPC after error@498434319) -> (continuation of Deferred@678379592 after retry RPC after error@381672903) -> (continuation of Deferred@1802847351 after retry RPC after error@1526275567) -> (continuation of Deferred@147221496 after retry RPC after error@1627377346) -> (continuation of Deferred@568883286 after retry RPC after error@871112673) -> (continuation of Deferred@147733455 after retry RPC after error@374959562)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.29.158.188:39061
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:34.975 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_4).
08:09:34.979 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#4 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_4.
08:09:34.983 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to FAILED on b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27147), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [31ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [33ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [35ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [35ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [57ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [59ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [60ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [60ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [82ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [83ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [84ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [84ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [102ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [102ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [103ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [103ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [122ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [122ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [161ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [161ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [162ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [163ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [181ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [182ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [183ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [183ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [221ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [222ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [227ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [229ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [322ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [322ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [323ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [323ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [800ms] refreshing cache from master, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [802ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [802ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [802ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [803ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1420ms] refreshing cache from master, [1420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1423ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1720ms] refreshing cache from master, [1720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1723ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1723ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1724ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1724ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2880ms] refreshing cache from master, [2880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2882ms] too many traces: truncated at 100 traces, deferred=Deferred@749318220(state=PENDING, result=null, callback=(continuation of Deferred@67950976 after retry RPC after error@517091426) -> (continuation of Deferred@1313291235 after retry RPC after error@797821367) -> (continuation of Deferred@1294976287 after retry RPC after error@1123134968) -> (continuation of Deferred@891166310 after retry RPC after error@1948231939) -> (continuation of Deferred@1202425250 after retry RPC after error@150632130) -> (continuation of Deferred@1305650325 after retry RPC after error@1150045085) -> (continuation of Deferred@1599150131 after retry RPC after error@71711101) -> (continuation of Deferred@1550369644 after retry RPC after error@2057219039) -> (continuation of Deferred@769238079 after retry RPC after error@409074984) -> (continuation of Deferred@42479339 after retry RPC after error@222801206) -> (continuation of Deferred@1834948861 after retry RPC after error@2059411651) -> (continuation of Deferred@972858886 after retry RPC after error@157450770) -> (continuation of Deferred@477096755 after retry RPC after error@1741817413) -> (continuation of Deferred@994197551 after retry RPC after error@640497479) -> (continuation of Deferred@1173907138 after retry RPC after error@846176278) -> (continuation of Deferred@461757772 after retry RPC after error@1423791732) -> (continuation of Deferred@1385555035 after retry RPC after error@498434319) -> (continuation of Deferred@678379592 after retry RPC after error@381672903) -> (continuation of Deferred@1802847351 after retry RPC after error@1526275567) -> (continuation of Deferred@147221496 after retry RPC after error@1627377346) -> (continuation of Deferred@568883286 after retry RPC after error@871112673) -> (continuation of Deferred@147733455 after retry RPC after error@374959562), errback=(continuation of Deferred@67950976 after retry RPC after error@517091426) -> (continuation of Deferred@1313291235 after retry RPC after error@797821367) -> (continuation of Deferred@1294976287 after retry RPC after error@1123134968) -> (continuation of Deferred@891166310 after retry RPC after error@1948231939) -> (continuation of Deferred@1202425250 after retry RPC after error@150632130) -> (continuation of Deferred@1305650325 after retry RPC after error@1150045085) -> (continuation of Deferred@1599150131 after retry RPC after error@71711101) -> (continuation of Deferred@1550369644 after retry RPC after error@2057219039) -> (continuation of Deferred@769238079 after retry RPC after error@409074984) -> (continuation of Deferred@42479339 after retry RPC after error@222801206) -> (continuation of Deferred@1834948861 after retry RPC after error@2059411651) -> (continuation of Deferred@972858886 after retry RPC after error@157450770) -> (continuation of Deferred@477096755 after retry RPC after error@1741817413) -> (continuation of Deferred@994197551 after retry RPC after error@640497479) -> (continuation of Deferred@1173907138 after retry RPC after error@846176278) -> (continuation of Deferred@461757772 after retry RPC after error@1423791732) -> (continuation of Deferred@1385555035 after retry RPC after error@498434319) -> (continuation of Deferred@678379592 after retry RPC after error@381672903) -> (continuation of Deferred@1802847351 after retry RPC after error@1526275567) -> (continuation of Deferred@147221496 after retry RPC after error@1627377346) -> (continuation of Deferred@568883286 after retry RPC after error@871112673) -> (continuation of Deferred@147733455 after retry RPC after error@374959562)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.29.158.188:39061
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:34.990 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:09:34.991 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#4) of source Source: KuduSource.
08:09:34.993 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_4.
08:09:34.993 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (a72e6b48022ef36361b5eef11ee7c683) switched from state RUNNING to RESTARTING.
08:09:34.994 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:34.994 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:34.994 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:34.995 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:34.995 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:34.995 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:34.996 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:34.996 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:34.996 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:34.996 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:34.996 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:34.996 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:34.996 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:35.028 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:35.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:35.056 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:35.116 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:35.123 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:35.124 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:35.124 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:35.124 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:35.124 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:35.124 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:35.124 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:35.124 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:35.124 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:35.125 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:35.125 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:35.125 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:35.125 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:35.225 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:35.225 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:35.225 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:35.225 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:35.225 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:35.226 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:35.226 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:35.226 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:35.226 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:35.227 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:35.227 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:35.227 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:35.227 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:35.272 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:35.272 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:35.272 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:35.273 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:35.273 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:35.274 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:35.274 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:35.274 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:35.274 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:35.275 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:35.275 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:35.275 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:35.275 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:35.295 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:35.295 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:35.295 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:35.296 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:35.296 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:35.296 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:35.296 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:35.296 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:35.296 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:35.296 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:35.296 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:35.296 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:35.296 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:35.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:35.346592  5373 rpc_server.cc:307] RPC server started. Bound to: 127.4.224.129:40841
08:09:35.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:35.346822  5608 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.224.129:40841 every 8 connection(s)
08:09:35.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:35.351671  5373 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-0/data/info.pb
08:09:35.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:35.355389  4994 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 5373
08:09:35.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:35.356102  4994 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-0/wal/instance
08:09:35.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:35.404505  4994 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:09:35.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:09:35.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-1/wal
08:09:35.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-1/data
08:09:35.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:09:35.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:09:35.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:09:35.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:09:35.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:09:35.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:09:35.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-1/logs
08:09:35.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-1/data/info.pb
08:09:35.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:09:35.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:09:35.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:09:35.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:09:35.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:09:35.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:09:35.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:09:35.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:09:35.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:09:35.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:09:35.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.224.130:0
08:09:35.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.224.130
08:09:35.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.224.130
08:09:35.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:09:35.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.224.190:36787,127.4.224.189:45505,127.4.224.188:40437
08:09:35.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.224.148:40383
08:09:35.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:09:35.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:09:35.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:09:35.410 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:35.421 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:35.422 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:35.422 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:35.422 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:35.423 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:35.423 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:35.423 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:35.423 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:35.423 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:35.426 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:35.426 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:35.426 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:35.426 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:35.473 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:35.473 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:35.473 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:35.474 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:35.474 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:35.474 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:35.474 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:35.474 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:35.474 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:35.475 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:35.475 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:35.475 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:35.475 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:35.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:35.496995  5610 heartbeater.cc:344] Connected to a master server at 127.4.224.189:45505
08:09:35.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:35.497673  5610 heartbeater.cc:461] Registering TS with master...
08:09:35.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:35.499554  5610 heartbeater.cc:507] Master 127.4.224.189:45505 requested a full tablet report, sending...
08:09:35.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:35.504415  5152 ts_manager.cc:194] Registered new tserver with Master: 0fedadaec47b41689759821a31ad4da5 (127.4.224.129:40841)
08:09:35.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:35.508477  5609 heartbeater.cc:344] Connected to a master server at 127.4.224.188:40437
08:09:35.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:35.508977  5609 heartbeater.cc:461] Registering TS with master...
08:09:35.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:35.510865  5609 heartbeater.cc:507] Master 127.4.224.188:40437 requested a full tablet report, sending...
08:09:35.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:35.514556  5291 ts_manager.cc:194] Registered new tserver with Master: 0fedadaec47b41689759821a31ad4da5 (127.4.224.129:40841)
08:09:35.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:35.518158  5291 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.224.129:38611
08:09:35.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:35.522624  5611 heartbeater.cc:344] Connected to a master server at 127.4.224.190:36787
08:09:35.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:35.523052  5611 heartbeater.cc:461] Registering TS with master...
08:09:35.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:35.524950  5611 heartbeater.cc:507] Master 127.4.224.190:36787 requested a full tablet report, sending...
08:09:35.527 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:35.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:35.529599  5063 ts_manager.cc:194] Registered new tserver with Master: 0fedadaec47b41689759821a31ad4da5 (127.4.224.129:40841)
08:09:35.543 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:35.543 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:35.543 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:35.544 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:35.544 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:35.544 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:35.544 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:35.544 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:35.544 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:35.545 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:35.545 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:35.545 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:35.545 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:35.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:35.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:35.583 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:35.584 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:35.584 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:35.584 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:35.584 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:35.584 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:35.584 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:35.584 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:35.584 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:35.585 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:35.585 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:35.585 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:35.585 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:35.616 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:35.644 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:35.644 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:35.644 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:35.645 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:35.645 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:35.645 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:35.646 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:35.646 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:35.646 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:35.645 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:35.646 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:35.646 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:35.646 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:35.744 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:35.744 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:35.744 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:35.744 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:35.744 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:35.744 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:35.745 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:35.745 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:35.745 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:35.745 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:35.745 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:35.745 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:35.745 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:35.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:35.974 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:35.974 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:35.974 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:35.974 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:35.975 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:35.975 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:35.975 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:35.975 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:35.975 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:35.976 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:35.976 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:35.976 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:35.976 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:36.028 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:36.033 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:36.033 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:36.033 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:36.033 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:36.033 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:36.033 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:36.034 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:36.034 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:36.034 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:36.034 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:36.034 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:36.034 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:36.034 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:36.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:36.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:36.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:36.067713  5619 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:09:36.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:36.068477  5619 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:09:36.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:36.069280  5619 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:09:36.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:36.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:36.140189  5619 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:09:36.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:36.142819  5619 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.224.130
08:09:36.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:36.218775  5619 tablet_server_runner.cc:78] Tablet server non-default flags:
08:09:36.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:09:36.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.224.148:40383
08:09:36.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:09:36.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:09:36.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-1/data
08:09:36.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-1/wal
08:09:36.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:09:36.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:09:36.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.224.130:0
08:09:36.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:09:36.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:09:36.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:09:36.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-1/data/info.pb
08:09:36.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.224.130
08:09:36.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:09:36.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.224.190:36787,127.4.224.189:45505,127.4.224.188:40437
08:09:36.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:09:36.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:09:36.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:09:36.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:09:36.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:09:36.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.224.130
08:09:36.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-1/logs
08:09:36.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:09:36.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:09:36.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:09:36.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:09:36.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:09:36.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:09:36.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:09:36.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:09:36.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:09:36.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:09:36.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:36.220906  5619 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:09:36.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:36.224398  5619 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:09:36.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:36.254329  5626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:36.290 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:36.290 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:36.290 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:36.291 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:36.291 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:36.291 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:36.292 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:36.292 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:36.292 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:36.292 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:36.292 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:36.292 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:36.293 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:36.294 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=27515), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [6ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [11ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [11ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [23ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [24ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [24ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [24ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [49ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [69ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [71ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [71ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [82ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [83ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [83ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [83ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [102ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [122ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [122ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [122ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [122ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [141ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [142ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [142ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [142ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [241ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [241ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [242ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [382ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [382ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [383ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [383ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [562ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [563ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [563ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [563ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1424ms] refreshing cache from master, [1424ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1425ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1426ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1426ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1426ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1426ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1427ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [3321ms] refreshing cache from master, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [3321ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [3322ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [3322ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [3322ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [6100ms] refreshing cache from master, [6101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [6101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [6101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [6102ms] too many traces: truncated at 100 traces, deferred=Deferred@1650956010(state=PENDING, result=null, callback=(continuation of Deferred@383428820 after retry RPC after error@808090688) -> (continuation of Deferred@288589149 after retry RPC after error@1337823575) -> (continuation of Deferred@216140924 after retry RPC after error@1867098588) -> (continuation of Deferred@1658699781 after retry RPC after error@1095356960) -> (continuation of Deferred@1565829017 after retry RPC after error@2146558630) -> (continuation of Deferred@1939916981 after retry RPC after error@2096614451) -> (continuation of Deferred@73913435 after retry RPC after error@1962140323) -> (continuation of Deferred@23292392 after retry RPC after error@1136110499) -> (continuation of Deferred@2034788994 after retry RPC after error@306543090) -> (continuation of Deferred@141782651 after retry RPC after error@1986471525) -> (continuation of Deferred@1279348305 after retry RPC after error@1970414786) -> (continuation of Deferred@1717669025 after retry RPC after error@695912966) -> (continuation of Deferred@1863264958 after retry RPC after error@188700585) -> (continuation of Deferred@1641137899 after retry RPC after error@511973933) -> (continuation of Deferred@138975641 after retry RPC after error@2042303782) -> (continuation of Deferred@380793444 after retry RPC after error@685332461) -> (continuation of Deferred@1687258942 after retry RPC after error@1168288943) -> (continuation of Deferred@1074186029 after retry RPC after error@578983679) -> (continuation of Deferred@1245863398 after retry RPC after error@441800661) -> (continuation of Deferred@1813824541 after retry RPC after error@1520407055) -> (continuation of Deferred@48908759 after retry RPC after error@850484640), errback=(continuation of Deferred@383428820 after retry RPC after error@808090688) -> (continuation of Deferred@288589149 after retry RPC after error@1337823575) -> (continuation of Deferred@216140924 after retry RPC after error@1867098588) -> (continuation of Deferred@1658699781 after retry RPC after error@1095356960) -> (continuation of Deferred@1565829017 after retry RPC after error@2146558630) -> (continuation of Deferred@1939916981 after retry RPC after error@2096614451) -> (continuation of Deferred@73913435 after retry RPC after error@1962140323) -> (continuation of Deferred@23292392 after retry RPC after error@1136110499) -> (continuation of Deferred@2034788994 after retry RPC after error@306543090) -> (continuation of Deferred@141782651 after retry RPC after error@1986471525) -> (continuation of Deferred@1279348305 after retry RPC after error@1970414786) -> (continuation of Deferred@1717669025 after retry RPC after error@695912966) -> (continuation of Deferred@1863264958 after retry RPC after error@188700585) -> (continuation of Deferred@1641137899 after retry RPC after error@511973933) -> (continuation of Deferred@138975641 after retry RPC after error@2042303782) -> (continuation of Deferred@380793444 after retry RPC after error@685332461) -> (continuation of Deferred@1687258942 after retry RPC after error@1168288943) -> (continuation of Deferred@1074186029 after retry RPC after error@578983679) -> (continuation of Deferred@1245863398 after retry RPC after error@441800661) -> (continuation of Deferred@1813824541 after retry RPC after error@1520407055) -> (continuation of Deferred@48908759 after retry RPC after error@850484640)))
08:09:36.301 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (SourceReaderBase.java:338) Closing Source Reader.
08:09:36.301 [WARN - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#7 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=27515), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [6ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [11ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [11ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [23ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [24ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [24ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [24ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [49ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [69ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [71ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [71ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [82ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [83ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [83ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [83ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [102ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [122ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [122ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [122ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [122ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [141ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [142ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [142ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [142ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [241ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [241ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [242ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [382ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [382ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [383ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [383ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [562ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [563ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [563ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [563ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1424ms] refreshing cache from master, [1424ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1425ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1426ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1426ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1426ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1426ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1427ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [3321ms] refreshing cache from master, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [3321ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [3322ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [3322ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [3322ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [6100ms] refreshing cache from master, [6101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [6101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [6101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [6102ms] too many traces: truncated at 100 traces, deferred=Deferred@1650956010(state=PENDING, result=null, callback=(continuation of Deferred@383428820 after retry RPC after error@808090688) -> (continuation of Deferred@288589149 after retry RPC after error@1337823575) -> (continuation of Deferred@216140924 after retry RPC after error@1867098588) -> (continuation of Deferred@1658699781 after retry RPC after error@1095356960) -> (continuation of Deferred@1565829017 after retry RPC after error@2146558630) -> (continuation of Deferred@1939916981 after retry RPC after error@2096614451) -> (continuation of Deferred@73913435 after retry RPC after error@1962140323) -> (continuation of Deferred@23292392 after retry RPC after error@1136110499) -> (continuation of Deferred@2034788994 after retry RPC after error@306543090) -> (continuation of Deferred@141782651 after retry RPC after error@1986471525) -> (continuation of Deferred@1279348305 after retry RPC after error@1970414786) -> (continuation of Deferred@1717669025 after retry RPC after error@695912966) -> (continuation of Deferred@1863264958 after retry RPC after error@188700585) -> (continuation of Deferred@1641137899 after retry RPC after error@511973933) -> (continuation of Deferred@138975641 after retry RPC after error@2042303782) -> (continuation of Deferred@380793444 after retry RPC after error@685332461) -> (continuation of Deferred@1687258942 after retry RPC after error@1168288943) -> (continuation of Deferred@1074186029 after retry RPC after error@578983679) -> (continuation of Deferred@1245863398 after retry RPC after error@441800661) -> (continuation of Deferred@1813824541 after retry RPC after error@1520407055) -> (continuation of Deferred@48908759 after retry RPC after error@850484640), errback=(continuation of Deferred@383428820 after retry RPC after error@808090688) -> (continuation of Deferred@288589149 after retry RPC after error@1337823575) -> (continuation of Deferred@216140924 after retry RPC after error@1867098588) -> (continuation of Deferred@1658699781 after retry RPC after error@1095356960) -> (continuation of Deferred@1565829017 after retry RPC after error@2146558630) -> (continuation of Deferred@1939916981 after retry RPC after error@2096614451) -> (continuation of Deferred@73913435 after retry RPC after error@1962140323) -> (continuation of Deferred@23292392 after retry RPC after error@1136110499) -> (continuation of Deferred@2034788994 after retry RPC after error@306543090) -> (continuation of Deferred@141782651 after retry RPC after error@1986471525) -> (continuation of Deferred@1279348305 after retry RPC after error@1970414786) -> (continuation of Deferred@1717669025 after retry RPC after error@695912966) -> (continuation of Deferred@1863264958 after retry RPC after error@188700585) -> (continuation of Deferred@1641137899 after retry RPC after error@511973933) -> (continuation of Deferred@138975641 after retry RPC after error@2042303782) -> (continuation of Deferred@380793444 after retry RPC after error@685332461) -> (continuation of Deferred@1687258942 after retry RPC after error@1168288943) -> (continuation of Deferred@1074186029 after retry RPC after error@578983679) -> (continuation of Deferred@1245863398 after retry RPC after error@441800661) -> (continuation of Deferred@1813824541 after retry RPC after error@1520407055) -> (continuation of Deferred@48908759 after retry RPC after error@850484640)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.189:46677
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:36.305 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#7 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_7).
08:09:36.307 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#7 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_7.
08:09:36.321 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from INITIALIZING to FAILED on 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=27515), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [6ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [11ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [11ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [23ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [24ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [24ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [24ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [49ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [69ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [71ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [71ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [82ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [83ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [83ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [83ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [102ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [102ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [122ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [122ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [122ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [122ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [141ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [142ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [142ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [142ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [241ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [241ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [242ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [242ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [382ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [382ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [383ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [383ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [562ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [563ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [563ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [563ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1424ms] refreshing cache from master, [1424ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1425ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [1426ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [1426ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [1426ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [1426ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [1427ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [3321ms] refreshing cache from master, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [3321ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [3322ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [3322ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [3322ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [6100ms] refreshing cache from master, [6101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [6101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [6101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [6102ms] too many traces: truncated at 100 traces, deferred=Deferred@1650956010(state=PENDING, result=null, callback=(continuation of Deferred@383428820 after retry RPC after error@808090688) -> (continuation of Deferred@288589149 after retry RPC after error@1337823575) -> (continuation of Deferred@216140924 after retry RPC after error@1867098588) -> (continuation of Deferred@1658699781 after retry RPC after error@1095356960) -> (continuation of Deferred@1565829017 after retry RPC after error@2146558630) -> (continuation of Deferred@1939916981 after retry RPC after error@2096614451) -> (continuation of Deferred@73913435 after retry RPC after error@1962140323) -> (continuation of Deferred@23292392 after retry RPC after error@1136110499) -> (continuation of Deferred@2034788994 after retry RPC after error@306543090) -> (continuation of Deferred@141782651 after retry RPC after error@1986471525) -> (continuation of Deferred@1279348305 after retry RPC after error@1970414786) -> (continuation of Deferred@1717669025 after retry RPC after error@695912966) -> (continuation of Deferred@1863264958 after retry RPC after error@188700585) -> (continuation of Deferred@1641137899 after retry RPC after error@511973933) -> (continuation of Deferred@138975641 after retry RPC after error@2042303782) -> (continuation of Deferred@380793444 after retry RPC after error@685332461) -> (continuation of Deferred@1687258942 after retry RPC after error@1168288943) -> (continuation of Deferred@1074186029 after retry RPC after error@578983679) -> (continuation of Deferred@1245863398 after retry RPC after error@441800661) -> (continuation of Deferred@1813824541 after retry RPC after error@1520407055) -> (continuation of Deferred@48908759 after retry RPC after error@850484640), errback=(continuation of Deferred@383428820 after retry RPC after error@808090688) -> (continuation of Deferred@288589149 after retry RPC after error@1337823575) -> (continuation of Deferred@216140924 after retry RPC after error@1867098588) -> (continuation of Deferred@1658699781 after retry RPC after error@1095356960) -> (continuation of Deferred@1565829017 after retry RPC after error@2146558630) -> (continuation of Deferred@1939916981 after retry RPC after error@2096614451) -> (continuation of Deferred@73913435 after retry RPC after error@1962140323) -> (continuation of Deferred@23292392 after retry RPC after error@1136110499) -> (continuation of Deferred@2034788994 after retry RPC after error@306543090) -> (continuation of Deferred@141782651 after retry RPC after error@1986471525) -> (continuation of Deferred@1279348305 after retry RPC after error@1970414786) -> (continuation of Deferred@1717669025 after retry RPC after error@695912966) -> (continuation of Deferred@1863264958 after retry RPC after error@188700585) -> (continuation of Deferred@1641137899 after retry RPC after error@511973933) -> (continuation of Deferred@138975641 after retry RPC after error@2042303782) -> (continuation of Deferred@380793444 after retry RPC after error@685332461) -> (continuation of Deferred@1687258942 after retry RPC after error@1168288943) -> (continuation of Deferred@1074186029 after retry RPC after error@578983679) -> (continuation of Deferred@1245863398 after retry RPC after error@441800661) -> (continuation of Deferred@1813824541 after retry RPC after error@1520407055) -> (continuation of Deferred@48908759 after retry RPC after error@850484640)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.189:46677
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:36.339 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:09:36.341 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#7) of source Source: KuduSource.
08:09:36.343 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_7.
08:09:36.343 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (e26b904229418d0e047d5d94c5b9f905) switched from state RUNNING to RESTARTING.
08:09:36.358 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:36.359 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:36.359 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:36.359 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:36.359 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:36.359 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:36.359 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:36.360 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:36.360 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:36.360 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:36.360 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:36.360 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:36.361 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:36.362 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27567), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [3ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [4ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [4ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [22ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [22ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [23ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [23ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [61ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [63ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [63ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [63ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [82ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [82ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [82ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [82ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [103ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [103ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [104ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [104ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [141ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [142ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [142ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [142ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [223ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [262ms] refreshing cache from master, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [264ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [264ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [265ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [265ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [462ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [462ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [462ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [463ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [481ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [482ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [482ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [482ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [821ms] refreshing cache from master, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [822ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [822ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [823ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [823ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2420ms] refreshing cache from master, [2420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2422ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2422ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [2423ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2423ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [6301ms] refreshing cache from master, [6301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [6301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [6301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [6302ms] too many traces: truncated at 100 traces, deferred=Deferred@1200355626(state=PENDING, result=null, callback=(continuation of Deferred@2121308214 after retry RPC after error@1114251681) -> (continuation of Deferred@459139380 after retry RPC after error@59183580) -> (continuation of Deferred@2035058866 after retry RPC after error@1782106387) -> (continuation of Deferred@509122857 after retry RPC after error@627729103) -> (continuation of Deferred@947812296 after retry RPC after error@346182021) -> (continuation of Deferred@1323893737 after retry RPC after error@954428641) -> (continuation of Deferred@1944624130 after retry RPC after error@1967183235) -> (continuation of Deferred@1940940425 after retry RPC after error@1343719546) -> (continuation of Deferred@1739065078 after retry RPC after error@339163981) -> (continuation of Deferred@1682146156 after retry RPC after error@150700998) -> (continuation of Deferred@801356697 after retry RPC after error@33751167) -> (continuation of Deferred@2049162160 after retry RPC after error@781378177) -> (continuation of Deferred@482315193 after retry RPC after error@111505577) -> (continuation of Deferred@1631368694 after retry RPC after error@1476646330) -> (continuation of Deferred@939618112 after retry RPC after error@353136849) -> (continuation of Deferred@287040643 after retry RPC after error@1467178271) -> (continuation of Deferred@1681605598 after retry RPC after error@315047280) -> (continuation of Deferred@1555496023 after retry RPC after error@299944315) -> (continuation of Deferred@796609834 after retry RPC after error@75290888) -> (continuation of Deferred@1875102100 after retry RPC after error@2030005766) -> (continuation of Deferred@219704878 after retry RPC after error@1867403804) -> (continuation of Deferred@506509576 after retry RPC after error@490503062) -> (continuation of Deferred@1394282241 after retry RPC after error@1322805708) -> (continuation of Deferred@1429955046 after retry RPC after error@723861532), errback=(continuation of Deferred@2121308214 after retry RPC after error@1114251681) -> (continuation of Deferred@459139380 after retry RPC after error@59183580) -> (continuation of Deferred@2035058866 after retry RPC after error@1782106387) -> (continuation of Deferred@509122857 after retry RPC after error@627729103) -> (continuation of Deferred@947812296 after retry RPC after error@346182021) -> (continuation of Deferred@1323893737 after retry RPC after error@954428641) -> (continuation of Deferred@1944624130 after retry RPC after error@1967183235) -> (continuation of Deferred@1940940425 after retry RPC after error@1343719546) -> (continuation of Deferred@1739065078 after retry RPC after error@339163981) -> (continuation of Deferred@1682146156 after retry RPC after error@150700998) -> (continuation of Deferred@801356697 after retry RPC after error@33751167) -> (continuation of Deferred@2049162160 after retry RPC after error@781378177) -> (continuation of Deferred@482315193 after retry RPC after error@111505577) -> (continuation of Deferred@1631368694 after retry RPC after error@1476646330) -> (continuation of Deferred@939618112 after retry RPC after error@353136849) -> (continuation of Deferred@287040643 after retry RPC after error@1467178271) -> (continuation of Deferred@1681605598 after retry RPC after error@315047280) -> (continuation of Deferred@1555496023 after retry RPC after error@299944315) -> (continuation of Deferred@796609834 after retry RPC after error@75290888) -> (continuation of Deferred@1875102100 after retry RPC after error@2030005766) -> (continuation of Deferred@219704878 after retry RPC after error@1867403804) -> (continuation of Deferred@506509576 after retry RPC after error@490503062) -> (continuation of Deferred@1394282241 after retry RPC after error@1322805708) -> (continuation of Deferred@1429955046 after retry RPC after error@723861532)))
08:09:36.364 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (SourceReaderBase.java:338) Closing Source Reader.
08:09:36.365 [WARN - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#7 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27567), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [3ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [4ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [4ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [22ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [22ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [23ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [23ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [61ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [63ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [63ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [63ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [82ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [82ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [82ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [82ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [103ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [103ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [104ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [104ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [141ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [142ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [142ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [142ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [223ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [262ms] refreshing cache from master, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [264ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [264ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [265ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [265ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [462ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [462ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [462ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [463ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [481ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [482ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [482ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [482ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [821ms] refreshing cache from master, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [822ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [822ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [823ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [823ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2420ms] refreshing cache from master, [2420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2422ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2422ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [2423ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2423ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [6301ms] refreshing cache from master, [6301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [6301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [6301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [6302ms] too many traces: truncated at 100 traces, deferred=Deferred@1200355626(state=PENDING, result=null, callback=(continuation of Deferred@2121308214 after retry RPC after error@1114251681) -> (continuation of Deferred@459139380 after retry RPC after error@59183580) -> (continuation of Deferred@2035058866 after retry RPC after error@1782106387) -> (continuation of Deferred@509122857 after retry RPC after error@627729103) -> (continuation of Deferred@947812296 after retry RPC after error@346182021) -> (continuation of Deferred@1323893737 after retry RPC after error@954428641) -> (continuation of Deferred@1944624130 after retry RPC after error@1967183235) -> (continuation of Deferred@1940940425 after retry RPC after error@1343719546) -> (continuation of Deferred@1739065078 after retry RPC after error@339163981) -> (continuation of Deferred@1682146156 after retry RPC after error@150700998) -> (continuation of Deferred@801356697 after retry RPC after error@33751167) -> (continuation of Deferred@2049162160 after retry RPC after error@781378177) -> (continuation of Deferred@482315193 after retry RPC after error@111505577) -> (continuation of Deferred@1631368694 after retry RPC after error@1476646330) -> (continuation of Deferred@939618112 after retry RPC after error@353136849) -> (continuation of Deferred@287040643 after retry RPC after error@1467178271) -> (continuation of Deferred@1681605598 after retry RPC after error@315047280) -> (continuation of Deferred@1555496023 after retry RPC after error@299944315) -> (continuation of Deferred@796609834 after retry RPC after error@75290888) -> (continuation of Deferred@1875102100 after retry RPC after error@2030005766) -> (continuation of Deferred@219704878 after retry RPC after error@1867403804) -> (continuation of Deferred@506509576 after retry RPC after error@490503062) -> (continuation of Deferred@1394282241 after retry RPC after error@1322805708) -> (continuation of Deferred@1429955046 after retry RPC after error@723861532), errback=(continuation of Deferred@2121308214 after retry RPC after error@1114251681) -> (continuation of Deferred@459139380 after retry RPC after error@59183580) -> (continuation of Deferred@2035058866 after retry RPC after error@1782106387) -> (continuation of Deferred@509122857 after retry RPC after error@627729103) -> (continuation of Deferred@947812296 after retry RPC after error@346182021) -> (continuation of Deferred@1323893737 after retry RPC after error@954428641) -> (continuation of Deferred@1944624130 after retry RPC after error@1967183235) -> (continuation of Deferred@1940940425 after retry RPC after error@1343719546) -> (continuation of Deferred@1739065078 after retry RPC after error@339163981) -> (continuation of Deferred@1682146156 after retry RPC after error@150700998) -> (continuation of Deferred@801356697 after retry RPC after error@33751167) -> (continuation of Deferred@2049162160 after retry RPC after error@781378177) -> (continuation of Deferred@482315193 after retry RPC after error@111505577) -> (continuation of Deferred@1631368694 after retry RPC after error@1476646330) -> (continuation of Deferred@939618112 after retry RPC after error@353136849) -> (continuation of Deferred@287040643 after retry RPC after error@1467178271) -> (continuation of Deferred@1681605598 after retry RPC after error@315047280) -> (continuation of Deferred@1555496023 after retry RPC after error@299944315) -> (continuation of Deferred@796609834 after retry RPC after error@75290888) -> (continuation of Deferred@1875102100 after retry RPC after error@2030005766) -> (continuation of Deferred@219704878 after retry RPC after error@1867403804) -> (continuation of Deferred@506509576 after retry RPC after error@490503062) -> (continuation of Deferred@1394282241 after retry RPC after error@1322805708) -> (continuation of Deferred@1429955046 after retry RPC after error@723861532)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.189:46677
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:36.368 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#7 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_7).
08:09:36.369 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#7 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_7.
08:09:36.371 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from INITIALIZING to FAILED on 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27567), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [3ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [4ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [4ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [22ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [22ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [23ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [23ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [61ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [63ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [63ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [63ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [82ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [82ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [82ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [82ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [103ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [103ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [104ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [104ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [141ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [142ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [142ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [142ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [222ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [223ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [223ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [262ms] refreshing cache from master, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [264ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [264ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [265ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [265ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [462ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [462ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [462ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [463ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [481ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [482ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [482ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [482ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [821ms] refreshing cache from master, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [822ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [822ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [823ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [823ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2420ms] refreshing cache from master, [2420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [2421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [2421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [2422ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.188:41049: Network error: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049, [2422ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.190:44627: Network error: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627, [2423ms] Sub RPC ConnectToMaster: received response from server master-127.25.158.189:46677: Network error: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [2423ms] delaying RPC due to: Service unavailable: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677, [6301ms] refreshing cache from master, [6301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.188:41049, [6301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.190:44627, [6301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.158.189:46677, [6302ms] too many traces: truncated at 100 traces, deferred=Deferred@1200355626(state=PENDING, result=null, callback=(continuation of Deferred@2121308214 after retry RPC after error@1114251681) -> (continuation of Deferred@459139380 after retry RPC after error@59183580) -> (continuation of Deferred@2035058866 after retry RPC after error@1782106387) -> (continuation of Deferred@509122857 after retry RPC after error@627729103) -> (continuation of Deferred@947812296 after retry RPC after error@346182021) -> (continuation of Deferred@1323893737 after retry RPC after error@954428641) -> (continuation of Deferred@1944624130 after retry RPC after error@1967183235) -> (continuation of Deferred@1940940425 after retry RPC after error@1343719546) -> (continuation of Deferred@1739065078 after retry RPC after error@339163981) -> (continuation of Deferred@1682146156 after retry RPC after error@150700998) -> (continuation of Deferred@801356697 after retry RPC after error@33751167) -> (continuation of Deferred@2049162160 after retry RPC after error@781378177) -> (continuation of Deferred@482315193 after retry RPC after error@111505577) -> (continuation of Deferred@1631368694 after retry RPC after error@1476646330) -> (continuation of Deferred@939618112 after retry RPC after error@353136849) -> (continuation of Deferred@287040643 after retry RPC after error@1467178271) -> (continuation of Deferred@1681605598 after retry RPC after error@315047280) -> (continuation of Deferred@1555496023 after retry RPC after error@299944315) -> (continuation of Deferred@796609834 after retry RPC after error@75290888) -> (continuation of Deferred@1875102100 after retry RPC after error@2030005766) -> (continuation of Deferred@219704878 after retry RPC after error@1867403804) -> (continuation of Deferred@506509576 after retry RPC after error@490503062) -> (continuation of Deferred@1394282241 after retry RPC after error@1322805708) -> (continuation of Deferred@1429955046 after retry RPC after error@723861532), errback=(continuation of Deferred@2121308214 after retry RPC after error@1114251681) -> (continuation of Deferred@459139380 after retry RPC after error@59183580) -> (continuation of Deferred@2035058866 after retry RPC after error@1782106387) -> (continuation of Deferred@509122857 after retry RPC after error@627729103) -> (continuation of Deferred@947812296 after retry RPC after error@346182021) -> (continuation of Deferred@1323893737 after retry RPC after error@954428641) -> (continuation of Deferred@1944624130 after retry RPC after error@1967183235) -> (continuation of Deferred@1940940425 after retry RPC after error@1343719546) -> (continuation of Deferred@1739065078 after retry RPC after error@339163981) -> (continuation of Deferred@1682146156 after retry RPC after error@150700998) -> (continuation of Deferred@801356697 after retry RPC after error@33751167) -> (continuation of Deferred@2049162160 after retry RPC after error@781378177) -> (continuation of Deferred@482315193 after retry RPC after error@111505577) -> (continuation of Deferred@1631368694 after retry RPC after error@1476646330) -> (continuation of Deferred@939618112 after retry RPC after error@353136849) -> (continuation of Deferred@287040643 after retry RPC after error@1467178271) -> (continuation of Deferred@1681605598 after retry RPC after error@315047280) -> (continuation of Deferred@1555496023 after retry RPC after error@299944315) -> (continuation of Deferred@796609834 after retry RPC after error@75290888) -> (continuation of Deferred@1875102100 after retry RPC after error@2030005766) -> (continuation of Deferred@219704878 after retry RPC after error@1867403804) -> (continuation of Deferred@506509576 after retry RPC after error@490503062) -> (continuation of Deferred@1394282241 after retry RPC after error@1322805708) -> (continuation of Deferred@1429955046 after retry RPC after error@723861532)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.25.158.189:46677
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:36.375 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:09:36.376 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#7) of source Source: KuduSource.
08:09:36.377 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_7.
08:09:36.528 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:36.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:36.539978  5609 heartbeater.cc:499] Master 127.4.224.188:40437 was elected leader, sending a full tablet report...
08:09:36.556 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:36.556 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:36.598 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:36.598 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:36.599 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:36.599 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:36.600 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:36.600 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:36.600 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:36.600 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:36.600 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:36.601 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:36.601 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:36.601 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:36.601 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:36.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:36.684 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:36.686 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:36.686 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:36.687 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:36.687 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:36.687 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:36.687 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:36.687 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:36.687 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:36.688 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:36.688 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:36.688 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:36.688 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:36.695 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:36.695 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:36.695 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:36.695 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.695 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.695 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.696 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.696 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.696 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.696 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.696 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.696 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.696 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:36.697 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28886), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [27ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [32ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [35ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [35ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [39ms] refreshing cache from master, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [47ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [49ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [50ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [50ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [58ms] refreshing cache from master, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [64ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [65ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [65ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [65ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [79ms] refreshing cache from master, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [80ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [80ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [81ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [99ms] refreshing cache from master, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [109ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [109ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [139ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [140ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [140ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [140ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [141ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [218ms] refreshing cache from master, [218ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [219ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [219ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [220ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [220ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [221ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [221ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [238ms] refreshing cache from master, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [239ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [240ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [240ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [240ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [278ms] refreshing cache from master, [278ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [279ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [279ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [280ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [280ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [281ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [281ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [618ms] refreshing cache from master, [619ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [619ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [619ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [619ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [620ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [620ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [621ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1299ms] refreshing cache from master, [1299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [1299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [1300ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1301ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2779ms] refreshing cache from master, [2779ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2779ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2779ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [2780ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [2780ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [2781ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2781ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [3298ms] refreshing cache from master, [3299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [3299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [3299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [3300ms] too many traces: truncated at 100 traces, deferred=Deferred@1889877317(state=PENDING, result=null, callback=(continuation of Deferred@2053732639 after retry RPC after error@961537073) -> (continuation of Deferred@1845035241 after retry RPC after error@888096518) -> (continuation of Deferred@92238085 after retry RPC after error@1138189303) -> (continuation of Deferred@1712119084 after retry RPC after error@672493980) -> (continuation of Deferred@1453116098 after retry RPC after error@783074109) -> (continuation of Deferred@776576633 after retry RPC after error@768840637) -> (continuation of Deferred@489260575 after retry RPC after error@1439964076) -> (continuation of Deferred@923598137 after retry RPC after error@116641310) -> (continuation of Deferred@1471920545 after retry RPC after error@575132033) -> (continuation of Deferred@1928463813 after retry RPC after error@1785312955) -> (continuation of Deferred@1612020966 after retry RPC after error@2093114044) -> (continuation of Deferred@519871692 after retry RPC after error@956775878) -> (continuation of Deferred@1916703820 after retry RPC after error@495374133) -> (continuation of Deferred@1743137461 after retry RPC after error@1737474690) -> (continuation of Deferred@1637201611 after retry RPC after error@1245782699) -> (continuation of Deferred@480516820 after retry RPC after error@94785552) -> (continuation of Deferred@1229557121 after retry RPC after error@173976185) -> (continuation of Deferred@907043676 after retry RPC after error@25269086) -> (continuation of Deferred@77669226 after retry RPC after error@2069060837) -> (continuation of Deferred@1324145232 after retry RPC after error@1132116912) -> (continuation of Deferred@1313700550 after retry RPC after error@790143902) -> (continuation of Deferred@126796407 after retry RPC after error@297750029) -> (continuation of Deferred@880909750 after retry RPC after error@1584389355) -> (continuation of Deferred@788738091 after retry RPC after error@1143459040), errback=(continuation of Deferred@2053732639 after retry RPC after error@961537073) -> (continuation of Deferred@1845035241 after retry RPC after error@888096518) -> (continuation of Deferred@92238085 after retry RPC after error@1138189303) -> (continuation of Deferred@1712119084 after retry RPC after error@672493980) -> (continuation of Deferred@1453116098 after retry RPC after error@783074109) -> (continuation of Deferred@776576633 after retry RPC after error@768840637) -> (continuation of Deferred@489260575 after retry RPC after error@1439964076) -> (continuation of Deferred@923598137 after retry RPC after error@116641310) -> (continuation of Deferred@1471920545 after retry RPC after error@575132033) -> (continuation of Deferred@1928463813 after retry RPC after error@1785312955) -> (continuation of Deferred@1612020966 after retry RPC after error@2093114044) -> (continuation of Deferred@519871692 after retry RPC after error@956775878) -> (continuation of Deferred@1916703820 after retry RPC after error@495374133) -> (continuation of Deferred@1743137461 after retry RPC after error@1737474690) -> (continuation of Deferred@1637201611 after retry RPC after error@1245782699) -> (continuation of Deferred@480516820 after retry RPC after error@94785552) -> (continuation of Deferred@1229557121 after retry RPC after error@173976185) -> (continuation of Deferred@907043676 after retry RPC after error@25269086) -> (continuation of Deferred@77669226 after retry RPC after error@2069060837) -> (continuation of Deferred@1324145232 after retry RPC after error@1132116912) -> (continuation of Deferred@1313700550 after retry RPC after error@790143902) -> (continuation of Deferred@126796407 after retry RPC after error@297750029) -> (continuation of Deferred@880909750 after retry RPC after error@1584389355) -> (continuation of Deferred@788738091 after retry RPC after error@1143459040)))
08:09:36.702 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:36.702 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:36.702 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:36.702 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28886), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [27ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [32ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [35ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [35ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [39ms] refreshing cache from master, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [47ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [49ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [50ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [50ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [58ms] refreshing cache from master, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [64ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [65ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [65ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [65ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [79ms] refreshing cache from master, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [80ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [80ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [81ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [99ms] refreshing cache from master, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [109ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [109ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [139ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [140ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [140ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [140ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [141ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [218ms] refreshing cache from master, [218ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [219ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [219ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [220ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [220ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [221ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [221ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [238ms] refreshing cache from master, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [239ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [240ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [240ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [240ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [278ms] refreshing cache from master, [278ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [279ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [279ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [280ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [280ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [281ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [281ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [618ms] refreshing cache from master, [619ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [619ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [619ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [619ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [620ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [620ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [621ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1299ms] refreshing cache from master, [1299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [1299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [1300ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1301ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2779ms] refreshing cache from master, [2779ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2779ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2779ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [2780ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [2780ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [2781ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2781ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [3298ms] refreshing cache from master, [3299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [3299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [3299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [3300ms] too many traces: truncated at 100 traces, deferred=Deferred@1889877317(state=PENDING, result=null, callback=(continuation of Deferred@2053732639 after retry RPC after error@961537073) -> (continuation of Deferred@1845035241 after retry RPC after error@888096518) -> (continuation of Deferred@92238085 after retry RPC after error@1138189303) -> (continuation of Deferred@1712119084 after retry RPC after error@672493980) -> (continuation of Deferred@1453116098 after retry RPC after error@783074109) -> (continuation of Deferred@776576633 after retry RPC after error@768840637) -> (continuation of Deferred@489260575 after retry RPC after error@1439964076) -> (continuation of Deferred@923598137 after retry RPC after error@116641310) -> (continuation of Deferred@1471920545 after retry RPC after error@575132033) -> (continuation of Deferred@1928463813 after retry RPC after error@1785312955) -> (continuation of Deferred@1612020966 after retry RPC after error@2093114044) -> (continuation of Deferred@519871692 after retry RPC after error@956775878) -> (continuation of Deferred@1916703820 after retry RPC after error@495374133) -> (continuation of Deferred@1743137461 after retry RPC after error@1737474690) -> (continuation of Deferred@1637201611 after retry RPC after error@1245782699) -> (continuation of Deferred@480516820 after retry RPC after error@94785552) -> (continuation of Deferred@1229557121 after retry RPC after error@173976185) -> (continuation of Deferred@907043676 after retry RPC after error@25269086) -> (continuation of Deferred@77669226 after retry RPC after error@2069060837) -> (continuation of Deferred@1324145232 after retry RPC after error@1132116912) -> (continuation of Deferred@1313700550 after retry RPC after error@790143902) -> (continuation of Deferred@126796407 after retry RPC after error@297750029) -> (continuation of Deferred@880909750 after retry RPC after error@1584389355) -> (continuation of Deferred@788738091 after retry RPC after error@1143459040), errback=(continuation of Deferred@2053732639 after retry RPC after error@961537073) -> (continuation of Deferred@1845035241 after retry RPC after error@888096518) -> (continuation of Deferred@92238085 after retry RPC after error@1138189303) -> (continuation of Deferred@1712119084 after retry RPC after error@672493980) -> (continuation of Deferred@1453116098 after retry RPC after error@783074109) -> (continuation of Deferred@776576633 after retry RPC after error@768840637) -> (continuation of Deferred@489260575 after retry RPC after error@1439964076) -> (continuation of Deferred@923598137 after retry RPC after error@116641310) -> (continuation of Deferred@1471920545 after retry RPC after error@575132033) -> (continuation of Deferred@1928463813 after retry RPC after error@1785312955) -> (continuation of Deferred@1612020966 after retry RPC after error@2093114044) -> (continuation of Deferred@519871692 after retry RPC after error@956775878) -> (continuation of Deferred@1916703820 after retry RPC after error@495374133) -> (continuation of Deferred@1743137461 after retry RPC after error@1737474690) -> (continuation of Deferred@1637201611 after retry RPC after error@1245782699) -> (continuation of Deferred@480516820 after retry RPC after error@94785552) -> (continuation of Deferred@1229557121 after retry RPC after error@173976185) -> (continuation of Deferred@907043676 after retry RPC after error@25269086) -> (continuation of Deferred@77669226 after retry RPC after error@2069060837) -> (continuation of Deferred@1324145232 after retry RPC after error@1132116912) -> (continuation of Deferred@1313700550 after retry RPC after error@790143902) -> (continuation of Deferred@126796407 after retry RPC after error@297750029) -> (continuation of Deferred@880909750 after retry RPC after error@1584389355) -> (continuation of Deferred@788738091 after retry RPC after error@1143459040)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28886), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [27ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [32ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [35ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [35ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [39ms] refreshing cache from master, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [47ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [49ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [50ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [50ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [58ms] refreshing cache from master, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [64ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [65ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [65ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [65ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [79ms] refreshing cache from master, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [80ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [80ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [81ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [99ms] refreshing cache from master, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [109ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [109ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [139ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [140ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [140ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [140ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [141ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [218ms] refreshing cache from master, [218ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [219ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [219ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [220ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [220ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [221ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [221ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [238ms] refreshing cache from master, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [239ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [240ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [240ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [240ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [278ms] refreshing cache from master, [278ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [279ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [279ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [280ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [280ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [281ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [281ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [618ms] refreshing cache from master, [619ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [619ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [619ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [619ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [620ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [620ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [621ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1299ms] refreshing cache from master, [1299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [1299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [1300ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1301ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2779ms] refreshing cache from master, [2779ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2779ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2779ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [2780ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [2780ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [2781ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2781ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [3298ms] refreshing cache from master, [3299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [3299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [3299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [3300ms] too many traces: truncated at 100 traces, deferred=Deferred@1889877317(state=PENDING, result=null, callback=(continuation of Deferred@2053732639 after retry RPC after error@961537073) -> (continuation of Deferred@1845035241 after retry RPC after error@888096518) -> (continuation of Deferred@92238085 after retry RPC after error@1138189303) -> (continuation of Deferred@1712119084 after retry RPC after error@672493980) -> (continuation of Deferred@1453116098 after retry RPC after error@783074109) -> (continuation of Deferred@776576633 after retry RPC after error@768840637) -> (continuation of Deferred@489260575 after retry RPC after error@1439964076) -> (continuation of Deferred@923598137 after retry RPC after error@116641310) -> (continuation of Deferred@1471920545 after retry RPC after error@575132033) -> (continuation of Deferred@1928463813 after retry RPC after error@1785312955) -> (continuation of Deferred@1612020966 after retry RPC after error@2093114044) -> (continuation of Deferred@519871692 after retry RPC after error@956775878) -> (continuation of Deferred@1916703820 after retry RPC after error@495374133) -> (continuation of Deferred@1743137461 after retry RPC after error@1737474690) -> (continuation of Deferred@1637201611 after retry RPC after error@1245782699) -> (continuation of Deferred@480516820 after retry RPC after error@94785552) -> (continuation of Deferred@1229557121 after retry RPC after error@173976185) -> (continuation of Deferred@907043676 after retry RPC after error@25269086) -> (continuation of Deferred@77669226 after retry RPC after error@2069060837) -> (continuation of Deferred@1324145232 after retry RPC after error@1132116912) -> (continuation of Deferred@1313700550 after retry RPC after error@790143902) -> (continuation of Deferred@126796407 after retry RPC after error@297750029) -> (continuation of Deferred@880909750 after retry RPC after error@1584389355) -> (continuation of Deferred@788738091 after retry RPC after error@1143459040), errback=(continuation of Deferred@2053732639 after retry RPC after error@961537073) -> (continuation of Deferred@1845035241 after retry RPC after error@888096518) -> (continuation of Deferred@92238085 after retry RPC after error@1138189303) -> (continuation of Deferred@1712119084 after retry RPC after error@672493980) -> (continuation of Deferred@1453116098 after retry RPC after error@783074109) -> (continuation of Deferred@776576633 after retry RPC after error@768840637) -> (continuation of Deferred@489260575 after retry RPC after error@1439964076) -> (continuation of Deferred@923598137 after retry RPC after error@116641310) -> (continuation of Deferred@1471920545 after retry RPC after error@575132033) -> (continuation of Deferred@1928463813 after retry RPC after error@1785312955) -> (continuation of Deferred@1612020966 after retry RPC after error@2093114044) -> (continuation of Deferred@519871692 after retry RPC after error@956775878) -> (continuation of Deferred@1916703820 after retry RPC after error@495374133) -> (continuation of Deferred@1743137461 after retry RPC after error@1737474690) -> (continuation of Deferred@1637201611 after retry RPC after error@1245782699) -> (continuation of Deferred@480516820 after retry RPC after error@94785552) -> (continuation of Deferred@1229557121 after retry RPC after error@173976185) -> (continuation of Deferred@907043676 after retry RPC after error@25269086) -> (continuation of Deferred@77669226 after retry RPC after error@2069060837) -> (continuation of Deferred@1324145232 after retry RPC after error@1132116912) -> (continuation of Deferred@1313700550 after retry RPC after error@790143902) -> (continuation of Deferred@126796407 after retry RPC after error@297750029) -> (continuation of Deferred@880909750 after retry RPC after error@1584389355) -> (continuation of Deferred@788738091 after retry RPC after error@1143459040)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.220.252:33543
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:36.703 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.703 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.703 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.704 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.703 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.705 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.707 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.707 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.708 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.709 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:36.714 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:36.715 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:36.715 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:36.715 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.715 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.715 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.716 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.716 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.716 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.716 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.716 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.716 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.716 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:36.719 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28886), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [27ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [32ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [35ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [35ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [39ms] refreshing cache from master, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [47ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [49ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [50ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [50ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [58ms] refreshing cache from master, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [64ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [65ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [65ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [65ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [79ms] refreshing cache from master, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [80ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [80ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [81ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [99ms] refreshing cache from master, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [109ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [109ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [139ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [140ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [140ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [140ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [141ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [218ms] refreshing cache from master, [218ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [219ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [219ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [220ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [220ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [221ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [221ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [238ms] refreshing cache from master, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [239ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [240ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [240ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [240ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [278ms] refreshing cache from master, [278ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [279ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [279ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [280ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [280ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [281ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [281ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [618ms] refreshing cache from master, [619ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [619ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [619ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [619ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [620ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [620ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [621ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1299ms] refreshing cache from master, [1299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [1299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [1300ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1301ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2779ms] refreshing cache from master, [2779ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2779ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2779ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [2780ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [2780ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [2781ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2781ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [3298ms] refreshing cache from master, [3299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [3299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [3299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [3300ms] too many traces: truncated at 100 traces, deferred=Deferred@1889877317(state=PENDING, result=null, callback=(continuation of Deferred@2053732639 after retry RPC after error@961537073) -> (continuation of Deferred@1845035241 after retry RPC after error@888096518) -> (continuation of Deferred@92238085 after retry RPC after error@1138189303) -> (continuation of Deferred@1712119084 after retry RPC after error@672493980) -> (continuation of Deferred@1453116098 after retry RPC after error@783074109) -> (continuation of Deferred@776576633 after retry RPC after error@768840637) -> (continuation of Deferred@489260575 after retry RPC after error@1439964076) -> (continuation of Deferred@923598137 after retry RPC after error@116641310) -> (continuation of Deferred@1471920545 after retry RPC after error@575132033) -> (continuation of Deferred@1928463813 after retry RPC after error@1785312955) -> (continuation of Deferred@1612020966 after retry RPC after error@2093114044) -> (continuation of Deferred@519871692 after retry RPC after error@956775878) -> (continuation of Deferred@1916703820 after retry RPC after error@495374133) -> (continuation of Deferred@1743137461 after retry RPC after error@1737474690) -> (continuation of Deferred@1637201611 after retry RPC after error@1245782699) -> (continuation of Deferred@480516820 after retry RPC after error@94785552) -> (continuation of Deferred@1229557121 after retry RPC after error@173976185) -> (continuation of Deferred@907043676 after retry RPC after error@25269086) -> (continuation of Deferred@77669226 after retry RPC after error@2069060837) -> (continuation of Deferred@1324145232 after retry RPC after error@1132116912) -> (continuation of Deferred@1313700550 after retry RPC after error@790143902) -> (continuation of Deferred@126796407 after retry RPC after error@297750029) -> (continuation of Deferred@880909750 after retry RPC after error@1584389355) -> (continuation of Deferred@788738091 after retry RPC after error@1143459040), errback=(continuation of Deferred@2053732639 after retry RPC after error@961537073) -> (continuation of Deferred@1845035241 after retry RPC after error@888096518) -> (continuation of Deferred@92238085 after retry RPC after error@1138189303) -> (continuation of Deferred@1712119084 after retry RPC after error@672493980) -> (continuation of Deferred@1453116098 after retry RPC after error@783074109) -> (continuation of Deferred@776576633 after retry RPC after error@768840637) -> (continuation of Deferred@489260575 after retry RPC after error@1439964076) -> (continuation of Deferred@923598137 after retry RPC after error@116641310) -> (continuation of Deferred@1471920545 after retry RPC after error@575132033) -> (continuation of Deferred@1928463813 after retry RPC after error@1785312955) -> (continuation of Deferred@1612020966 after retry RPC after error@2093114044) -> (continuation of Deferred@519871692 after retry RPC after error@956775878) -> (continuation of Deferred@1916703820 after retry RPC after error@495374133) -> (continuation of Deferred@1743137461 after retry RPC after error@1737474690) -> (continuation of Deferred@1637201611 after retry RPC after error@1245782699) -> (continuation of Deferred@480516820 after retry RPC after error@94785552) -> (continuation of Deferred@1229557121 after retry RPC after error@173976185) -> (continuation of Deferred@907043676 after retry RPC after error@25269086) -> (continuation of Deferred@77669226 after retry RPC after error@2069060837) -> (continuation of Deferred@1324145232 after retry RPC after error@1132116912) -> (continuation of Deferred@1313700550 after retry RPC after error@790143902) -> (continuation of Deferred@126796407 after retry RPC after error@297750029) -> (continuation of Deferred@880909750 after retry RPC after error@1584389355) -> (continuation of Deferred@788738091 after retry RPC after error@1143459040)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28886), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [27ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [32ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [35ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [35ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [39ms] refreshing cache from master, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [47ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [49ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [50ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [50ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [58ms] refreshing cache from master, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [64ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [65ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [65ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [65ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [79ms] refreshing cache from master, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [80ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [80ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [81ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [99ms] refreshing cache from master, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [109ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [109ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [139ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [140ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [140ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [140ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [141ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [218ms] refreshing cache from master, [218ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [219ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [219ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [220ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [220ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [221ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [221ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [238ms] refreshing cache from master, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [239ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [240ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [240ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [240ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [278ms] refreshing cache from master, [278ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [279ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [279ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [280ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [280ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [281ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [281ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [618ms] refreshing cache from master, [619ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [619ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [619ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [619ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [620ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [620ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [621ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1299ms] refreshing cache from master, [1299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [1299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [1299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [1300ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [1301ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2779ms] refreshing cache from master, [2779ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [2779ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [2779ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [2780ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.253:45079: Network error: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079, [2780ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.254:37365: Network error: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365, [2781ms] Sub RPC ConnectToMaster: received response from server master-127.28.220.252:33543: Network error: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [2781ms] delaying RPC due to: Service unavailable: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543, [3298ms] refreshing cache from master, [3299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.253:45079, [3299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.254:37365, [3299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.220.252:33543, [3300ms] too many traces: truncated at 100 traces, deferred=Deferred@1889877317(state=PENDING, result=null, callback=(continuation of Deferred@2053732639 after retry RPC after error@961537073) -> (continuation of Deferred@1845035241 after retry RPC after error@888096518) -> (continuation of Deferred@92238085 after retry RPC after error@1138189303) -> (continuation of Deferred@1712119084 after retry RPC after error@672493980) -> (continuation of Deferred@1453116098 after retry RPC after error@783074109) -> (continuation of Deferred@776576633 after retry RPC after error@768840637) -> (continuation of Deferred@489260575 after retry RPC after error@1439964076) -> (continuation of Deferred@923598137 after retry RPC after error@116641310) -> (continuation of Deferred@1471920545 after retry RPC after error@575132033) -> (continuation of Deferred@1928463813 after retry RPC after error@1785312955) -> (continuation of Deferred@1612020966 after retry RPC after error@2093114044) -> (continuation of Deferred@519871692 after retry RPC after error@956775878) -> (continuation of Deferred@1916703820 after retry RPC after error@495374133) -> (continuation of Deferred@1743137461 after retry RPC after error@1737474690) -> (continuation of Deferred@1637201611 after retry RPC after error@1245782699) -> (continuation of Deferred@480516820 after retry RPC after error@94785552) -> (continuation of Deferred@1229557121 after retry RPC after error@173976185) -> (continuation of Deferred@907043676 after retry RPC after error@25269086) -> (continuation of Deferred@77669226 after retry RPC after error@2069060837) -> (continuation of Deferred@1324145232 after retry RPC after error@1132116912) -> (continuation of Deferred@1313700550 after retry RPC after error@790143902) -> (continuation of Deferred@126796407 after retry RPC after error@297750029) -> (continuation of Deferred@880909750 after retry RPC after error@1584389355) -> (continuation of Deferred@788738091 after retry RPC after error@1143459040), errback=(continuation of Deferred@2053732639 after retry RPC after error@961537073) -> (continuation of Deferred@1845035241 after retry RPC after error@888096518) -> (continuation of Deferred@92238085 after retry RPC after error@1138189303) -> (continuation of Deferred@1712119084 after retry RPC after error@672493980) -> (continuation of Deferred@1453116098 after retry RPC after error@783074109) -> (continuation of Deferred@776576633 after retry RPC after error@768840637) -> (continuation of Deferred@489260575 after retry RPC after error@1439964076) -> (continuation of Deferred@923598137 after retry RPC after error@116641310) -> (continuation of Deferred@1471920545 after retry RPC after error@575132033) -> (continuation of Deferred@1928463813 after retry RPC after error@1785312955) -> (continuation of Deferred@1612020966 after retry RPC after error@2093114044) -> (continuation of Deferred@519871692 after retry RPC after error@956775878) -> (continuation of Deferred@1916703820 after retry RPC after error@495374133) -> (continuation of Deferred@1743137461 after retry RPC after error@1737474690) -> (continuation of Deferred@1637201611 after retry RPC after error@1245782699) -> (continuation of Deferred@480516820 after retry RPC after error@94785552) -> (continuation of Deferred@1229557121 after retry RPC after error@173976185) -> (continuation of Deferred@907043676 after retry RPC after error@25269086) -> (continuation of Deferred@77669226 after retry RPC after error@2069060837) -> (continuation of Deferred@1324145232 after retry RPC after error@1132116912) -> (continuation of Deferred@1313700550 after retry RPC after error@790143902) -> (continuation of Deferred@126796407 after retry RPC after error@297750029) -> (continuation of Deferred@880909750 after retry RPC after error@1584389355) -> (continuation of Deferred@788738091 after retry RPC after error@1143459040)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.220.252:33543
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:36.734 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:36.734 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:36.735 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:36.735 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.735 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.735 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.736 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.736 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.736 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.736 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.736 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.736 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.736 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:36.737 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
08:09:36.738 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#4) of source Source: KuduSource.
08:09:36.738 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to CANCELING.
08:09:36.739 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to CANCELING.
08:09:36.739 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to CANCELING.
08:09:36.739 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_4).
08:09:36.739 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to CANCELING.
08:09:36.740 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_4).
08:09:36.741 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#4) of source Source: KuduSource.
08:09:36.741 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#4) of source Source: KuduSource.
08:09:36.742 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
08:09:36.742 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CANCELING to CANCELED.
08:09:36.742 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_4).
08:09:36.744 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:36.744 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:36.744 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:36.745 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:36.745 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:36.745 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:36.745 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_4).
08:09:36.745 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to CANCELING.
08:09:36.746 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_4).
08:09:36.746 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:36.746 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:36.746 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:36.746 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:36.746 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:36.747 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:36.747 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:36.748 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28987), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [4ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [28ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [51ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [51ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [70ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [84ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [92ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [92ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [99ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [101ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [102ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [102ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [103ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [122ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [122ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [140ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [141ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [141ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [143ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [181ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [181ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [182ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [182ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [221ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [221ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [222ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [222ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [281ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [281ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [282ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [282ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [482ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [483ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [483ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [483ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [702ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [703ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [703ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [703ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [940ms] refreshing cache from master, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [942ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [942ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [943ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [943ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1000ms] refreshing cache from master, [1000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1001ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1002ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [5100ms] refreshing cache from master, [5100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [5100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [5100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [5101ms] too many traces: truncated at 100 traces, deferred=Deferred@2005522489(state=PENDING, result=null, callback=(continuation of Deferred@1856829509 after retry RPC after error@847082156) -> (continuation of Deferred@541749965 after retry RPC after error@423313133) -> (continuation of Deferred@282891103 after retry RPC after error@1231907834) -> (continuation of Deferred@977445888 after retry RPC after error@2060331507) -> (continuation of Deferred@243014558 after retry RPC after error@745313040) -> (continuation of Deferred@60903481 after retry RPC after error@145453071) -> (continuation of Deferred@1726298735 after retry RPC after error@777634224) -> (continuation of Deferred@670067930 after retry RPC after error@1955089187) -> (continuation of Deferred@997274015 after retry RPC after error@1531261696) -> (continuation of Deferred@2138505742 after retry RPC after error@1234210704) -> (continuation of Deferred@2069869300 after retry RPC after error@158356396) -> (continuation of Deferred@1322276862 after retry RPC after error@66174395) -> (continuation of Deferred@96433955 after retry RPC after error@240757003) -> (continuation of Deferred@1123704985 after retry RPC after error@1290273048) -> (continuation of Deferred@839938505 after retry RPC after error@1908578161) -> (continuation of Deferred@1613619064 after retry RPC after error@1816257188) -> (continuation of Deferred@1567508700 after retry RPC after error@955397407) -> (continuation of Deferred@917175142 after retry RPC after error@1436384213) -> (continuation of Deferred@2048581906 after retry RPC after error@1407809923) -> (continuation of Deferred@846846291 after retry RPC after error@201608986) -> (continuation of Deferred@565915129 after retry RPC after error@956726572) -> (continuation of Deferred@1162446878 after retry RPC after error@1796961074) -> (continuation of Deferred@330784589 after retry RPC after error@424853258) -> (continuation of Deferred@282254662 after retry RPC after error@543211149) -> (continuation of Deferred@151306491 after retry RPC after error@94536766), errback=(continuation of Deferred@1856829509 after retry RPC after error@847082156) -> (continuation of Deferred@541749965 after retry RPC after error@423313133) -> (continuation of Deferred@282891103 after retry RPC after error@1231907834) -> (continuation of Deferred@977445888 after retry RPC after error@2060331507) -> (continuation of Deferred@243014558 after retry RPC after error@745313040) -> (continuation of Deferred@60903481 after retry RPC after error@145453071) -> (continuation of Deferred@1726298735 after retry RPC after error@777634224) -> (continuation of Deferred@670067930 after retry RPC after error@1955089187) -> (continuation of Deferred@997274015 after retry RPC after error@1531261696) -> (continuation of Deferred@2138505742 after retry RPC after error@1234210704) -> (continuation of Deferred@2069869300 after retry RPC after error@158356396) -> (continuation of Deferred@1322276862 after retry RPC after error@66174395) -> (continuation of Deferred@96433955 after retry RPC after error@240757003) -> (continuation of Deferred@1123704985 after retry RPC after error@1290273048) -> (continuation of Deferred@839938505 after retry RPC after error@1908578161) -> (continuation of Deferred@1613619064 after retry RPC after error@1816257188) -> (continuation of Deferred@1567508700 after retry RPC after error@955397407) -> (continuation of Deferred@917175142 after retry RPC after error@1436384213) -> (continuation of Deferred@2048581906 after retry RPC after error@1407809923) -> (continuation of Deferred@846846291 after retry RPC after error@201608986) -> (continuation of Deferred@565915129 after retry RPC after error@956726572) -> (continuation of Deferred@1162446878 after retry RPC after error@1796961074) -> (continuation of Deferred@330784589 after retry RPC after error@424853258) -> (continuation of Deferred@282254662 after retry RPC after error@543211149) -> (continuation of Deferred@151306491 after retry RPC after error@94536766)))
08:09:36.751 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:36.751 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
08:09:36.752 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CANCELING to CANCELED.
08:09:36.752 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_4).
08:09:36.752 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
08:09:36.752 [WARN - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28987), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [4ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [28ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [51ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [51ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [70ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [84ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [92ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [92ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [99ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [101ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [102ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [102ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [103ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [121ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [122ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [122ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [140ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [141ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [141ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [143ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [181ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [181ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [182ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [182ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [221ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [221ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [222ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [222ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [281ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [281ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [282ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [282ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [482ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [483ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [483ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [483ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [702ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [703ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [703ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [703ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [940ms] refreshing cache from master, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [942ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [942ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [943ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [943ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1000ms] refreshing cache from master, [1000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1001ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1002ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [5100ms] refreshing cache from master, [5100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [5100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [5100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [5101ms] too many traces: truncated at 100 traces, deferred=Deferred@2005522489(state=PENDING, result=null, callback=(continuation of Deferred@1856829509 after retry RPC after error@847082156) -> (continuation of Deferred@541749965 after retry RPC after error@423313133) -> (continuation of Deferred@282891103 after retry RPC after error@1231907834) -> (continuation of Deferred@977445888 after retry RPC after error@2060331507) -> (continuation of Deferred@243014558 after retry RPC after error@745313040) -> (continuation of Deferred@60903481 after retry RPC after error@145453071) -> (continuation of Deferred@1726298735 after retry RPC after error@777634224) -> (continuation of Deferred@670067930 after retry RPC after error@1955089187) -> (continuation of Deferred@997274015 after retry RPC after error@1531261696) -> (continuation of Deferred@2138505742 after retry RPC after error@1234210704) -> (continuation of Deferred@2069869300 after retry RPC after error@158356396) -> (continuation of Deferred@1322276862 after retry RPC after error@66174395) -> (continuation of Deferred@96433955 after retry RPC after error@240757003) -> (continuation of Deferred@1123704985 after retry RPC after error@1290273048) -> (continuation of Deferred@839938505 after retry RPC after error@1908578161) -> (continuation of Deferred@1613619064 after retry RPC after error@1816257188) -> (continuation of Deferred@1567508700 after retry RPC after error@955397407) -> (continuation of Deferred@917175142 after retry RPC after error@1436384213) -> (continuation of Deferred@2048581906 after retry RPC after error@1407809923) -> (continuation of Deferred@846846291 after retry RPC after error@201608986) -> (continuation of Deferred@565915129 after retry RPC after error@956726572) -> (continuation of Deferred@1162446878 after retry RPC after error@1796961074) -> (continuation of Deferred@330784589 after retry RPC after error@424853258) -> (continuation of Deferred@282254662 after retry RPC after error@543211149) -> (continuation of Deferred@151306491 after retry RPC after error@94536766), errback=(continuation of Deferred@1856829509 after retry RPC after error@847082156) -> (continuation of Deferred@541749965 after retry RPC after error@423313133) -> (continuation of Deferred@282891103 after retry RPC after error@1231907834) -> (continuation of Deferred@977445888 after retry RPC after error@2060331507) -> (continuation of Deferred@243014558 after retry RPC after error@745313040) -> (continuation of Deferred@60903481 after retry RPC after error@145453071) -> (continuation of Deferred@1726298735 after retry RPC after error@777634224) -> (continuation of Deferred@670067930 after retry RPC after error@1955089187) -> (continuation of Deferred@997274015 after retry RPC after error@1531261696) -> (continuation of Deferred@2138505742 after retry RPC after error@1234210704) -> (continuation of Deferred@2069869300 after retry RPC after error@158356396) -> (continuation of Deferred@1322276862 after retry RPC after error@66174395) -> (continuation of Deferred@96433955 after retry RPC after error@240757003) -> (continuation of Deferred@1123704985 after retry RPC after error@1290273048) -> (continuation of Deferred@839938505 after retry RPC after error@1908578161) -> (continuation of Deferred@1613619064 after retry RPC after error@1816257188) -> (continuation of Deferred@1567508700 after retry RPC after error@955397407) -> (continuation of Deferred@917175142 after retry RPC after error@1436384213) -> (continuation of Deferred@2048581906 after retry RPC after error@1407809923) -> (continuation of Deferred@846846291 after retry RPC after error@201608986) -> (continuation of Deferred@565915129 after retry RPC after error@956726572) -> (continuation of Deferred@1162446878 after retry RPC after error@1796961074) -> (continuation of Deferred@330784589 after retry RPC after error@424853258) -> (continuation of Deferred@282254662 after retry RPC after error@543211149) -> (continuation of Deferred@151306491 after retry RPC after error@94536766)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.29.158.190:38071
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:36.752 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:36.753 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:36.753 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:36.753 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:36.753 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:36.753 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:36.753 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:36.754 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:36.754 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:36.755 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:36.755 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:36.755 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.756 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:36.756 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:36.756 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
08:09:36.756 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:36.756 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28975), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [37ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [45ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [49ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [49ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [68ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [70ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [71ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [71ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [87ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [88ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [89ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [90ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [101ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [101ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [101ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [101ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [123ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [123ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [123ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [123ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [143ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [144ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [145ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [145ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [163ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [163ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [165ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [165ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [281ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [281ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [282ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [282ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [543ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [543ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [543ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [544ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [622ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [623ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [631ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [631ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [662ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [662ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [663ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [663ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [761ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [761ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [762ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [762ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [2080ms] refreshing cache from master, [2080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [2080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [2081ms] too many traces: truncated at 100 traces, deferred=Deferred@1472677038(state=PENDING, result=null, callback=(continuation of Deferred@289559520 after retry RPC after error@744353298) -> (continuation of Deferred@1095839296 after retry RPC after error@744415472) -> (continuation of Deferred@796945352 after retry RPC after error@1827552596) -> (continuation of Deferred@612711847 after retry RPC after error@2131165351) -> (continuation of Deferred@1408625316 after retry RPC after error@1324116243) -> (continuation of Deferred@1133059436 after retry RPC after error@72105858) -> (continuation of Deferred@2022724965 after retry RPC after error@1436094357) -> (continuation of Deferred@1584400951 after retry RPC after error@1000709716) -> (continuation of Deferred@1097129784 after retry RPC after error@1553761574) -> (continuation of Deferred@40045872 after retry RPC after error@354640918) -> (continuation of Deferred@1918493845 after retry RPC after error@1255471693) -> (continuation of Deferred@1355048106 after retry RPC after error@1590274416) -> (continuation of Deferred@1669956464 after retry RPC after error@249695198) -> (continuation of Deferred@2112933788 after retry RPC after error@1860266875) -> (continuation of Deferred@1104996308 after retry RPC after error@1610524874) -> (continuation of Deferred@612962438 after retry RPC after error@1104551391) -> (continuation of Deferred@1737662582 after retry RPC after error@1291906230) -> (continuation of Deferred@560056496 after retry RPC after error@1344803238) -> (continuation of Deferred@575380165 after retry RPC after error@1751431014) -> (continuation of Deferred@1198507666 after retry RPC after error@1473927928) -> (continuation of Deferred@700018548 after retry RPC after error@1688941218) -> (continuation of Deferred@1565074419 after retry RPC after error@1480703800) -> (continuation of Deferred@979483019 after retry RPC after error@132297287), errback=(continuation of Deferred@289559520 after retry RPC after error@744353298) -> (continuation of Deferred@1095839296 after retry RPC after error@744415472) -> (continuation of Deferred@796945352 after retry RPC after error@1827552596) -> (continuation of Deferred@612711847 after retry RPC after error@2131165351) -> (continuation of Deferred@1408625316 after retry RPC after error@1324116243) -> (continuation of Deferred@1133059436 after retry RPC after error@72105858) -> (continuation of Deferred@2022724965 after retry RPC after error@1436094357) -> (continuation of Deferred@1584400951 after retry RPC after error@1000709716) -> (continuation of Deferred@1097129784 after retry RPC after error@1553761574) -> (continuation of Deferred@40045872 after retry RPC after error@354640918) -> (continuation of Deferred@1918493845 after retry RPC after error@1255471693) -> (continuation of Deferred@1355048106 after retry RPC after error@1590274416) -> (continuation of Deferred@1669956464 after retry RPC after error@249695198) -> (continuation of Deferred@2112933788 after retry RPC after error@1860266875) -> (continuation of Deferred@1104996308 after retry RPC after error@1610524874) -> (continuation of Deferred@612962438 after retry RPC after error@1104551391) -> (continuation of Deferred@1737662582 after retry RPC after error@1291906230) -> (continuation of Deferred@560056496 after retry RPC after error@1344803238) -> (continuation of Deferred@575380165 after retry RPC after error@1751431014) -> (continuation of Deferred@1198507666 after retry RPC after error@1473927928) -> (continuation of Deferred@700018548 after retry RPC after error@1688941218) -> (continuation of Deferred@1565074419 after retry RPC after error@1480703800) -> (continuation of Deferred@979483019 after retry RPC after error@132297287)))
08:09:36.758 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.758 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.758 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:36.759 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.759 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.759 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.759 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.759 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.759 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.759 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:36.760 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#4 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
08:09:36.760 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1190) Task Source: KuduSource -> Sink: Writer (1/4)#4 is already in state FAILED
08:09:36.760 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#4 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_4.
08:09:36.761 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#4 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_4.
08:09:36.761 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#4 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_4.
08:09:36.762 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CANCELING to CANCELED.
08:09:36.763 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:09:36.764 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CANCELING to CANCELED.
08:09:36.765 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:09:36.772 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CANCELING to CANCELED.
08:09:36.773 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:318) Clearing resource requirements of job a72e6b48022ef36361b5eef11ee7c683
08:09:36.774 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1318) Discarding the results produced by task execution 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_4.
08:09:36.775 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:36.775 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:36.775 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:36.775 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.776 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.776 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.776 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.776 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.776 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.776 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.777 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.777 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.777 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:36.795 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:36.795 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:36.795 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:36.796 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.796 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.796 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.796 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.796 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.796 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.797 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.797 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.797 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.797 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:36.801 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:36.802 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:36.802 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:36.802 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:36.802 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:36.802 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:36.802 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:36.802 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:36.802 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:36.803 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:36.803 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:36.802 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:36.803 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:36.873 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:36.873 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:36.873 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:36.874 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:36.874 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:36.874 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:36.874 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:36.874 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:36.875 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:36.875 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:36.875 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:36.875 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:36.875 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.875 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.875 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.876 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.876 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.876 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.876 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:36.876 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:36.876 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:36.876 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:36.877 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.877 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.877 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.877 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:36.935 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:36.935 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:36.935 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:36.936 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.936 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.936 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.936 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.936 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:36.936 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.936 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:36.936 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.936 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:36.937 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:37.030 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:37.054 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:37.054 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:37.054 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:37.055 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:37.055 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:37.055 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:37.055 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:37.055 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:37.056 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:37.056 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:37.056 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:37.056 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:37.055 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:37.056 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:37.056 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:37.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:37.202 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:37.202 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:37.202 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:37.203 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:37.203 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:37.203 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:37.204 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:37.204 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:37.204 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:37.204 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:37.204 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:37.204 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:37.204 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:37.205 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29440), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [16ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [17ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [18ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [18ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [37ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [50ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [61ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [62ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [83ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [85ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [86ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [86ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [101ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [102ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [102ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [102ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [121ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [122ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [122ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [124ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [124ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [142ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [142ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [143ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [143ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [221ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [222ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [222ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [223ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [242ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [244ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [244ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [244ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [244ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [341ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [342ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [343ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [343ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [344ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [641ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [642ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [642ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [642ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1641ms] refreshing cache from master, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [1642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [1642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [1643ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [1643ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [1643ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [3201ms] refreshing cache from master, [3201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [3201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [3201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [3202ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.190:38071: Network error: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071, [3203ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.189:41727: Network error: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727, [3203ms] Sub RPC ConnectToMaster: received response from server master-127.29.158.188:39061: Network error: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [3203ms] delaying RPC due to: Service unavailable: Master config (127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061, [5181ms] refreshing cache from master, [5181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.190:38071, [5182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.189:41727, [5182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.158.188:39061, [5182ms] too many traces: truncated at 100 traces, deferred=Deferred@1853739021(state=PENDING, result=null, callback=(continuation of Deferred@560719834 after retry RPC after error@462468689) -> (continuation of Deferred@1280580334 after retry RPC after error@1277773521) -> (continuation of Deferred@847392185 after retry RPC after error@742270854) -> (continuation of Deferred@1087490949 after retry RPC after error@1187517056) -> (continuation of Deferred@1703153669 after retry RPC after error@945494308) -> (continuation of Deferred@1981313097 after retry RPC after error@1883381784) -> (continuation of Deferred@897778221 after retry RPC after error@1441902464) -> (continuation of Deferred@1616779087 after retry RPC after error@33401276) -> (continuation of Deferred@742543812 after retry RPC after error@1956083299) -> (continuation of Deferred@1684272081 after retry RPC after error@138348200) -> (continuation of Deferred@919448090 after retry RPC after error@2032596686) -> (continuation of Deferred@44072768 after retry RPC after error@1926902778) -> (continuation of Deferred@698145473 after retry RPC after error@1732434362) -> (continuation of Deferred@1712971885 after retry RPC after error@1174362807) -> (continuation of Deferred@184207899 after retry RPC after error@2072268279) -> (continuation of Deferred@1387774050 after retry RPC after error@1830949473) -> (continuation of Deferred@827631564 after retry RPC after error@1751560164) -> (continuation of Deferred@79611482 after retry RPC after error@2037542326) -> (continuation of Deferred@1829556115 after retry RPC after error@810046553) -> (continuation of Deferred@1110886428 after retry RPC after error@683872817) -> (continuation of Deferred@599273709 after retry RPC after error@1361068639), errback=(continuation of Deferred@560719834 after retry RPC after error@462468689) -> (continuation of Deferred@1280580334 after retry RPC after error@1277773521) -> (continuation of Deferred@847392185 after retry RPC after error@742270854) -> (continuation of Deferred@1087490949 after retry RPC after error@1187517056) -> (continuation of Deferred@1703153669 after retry RPC after error@945494308) -> (continuation of Deferred@1981313097 after retry RPC after error@1883381784) -> (continuation of Deferred@897778221 after retry RPC after error@1441902464) -> (continuation of Deferred@1616779087 after retry RPC after error@33401276) -> (continuation of Deferred@742543812 after retry RPC after error@1956083299) -> (continuation of Deferred@1684272081 after retry RPC after error@138348200) -> (continuation of Deferred@919448090 after retry RPC after error@2032596686) -> (continuation of Deferred@44072768 after retry RPC after error@1926902778) -> (continuation of Deferred@698145473 after retry RPC after error@1732434362) -> (continuation of Deferred@1712971885 after retry RPC after error@1174362807) -> (continuation of Deferred@184207899 after retry RPC after error@2072268279) -> (continuation of Deferred@1387774050 after retry RPC after error@1830949473) -> (continuation of Deferred@827631564 after retry RPC after error@1751560164) -> (continuation of Deferred@79611482 after retry RPC after error@2037542326) -> (continuation of Deferred@1829556115 after retry RPC after error@810046553) -> (continuation of Deferred@1110886428 after retry RPC after error@683872817) -> (continuation of Deferred@599273709 after retry RPC after error@1361068639)))
08:09:37.230 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:37.230 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:37.231 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:37.231 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:37.231 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:37.231 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:37.231 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:37.231 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:37.231 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:37.232 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:37.232 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:37.232 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:37.232 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:37.273 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:37.274 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:37.274 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:37.274 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:37.274 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:37.274 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:37.274 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:37.274 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:37.274 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:37.275 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:37.275 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:37.275 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:37.275 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:37.290 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:37.290 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:37.290 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:37.291 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:37.291 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:37.291 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:37.291 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:37.291 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:37.292 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:37.292 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:37.292 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:37.292 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:37.292 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:37.306 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:37.306 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:37.306 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:37.310 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:37.310 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:37.310 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:37.311 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:37.311 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:37.311 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:37.311 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:37.311 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:37.311 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:37.312 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:37.528 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:37.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:37.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:37.555 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:37.555 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:37.556 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:37.557 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:37.557 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:37.557 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:37.557 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:37.557 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:37.557 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:37.557 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:37.557 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:37.557 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:37.558 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:37.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:37.685 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:37.685 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:37.685 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:37.686 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:37.686 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:37.686 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:37.686 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:37.686 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:37.686 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:37.686 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:37.686 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:37.686 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:37.686 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:37.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:37.655715  5625 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 5619
08:09:37.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:37.866436  5619 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.614s	user 0.563s	sys 0.929s
08:09:37.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:37.866793  5619 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.615s	user 0.563s	sys 0.929s
08:09:37.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:36.255605  5627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:37.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:37.878360  5638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:37.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:37.879422  5619 server_base.cc:1061] running on GCE node
08:09:37.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:37.880878  5619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:09:37.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:37.883850  5619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:09:37.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:37.885298  5619 hybrid_clock.cc:648] HybridClock initialized: now 1779091777885259 us; error 36 us; skew 500 ppm
08:09:37.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:37.886514  5619 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:09:37.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:37.894439  5619 webserver.cc:533] Webserver started at http://127.4.224.130:38839/ using document root <none> and password file <none>
08:09:37.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:37.895598  5619 fs_manager.cc:362] Metadata directory not provided
08:09:37.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:37.895818  5619 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:09:37.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:37.896353  5619 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:09:37.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:37.902321  5619 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-1/data/instance:
08:09:37.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6970736694d04ba2a93e80cda13d1533"
08:09:37.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:37 on dist-test-slave-1jss"
08:09:37.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:37.903890  5619 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-1/wal/instance:
08:09:37.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6970736694d04ba2a93e80cda13d1533"
08:09:37.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:37 on dist-test-slave-1jss"
08:09:37.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:37.914669  5619 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.010s	sys 0.001s
08:09:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:37.922910  5644 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:09:37.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:37.924355  5619 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.001s	sys 0.003s
08:09:37.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:37.924736  5619 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-1/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-1/wal
08:09:37.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6970736694d04ba2a93e80cda13d1533"
08:09:37.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:37 on dist-test-slave-1jss"
08:09:37.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:37.925127  5619 fs_report.cc:389] FS layout report
08:09:37.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:09:37.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-1/wal
08:09:37.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-1/wal
08:09:37.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-1/data/data
08:09:37.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:09:37.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:09:37.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:09:37.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:09:37.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:09:37.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:09:37.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:09:37.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:09:37.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:09:37.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:09:37.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:09:37.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:37.986027  5619 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:09:37.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:37.988093  5619 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:09:37.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:37.988704  5619 kserver.cc:163] Server-wide thread pool size limit: 3276
08:09:37.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:37.992573  5619 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:09:37.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:37.998359  5619 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:09:37.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:37.998581  5619 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:09:37.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:37.999050  5619 ts_tablet_manager.cc:616] Registered 0 tablets
08:09:37.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:37.999244  5619 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:09:38.011 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:38.011 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:38.011 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:38.011 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:38.011 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:38.011 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:38.011 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:38.012 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:38.012 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:38.012 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:38.012 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:38.012 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:38.012 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:38.029 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:38.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:38.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:38.116 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:38.134 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:38.135 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:38.135 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:38.135 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:38.135 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:38.135 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:38.135 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:38.135 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:38.136 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:38.136 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:38.136 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:38.136 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:38.136 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:38.192 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:38.192 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:38.192 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:38.192 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:38.192 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:38.193 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:38.193 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:38.193 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:38.193 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:38.193 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:38.193 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:38.193 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:38.194 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:38.204 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:38.204 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:38.204 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:38.205 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:38.205 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:38.205 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:38.205 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:38.205 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:38.205 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:38.206 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:38.206 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:38.206 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:38.206 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:38.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:38.234719  5619 rpc_server.cc:307] RPC server started. Bound to: 127.4.224.130:37197
08:09:38.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:38.234889  5756 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.224.130:37197 every 8 connection(s)
08:09:38.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:38.238730  5619 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-1/data/info.pb
08:09:38.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:38.244732  4994 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 5619
08:09:38.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:38.245309  4994 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-1/wal/instance
08:09:38.255 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:38.255 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:38.255 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:38.256 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:38.256 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:38.256 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:38.256 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:38.256 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:38.256 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:38.256 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:38.256 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:38.256 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:38.257 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:38.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:38.289951  4994 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:09:38.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu
08:09:38.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-2/wal
08:09:38.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-2/data
08:09:38.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:09:38.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:09:38.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:09:38.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:09:38.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:09:38.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:09:38.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-2/logs
08:09:38.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-2/data/info.pb
08:09:38.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:09:38.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:09:38.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:09:38.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:09:38.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:09:38.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:09:38.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:09:38.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:09:38.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:09:38.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:09:38.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.224.131:0
08:09:38.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.224.131
08:09:38.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.224.131
08:09:38.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:09:38.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.224.190:36787,127.4.224.189:45505,127.4.224.188:40437
08:09:38.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.224.148:40383
08:09:38.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:09:38.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:09:38.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:09:38.326 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:38.326 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:38.326 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:38.327 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:38.330 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:38.330 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:38.330 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:38.330 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:38.330 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:38.330 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:38.331 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:38.331 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:38.331 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:38.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:38.347849  5757 heartbeater.cc:344] Connected to a master server at 127.4.224.188:40437
08:09:38.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:38.348419  5757 heartbeater.cc:461] Registering TS with master...
08:09:38.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:38.349973  5757 heartbeater.cc:507] Master 127.4.224.188:40437 requested a full tablet report, sending...
08:09:38.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:38.353276  5291 ts_manager.cc:194] Registered new tserver with Master: 6970736694d04ba2a93e80cda13d1533 (127.4.224.130:37197)
08:09:38.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:38.355410  5291 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.224.130:48195
08:09:38.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:38.362187  5759 heartbeater.cc:344] Connected to a master server at 127.4.224.190:36787
08:09:38.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:38.362612  5759 heartbeater.cc:461] Registering TS with master...
08:09:38.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:38.363402  5759 heartbeater.cc:507] Master 127.4.224.190:36787 requested a full tablet report, sending...
08:09:38.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:38.364908  5758 heartbeater.cc:344] Connected to a master server at 127.4.224.189:45505
08:09:38.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:38.365257  5758 heartbeater.cc:461] Registering TS with master...
08:09:38.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:38.365952  5758 heartbeater.cc:507] Master 127.4.224.189:45505 requested a full tablet report, sending...
08:09:38.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:38.366528  5063 ts_manager.cc:194] Registered new tserver with Master: 6970736694d04ba2a93e80cda13d1533 (127.4.224.130:37197)
08:09:38.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:38.368737  5152 ts_manager.cc:194] Registered new tserver with Master: 6970736694d04ba2a93e80cda13d1533 (127.4.224.130:37197)
08:09:38.394 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:38.395 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:38.395 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:38.395 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:38.395 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:38.395 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:38.395 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:38.395 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:38.395 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:38.396 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:38.396 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:38.396 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:38.396 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:38.528 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:38.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:38.554 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:38.616 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:38.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:38.757148  5768 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:09:38.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:38.757900  5768 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:09:38.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:38.758580  5768 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:09:38.769 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:38.770 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:38.770 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:38.770 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:38.770 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:38.770 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:38.770 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:38.770 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:38.770 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:38.770 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:38.770 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:38.770 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:38.770 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:38.798 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:38.798 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:38.798 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:38.798 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:38.798 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:38.798 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:38.798 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:38.798 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:38.798 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:38.799 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:38.799 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:38.799 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:38.799 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:38.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:38.803826  5768 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:09:38.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:38.804912  5768 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.224.131
08:09:38.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:38.853713  5768 tablet_server_runner.cc:78] Tablet server non-default flags:
08:09:38.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:09:38.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.224.148:40383
08:09:38.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:09:38.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:09:38.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-2/data
08:09:38.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-2/wal
08:09:38.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:09:38.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:09:38.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.224.131:0
08:09:38.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:09:38.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:09:38.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:09:38.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-2/data/info.pb
08:09:38.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.224.131
08:09:38.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:09:38.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.224.190:36787,127.4.224.189:45505,127.4.224.188:40437
08:09:38.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:09:38.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:09:38.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:09:38.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:09:38.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:09:38.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.224.131
08:09:38.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-2/logs
08:09:38.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:09:38.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:09:38.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:09:38.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:09:38.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:09:38.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:09:38.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:09:38.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:09:38.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:09:38.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:09:38.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:38.855700  5768 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:09:38.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:38.857784  5768 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:09:38.864 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:38.864 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:38.864 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:38.864 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:38.864 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:38.864 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:38.864 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:38.864 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:38.864 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:38.864 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:38.865 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:38.865 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:38.865 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:38.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:38.876251  5774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:39.028 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:39.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:39.058 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:39.074 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:39.074 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:39.074 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:39.075 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:39.075 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:39.075 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:39.075 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:39.076 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:39.076 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:39.076 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:39.076 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:39.076 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:39.076 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:39.116 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:39.251 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:39.251 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:39.251 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:39.251 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:39.251 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:39.252 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:39.252 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:39.252 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:39.252 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:39.251 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:39.252 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:39.252 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:39.252 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:39.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:39.361227  5757 heartbeater.cc:499] Master 127.4.224.188:40437 was elected leader, sending a full tablet report...
08:09:39.424 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:39.424 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:39.424 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:39.425 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:39.425 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:39.425 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:39.425 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:39.426 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:39.425 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:39.426 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:39.427 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:39.428 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:39.428 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:39.492 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:39.493 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:39.493 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:39.494 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:39.494 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:39.494 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:39.495 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:39.495 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:39.495 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:39.495 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:39.495 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:39.495 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:39.495 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:39.528 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:39.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:39.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:39.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:39.812 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:39.813 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:39.813 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:39.813 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:39.813 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:39.814 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:39.814 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:39.814 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:39.814 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:39.815 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:39.815 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:39.816 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:39.816 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:39.969 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:39.970 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:39.970 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:39.970 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:39.970 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:39.971 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:39.971 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:39.971 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:39.971 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:39.971 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:39.973 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:39.973 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:39.973 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:40.004 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:40.005 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:40.005 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:40.005 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:40.005 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:40.005 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:40.005 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:40.005 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:40.005 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:40.005 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:40.005 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:40.006 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:40.006 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:40.006 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:40.006 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:40.006 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:40.005 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:40.006 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:40.006 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:40.006 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:40.006 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:40.006 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:40.006 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:40.006 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:40.007 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:40.007 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:40.028 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:40.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:40.054 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:40.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:40.190 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:40.190 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:40.190 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:40.191 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:40.191 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:40.191 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:40.192 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:40.192 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:40.192 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:40.192 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:40.193 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:40.193 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:40.193 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:40.221 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:40.222 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:40.222 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:40.222 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:40.222 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:40.222 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:40.222 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:40.222 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:40.223 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:40.223 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:40.223 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:40.223 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:40.223 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:40.265 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (a72e6b48022ef36361b5eef11ee7c683) switched from state RESTARTING to RUNNING.
08:09:40.267 [INFO - flink-pekko.actor.default-dispatcher-6] (CheckpointCoordinator.java:1805) Restoring job a72e6b48022ef36361b5eef11ee7c683 from Checkpoint 78 @ 1779091656118 for a72e6b48022ef36361b5eef11ee7c683 located at file:/tmp/junit13140095929423248446/checkpoints/a72e6b48022ef36361b5eef11ee7c683/chk-78.
08:09:40.269 [INFO - flink-pekko.actor.default-dispatcher-6] (MasterHooks.java:201) No master state to restore
08:09:40.270 [INFO - flink-pekko.actor.default-dispatcher-6] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
08:09:40.273 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CREATED to SCHEDULED.
08:09:40.274 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:09:40.276 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from SCHEDULED to DEPLOYING.
08:09:40.276 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #5) with attempt id 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1) with allocation id 68aed56532af9c33564af146c662175d
08:09:40.276 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to SCHEDULED.
08:09:40.277 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 68aed56532af9c33564af146c662175d.
08:09:40.277 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:09:40.278 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#5 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_5), deploy into slot with allocation id 68aed56532af9c33564af146c662175d.
08:09:40.279 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from SCHEDULED to DEPLOYING.
08:09:40.279 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #5) with attempt id 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1) with allocation id 99f4948912648970d945ee4b7d180287
08:09:40.279 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 99f4948912648970d945ee4b7d180287.
08:09:40.280 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CREATED to SCHEDULED.
08:09:40.280 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#5 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_5), deploy into slot with allocation id 99f4948912648970d945ee4b7d180287.
08:09:40.280 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:09:40.281 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from SCHEDULED to DEPLOYING.
08:09:40.281 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #5) with attempt id 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1) with allocation id 4d91c4a4289e885e1ccd40283ee9eec0
08:09:40.282 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CREATED to SCHEDULED.
08:09:40.282 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job a72e6b48022ef36361b5eef11ee7c683: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:09:40.284 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from SCHEDULED to DEPLOYING.
08:09:40.284 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #5) with attempt id 135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to b6dd0119-1e0e-426b-ad00-c348de2a598b @ 127.0.0.1 (dataPort=-1) with allocation id 0a17552dd40f187ff1067ce2b4829466
08:09:40.285 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 4d91c4a4289e885e1ccd40283ee9eec0.
08:09:40.285 [INFO - Thread-64] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
08:09:40.289 [DEBUG - Thread-64] (Connection.java:575) [peer master-127.28.220.253:45079(127.28.220.253:45079)] disconnecting while in state TERMINATED
08:09:40.289 [DEBUG - Thread-64] (Connection.java:575) [peer master-127.28.220.254:37365(127.28.220.254:37365)] disconnecting while in state TERMINATED
08:09:40.291 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#5 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_5), deploy into slot with allocation id 4d91c4a4289e885e1ccd40283ee9eec0.
08:09:40.292 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to DEPLOYING.
08:09:40.292 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#5 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_5) [DEPLOYING].
08:09:40.291 [DEBUG - Thread-64] (Connection.java:575) [peer master-127.28.220.252:33543(127.28.220.252:33543)] disconnecting while in state TERMINATED
08:09:40.292 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CREATED to DEPLOYING.
08:09:40.293 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#5 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_5) [DEPLOYING].
08:09:40.293 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:09:40.294 [INFO - Thread-64] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
08:09:40.295 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@35b30848
08:09:40.295 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:40.295 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13140095929423248446/checkpoints")
08:09:40.296 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
08:09:40.296 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
08:09:40.299 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 0a17552dd40f187ff1067ce2b4829466.
08:09:40.300 [INFO - Thread-64] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
08:09:40.313 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#5 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_5), deploy into slot with allocation id 0a17552dd40f187ff1067ce2b4829466.
08:09:40.323 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CREATED to DEPLOYING.
08:09:40.323 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#5 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_5) [DEPLOYING].
08:09:40.324 [DEBUG - Thread-64] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:40.324 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5457113b
08:09:40.325 [INFO - Thread-64] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
08:09:40.325 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CREATED to DEPLOYING.
08:09:40.326 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:40.327 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@ae17135
08:09:40.329 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13140095929423248446/checkpoints")
08:09:40.331 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:09:40.332 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:09:40.332 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:09:40.332 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from DEPLOYING to INITIALIZING.
08:09:40.332 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:40.332 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
08:09:40.333 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13140095929423248446/checkpoints")
08:09:40.333 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from DEPLOYING to INITIALIZING.
08:09:40.333 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from DEPLOYING to INITIALIZING.
08:09:40.334 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from DEPLOYING to INITIALIZING.
08:09:40.336 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6aa7467
08:09:40.337 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#5 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_5) [DEPLOYING].
08:09:40.338 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@ef1d761
08:09:40.338 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:40.338 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13140095929423248446/checkpoints")
08:09:40.338 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from DEPLOYING to INITIALIZING.
08:09:40.339 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (135652f4f6003b96813527d569fde750_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from DEPLOYING to INITIALIZING.
08:09:40.343 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@494f9dd5
08:09:40.348 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:40.343 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:40.349 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:40.350 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1ca1ebce
08:09:40.350 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@9ccd0bf
08:09:40.352 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:40.353 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:40.354 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:40.355 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.355 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.355 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.361 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:40.361 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.361 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.362 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.364 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.366 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.375 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.384 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:40.454 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.455 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.456 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.456 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.456 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.456 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.456 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.456 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:40.457 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.458 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.458 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.458 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.463 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:40.466 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.467 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.467 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.467 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.469 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.469 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.469 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.469 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.470 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.471 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.471 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.471 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.473 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.473 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.473 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.474 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.475 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:40.476 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.476 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.476 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.477 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:40.478 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.479 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.479 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.484 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.492 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.492 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.492 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.492 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:40.502 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:40.504 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:40.504 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:40.504 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:40.504 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:40.504 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:40.505 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:40.505 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:40.505 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:40.505 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:40.505 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:40.505 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:40.505 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:40.505 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:40.509 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.509 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.510 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.510 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.510 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.510 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.511 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.511 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.511 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.511 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:40.512 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.512 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.512 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.512 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:40.512 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.512 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.513 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.514 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.514 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.515 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.515 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:40.515 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.516 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.516 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.516 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.516 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.517 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.517 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.517 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.517 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.518 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.518 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.518 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.519 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.519 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.519 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.519 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.520 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.520 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.520 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.520 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.520 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.520 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.520 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.508 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.522 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.522 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.522 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.522 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:40.523 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:40.523 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:40.523 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.523 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.523 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.524 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.524 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.525 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.526 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.526 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.526 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.526 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.526 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.526 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.526 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.526 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.526 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.527 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:40.527 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.528 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:40.530 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.531 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.531 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.531 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.532 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.533 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.533 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.533 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.534 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.534 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.534 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.534 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.536 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.536 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.536 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.536 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.536 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.537 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.537 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.537 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.537 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.538 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.538 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.538 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.538 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.539 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.539 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.540 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.540 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.541 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.541 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.541 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.541 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.543 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:40.543 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:40.543 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:40.543 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.543 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.543 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.543 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.543 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.543 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.543 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.544 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.544 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.544 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.544 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.544 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.544 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.545 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.545 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.545 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.545 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.545 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.545 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.545 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.544 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.545 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:40.545 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.545 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.546 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.544 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.546 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.546 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.547 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.552 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:40.553 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:40.553 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:40.553 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:40.554 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:40.554 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:40.554 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:40.554 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:40.554 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:40.554 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:40.554 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:40.554 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:40.555 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:40.555 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:40.555 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:40.561 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.562 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.562 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.562 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.565 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.565 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.565 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.565 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.565 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.565 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.566 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.566 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.566 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.566 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.566 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.566 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.566 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.571 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.571 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.571 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.571 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.578 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.583 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:40.583 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:40.583 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:40.583 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.583 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.583 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.584 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.584 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.584 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.584 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.584 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.584 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.584 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:40.585 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.588 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.604 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.607 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.607 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.607 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.607 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.607 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.607 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.607 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.607 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.607 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.607 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.607 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.608 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.608 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.608 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.609 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.610 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.610 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.610 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.610 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.610 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.610 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.610 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.612 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:40.613 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:40.613 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:40.613 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:40.613 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:40.613 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:40.613 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:40.613 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:40.613 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:40.614 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:40.614 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:40.614 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:40.614 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:40.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:40.619 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.621 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.621 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.621 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.624 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.624 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.624 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.625 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.627 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.627 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.627 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.627 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.627 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.627 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.627 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.627 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.627 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.627 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.627 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.627 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.627 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.627 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.627 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.627 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.627 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.631 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.632 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.634 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.634 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.635 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.636 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.636 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.636 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.636 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.636 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.636 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.636 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.637 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.637 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.637 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.637 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.637 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.638 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.638 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.638 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.639 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.639 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.640 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.640 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.640 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.643 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:40.643 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:40.643 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:40.643 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.643 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.643 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.643 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.643 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.643 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.644 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.644 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.644 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.644 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:40.647 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.647 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.647 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.647 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.647 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.648 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.648 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.648 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.648 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.648 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.648 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.648 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.648 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.653 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:40.653 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:40.653 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:40.653 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:40.653 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:40.653 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:40.654 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:40.654 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:40.654 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:40.654 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:40.654 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:40.654 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:40.654 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:40.656 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.656 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.656 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.657 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.657 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.657 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.657 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.657 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.657 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.657 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.658 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.658 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.658 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.665 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.665 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.665 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.665 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.665 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.666 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.666 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.666 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.666 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.666 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.666 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.666 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.666 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.666 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.666 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.666 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.666 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.667 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.667 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.667 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.667 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.667 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.667 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.669 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.669 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.670 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.676 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.676 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.676 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.676 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.677 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.677 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.677 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.677 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.677 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.677 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.677 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.677 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.678 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.685 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.686 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.686 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.686 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.686 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.686 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.686 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.686 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.686 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.686 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.686 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.687 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.687 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.687 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.688 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.688 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.688 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.688 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.688 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.688 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.688 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.688 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.689 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.689 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.689 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.689 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.716 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.716 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.716 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.717 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.717 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.717 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.718 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.718 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.718 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.718 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.718 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.718 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.718 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.719 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:40.719 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:40.719 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:40.719 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:40.720 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:40.720 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:40.720 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:40.720 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:40.720 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:40.721 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:40.721 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:40.721 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:40.721 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:40.725 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.726 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.726 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.727 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.727 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.727 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.727 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.727 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.727 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.727 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.728 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.728 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.728 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.729 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.729 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.729 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.729 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.729 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.730 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.730 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.730 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.730 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.730 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.730 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.730 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.730 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.743 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:40.743 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:40.743 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:40.744 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.744 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.744 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.744 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.744 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.744 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.745 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.745 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.745 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.745 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:40.770 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.770 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.770 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.771 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.771 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.772 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.772 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.772 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.772 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.773 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.773 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.773 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.774 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.775 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.775 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.775 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.776 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.776 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.776 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.776 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.776 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.776 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.776 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.776 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.777 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.777 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.777 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.778 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.778 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.778 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.778 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.779 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.779 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.779 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.779 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.779 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.779 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.779 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.779 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.785 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.785 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.785 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.786 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.786 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.786 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.786 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.787 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.787 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.787 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.787 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.787 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.787 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:40.279176  5773 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 5768
08:09:40.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:40.860576  5773 kernel_stack_watchdog.cc:198] Thread 5768 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 400ms:
08:09:40.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:09:40.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:09:40.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:09:40.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:09:40.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:38.876925  5775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:40.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:40.862428  5768 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.987s	user 0.000s	sys 0.002s
08:09:40.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:40.862907  5768 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.987s	user 0.000s	sys 0.003s
08:09:40.865 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.865 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:40.865353  5777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:09:40.865 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.865 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.866 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:40.866 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.866 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:40.866 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.866 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:40.866 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.866 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.866 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.866 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:40.866 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:40.866 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:40.866 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:40.866 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:40.867 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:40.867 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.867 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:40.867 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.867 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.867 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:40.867 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.867 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:40.867 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:40.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:40.868371  5776 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1986 milliseconds
08:09:40.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:40.868379  5768 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:09:40.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:40.870190  5768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:09:40.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:40.873229  5768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:09:40.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:40.874760  5768 hybrid_clock.cc:648] HybridClock initialized: now 1779091780874696 us; error 51 us; skew 500 ppm
08:09:40.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:40.875901  5768 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:09:40.882 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:40.883 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:40.883 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:40.883 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.883 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.883 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:40.883 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.883 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.883 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:40.883 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.883 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.883 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:40.883 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:40.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:40.885221  5768 webserver.cc:533] Webserver started at http://127.4.224.131:33153/ using document root <none> and password file <none>
08:09:40.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:40.886525  5768 fs_manager.cc:362] Metadata directory not provided
08:09:40.887 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.887 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.887 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.887 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.887 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.887 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.887 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.887 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.887 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.888 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.888 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.888 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.888 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:40.886790  5768 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:09:40.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:40.887686  5768 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:09:40.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:40.893600  5768 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-2/data/instance:
08:09:40.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "be6a60c33c2943c9973c8f63d1e4fb49"
08:09:40.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:40 on dist-test-slave-1jss"
08:09:40.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:40.895020  5768 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-2/wal/instance:
08:09:40.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "be6a60c33c2943c9973c8f63d1e4fb49"
08:09:40.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:40 on dist-test-slave-1jss"
08:09:40.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:40.905872  5768 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.005s	sys 0.004s
08:09:40.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:40.913365  5842 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:09:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:40.914836  5768 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.000s
08:09:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:40.915189  5768 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-2/data,/tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-2/wal
08:09:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "be6a60c33c2943c9973c8f63d1e4fb49"
08:09:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:09:40 on dist-test-slave-1jss"
08:09:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:40.915622  5768 fs_report.cc:389] FS layout report
08:09:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:09:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-2/wal
08:09:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-2/wal
08:09:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-2/data/data
08:09:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:09:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:09:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:09:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:09:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:09:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:09:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:09:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:09:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:09:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:09:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:09:40.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:40.956 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:40.956 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:40.956 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:40.956 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.956 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.956 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.957 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.957 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.957 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.957 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:40.957 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:40.957 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:40.957 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:40.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:40.978240  5768 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:09:40.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:40.980103  5768 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:09:40.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:40.980646  5768 kserver.cc:163] Server-wide thread pool size limit: 3276
08:09:40.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:40.984251  5768 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:09:40.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:40.989964  5768 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:09:40.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:40.990252  5768 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:09:40.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:40.990561  5768 ts_tablet_manager.cc:616] Registered 0 tablets
08:09:40.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:40.990767  5768 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:09:41.005 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:41.006 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:41.006 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:41.006 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:41.006 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:41.006 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.006 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:41.006 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.006 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.006 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.007 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.007 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.007 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.007 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.008 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.008 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.008 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.008 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.008 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.008 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.008 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.008 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.008 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.008 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.008 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:41.008 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:41.027 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:41.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:41.054 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:41.054 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:41.054 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:41.054 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:41.054 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:41.055 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:41.055 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:41.055 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:41.055 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:41.055 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:41.055 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:41.055 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:41.056 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:41.056 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:41.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:41.157 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:41.157 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:41.157 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.157 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.157 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:41.158 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.158 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.158 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.158 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.158 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.158 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.158 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.158 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:41.183 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:41.183 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:41.184 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:41.184 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:41.184 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:41.184 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:41.184 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:41.184 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:41.184 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:41.184 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:41.184 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:41.184 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:41.184 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:41.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.227643  5768 rpc_server.cc:307] RPC server started. Bound to: 127.4.224.131:39813
08:09:41.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.227802  5954 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.224.131:39813 every 8 connection(s)
08:09:41.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.231573  5768 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-2/data/info.pb
08:09:41.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.242448  4994 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu as pid 5768
08:09:41.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.243275  4994 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskk4_r_T/test-tmp/mini-kudu-cluster5076480806629700456/ts-2/wal/instance
08:09:41.267 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:41.267 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:41.267 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:41.268 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.268 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.268 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.268 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.268 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.268 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.268 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.268 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.269 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.269 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:41.276 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:41.276 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:41.276 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:41.276 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.276 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.276 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.277 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.277 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.277 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.277 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.277 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.277 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.277 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:41.304 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:41.305 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:41.305 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:41.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.304678  5956 heartbeater.cc:344] Connected to a master server at 127.4.224.189:45505
08:09:41.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.305259  5956 heartbeater.cc:461] Registering TS with master...
08:09:41.306 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.306 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.306 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.306 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.306 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.306 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.307 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:41.307 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:41.307 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:41.307 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.307 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.307 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.308 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.308 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.308 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.308 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.308 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.309 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.309 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.309 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:41.312 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.312 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.312 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:41.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.314466  5956 heartbeater.cc:507] Master 127.4.224.189:45505 requested a full tablet report, sending...
08:09:41.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.318481  5152 ts_manager.cc:194] Registered new tserver with Master: be6a60c33c2943c9973c8f63d1e4fb49 (127.4.224.131:39813)
08:09:41.325 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:41.325 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:41.325 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:41.325 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:41.325 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:41.325 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:41.326 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:41.326 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:41.326 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:41.326 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:41.326 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:41.327 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:41.327 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:41.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.329031  5959 heartbeater.cc:344] Connected to a master server at 127.4.224.190:36787
08:09:41.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.329442  5959 heartbeater.cc:461] Registering TS with master...
08:09:41.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.330534  5959 heartbeater.cc:507] Master 127.4.224.190:36787 requested a full tablet report, sending...
08:09:41.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.333901  5063 ts_manager.cc:194] Registered new tserver with Master: be6a60c33c2943c9973c8f63d1e4fb49 (127.4.224.131:39813)
08:09:41.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.334573  5955 heartbeater.cc:344] Connected to a master server at 127.4.224.188:40437
08:09:41.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.334954  5955 heartbeater.cc:461] Registering TS with master...
08:09:41.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.336025  5955 heartbeater.cc:507] Master 127.4.224.188:40437 requested a full tablet report, sending...
08:09:41.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.338335  5291 ts_manager.cc:194] Registered new tserver with Master: be6a60c33c2943c9973c8f63d1e4fb49 (127.4.224.131:39813)
08:09:41.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.339986  5291 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.224.131:40679
08:09:41.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.353385  4994 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
08:09:41.368 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:09:41.368 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

08:09:41.370 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.4.224.190"
      port: 36787
    }
    bound_http_address {
      host: "127.4.224.190"
      port: 33301
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.4.224.189"
      port: 45505
    }
    bound_http_address {
      host: "127.4.224.189"
      port: 45701
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.4.224.188"
      port: 40437
    }
    bound_http_address {
      host: "127.4.224.188"
      port: 46803
    }
  }
}

08:09:41.370 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

08:09:41.371 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.4.224.129"
      port: 40841
    }
    bound_http_address {
      host: "127.4.224.129"
      port: 35613
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.4.224.130"
      port: 37197
    }
    bound_http_address {
      host: "127.4.224.130"
      port: 38839
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.4.224.131"
      port: 39813
    }
    bound_http_address {
      host: "127.4.224.131"
      port: 33153
    }
  }
}

08:09:41.371 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
08:09:41.373 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:41.376 [DEBUG - main] (Connection.java:748) [peer master-127.4.9.126:44985(127.4.9.126:44985)] connecting to peer
08:09:41.377 [DEBUG - main] (Connection.java:748) [peer master-127.4.9.125:45723(127.4.9.125:45723)] connecting to peer
08:09:41.377 [DEBUG - main] (Connection.java:748) [peer master-127.4.9.124:41733(127.4.9.124:41733)] connecting to peer
08:09:41.378 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.4.9.126:44985(127.4.9.126:44985)] Successfully connected to peer
08:09:41.378 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.4.9.125:45723(127.4.9.125:45723)] Successfully connected to peer
08:09:41.380 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.4.9.124:41733(127.4.9.124:41733)] Successfully connected to peer
08:09:41.385 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.9.124
08:09:41.385 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.9.125
08:09:41.385 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.9.126
08:09:41.398 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:41.399 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:41.400 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:41.402 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb601c9e0, L:/127.0.0.1:43724 - R:/127.4.9.126:44985] using SASL/PLAIN
08:09:41.403 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xbbf7c31c, L:/127.0.0.1:40236 - R:/127.4.9.124:41733] using SASL/PLAIN
08:09:41.409 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:09:41.410 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=33), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.9.126:44985, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.9.125:45723, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.9.124:41733, [31ms] Sub RPC ConnectToMaster: received response from server master-127.4.9.124:41733: OK, [32ms] Sub RPC ConnectToMaster: received response from server master-127.4.9.126:44985: OK, deferred=null) after lookup
08:09:41.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.416611  4393 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40236:
08:09:41.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
08:09:41.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
08:09:41.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:41.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int8"
08:09:41.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT8
08:09:41.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:09:41.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:41.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:41.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:41.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:41.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int16"
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT16
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int32"
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int64"
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT64
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "bool"
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:41.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:41.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "float"
08:09:41.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: FLOAT
08:09:41.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:41.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:41.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:41.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:41.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:41.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:41.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:41.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "double"
08:09:41.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DOUBLE
08:09:41.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:41.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:41.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:41.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:41.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:41.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:41.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:41.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "string"
08:09:41.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:09:41.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:41.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:41.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:41.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:41.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:41.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:41.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:41.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:41.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "binary-array"
08:09:41.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BINARY
08:09:41.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:41.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:41.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:41.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:41.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:41.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:41.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:41.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "binary-bytebuffer"
08:09:41.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BINARY
08:09:41.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:41.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:41.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:41.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:41.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:41.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:41.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "null"
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "timestamp"
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: UNIXTIME_MICROS
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "decimal"
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DECIMAL32
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type_attributes {
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       precision: 5
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       scale: 3
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "varchar"
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: VARCHAR
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:41.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:41.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type_attributes {
08:09:41.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       length: 10
08:09:41.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:09:41.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:41.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:41.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:41.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:41.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "date"
08:09:41.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DATE
08:09:41.424 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x200b4b2a, L:/127.0.0.1:45098 - R:/127.4.9.125:45723] using SASL/PLAIN
08:09:41.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:41.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:41.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:41.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:41.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:41.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:41.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:09:41.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
08:09:41.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
08:09:41.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
08:09:41.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "int8"
08:09:41.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:09:41.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:41.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:09:41.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:41.425201  4393 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
08:09:41.466 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:41.466 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:41.466 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:41.467 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.467 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.467 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.467 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.467 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.467 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.468 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.468 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.468 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.468 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:41.497 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 6de1c5d6e18848f98421ddb9a0206801
08:09:41.505 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:41.505 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:41.505 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:41.505 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.505 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.506 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:41.506 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.506 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.506 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.506 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:41.506 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.506 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:41.506 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:41.527 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:41.552 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:41.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:41.596 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:41.596 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:41.596 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:41.596 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:41.596 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:41.596 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:41.597 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:41.597 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:41.597 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:41.597 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:41.597 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:41.598 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:41.598 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:41.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.604532  4726 tablet_service.cc:1511] Processing CreateTablet for tablet 575ff3b76e2c433182dc6c13ceccca59 (DEFAULT_TABLE table=replication_test_table [id=6de1c5d6e18848f98421ddb9a0206801]), partition=RANGE (int8) PARTITION UNBOUNDED
08:09:41.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.605481  4919 tablet_service.cc:1511] Processing CreateTablet for tablet 575ff3b76e2c433182dc6c13ceccca59 (DEFAULT_TABLE table=replication_test_table [id=6de1c5d6e18848f98421ddb9a0206801]), partition=RANGE (int8) PARTITION UNBOUNDED
08:09:41.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.608283  4919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 575ff3b76e2c433182dc6c13ceccca59. 1 dirs total, 0 dirs full, 0 dirs failed
08:09:41.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.608726  4726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 575ff3b76e2c433182dc6c13ceccca59. 1 dirs total, 0 dirs full, 0 dirs failed
08:09:41.619 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:41.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.622351  4586 tablet_service.cc:1511] Processing CreateTablet for tablet 575ff3b76e2c433182dc6c13ceccca59 (DEFAULT_TABLE table=replication_test_table [id=6de1c5d6e18848f98421ddb9a0206801]), partition=RANGE (int8) PARTITION UNBOUNDED
08:09:41.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.625319  4586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 575ff3b76e2c433182dc6c13ceccca59. 1 dirs total, 0 dirs full, 0 dirs failed
08:09:41.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.655112  5989 tablet_bootstrap.cc:492] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e: Bootstrap starting.
08:09:41.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.662267  5990 tablet_bootstrap.cc:492] T 575ff3b76e2c433182dc6c13ceccca59 P 17223fa74c2243e899d62a8a629c92ea: Bootstrap starting.
08:09:41.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.664822  5989 tablet_bootstrap.cc:654] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e: Neither blocks nor log segments found. Creating new log.
08:09:41.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.668057  5989 log.cc:826] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e: Log is configured to *not* fsync() on all Append() calls
08:09:41.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.676955  5989 tablet_bootstrap.cc:492] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e: No bootstrap required, opened a new log
08:09:41.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.677923  5989 ts_tablet_manager.cc:1403] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.012s
08:09:41.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.678406  5990 tablet_bootstrap.cc:654] T 575ff3b76e2c433182dc6c13ceccca59 P 17223fa74c2243e899d62a8a629c92ea: Neither blocks nor log segments found. Creating new log.
08:09:41.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.680863  5992 tablet_bootstrap.cc:492] T 575ff3b76e2c433182dc6c13ceccca59 P 0a7023e11f684b96aa2d4965a85ddaa3: Bootstrap starting.
08:09:41.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.681541  5990 log.cc:826] T 575ff3b76e2c433182dc6c13ceccca59 P 17223fa74c2243e899d62a8a629c92ea: Log is configured to *not* fsync() on all Append() calls
08:09:41.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.689320  5990 tablet_bootstrap.cc:492] T 575ff3b76e2c433182dc6c13ceccca59 P 17223fa74c2243e899d62a8a629c92ea: No bootstrap required, opened a new log
08:09:41.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.690163  5990 ts_tablet_manager.cc:1403] T 575ff3b76e2c433182dc6c13ceccca59 P 17223fa74c2243e899d62a8a629c92ea: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.009s
08:09:41.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.692570  5992 tablet_bootstrap.cc:654] T 575ff3b76e2c433182dc6c13ceccca59 P 0a7023e11f684b96aa2d4965a85ddaa3: Neither blocks nor log segments found. Creating new log.
08:09:41.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.697744  5992 log.cc:826] T 575ff3b76e2c433182dc6c13ceccca59 P 0a7023e11f684b96aa2d4965a85ddaa3: Log is configured to *not* fsync() on all Append() calls
08:09:41.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.711647  5992 tablet_bootstrap.cc:492] T 575ff3b76e2c433182dc6c13ceccca59 P 0a7023e11f684b96aa2d4965a85ddaa3: No bootstrap required, opened a new log
08:09:41.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.712399  5992 ts_tablet_manager.cc:1403] T 575ff3b76e2c433182dc6c13ceccca59 P 0a7023e11f684b96aa2d4965a85ddaa3: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.014s
08:09:41.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.717139  5989 raft_consensus.cc:359] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4307e383fdb4861a47655fcaa08be4e" member_type: VOTER last_known_addr { host: "127.4.9.67" port: 37907 } } peers { permanent_uuid: "17223fa74c2243e899d62a8a629c92ea" member_type: VOTER last_known_addr { host: "127.4.9.66" port: 45705 } } peers { permanent_uuid: "0a7023e11f684b96aa2d4965a85ddaa3" member_type: VOTER last_known_addr { host: "127.4.9.65" port: 39865 } }
08:09:41.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.718806  5989 raft_consensus.cc:385] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:09:41.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.720965  5989 raft_consensus.cc:740] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4307e383fdb4861a47655fcaa08be4e, State: Initialized, Role: FOLLOWER
08:09:41.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.722952  5989 consensus_queue.cc:260] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4307e383fdb4861a47655fcaa08be4e" member_type: VOTER last_known_addr { host: "127.4.9.67" port: 37907 } } peers { permanent_uuid: "17223fa74c2243e899d62a8a629c92ea" member_type: VOTER last_known_addr { host: "127.4.9.66" port: 45705 } } peers { permanent_uuid: "0a7023e11f684b96aa2d4965a85ddaa3" member_type: VOTER last_known_addr { host: "127.4.9.65" port: 39865 } }
08:09:41.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.724515  5990 raft_consensus.cc:359] T 575ff3b76e2c433182dc6c13ceccca59 P 17223fa74c2243e899d62a8a629c92ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4307e383fdb4861a47655fcaa08be4e" member_type: VOTER last_known_addr { host: "127.4.9.67" port: 37907 } } peers { permanent_uuid: "17223fa74c2243e899d62a8a629c92ea" member_type: VOTER last_known_addr { host: "127.4.9.66" port: 45705 } } peers { permanent_uuid: "0a7023e11f684b96aa2d4965a85ddaa3" member_type: VOTER last_known_addr { host: "127.4.9.65" port: 39865 } }
08:09:41.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.726027  5990 raft_consensus.cc:385] T 575ff3b76e2c433182dc6c13ceccca59 P 17223fa74c2243e899d62a8a629c92ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:09:41.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.726450  5990 raft_consensus.cc:740] T 575ff3b76e2c433182dc6c13ceccca59 P 17223fa74c2243e899d62a8a629c92ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17223fa74c2243e899d62a8a629c92ea, State: Initialized, Role: FOLLOWER
08:09:41.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.727677  5990 consensus_queue.cc:260] T 575ff3b76e2c433182dc6c13ceccca59 P 17223fa74c2243e899d62a8a629c92ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4307e383fdb4861a47655fcaa08be4e" member_type: VOTER last_known_addr { host: "127.4.9.67" port: 37907 } } peers { permanent_uuid: "17223fa74c2243e899d62a8a629c92ea" member_type: VOTER last_known_addr { host: "127.4.9.66" port: 45705 } } peers { permanent_uuid: "0a7023e11f684b96aa2d4965a85ddaa3" member_type: VOTER last_known_addr { host: "127.4.9.65" port: 39865 } }
08:09:41.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.730973  5989 ts_tablet_manager.cc:1434] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e: Time spent starting tablet: real 0.053s	user 0.032s	sys 0.012s
08:09:41.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.732704  5990 ts_tablet_manager.cc:1434] T 575ff3b76e2c433182dc6c13ceccca59 P 17223fa74c2243e899d62a8a629c92ea: Time spent starting tablet: real 0.042s	user 0.031s	sys 0.007s
08:09:41.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.753894  5995 raft_consensus.cc:493] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:09:41.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.754611  5995 raft_consensus.cc:515] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4307e383fdb4861a47655fcaa08be4e" member_type: VOTER last_known_addr { host: "127.4.9.67" port: 37907 } } peers { permanent_uuid: "17223fa74c2243e899d62a8a629c92ea" member_type: VOTER last_known_addr { host: "127.4.9.66" port: 45705 } } peers { permanent_uuid: "0a7023e11f684b96aa2d4965a85ddaa3" member_type: VOTER last_known_addr { host: "127.4.9.65" port: 39865 } }
08:09:41.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.758368  5995 leader_election.cc:290] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17223fa74c2243e899d62a8a629c92ea (127.4.9.66:45705), 0a7023e11f684b96aa2d4965a85ddaa3 (127.4.9.65:39865)
08:09:41.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.764360  5992 raft_consensus.cc:359] T 575ff3b76e2c433182dc6c13ceccca59 P 0a7023e11f684b96aa2d4965a85ddaa3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4307e383fdb4861a47655fcaa08be4e" member_type: VOTER last_known_addr { host: "127.4.9.67" port: 37907 } } peers { permanent_uuid: "17223fa74c2243e899d62a8a629c92ea" member_type: VOTER last_known_addr { host: "127.4.9.66" port: 45705 } } peers { permanent_uuid: "0a7023e11f684b96aa2d4965a85ddaa3" member_type: VOTER last_known_addr { host: "127.4.9.65" port: 39865 } }
08:09:41.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.765568  5992 raft_consensus.cc:385] T 575ff3b76e2c433182dc6c13ceccca59 P 0a7023e11f684b96aa2d4965a85ddaa3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:09:41.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.765933  5992 raft_consensus.cc:740] T 575ff3b76e2c433182dc6c13ceccca59 P 0a7023e11f684b96aa2d4965a85ddaa3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a7023e11f684b96aa2d4965a85ddaa3, State: Initialized, Role: FOLLOWER
08:09:41.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.767184  5992 consensus_queue.cc:260] T 575ff3b76e2c433182dc6c13ceccca59 P 0a7023e11f684b96aa2d4965a85ddaa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4307e383fdb4861a47655fcaa08be4e" member_type: VOTER last_known_addr { host: "127.4.9.67" port: 37907 } } peers { permanent_uuid: "17223fa74c2243e899d62a8a629c92ea" member_type: VOTER last_known_addr { host: "127.4.9.66" port: 45705 } } peers { permanent_uuid: "0a7023e11f684b96aa2d4965a85ddaa3" member_type: VOTER last_known_addr { host: "127.4.9.65" port: 39865 } }
08:09:41.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.785671  4606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575ff3b76e2c433182dc6c13ceccca59" candidate_uuid: "f4307e383fdb4861a47655fcaa08be4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a7023e11f684b96aa2d4965a85ddaa3" is_pre_election: true
08:09:41.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.787025  4606 raft_consensus.cc:2468] T 575ff3b76e2c433182dc6c13ceccca59 P 0a7023e11f684b96aa2d4965a85ddaa3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4307e383fdb4861a47655fcaa08be4e in term 0.
08:09:41.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.788751  5992 ts_tablet_manager.cc:1434] T 575ff3b76e2c433182dc6c13ceccca59 P 0a7023e11f684b96aa2d4965a85ddaa3: Time spent starting tablet: real 0.076s	user 0.034s	sys 0.022s
08:09:41.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.792114  4746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575ff3b76e2c433182dc6c13ceccca59" candidate_uuid: "f4307e383fdb4861a47655fcaa08be4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17223fa74c2243e899d62a8a629c92ea" is_pre_election: true
08:09:41.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.793211  4746 raft_consensus.cc:2468] T 575ff3b76e2c433182dc6c13ceccca59 P 17223fa74c2243e899d62a8a629c92ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4307e383fdb4861a47655fcaa08be4e in term 0.
08:09:41.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.796468  4875 leader_election.cc:304] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a7023e11f684b96aa2d4965a85ddaa3, f4307e383fdb4861a47655fcaa08be4e; no voters: 
08:09:41.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.797428  5995 raft_consensus.cc:2804] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e [term 0 FOLLOWER]: Leader pre-election won for term 1
08:09:41.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.797857  5995 raft_consensus.cc:493] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:09:41.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.798244  5995 raft_consensus.cc:3060] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e [term 0 FOLLOWER]: Advancing to term 1
08:09:41.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.806615  5995 raft_consensus.cc:515] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4307e383fdb4861a47655fcaa08be4e" member_type: VOTER last_known_addr { host: "127.4.9.67" port: 37907 } } peers { permanent_uuid: "17223fa74c2243e899d62a8a629c92ea" member_type: VOTER last_known_addr { host: "127.4.9.66" port: 45705 } } peers { permanent_uuid: "0a7023e11f684b96aa2d4965a85ddaa3" member_type: VOTER last_known_addr { host: "127.4.9.65" port: 39865 } }
08:09:41.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.808617  5995 leader_election.cc:290] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e [CANDIDATE]: Term 1 election: Requested vote from peers 17223fa74c2243e899d62a8a629c92ea (127.4.9.66:45705), 0a7023e11f684b96aa2d4965a85ddaa3 (127.4.9.65:39865)
08:09:41.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.809770  4746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575ff3b76e2c433182dc6c13ceccca59" candidate_uuid: "f4307e383fdb4861a47655fcaa08be4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17223fa74c2243e899d62a8a629c92ea"
08:09:41.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.809991  4606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "575ff3b76e2c433182dc6c13ceccca59" candidate_uuid: "f4307e383fdb4861a47655fcaa08be4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a7023e11f684b96aa2d4965a85ddaa3"
08:09:41.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.810475  4746 raft_consensus.cc:3060] T 575ff3b76e2c433182dc6c13ceccca59 P 17223fa74c2243e899d62a8a629c92ea [term 0 FOLLOWER]: Advancing to term 1
08:09:41.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.810627  4606 raft_consensus.cc:3060] T 575ff3b76e2c433182dc6c13ceccca59 P 0a7023e11f684b96aa2d4965a85ddaa3 [term 0 FOLLOWER]: Advancing to term 1
08:09:41.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.818946  4746 raft_consensus.cc:2468] T 575ff3b76e2c433182dc6c13ceccca59 P 17223fa74c2243e899d62a8a629c92ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4307e383fdb4861a47655fcaa08be4e in term 1.
08:09:41.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.818946  4606 raft_consensus.cc:2468] T 575ff3b76e2c433182dc6c13ceccca59 P 0a7023e11f684b96aa2d4965a85ddaa3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4307e383fdb4861a47655fcaa08be4e in term 1.
08:09:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.820456  4875 leader_election.cc:304] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a7023e11f684b96aa2d4965a85ddaa3, f4307e383fdb4861a47655fcaa08be4e; no voters: 
08:09:41.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.821307  5995 raft_consensus.cc:2804] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e [term 1 FOLLOWER]: Leader election won for term 1
08:09:41.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.823724  5995 raft_consensus.cc:697] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e [term 1 LEADER]: Becoming Leader. State: Replica: f4307e383fdb4861a47655fcaa08be4e, State: Running, Role: LEADER
08:09:41.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.825201  5995 consensus_queue.cc:237] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4307e383fdb4861a47655fcaa08be4e" member_type: VOTER last_known_addr { host: "127.4.9.67" port: 37907 } } peers { permanent_uuid: "17223fa74c2243e899d62a8a629c92ea" member_type: VOTER last_known_addr { host: "127.4.9.66" port: 45705 } } peers { permanent_uuid: "0a7023e11f684b96aa2d4965a85ddaa3" member_type: VOTER last_known_addr { host: "127.4.9.65" port: 39865 } }
08:09:41.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.837591  4391 catalog_manager.cc:5696] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e reported cstate change: term changed from 0 to 1, leader changed from <none> to f4307e383fdb4861a47655fcaa08be4e (127.4.9.67). New cstate: current_term: 1 leader_uuid: "f4307e383fdb4861a47655fcaa08be4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4307e383fdb4861a47655fcaa08be4e" member_type: VOTER last_known_addr { host: "127.4.9.67" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17223fa74c2243e899d62a8a629c92ea" member_type: VOTER last_known_addr { host: "127.4.9.66" port: 45705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a7023e11f684b96aa2d4965a85ddaa3" member_type: VOTER last_known_addr { host: "127.4.9.65" port: 39865 } health_report { overall_health: UNKNOWN } } }
08:09:41.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:41.840130  4991 tablet.cc:2404] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:09:41.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:41.870083  4798 tablet.cc:2404] T 575ff3b76e2c433182dc6c13ceccca59 P 17223fa74c2243e899d62a8a629c92ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:09:41.923 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:41.925 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 6de1c5d6e18848f98421ddb9a0206801
08:09:41.942 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 575ff3b76e2c433182dc6c13ceccca59 for table 'replication_test_table' with partition [<start>, <end>)
08:09:41.942 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=575ff3b76e2c433182dc6c13ceccca59@[0a7023e11f684b96aa2d4965a85ddaa3(127.4.9.65:39865),17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705),f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907)[L]]}]
08:09:41.943 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.9.124:41733, [4ms] Sub RPC GetTableLocations: received response from server master-127.4.9.124:41733: OK, deferred=null) after lookup
08:09:41.943 [DEBUG - kudu-nio-2] (Connection.java:748) [peer f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907)] connecting to peer
08:09:41.944 [DEBUG - kudu-nio-3] (Connection.java:757) [peer f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907)] Successfully connected to peer
08:09:41.955 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:41.958 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x5581e328, L:/127.0.0.1:46340 - R:/127.4.9.67:37907] using TOKEN/null
08:09:41.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.975977  4746 raft_consensus.cc:1275] T 575ff3b76e2c433182dc6c13ceccca59 P 17223fa74c2243e899d62a8a629c92ea [term 1 FOLLOWER]: Refusing update from remote peer f4307e383fdb4861a47655fcaa08be4e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:09:41.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.976006  4606 raft_consensus.cc:1275] T 575ff3b76e2c433182dc6c13ceccca59 P 0a7023e11f684b96aa2d4965a85ddaa3 [term 1 FOLLOWER]: Refusing update from remote peer f4307e383fdb4861a47655fcaa08be4e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:09:41.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.978067  6000 consensus_queue.cc:1048] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a7023e11f684b96aa2d4965a85ddaa3" member_type: VOTER last_known_addr { host: "127.4.9.65" port: 39865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:09:41.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:41.979656  5995 consensus_queue.cc:1048] T 575ff3b76e2c433182dc6c13ceccca59 P f4307e383fdb4861a47655fcaa08be4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "17223fa74c2243e899d62a8a629c92ea" member_type: VOTER last_known_addr { host: "127.4.9.66" port: 45705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:09:41.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:41.996788  4659 tablet.cc:2404] T 575ff3b76e2c433182dc6c13ceccca59 P 0a7023e11f684b96aa2d4965a85ddaa3: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:09:42.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.019359  6005 mvcc.cc:204] Tried to move back new op lower bound from 7287159938951757824 to 7287159938368000000. Current Snapshot: MvccSnapshot[applied={T|T < 7287159938951757824}]
08:09:42.027 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:42.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:42.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.056288  6007 mvcc.cc:204] Tried to move back new op lower bound from 7287159938951757824 to 7287159938368000000. Current Snapshot: MvccSnapshot[applied={T|T < 7287159938951757824}]
08:09:42.057 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:42.116 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:42.131 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:42.131 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:42.132 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:42.132 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:42.132 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:42.132 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:42.132 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:42.132 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:42.132 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:42.132 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:42.133 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:42.133 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:42.133 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:42.163 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:42.163 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:42.164 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:42.164 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:42.164 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:42.164 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:42.164 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:42.164 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:42.164 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:42.164 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:42.164 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:42.164 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:42.164 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:42.203 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:42.203 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:42.203 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:42.204 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:42.204 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:42.204 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:42.204 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:42.204 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:42.204 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:42.204 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:42.204 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:42.204 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:42.204 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:42.276 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:42.277 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:42.277 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:42.278 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:42.278 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:42.278 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:42.278 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:42.278 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:42.278 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:42.279 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:42.279 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:42.279 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:42.279 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:42.326 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:42.326 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:42.326 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:42.327 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:42.327 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:42.327 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:42.327 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:42.327 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:42.327 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:42.327 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:42.327 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:42.327 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:42.327 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:42.330 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:42.342 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:42.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.343778  5955 heartbeater.cc:499] Master 127.4.224.188:40437 was elected leader, sending a full tablet report...
08:09:42.359 [DEBUG - main] (Connection.java:748) [peer master-127.4.224.189:45505(127.4.224.189:45505)] connecting to peer
08:09:42.359 [DEBUG - main] (Connection.java:748) [peer master-127.4.224.190:36787(127.4.224.190:36787)] connecting to peer
08:09:42.362 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.4.224.189:45505(127.4.224.189:45505)] Successfully connected to peer
08:09:42.364 [DEBUG - main] (Connection.java:748) [peer master-127.4.224.188:40437(127.4.224.188:40437)] connecting to peer
08:09:42.364 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.4.224.190:36787(127.4.224.190:36787)] Successfully connected to peer
08:09:42.365 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.224.189
08:09:42.368 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.224.190
08:09:42.369 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.4.224.188:40437(127.4.224.188:40437)] Successfully connected to peer
08:09:42.374 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.224.188
08:09:42.379 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:42.383 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:42.386 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:42.386 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc3e61988, L:/127.0.0.1:47774 - R:/127.4.224.189:45505] using SASL/PLAIN
08:09:42.388 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xf342f308, L:/127.0.0.1:54260 - R:/127.4.224.190:36787] using SASL/PLAIN
08:09:42.391 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:42.391 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:42.391 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:42.391 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:42.391 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:42.391 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:42.391 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:42.392 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:42.392 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:42.392 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:42.392 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:42.392 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:42.393 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:42.395 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xf20669ba, L:/127.0.0.1:34656 - R:/127.4.224.188:40437] using SASL/PLAIN
08:09:42.400 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:09:42.400 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=49), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.224.189:45505, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.224.190:36787, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.224.188:40437, [33ms] Sub RPC ConnectToMaster: received response from server master-127.4.224.189:45505: OK, [33ms] Sub RPC ConnectToMaster: received response from server master-127.4.224.190:36787: OK, [41ms] Sub RPC ConnectToMaster: received response from server master-127.4.224.188:40437: OK, deferred=null) after lookup
08:09:42.406 [DEBUG - main] (Connection.java:748) [peer master-127.4.9.126:44985(127.4.9.126:44985)] connecting to peer
08:09:42.412 [DEBUG - main] (Connection.java:748) [peer master-127.4.9.125:45723(127.4.9.125:45723)] connecting to peer
08:09:42.413 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.4.9.126:44985(127.4.9.126:44985)] Successfully connected to peer
08:09:42.419 [DEBUG - main] (Connection.java:748) [peer master-127.4.9.124:41733(127.4.9.124:41733)] connecting to peer
08:09:42.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:42.427 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.4.9.125:45723(127.4.9.125:45723)] Successfully connected to peer
08:09:42.428 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.4.9.124:41733(127.4.9.124:41733)] Successfully connected to peer
08:09:42.447 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.9.124
08:09:42.454 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.9.125
08:09:42.458 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.9.126
08:09:42.469 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:42.469 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:42.473 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x80faf0e5, L:/127.0.0.1:43730 - R:/127.4.9.126:44985] using SASL/PLAIN
08:09:42.476 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x48266cfd, L:/127.0.0.1:45100 - R:/127.4.9.125:45723] using SASL/PLAIN
08:09:42.482 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:42.489 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x69f70a86, L:/127.0.0.1:40252 - R:/127.4.9.124:41733] using SASL/PLAIN
08:09:42.494 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:09:42.494 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=91), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.9.126:44985, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.9.125:45723, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.9.124:41733, [72ms] Sub RPC ConnectToMaster: received response from server master-127.4.9.126:44985: OK, [73ms] Sub RPC ConnectToMaster: received response from server master-127.4.9.125:45723: OK, [87ms] Sub RPC ConnectToMaster: received response from server master-127.4.9.124:41733: OK, deferred=null) after lookup
08:09:42.502 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 6de1c5d6e18848f98421ddb9a0206801
08:09:42.507 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 575ff3b76e2c433182dc6c13ceccca59 for table 'replication_test_table' with partition [<start>, <end>)
08:09:42.507 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=575ff3b76e2c433182dc6c13ceccca59@[0a7023e11f684b96aa2d4965a85ddaa3(127.4.9.65:39865),17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705),f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907)[L]]}]
08:09:42.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.511135  5290 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34656:
08:09:42.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
08:09:42.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
08:09:42.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:42.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int8"
08:09:42.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT8
08:09:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:09:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:09:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:09:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int16"
08:09:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT16
08:09:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:09:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:09:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int32"
08:09:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:09:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:42.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int64"
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT64
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "bool"
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "float"
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: FLOAT
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:42.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "double"
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DOUBLE
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "string"
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "binary-array"
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BINARY
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:42.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:42.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:42.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:42.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "binary-bytebuffer"
08:09:42.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BINARY
08:09:42.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:42.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:42.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:09:42.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:09:42.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:42.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:42.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:42.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:42.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:42.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "null"
08:09:42.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:09:42.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:42.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "timestamp"
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: UNIXTIME_MICROS
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "decimal"
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DECIMAL32
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type_attributes {
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       precision: 5
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       scale: 3
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:09:42.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "varchar"
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: VARCHAR
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type_attributes {
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       length: 10
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "date"
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DATE
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\000\000\000\000\007\000\000\000\000"
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "int8"
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:09:42.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
08:09:42.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:42.520212  5290 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
08:09:42.527 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:42.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:42.554 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:42.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:42.674 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 16cb6bf6f4d643eea297d8fcccff08b6
08:09:42.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.759903  5692 tablet_service.cc:1511] Processing CreateTablet for tablet 00c766741b374f8193ab6ebd940ea4d2 (DEFAULT_TABLE table=replication_test_table [id=16cb6bf6f4d643eea297d8fcccff08b6]), partition=RANGE (int8) PARTITION UNBOUNDED
08:09:42.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.765265  5692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00c766741b374f8193ab6ebd940ea4d2. 1 dirs total, 0 dirs full, 0 dirs failed
08:09:42.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.774609  5890 tablet_service.cc:1511] Processing CreateTablet for tablet 00c766741b374f8193ab6ebd940ea4d2 (DEFAULT_TABLE table=replication_test_table [id=16cb6bf6f4d643eea297d8fcccff08b6]), partition=RANGE (int8) PARTITION UNBOUNDED
08:09:42.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.776943  5890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00c766741b374f8193ab6ebd940ea4d2. 1 dirs total, 0 dirs full, 0 dirs failed
08:09:42.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.795820  5543 tablet_service.cc:1511] Processing CreateTablet for tablet 00c766741b374f8193ab6ebd940ea4d2 (DEFAULT_TABLE table=replication_test_table [id=16cb6bf6f4d643eea297d8fcccff08b6]), partition=RANGE (int8) PARTITION UNBOUNDED
08:09:42.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.798590  5543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00c766741b374f8193ab6ebd940ea4d2. 1 dirs total, 0 dirs full, 0 dirs failed
08:09:42.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.802264  6045 tablet_bootstrap.cc:492] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533: Bootstrap starting.
08:09:42.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.811751  6045 tablet_bootstrap.cc:654] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533: Neither blocks nor log segments found. Creating new log.
08:09:42.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.814692  6045 log.cc:826] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533: Log is configured to *not* fsync() on all Append() calls
08:09:42.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.820317  6046 tablet_bootstrap.cc:492] T 00c766741b374f8193ab6ebd940ea4d2 P be6a60c33c2943c9973c8f63d1e4fb49: Bootstrap starting.
08:09:42.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.822559  6045 tablet_bootstrap.cc:492] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533: No bootstrap required, opened a new log
08:09:42.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.823140  6045 ts_tablet_manager.cc:1403] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.005s
08:09:42.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.830022  6046 tablet_bootstrap.cc:654] T 00c766741b374f8193ab6ebd940ea4d2 P be6a60c33c2943c9973c8f63d1e4fb49: Neither blocks nor log segments found. Creating new log.
08:09:42.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.833649  6046 log.cc:826] T 00c766741b374f8193ab6ebd940ea4d2 P be6a60c33c2943c9973c8f63d1e4fb49: Log is configured to *not* fsync() on all Append() calls
08:09:42.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.842605  6049 tablet_bootstrap.cc:492] T 00c766741b374f8193ab6ebd940ea4d2 P 0fedadaec47b41689759821a31ad4da5: Bootstrap starting.
08:09:42.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.845052  6046 tablet_bootstrap.cc:492] T 00c766741b374f8193ab6ebd940ea4d2 P be6a60c33c2943c9973c8f63d1e4fb49: No bootstrap required, opened a new log
08:09:42.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.845690  6046 ts_tablet_manager.cc:1403] T 00c766741b374f8193ab6ebd940ea4d2 P be6a60c33c2943c9973c8f63d1e4fb49: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.008s
08:09:42.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.853276  6049 tablet_bootstrap.cc:654] T 00c766741b374f8193ab6ebd940ea4d2 P 0fedadaec47b41689759821a31ad4da5: Neither blocks nor log segments found. Creating new log.
08:09:42.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.856529  6049 log.cc:826] T 00c766741b374f8193ab6ebd940ea4d2 P 0fedadaec47b41689759821a31ad4da5: Log is configured to *not* fsync() on all Append() calls
08:09:42.864 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:42.864 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:42.864 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:42.865 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:42.865 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:42.865 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:42.865 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:42.865 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:42.865 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:42.867 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:42.867 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:42.867 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:42.867 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:42.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.871224  6045 raft_consensus.cc:359] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6970736694d04ba2a93e80cda13d1533" member_type: VOTER last_known_addr { host: "127.4.224.130" port: 37197 } } peers { permanent_uuid: "0fedadaec47b41689759821a31ad4da5" member_type: VOTER last_known_addr { host: "127.4.224.129" port: 40841 } } peers { permanent_uuid: "be6a60c33c2943c9973c8f63d1e4fb49" member_type: VOTER last_known_addr { host: "127.4.224.131" port: 39813 } }
08:09:42.873 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:42.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.872396  6045 raft_consensus.cc:385] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:09:42.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.872720  6045 raft_consensus.cc:740] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6970736694d04ba2a93e80cda13d1533, State: Initialized, Role: FOLLOWER
08:09:42.874 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:42.874 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:42.874 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:42.874 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:42.874 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:42.874 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:42.874 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:42.874 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:42.874 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:42.874 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:42.874 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:42.875 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:42.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.876468  6049 tablet_bootstrap.cc:492] T 00c766741b374f8193ab6ebd940ea4d2 P 0fedadaec47b41689759821a31ad4da5: No bootstrap required, opened a new log
08:09:42.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.876192  6045 consensus_queue.cc:260] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6970736694d04ba2a93e80cda13d1533" member_type: VOTER last_known_addr { host: "127.4.224.130" port: 37197 } } peers { permanent_uuid: "0fedadaec47b41689759821a31ad4da5" member_type: VOTER last_known_addr { host: "127.4.224.129" port: 40841 } } peers { permanent_uuid: "be6a60c33c2943c9973c8f63d1e4fb49" member_type: VOTER last_known_addr { host: "127.4.224.131" port: 39813 } }
08:09:42.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.877100  6049 ts_tablet_manager.cc:1403] T 00c766741b374f8193ab6ebd940ea4d2 P 0fedadaec47b41689759821a31ad4da5: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.009s
08:09:42.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.880784  6046 raft_consensus.cc:359] T 00c766741b374f8193ab6ebd940ea4d2 P be6a60c33c2943c9973c8f63d1e4fb49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6970736694d04ba2a93e80cda13d1533" member_type: VOTER last_known_addr { host: "127.4.224.130" port: 37197 } } peers { permanent_uuid: "0fedadaec47b41689759821a31ad4da5" member_type: VOTER last_known_addr { host: "127.4.224.129" port: 40841 } } peers { permanent_uuid: "be6a60c33c2943c9973c8f63d1e4fb49" member_type: VOTER last_known_addr { host: "127.4.224.131" port: 39813 } }
08:09:42.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.881986  6046 raft_consensus.cc:385] T 00c766741b374f8193ab6ebd940ea4d2 P be6a60c33c2943c9973c8f63d1e4fb49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:09:42.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.882090  6045 ts_tablet_manager.cc:1434] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533: Time spent starting tablet: real 0.059s	user 0.042s	sys 0.001s
08:09:42.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.882314  6046 raft_consensus.cc:740] T 00c766741b374f8193ab6ebd940ea4d2 P be6a60c33c2943c9973c8f63d1e4fb49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be6a60c33c2943c9973c8f63d1e4fb49, State: Initialized, Role: FOLLOWER
08:09:42.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.883425  6046 consensus_queue.cc:260] T 00c766741b374f8193ab6ebd940ea4d2 P be6a60c33c2943c9973c8f63d1e4fb49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6970736694d04ba2a93e80cda13d1533" member_type: VOTER last_known_addr { host: "127.4.224.130" port: 37197 } } peers { permanent_uuid: "0fedadaec47b41689759821a31ad4da5" member_type: VOTER last_known_addr { host: "127.4.224.129" port: 40841 } } peers { permanent_uuid: "be6a60c33c2943c9973c8f63d1e4fb49" member_type: VOTER last_known_addr { host: "127.4.224.131" port: 39813 } }
08:09:42.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.888007  6046 ts_tablet_manager.cc:1434] T 00c766741b374f8193ab6ebd940ea4d2 P be6a60c33c2943c9973c8f63d1e4fb49: Time spent starting tablet: real 0.042s	user 0.033s	sys 0.007s
08:09:42.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:42.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.921484  6049 raft_consensus.cc:359] T 00c766741b374f8193ab6ebd940ea4d2 P 0fedadaec47b41689759821a31ad4da5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6970736694d04ba2a93e80cda13d1533" member_type: VOTER last_known_addr { host: "127.4.224.130" port: 37197 } } peers { permanent_uuid: "0fedadaec47b41689759821a31ad4da5" member_type: VOTER last_known_addr { host: "127.4.224.129" port: 40841 } } peers { permanent_uuid: "be6a60c33c2943c9973c8f63d1e4fb49" member_type: VOTER last_known_addr { host: "127.4.224.131" port: 39813 } }
08:09:42.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.922955  6049 raft_consensus.cc:385] T 00c766741b374f8193ab6ebd940ea4d2 P 0fedadaec47b41689759821a31ad4da5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:09:42.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.923193  6049 raft_consensus.cc:740] T 00c766741b374f8193ab6ebd940ea4d2 P 0fedadaec47b41689759821a31ad4da5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fedadaec47b41689759821a31ad4da5, State: Initialized, Role: FOLLOWER
08:09:42.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.924170  6049 consensus_queue.cc:260] T 00c766741b374f8193ab6ebd940ea4d2 P 0fedadaec47b41689759821a31ad4da5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6970736694d04ba2a93e80cda13d1533" member_type: VOTER last_known_addr { host: "127.4.224.130" port: 37197 } } peers { permanent_uuid: "0fedadaec47b41689759821a31ad4da5" member_type: VOTER last_known_addr { host: "127.4.224.129" port: 40841 } } peers { permanent_uuid: "be6a60c33c2943c9973c8f63d1e4fb49" member_type: VOTER last_known_addr { host: "127.4.224.131" port: 39813 } }
08:09:42.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.929008  6049 ts_tablet_manager.cc:1434] T 00c766741b374f8193ab6ebd940ea4d2 P 0fedadaec47b41689759821a31ad4da5: Time spent starting tablet: real 0.052s	user 0.020s	sys 0.019s
08:09:42.930 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:42.930 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:42.931 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:42.931 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:42.931 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:42.931 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:42.931 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:42.931 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:42.932 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:42.932 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:42.932 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:42.932 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:42.932 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:42.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:42.965099  5616 tablet.cc:2404] T 00c766741b374f8193ab6ebd940ea4d2 P 0fedadaec47b41689759821a31ad4da5: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:09:42.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.996654  6052 raft_consensus.cc:493] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:09:42.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:42.997452  6052 raft_consensus.cc:515] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6970736694d04ba2a93e80cda13d1533" member_type: VOTER last_known_addr { host: "127.4.224.130" port: 37197 } } peers { permanent_uuid: "0fedadaec47b41689759821a31ad4da5" member_type: VOTER last_known_addr { host: "127.4.224.129" port: 40841 } } peers { permanent_uuid: "be6a60c33c2943c9973c8f63d1e4fb49" member_type: VOTER last_known_addr { host: "127.4.224.131" port: 39813 } }
08:09:43.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:43.000859  6052 leader_election.cc:290] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fedadaec47b41689759821a31ad4da5 (127.4.224.129:40841), be6a60c33c2943c9973c8f63d1e4fb49 (127.4.224.131:39813)
08:09:43.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:43.021432  5961 tablet.cc:2404] T 00c766741b374f8193ab6ebd940ea4d2 P be6a60c33c2943c9973c8f63d1e4fb49: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:09:43.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:43.027153  5910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c766741b374f8193ab6ebd940ea4d2" candidate_uuid: "6970736694d04ba2a93e80cda13d1533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be6a60c33c2943c9973c8f63d1e4fb49" is_pre_election: true
08:09:43.028 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:43.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:43.028226  5910 raft_consensus.cc:2468] T 00c766741b374f8193ab6ebd940ea4d2 P be6a60c33c2943c9973c8f63d1e4fb49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6970736694d04ba2a93e80cda13d1533 in term 0.
08:09:43.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:43.030167  5564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c766741b374f8193ab6ebd940ea4d2" candidate_uuid: "6970736694d04ba2a93e80cda13d1533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fedadaec47b41689759821a31ad4da5" is_pre_election: true
08:09:43.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:43.030501  5648 leader_election.cc:304] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6970736694d04ba2a93e80cda13d1533, be6a60c33c2943c9973c8f63d1e4fb49; no voters: 
08:09:43.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:43.031153  5564 raft_consensus.cc:2468] T 00c766741b374f8193ab6ebd940ea4d2 P 0fedadaec47b41689759821a31ad4da5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6970736694d04ba2a93e80cda13d1533 in term 0.
08:09:43.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:43.031551  6052 raft_consensus.cc:2804] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:09:43.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:43.031976  6052 raft_consensus.cc:493] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:09:43.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:43.032361  6052 raft_consensus.cc:3060] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533 [term 0 FOLLOWER]: Advancing to term 1
08:09:43.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:43.038308  6052 raft_consensus.cc:515] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6970736694d04ba2a93e80cda13d1533" member_type: VOTER last_known_addr { host: "127.4.224.130" port: 37197 } } peers { permanent_uuid: "0fedadaec47b41689759821a31ad4da5" member_type: VOTER last_known_addr { host: "127.4.224.129" port: 40841 } } peers { permanent_uuid: "be6a60c33c2943c9973c8f63d1e4fb49" member_type: VOTER last_known_addr { host: "127.4.224.131" port: 39813 } }
08:09:43.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:43.040117  6052 leader_election.cc:290] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533 [CANDIDATE]: Term 1 election: Requested vote from peers 0fedadaec47b41689759821a31ad4da5 (127.4.224.129:40841), be6a60c33c2943c9973c8f63d1e4fb49 (127.4.224.131:39813)
08:09:43.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:43.041312  5910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c766741b374f8193ab6ebd940ea4d2" candidate_uuid: "6970736694d04ba2a93e80cda13d1533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be6a60c33c2943c9973c8f63d1e4fb49"
08:09:43.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:43.041458  5564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c766741b374f8193ab6ebd940ea4d2" candidate_uuid: "6970736694d04ba2a93e80cda13d1533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fedadaec47b41689759821a31ad4da5"
08:09:43.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:43.042021  5564 raft_consensus.cc:3060] T 00c766741b374f8193ab6ebd940ea4d2 P 0fedadaec47b41689759821a31ad4da5 [term 0 FOLLOWER]: Advancing to term 1
08:09:43.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:43.042034  5910 raft_consensus.cc:3060] T 00c766741b374f8193ab6ebd940ea4d2 P be6a60c33c2943c9973c8f63d1e4fb49 [term 0 FOLLOWER]: Advancing to term 1
08:09:43.047 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:43.047 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:43.047 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:43.048 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:43.048 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:43.048 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:43.048 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:43.048 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:43.048 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:43.048 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:43.048 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:43.048 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:43.049 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:43.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:43.050402  5910 raft_consensus.cc:2468] T 00c766741b374f8193ab6ebd940ea4d2 P be6a60c33c2943c9973c8f63d1e4fb49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6970736694d04ba2a93e80cda13d1533 in term 1.
08:09:43.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:43.051717  5648 leader_election.cc:304] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6970736694d04ba2a93e80cda13d1533, be6a60c33c2943c9973c8f63d1e4fb49; no voters: 
08:09:43.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:43.052881  6052 raft_consensus.cc:2804] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533 [term 1 FOLLOWER]: Leader election won for term 1
08:09:43.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:43.054 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:43.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:43.055421  6052 raft_consensus.cc:697] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533 [term 1 LEADER]: Becoming Leader. State: Replica: 6970736694d04ba2a93e80cda13d1533, State: Running, Role: LEADER
08:09:43.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:43.055822  5564 raft_consensus.cc:2468] T 00c766741b374f8193ab6ebd940ea4d2 P 0fedadaec47b41689759821a31ad4da5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6970736694d04ba2a93e80cda13d1533 in term 1.
08:09:43.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:43.057184  6052 consensus_queue.cc:237] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6970736694d04ba2a93e80cda13d1533" member_type: VOTER last_known_addr { host: "127.4.224.130" port: 37197 } } peers { permanent_uuid: "0fedadaec47b41689759821a31ad4da5" member_type: VOTER last_known_addr { host: "127.4.224.129" port: 40841 } } peers { permanent_uuid: "be6a60c33c2943c9973c8f63d1e4fb49" member_type: VOTER last_known_addr { host: "127.4.224.131" port: 39813 } }
08:09:43.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:43.075352  5764 tablet.cc:2404] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:09:43.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:43.081362  5290 catalog_manager.cc:5696] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6970736694d04ba2a93e80cda13d1533 (127.4.224.130). New cstate: current_term: 1 leader_uuid: "6970736694d04ba2a93e80cda13d1533" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6970736694d04ba2a93e80cda13d1533" member_type: VOTER last_known_addr { host: "127.4.224.130" port: 37197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fedadaec47b41689759821a31ad4da5" member_type: VOTER last_known_addr { host: "127.4.224.129" port: 40841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be6a60c33c2943c9973c8f63d1e4fb49" member_type: VOTER last_known_addr { host: "127.4.224.131" port: 39813 } health_report { overall_health: UNKNOWN } } }
08:09:43.104 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:43.104 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:43.104 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:43.104 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:43.104 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:43.104 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:43.105 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:43.105 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:43.105 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:43.105 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:43.105 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:43.105 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:43.105 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:43.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 0d2ddb76420639a9ec06ca05e894cb50 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 0d2ddb76420639a9ec06ca05e894cb50 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:43.134 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:43.134 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:43.134 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:43.135 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:43.135 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:43.135 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:43.135 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:43.135 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:43.135 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:43.135 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:43.135 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:43.135 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:43.136 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:43.225 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:43.225 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:43.225 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:43.225 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:43.225 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:43.225 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:43.225 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:43.225 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:43.225 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:43.226 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:43.226 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:43.226 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:43.226 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:43.226 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:43.226 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:43.226 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:43.226 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:43.226 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:43.226 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:43.226 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:43.226 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:43.226 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:43.226 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:43.226 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:43.226 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:43.226 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:43.227 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=26626), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [11ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [12ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [12ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [12ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [22ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [23ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [50ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [51ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [52ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [52ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [63ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [63ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [63ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [82ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [102ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [102ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [122ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [122ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [122ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [123ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [221ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [222ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [223ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [223ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [402ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [402ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [402ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [402ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [841ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [843ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [844ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [844ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [844ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1281ms] refreshing cache from master, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1284ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2501ms] refreshing cache from master, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2502ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [5661ms] refreshing cache from master, [5661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [5661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [5662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [5663ms] too many traces: truncated at 100 traces, deferred=Deferred@1081776483(state=PENDING, result=null, callback=(continuation of Deferred@334291289 after retry RPC after error@1005209963) -> (continuation of Deferred@48670624 after retry RPC after error@373524254) -> (continuation of Deferred@1657887398 after retry RPC after error@186250886) -> (continuation of Deferred@1014340578 after retry RPC after error@914657285) -> (continuation of Deferred@1592322073 after retry RPC after error@436312196) -> (continuation of Deferred@171682477 after retry RPC after error@413996887) -> (continuation of Deferred@27036795 after retry RPC after error@399503732) -> (continuation of Deferred@1081495522 after retry RPC after error@814874388) -> (continuation of Deferred@1435189801 after retry RPC after error@1025990077) -> (continuation of Deferred@1339825316 after retry RPC after error@1888101140) -> (continuation of Deferred@2132786470 after retry RPC after error@2018692557) -> (continuation of Deferred@1472517983 after retry RPC after error@1987562544) -> (continuation of Deferred@1946401109 after retry RPC after error@441532093) -> (continuation of Deferred@1801354375 after retry RPC after error@595606416) -> (continuation of Deferred@1252059044 after retry RPC after error@1494715547) -> (continuation of Deferred@1102408058 after retry RPC after error@1674286695) -> (continuation of Deferred@781963389 after retry RPC after error@1267593825) -> (continuation of Deferred@555334867 after retry RPC after error@517893689) -> (continuation of Deferred@1849056679 after retry RPC after error@1242346746) -> (continuation of Deferred@639592012 after retry RPC after error@1272806160) -> (continuation of Deferred@400219305 after retry RPC after error@945689036) -> (continuation of Deferred@1697529229 after retry RPC after error@1158401987), errback=(continuation of Deferred@334291289 after retry RPC after error@1005209963) -> (continuation of Deferred@48670624 after retry RPC after error@373524254) -> (continuation of Deferred@1657887398 after retry RPC after error@186250886) -> (continuation of Deferred@1014340578 after retry RPC after error@914657285) -> (continuation of Deferred@1592322073 after retry RPC after error@436312196) -> (continuation of Deferred@171682477 after retry RPC after error@413996887) -> (continuation of Deferred@27036795 after retry RPC after error@399503732) -> (continuation of Deferred@1081495522 after retry RPC after error@814874388) -> (continuation of Deferred@1435189801 after retry RPC after error@1025990077) -> (continuation of Deferred@1339825316 after retry RPC after error@1888101140) -> (continuation of Deferred@2132786470 after retry RPC after error@2018692557) -> (continuation of Deferred@1472517983 after retry RPC after error@1987562544) -> (continuation of Deferred@1946401109 after retry RPC after error@441532093) -> (continuation of Deferred@1801354375 after retry RPC after error@595606416) -> (continuation of Deferred@1252059044 after retry RPC after error@1494715547) -> (continuation of Deferred@1102408058 after retry RPC after error@1674286695) -> (continuation of Deferred@781963389 after retry RPC after error@1267593825) -> (continuation of Deferred@555334867 after retry RPC after error@517893689) -> (continuation of Deferred@1849056679 after retry RPC after error@1242346746) -> (continuation of Deferred@639592012 after retry RPC after error@1272806160) -> (continuation of Deferred@400219305 after retry RPC after error@945689036) -> (continuation of Deferred@1697529229 after retry RPC after error@1158401987)))
08:09:43.230 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
08:09:43.230 [WARN - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=26626), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [11ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [12ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [12ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [12ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [22ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [23ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [50ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [51ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [52ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [52ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [63ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [63ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [63ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [82ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [102ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [102ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [122ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [122ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [122ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [123ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [221ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [222ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [223ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [223ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [402ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [402ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [402ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [402ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [841ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [843ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [844ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [844ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [844ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1281ms] refreshing cache from master, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1284ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2501ms] refreshing cache from master, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2502ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [5661ms] refreshing cache from master, [5661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [5661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [5662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [5663ms] too many traces: truncated at 100 traces, deferred=Deferred@1081776483(state=PENDING, result=null, callback=(continuation of Deferred@334291289 after retry RPC after error@1005209963) -> (continuation of Deferred@48670624 after retry RPC after error@373524254) -> (continuation of Deferred@1657887398 after retry RPC after error@186250886) -> (continuation of Deferred@1014340578 after retry RPC after error@914657285) -> (continuation of Deferred@1592322073 after retry RPC after error@436312196) -> (continuation of Deferred@171682477 after retry RPC after error@413996887) -> (continuation of Deferred@27036795 after retry RPC after error@399503732) -> (continuation of Deferred@1081495522 after retry RPC after error@814874388) -> (continuation of Deferred@1435189801 after retry RPC after error@1025990077) -> (continuation of Deferred@1339825316 after retry RPC after error@1888101140) -> (continuation of Deferred@2132786470 after retry RPC after error@2018692557) -> (continuation of Deferred@1472517983 after retry RPC after error@1987562544) -> (continuation of Deferred@1946401109 after retry RPC after error@441532093) -> (continuation of Deferred@1801354375 after retry RPC after error@595606416) -> (continuation of Deferred@1252059044 after retry RPC after error@1494715547) -> (continuation of Deferred@1102408058 after retry RPC after error@1674286695) -> (continuation of Deferred@781963389 after retry RPC after error@1267593825) -> (continuation of Deferred@555334867 after retry RPC after error@517893689) -> (continuation of Deferred@1849056679 after retry RPC after error@1242346746) -> (continuation of Deferred@639592012 after retry RPC after error@1272806160) -> (continuation of Deferred@400219305 after retry RPC after error@945689036) -> (continuation of Deferred@1697529229 after retry RPC after error@1158401987), errback=(continuation of Deferred@334291289 after retry RPC after error@1005209963) -> (continuation of Deferred@48670624 after retry RPC after error@373524254) -> (continuation of Deferred@1657887398 after retry RPC after error@186250886) -> (continuation of Deferred@1014340578 after retry RPC after error@914657285) -> (continuation of Deferred@1592322073 after retry RPC after error@436312196) -> (continuation of Deferred@171682477 after retry RPC after error@413996887) -> (continuation of Deferred@27036795 after retry RPC after error@399503732) -> (continuation of Deferred@1081495522 after retry RPC after error@814874388) -> (continuation of Deferred@1435189801 after retry RPC after error@1025990077) -> (continuation of Deferred@1339825316 after retry RPC after error@1888101140) -> (continuation of Deferred@2132786470 after retry RPC after error@2018692557) -> (continuation of Deferred@1472517983 after retry RPC after error@1987562544) -> (continuation of Deferred@1946401109 after retry RPC after error@441532093) -> (continuation of Deferred@1801354375 after retry RPC after error@595606416) -> (continuation of Deferred@1252059044 after retry RPC after error@1494715547) -> (continuation of Deferred@1102408058 after retry RPC after error@1674286695) -> (continuation of Deferred@781963389 after retry RPC after error@1267593825) -> (continuation of Deferred@555334867 after retry RPC after error@517893689) -> (continuation of Deferred@1849056679 after retry RPC after error@1242346746) -> (continuation of Deferred@639592012 after retry RPC after error@1272806160) -> (continuation of Deferred@400219305 after retry RPC after error@945689036) -> (continuation of Deferred@1697529229 after retry RPC after error@1158401987)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.200.126:43511
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:43.234 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_6).
08:09:43.236 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#6 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_6.
08:09:43.238 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from INITIALIZING to FAILED on 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=26626), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [11ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [12ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [12ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [12ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [22ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [23ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [50ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [51ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [52ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [52ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [63ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [63ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [63ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [82ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [101ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [102ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [102ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [122ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [122ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [122ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [123ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [221ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [222ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [223ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [223ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [402ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [402ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [402ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [402ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [841ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [843ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [844ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [844ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [844ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1281ms] refreshing cache from master, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1284ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2501ms] refreshing cache from master, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2502ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [5661ms] refreshing cache from master, [5661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [5661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [5662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [5663ms] too many traces: truncated at 100 traces, deferred=Deferred@1081776483(state=PENDING, result=null, callback=(continuation of Deferred@334291289 after retry RPC after error@1005209963) -> (continuation of Deferred@48670624 after retry RPC after error@373524254) -> (continuation of Deferred@1657887398 after retry RPC after error@186250886) -> (continuation of Deferred@1014340578 after retry RPC after error@914657285) -> (continuation of Deferred@1592322073 after retry RPC after error@436312196) -> (continuation of Deferred@171682477 after retry RPC after error@413996887) -> (continuation of Deferred@27036795 after retry RPC after error@399503732) -> (continuation of Deferred@1081495522 after retry RPC after error@814874388) -> (continuation of Deferred@1435189801 after retry RPC after error@1025990077) -> (continuation of Deferred@1339825316 after retry RPC after error@1888101140) -> (continuation of Deferred@2132786470 after retry RPC after error@2018692557) -> (continuation of Deferred@1472517983 after retry RPC after error@1987562544) -> (continuation of Deferred@1946401109 after retry RPC after error@441532093) -> (continuation of Deferred@1801354375 after retry RPC after error@595606416) -> (continuation of Deferred@1252059044 after retry RPC after error@1494715547) -> (continuation of Deferred@1102408058 after retry RPC after error@1674286695) -> (continuation of Deferred@781963389 after retry RPC after error@1267593825) -> (continuation of Deferred@555334867 after retry RPC after error@517893689) -> (continuation of Deferred@1849056679 after retry RPC after error@1242346746) -> (continuation of Deferred@639592012 after retry RPC after error@1272806160) -> (continuation of Deferred@400219305 after retry RPC after error@945689036) -> (continuation of Deferred@1697529229 after retry RPC after error@1158401987), errback=(continuation of Deferred@334291289 after retry RPC after error@1005209963) -> (continuation of Deferred@48670624 after retry RPC after error@373524254) -> (continuation of Deferred@1657887398 after retry RPC after error@186250886) -> (continuation of Deferred@1014340578 after retry RPC after error@914657285) -> (continuation of Deferred@1592322073 after retry RPC after error@436312196) -> (continuation of Deferred@171682477 after retry RPC after error@413996887) -> (continuation of Deferred@27036795 after retry RPC after error@399503732) -> (continuation of Deferred@1081495522 after retry RPC after error@814874388) -> (continuation of Deferred@1435189801 after retry RPC after error@1025990077) -> (continuation of Deferred@1339825316 after retry RPC after error@1888101140) -> (continuation of Deferred@2132786470 after retry RPC after error@2018692557) -> (continuation of Deferred@1472517983 after retry RPC after error@1987562544) -> (continuation of Deferred@1946401109 after retry RPC after error@441532093) -> (continuation of Deferred@1801354375 after retry RPC after error@595606416) -> (continuation of Deferred@1252059044 after retry RPC after error@1494715547) -> (continuation of Deferred@1102408058 after retry RPC after error@1674286695) -> (continuation of Deferred@781963389 after retry RPC after error@1267593825) -> (continuation of Deferred@555334867 after retry RPC after error@517893689) -> (continuation of Deferred@1849056679 after retry RPC after error@1242346746) -> (continuation of Deferred@639592012 after retry RPC after error@1272806160) -> (continuation of Deferred@400219305 after retry RPC after error@945689036) -> (continuation of Deferred@1697529229 after retry RPC after error@1158401987)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.200.126:43511
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:43.245 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#6) of source Source: KuduSource.
08:09:43.245 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:09:43.251 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_0_6.
08:09:43.251 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (0d2ddb76420639a9ec06ca05e894cb50) switched from state RUNNING to RESTARTING.
08:09:43.265 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:43.265 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:43.265 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:43.266 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:43.266 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:43.266 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:43.266 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:43.266 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:43.266 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:43.266 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:43.267 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:43.267 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:43.267 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:43.285 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:43.285 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:43.285 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:43.286 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:43.286 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:43.286 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:43.286 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:43.286 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:43.286 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:43.286 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:43.286 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:43.286 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:43.286 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:43.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:43.423 [DEBUG - main] (Connection.java:575) [peer master-127.4.9.126:44985(127.4.9.126:44985)] disconnecting while in state READY
08:09:43.423 [DEBUG - main] (Connection.java:575) [peer master-127.4.9.124:41733(127.4.9.124:41733)] disconnecting while in state READY
08:09:43.423 [DEBUG - main] (Connection.java:575) [peer master-127.4.9.125:45723(127.4.9.125:45723)] disconnecting while in state READY
08:09:43.424 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.4.9.126:44985(127.4.9.126:44985)] handling channelInactive
08:09:43.424 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.9.126:44985(127.4.9.126:44985)] cleaning up while in state READY due to: connection closed
08:09:43.425 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:09:43.424 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.4.9.124:41733(127.4.9.124:41733)] handling channelInactive
08:09:43.428 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
08:09:43.428 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.9.124:41733(127.4.9.124:41733)] cleaning up while in state READY due to: connection closed
08:09:43.429 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-2
08:09:43.438 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.4.9.125:45723(127.4.9.125:45723)] handling channelInactive
08:09:43.438 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.9.125:45723(127.4.9.125:45723)] cleaning up while in state READY due to: connection closed
08:09:43.438 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-1
08:09:43.439 [DEBUG - main] (Connection.java:575) [peer master-127.4.224.190:36787(127.4.224.190:36787)] disconnecting while in state READY
08:09:43.439 [DEBUG - main] (Connection.java:575) [peer master-127.4.224.188:40437(127.4.224.188:40437)] disconnecting while in state READY
08:09:43.439 [DEBUG - main] (Connection.java:575) [peer master-127.4.224.189:45505(127.4.224.189:45505)] disconnecting while in state READY
08:09:43.439 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.4.224.189:45505(127.4.224.189:45505)] handling channelInactive
08:09:43.440 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.224.189:45505(127.4.224.189:45505)] cleaning up while in state READY due to: connection closed
08:09:43.442 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:09:43.442 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.4.224.188:40437(127.4.224.188:40437)] handling channelInactive
08:09:43.444 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.224.188:40437(127.4.224.188:40437)] cleaning up while in state READY due to: connection closed
08:09:43.444 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-2
08:09:43.444 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:09:43.458 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.4.224.190:36787(127.4.224.190:36787)] handling channelInactive
08:09:43.458 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.224.190:36787(127.4.224.190:36787)] cleaning up while in state READY due to: connection closed
08:09:43.458 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-1
08:09:43.461 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:09:43.461 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
08:09:43.461 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
08:09:43.462 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:09:43.462 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:09:43.462 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
08:09:43.473 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
08:09:43.473 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
08:09:43.473 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
08:09:43.473 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
08:09:43.474 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
08:09:43.474 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
08:09:43.474 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
08:09:43.528 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:43.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:43.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:43.561 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:43.562 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:43.562 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:43.562 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:43.562 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:43.562 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:43.562 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:43.562 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:43.562 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:43.562 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:43.563 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:43.563 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:43.563 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:43.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:43.624681  6068 consensus_queue.cc:1048] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be6a60c33c2943c9973c8f63d1e4fb49" member_type: VOTER last_known_addr { host: "127.4.224.131" port: 39813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:09:43.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:43.635321  6068 consensus_queue.cc:1048] T 00c766741b374f8193ab6ebd940ea4d2 P 6970736694d04ba2a93e80cda13d1533 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fedadaec47b41689759821a31ad4da5" member_type: VOTER last_known_addr { host: "127.4.224.129" port: 40841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:09:43.666 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:43.666 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:43.667 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:43.667 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:43.667 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:43.667 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:43.668 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:43.668 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:43.668 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:43.668 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:43.668 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:43.669 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:43.669 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:43.807 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
08:09:43.867 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
08:09:43.868 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
08:09:43.868 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
08:09:43.884 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
08:09:43.884 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:43.884 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:43.884 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:43.885 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:43.885 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:43.886 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:43.886 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:43.886 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:43.886 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:43.887 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:43.887 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:43.887 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:43.887 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:43.892 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:43.892 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:43.893 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:43.893 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:43.893 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:43.893 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:43.894 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:43.894 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:43.894 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:43.894 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:43.894 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:43.894 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:43.895 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:43.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:43.929 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:43.930 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:43.930 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:43.930 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:43.930 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:43.930 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:43.930 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:43.930 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:43.930 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:43.930 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:43.931 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:43.931 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:43.931 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:43.944 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:43.944 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:43.944 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:43.944 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:43.944 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:43.944 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:43.945 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:43.945 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:43.945 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:43.945 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:43.945 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:43.945 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:43.945 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:44.051 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:44.056 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:44.056 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:44.057 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:44.057 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:44.057 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:44.057 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:44.058 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:44.058 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:44.058 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:44.058 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:44.058 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:44.059 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:44.059 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:44.059 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:44.059 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:44.103 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:44.103 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:44.103 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:44.104 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:44.104 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:44.104 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:44.104 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:44.104 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:44.104 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:44.105 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:44.105 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:44.105 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:44.105 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:44.111 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:44.111 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:44.111 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:44.112 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:44.112 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:44.112 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:44.112 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:44.112 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:44.112 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:44.112 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:44.112 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:44.112 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:44.113 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:44.120 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:44.121 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:44.121 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:44.121 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:44.121 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:44.121 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:44.121 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:44.121 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:44.122 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:44.122 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:44.122 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:44.122 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:44.122 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:44.154 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:44.154 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:44.154 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:44.155 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:44.155 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:44.155 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:44.155 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:44.155 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:44.156 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:44.156 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:44.156 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:44.156 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:44.156 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:44.157 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=27526), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [3ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [5ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [6ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [6ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [17ms] refreshing cache from master, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [19ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [21ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [35ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [35ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [57ms] refreshing cache from master, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [59ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [59ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [60ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [60ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [77ms] refreshing cache from master, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [78ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [78ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [79ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [79ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [98ms] refreshing cache from master, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [98ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [98ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [98ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [98ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [117ms] refreshing cache from master, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [118ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [118ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [118ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [118ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [177ms] refreshing cache from master, [177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [178ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [178ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [179ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [179ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [297ms] refreshing cache from master, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [298ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [298ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [298ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [298ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [298ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [299ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [498ms] refreshing cache from master, [498ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [498ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [498ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [499ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [499ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [499ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [499ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [678ms] refreshing cache from master, [678ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [678ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [678ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [679ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [680ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [680ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [681ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1017ms] refreshing cache from master, [1017ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1018ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1018ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1019ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1019ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1019ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1020ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1538ms] refreshing cache from master, [1538ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1538ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1538ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1539ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1540ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1541ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1541ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3377ms] refreshing cache from master, [3378ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [3378ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [3378ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [3379ms] too many traces: truncated at 100 traces, deferred=Deferred@1961749048(state=PENDING, result=null, callback=(continuation of Deferred@551028992 after retry RPC after error@1124419065) -> (continuation of Deferred@1121192920 after retry RPC after error@1509131664) -> (continuation of Deferred@956503975 after retry RPC after error@1354807283) -> (continuation of Deferred@841542904 after retry RPC after error@1999773736) -> (continuation of Deferred@1454227270 after retry RPC after error@50849103) -> (continuation of Deferred@1992136443 after retry RPC after error@275303268) -> (continuation of Deferred@721682848 after retry RPC after error@395682834) -> (continuation of Deferred@218489429 after retry RPC after error@1541417850) -> (continuation of Deferred@1348610215 after retry RPC after error@1785574285) -> (continuation of Deferred@1222173663 after retry RPC after error@305773125) -> (continuation of Deferred@1407164341 after retry RPC after error@1412022168) -> (continuation of Deferred@1541433561 after retry RPC after error@72620658) -> (continuation of Deferred@735645562 after retry RPC after error@840282342) -> (continuation of Deferred@1793827037 after retry RPC after error@1321775224) -> (continuation of Deferred@755614724 after retry RPC after error@847565763) -> (continuation of Deferred@98463750 after retry RPC after error@245259189) -> (continuation of Deferred@1842644870 after retry RPC after error@2044349236) -> (continuation of Deferred@267536969 after retry RPC after error@1942875121) -> (continuation of Deferred@980200121 after retry RPC after error@298112299) -> (continuation of Deferred@209282392 after retry RPC after error@276268357) -> (continuation of Deferred@1334959248 after retry RPC after error@2018190788) -> (continuation of Deferred@1063246896 after retry RPC after error@330181427) -> (continuation of Deferred@1385828490 after retry RPC after error@1943955992) -> (continuation of Deferred@849450511 after retry RPC after error@1354028251) -> (continuation of Deferred@1386778631 after retry RPC after error@1378266848), errback=(continuation of Deferred@551028992 after retry RPC after error@1124419065) -> (continuation of Deferred@1121192920 after retry RPC after error@1509131664) -> (continuation of Deferred@956503975 after retry RPC after error@1354807283) -> (continuation of Deferred@841542904 after retry RPC after error@1999773736) -> (continuation of Deferred@1454227270 after retry RPC after error@50849103) -> (continuation of Deferred@1992136443 after retry RPC after error@275303268) -> (continuation of Deferred@721682848 after retry RPC after error@395682834) -> (continuation of Deferred@218489429 after retry RPC after error@1541417850) -> (continuation of Deferred@1348610215 after retry RPC after error@1785574285) -> (continuation of Deferred@1222173663 after retry RPC after error@305773125) -> (continuation of Deferred@1407164341 after retry RPC after error@1412022168) -> (continuation of Deferred@1541433561 after retry RPC after error@72620658) -> (continuation of Deferred@735645562 after retry RPC after error@840282342) -> (continuation of Deferred@1793827037 after retry RPC after error@1321775224) -> (continuation of Deferred@755614724 after retry RPC after error@847565763) -> (continuation of Deferred@98463750 after retry RPC after error@245259189) -> (continuation of Deferred@1842644870 after retry RPC after error@2044349236) -> (continuation of Deferred@267536969 after retry RPC after error@1942875121) -> (continuation of Deferred@980200121 after retry RPC after error@298112299) -> (continuation of Deferred@209282392 after retry RPC after error@276268357) -> (continuation of Deferred@1334959248 after retry RPC after error@2018190788) -> (continuation of Deferred@1063246896 after retry RPC after error@330181427) -> (continuation of Deferred@1385828490 after retry RPC after error@1943955992) -> (continuation of Deferred@849450511 after retry RPC after error@1354028251) -> (continuation of Deferred@1386778631 after retry RPC after error@1378266848)))
08:09:44.160 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
08:09:44.161 [WARN - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=27526), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [3ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [5ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [6ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [6ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [17ms] refreshing cache from master, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [19ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [21ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [35ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [35ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [57ms] refreshing cache from master, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [59ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [59ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [60ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [60ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [77ms] refreshing cache from master, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [78ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [78ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [79ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [79ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [98ms] refreshing cache from master, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [98ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [98ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [98ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [98ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [117ms] refreshing cache from master, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [118ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [118ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [118ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [118ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [177ms] refreshing cache from master, [177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [178ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [178ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [179ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [179ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [297ms] refreshing cache from master, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [298ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [298ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [298ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [298ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [298ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [299ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [498ms] refreshing cache from master, [498ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [498ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [498ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [499ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [499ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [499ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [499ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [678ms] refreshing cache from master, [678ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [678ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [678ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [679ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [680ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [680ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [681ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1017ms] refreshing cache from master, [1017ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1018ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1018ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1019ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1019ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1019ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1020ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1538ms] refreshing cache from master, [1538ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1538ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1538ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1539ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1540ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1541ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1541ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3377ms] refreshing cache from master, [3378ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [3378ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [3378ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [3379ms] too many traces: truncated at 100 traces, deferred=Deferred@1961749048(state=PENDING, result=null, callback=(continuation of Deferred@551028992 after retry RPC after error@1124419065) -> (continuation of Deferred@1121192920 after retry RPC after error@1509131664) -> (continuation of Deferred@956503975 after retry RPC after error@1354807283) -> (continuation of Deferred@841542904 after retry RPC after error@1999773736) -> (continuation of Deferred@1454227270 after retry RPC after error@50849103) -> (continuation of Deferred@1992136443 after retry RPC after error@275303268) -> (continuation of Deferred@721682848 after retry RPC after error@395682834) -> (continuation of Deferred@218489429 after retry RPC after error@1541417850) -> (continuation of Deferred@1348610215 after retry RPC after error@1785574285) -> (continuation of Deferred@1222173663 after retry RPC after error@305773125) -> (continuation of Deferred@1407164341 after retry RPC after error@1412022168) -> (continuation of Deferred@1541433561 after retry RPC after error@72620658) -> (continuation of Deferred@735645562 after retry RPC after error@840282342) -> (continuation of Deferred@1793827037 after retry RPC after error@1321775224) -> (continuation of Deferred@755614724 after retry RPC after error@847565763) -> (continuation of Deferred@98463750 after retry RPC after error@245259189) -> (continuation of Deferred@1842644870 after retry RPC after error@2044349236) -> (continuation of Deferred@267536969 after retry RPC after error@1942875121) -> (continuation of Deferred@980200121 after retry RPC after error@298112299) -> (continuation of Deferred@209282392 after retry RPC after error@276268357) -> (continuation of Deferred@1334959248 after retry RPC after error@2018190788) -> (continuation of Deferred@1063246896 after retry RPC after error@330181427) -> (continuation of Deferred@1385828490 after retry RPC after error@1943955992) -> (continuation of Deferred@849450511 after retry RPC after error@1354028251) -> (continuation of Deferred@1386778631 after retry RPC after error@1378266848), errback=(continuation of Deferred@551028992 after retry RPC after error@1124419065) -> (continuation of Deferred@1121192920 after retry RPC after error@1509131664) -> (continuation of Deferred@956503975 after retry RPC after error@1354807283) -> (continuation of Deferred@841542904 after retry RPC after error@1999773736) -> (continuation of Deferred@1454227270 after retry RPC after error@50849103) -> (continuation of Deferred@1992136443 after retry RPC after error@275303268) -> (continuation of Deferred@721682848 after retry RPC after error@395682834) -> (continuation of Deferred@218489429 after retry RPC after error@1541417850) -> (continuation of Deferred@1348610215 after retry RPC after error@1785574285) -> (continuation of Deferred@1222173663 after retry RPC after error@305773125) -> (continuation of Deferred@1407164341 after retry RPC after error@1412022168) -> (continuation of Deferred@1541433561 after retry RPC after error@72620658) -> (continuation of Deferred@735645562 after retry RPC after error@840282342) -> (continuation of Deferred@1793827037 after retry RPC after error@1321775224) -> (continuation of Deferred@755614724 after retry RPC after error@847565763) -> (continuation of Deferred@98463750 after retry RPC after error@245259189) -> (continuation of Deferred@1842644870 after retry RPC after error@2044349236) -> (continuation of Deferred@267536969 after retry RPC after error@1942875121) -> (continuation of Deferred@980200121 after retry RPC after error@298112299) -> (continuation of Deferred@209282392 after retry RPC after error@276268357) -> (continuation of Deferred@1334959248 after retry RPC after error@2018190788) -> (continuation of Deferred@1063246896 after retry RPC after error@330181427) -> (continuation of Deferred@1385828490 after retry RPC after error@1943955992) -> (continuation of Deferred@849450511 after retry RPC after error@1354028251) -> (continuation of Deferred@1386778631 after retry RPC after error@1378266848)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.200.124:34439
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:44.168 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_6).
08:09:44.171 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#6 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_6.
08:09:44.175 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from INITIALIZING to FAILED on 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=27526), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [3ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [5ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [6ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [6ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [17ms] refreshing cache from master, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [19ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [21ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [35ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [35ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [57ms] refreshing cache from master, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [59ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [59ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [60ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [60ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [77ms] refreshing cache from master, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [78ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [78ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [79ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [79ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [98ms] refreshing cache from master, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [98ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [98ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [98ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [98ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [117ms] refreshing cache from master, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [118ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [118ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [118ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [118ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [177ms] refreshing cache from master, [177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [178ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [178ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [179ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [179ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [297ms] refreshing cache from master, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [298ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [298ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [298ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [298ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [298ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [299ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [498ms] refreshing cache from master, [498ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [498ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [498ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [499ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [499ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [499ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [499ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [678ms] refreshing cache from master, [678ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [678ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [678ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [679ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [680ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [680ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [681ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1017ms] refreshing cache from master, [1017ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1018ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1018ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1019ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1019ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1019ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1020ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1538ms] refreshing cache from master, [1538ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1538ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1538ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1539ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1540ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1541ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1541ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3377ms] refreshing cache from master, [3378ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [3378ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [3378ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [3379ms] too many traces: truncated at 100 traces, deferred=Deferred@1961749048(state=PENDING, result=null, callback=(continuation of Deferred@551028992 after retry RPC after error@1124419065) -> (continuation of Deferred@1121192920 after retry RPC after error@1509131664) -> (continuation of Deferred@956503975 after retry RPC after error@1354807283) -> (continuation of Deferred@841542904 after retry RPC after error@1999773736) -> (continuation of Deferred@1454227270 after retry RPC after error@50849103) -> (continuation of Deferred@1992136443 after retry RPC after error@275303268) -> (continuation of Deferred@721682848 after retry RPC after error@395682834) -> (continuation of Deferred@218489429 after retry RPC after error@1541417850) -> (continuation of Deferred@1348610215 after retry RPC after error@1785574285) -> (continuation of Deferred@1222173663 after retry RPC after error@305773125) -> (continuation of Deferred@1407164341 after retry RPC after error@1412022168) -> (continuation of Deferred@1541433561 after retry RPC after error@72620658) -> (continuation of Deferred@735645562 after retry RPC after error@840282342) -> (continuation of Deferred@1793827037 after retry RPC after error@1321775224) -> (continuation of Deferred@755614724 after retry RPC after error@847565763) -> (continuation of Deferred@98463750 after retry RPC after error@245259189) -> (continuation of Deferred@1842644870 after retry RPC after error@2044349236) -> (continuation of Deferred@267536969 after retry RPC after error@1942875121) -> (continuation of Deferred@980200121 after retry RPC after error@298112299) -> (continuation of Deferred@209282392 after retry RPC after error@276268357) -> (continuation of Deferred@1334959248 after retry RPC after error@2018190788) -> (continuation of Deferred@1063246896 after retry RPC after error@330181427) -> (continuation of Deferred@1385828490 after retry RPC after error@1943955992) -> (continuation of Deferred@849450511 after retry RPC after error@1354028251) -> (continuation of Deferred@1386778631 after retry RPC after error@1378266848), errback=(continuation of Deferred@551028992 after retry RPC after error@1124419065) -> (continuation of Deferred@1121192920 after retry RPC after error@1509131664) -> (continuation of Deferred@956503975 after retry RPC after error@1354807283) -> (continuation of Deferred@841542904 after retry RPC after error@1999773736) -> (continuation of Deferred@1454227270 after retry RPC after error@50849103) -> (continuation of Deferred@1992136443 after retry RPC after error@275303268) -> (continuation of Deferred@721682848 after retry RPC after error@395682834) -> (continuation of Deferred@218489429 after retry RPC after error@1541417850) -> (continuation of Deferred@1348610215 after retry RPC after error@1785574285) -> (continuation of Deferred@1222173663 after retry RPC after error@305773125) -> (continuation of Deferred@1407164341 after retry RPC after error@1412022168) -> (continuation of Deferred@1541433561 after retry RPC after error@72620658) -> (continuation of Deferred@735645562 after retry RPC after error@840282342) -> (continuation of Deferred@1793827037 after retry RPC after error@1321775224) -> (continuation of Deferred@755614724 after retry RPC after error@847565763) -> (continuation of Deferred@98463750 after retry RPC after error@245259189) -> (continuation of Deferred@1842644870 after retry RPC after error@2044349236) -> (continuation of Deferred@267536969 after retry RPC after error@1942875121) -> (continuation of Deferred@980200121 after retry RPC after error@298112299) -> (continuation of Deferred@209282392 after retry RPC after error@276268357) -> (continuation of Deferred@1334959248 after retry RPC after error@2018190788) -> (continuation of Deferred@1063246896 after retry RPC after error@330181427) -> (continuation of Deferred@1385828490 after retry RPC after error@1943955992) -> (continuation of Deferred@849450511 after retry RPC after error@1354028251) -> (continuation of Deferred@1386778631 after retry RPC after error@1378266848)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.200.124:34439
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:44.181 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#6) of source Source: KuduSource.
08:09:44.181 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:09:44.181 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_3_6.
08:09:44.191 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:44.192 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:44.192 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:44.192 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:44.192 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:44.192 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:44.192 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:44.192 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:44.192 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:44.192 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:44.192 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:44.192 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:44.193 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:44.193 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27588), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [5ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [7ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [7ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [16ms] refreshing cache from master, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [17ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [18ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [18ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [18ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [36ms] refreshing cache from master, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [39ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [42ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [42ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [43ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [56ms] refreshing cache from master, [56ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [56ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [57ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [57ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [57ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [57ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [76ms] refreshing cache from master, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [76ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [76ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [76ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [77ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [95ms] refreshing cache from master, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [96ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [96ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [96ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [96ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [136ms] refreshing cache from master, [136ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [137ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [137ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [138ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [138ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [196ms] refreshing cache from master, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [197ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [197ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [198ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [198ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [275ms] refreshing cache from master, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [277ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [277ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [278ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [278ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [278ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [516ms] refreshing cache from master, [516ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [517ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [517ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [518ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [519ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [520ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [520ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [876ms] refreshing cache from master, [876ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [877ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [877ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [878ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [879ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [879ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [880ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1598ms] refreshing cache from master, [1598ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1598ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1598ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1598ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1599ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1599ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1599ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3716ms] refreshing cache from master, [3716ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [3716ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [3716ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [3716ms] too many traces: truncated at 100 traces, deferred=Deferred@1043518532(state=PENDING, result=null, callback=(continuation of Deferred@942123602 after retry RPC after error@2123044940) -> (continuation of Deferred@1849245566 after retry RPC after error@1174488585) -> (continuation of Deferred@1139868065 after retry RPC after error@1696475371) -> (continuation of Deferred@1123756537 after retry RPC after error@243670689) -> (continuation of Deferred@1160899289 after retry RPC after error@1375521764) -> (continuation of Deferred@1255376067 after retry RPC after error@1956571182) -> (continuation of Deferred@1043571526 after retry RPC after error@162004111) -> (continuation of Deferred@1602520292 after retry RPC after error@1557711010) -> (continuation of Deferred@2144496108 after retry RPC after error@1227338013) -> (continuation of Deferred@855621497 after retry RPC after error@679017564) -> (continuation of Deferred@1149857206 after retry RPC after error@810718051) -> (continuation of Deferred@2140792423 after retry RPC after error@283934676) -> (continuation of Deferred@520570018 after retry RPC after error@996804010) -> (continuation of Deferred@200304254 after retry RPC after error@2022816267) -> (continuation of Deferred@1570165743 after retry RPC after error@909826722) -> (continuation of Deferred@1056016781 after retry RPC after error@1271213498) -> (continuation of Deferred@547849862 after retry RPC after error@1084794874) -> (continuation of Deferred@1923605379 after retry RPC after error@275626128) -> (continuation of Deferred@216178605 after retry RPC after error@166756028) -> (continuation of Deferred@1141256186 after retry RPC after error@970106578) -> (continuation of Deferred@567630258 after retry RPC after error@735762090) -> (continuation of Deferred@1582712276 after retry RPC after error@1922997498) -> (continuation of Deferred@2039301074 after retry RPC after error@77571535), errback=(continuation of Deferred@942123602 after retry RPC after error@2123044940) -> (continuation of Deferred@1849245566 after retry RPC after error@1174488585) -> (continuation of Deferred@1139868065 after retry RPC after error@1696475371) -> (continuation of Deferred@1123756537 after retry RPC after error@243670689) -> (continuation of Deferred@1160899289 after retry RPC after error@1375521764) -> (continuation of Deferred@1255376067 after retry RPC after error@1956571182) -> (continuation of Deferred@1043571526 after retry RPC after error@162004111) -> (continuation of Deferred@1602520292 after retry RPC after error@1557711010) -> (continuation of Deferred@2144496108 after retry RPC after error@1227338013) -> (continuation of Deferred@855621497 after retry RPC after error@679017564) -> (continuation of Deferred@1149857206 after retry RPC after error@810718051) -> (continuation of Deferred@2140792423 after retry RPC after error@283934676) -> (continuation of Deferred@520570018 after retry RPC after error@996804010) -> (continuation of Deferred@200304254 after retry RPC after error@2022816267) -> (continuation of Deferred@1570165743 after retry RPC after error@909826722) -> (continuation of Deferred@1056016781 after retry RPC after error@1271213498) -> (continuation of Deferred@547849862 after retry RPC after error@1084794874) -> (continuation of Deferred@1923605379 after retry RPC after error@275626128) -> (continuation of Deferred@216178605 after retry RPC after error@166756028) -> (continuation of Deferred@1141256186 after retry RPC after error@970106578) -> (continuation of Deferred@567630258 after retry RPC after error@735762090) -> (continuation of Deferred@1582712276 after retry RPC after error@1922997498) -> (continuation of Deferred@2039301074 after retry RPC after error@77571535)))
08:09:44.196 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
08:09:44.196 [WARN - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27588), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [5ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [7ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [7ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [16ms] refreshing cache from master, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [17ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [18ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [18ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [18ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [36ms] refreshing cache from master, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [39ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [42ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [42ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [43ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [56ms] refreshing cache from master, [56ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [56ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [57ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [57ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [57ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [57ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [76ms] refreshing cache from master, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [76ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [76ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [76ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [77ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [95ms] refreshing cache from master, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [96ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [96ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [96ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [96ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [136ms] refreshing cache from master, [136ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [137ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [137ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [138ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [138ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [196ms] refreshing cache from master, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [197ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [197ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [198ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [198ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [275ms] refreshing cache from master, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [277ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [277ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [278ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [278ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [278ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [516ms] refreshing cache from master, [516ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [517ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [517ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [518ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [519ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [520ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [520ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [876ms] refreshing cache from master, [876ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [877ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [877ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [878ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [879ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [879ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [880ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1598ms] refreshing cache from master, [1598ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1598ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1598ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1598ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1599ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1599ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1599ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3716ms] refreshing cache from master, [3716ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [3716ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [3716ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [3716ms] too many traces: truncated at 100 traces, deferred=Deferred@1043518532(state=PENDING, result=null, callback=(continuation of Deferred@942123602 after retry RPC after error@2123044940) -> (continuation of Deferred@1849245566 after retry RPC after error@1174488585) -> (continuation of Deferred@1139868065 after retry RPC after error@1696475371) -> (continuation of Deferred@1123756537 after retry RPC after error@243670689) -> (continuation of Deferred@1160899289 after retry RPC after error@1375521764) -> (continuation of Deferred@1255376067 after retry RPC after error@1956571182) -> (continuation of Deferred@1043571526 after retry RPC after error@162004111) -> (continuation of Deferred@1602520292 after retry RPC after error@1557711010) -> (continuation of Deferred@2144496108 after retry RPC after error@1227338013) -> (continuation of Deferred@855621497 after retry RPC after error@679017564) -> (continuation of Deferred@1149857206 after retry RPC after error@810718051) -> (continuation of Deferred@2140792423 after retry RPC after error@283934676) -> (continuation of Deferred@520570018 after retry RPC after error@996804010) -> (continuation of Deferred@200304254 after retry RPC after error@2022816267) -> (continuation of Deferred@1570165743 after retry RPC after error@909826722) -> (continuation of Deferred@1056016781 after retry RPC after error@1271213498) -> (continuation of Deferred@547849862 after retry RPC after error@1084794874) -> (continuation of Deferred@1923605379 after retry RPC after error@275626128) -> (continuation of Deferred@216178605 after retry RPC after error@166756028) -> (continuation of Deferred@1141256186 after retry RPC after error@970106578) -> (continuation of Deferred@567630258 after retry RPC after error@735762090) -> (continuation of Deferred@1582712276 after retry RPC after error@1922997498) -> (continuation of Deferred@2039301074 after retry RPC after error@77571535), errback=(continuation of Deferred@942123602 after retry RPC after error@2123044940) -> (continuation of Deferred@1849245566 after retry RPC after error@1174488585) -> (continuation of Deferred@1139868065 after retry RPC after error@1696475371) -> (continuation of Deferred@1123756537 after retry RPC after error@243670689) -> (continuation of Deferred@1160899289 after retry RPC after error@1375521764) -> (continuation of Deferred@1255376067 after retry RPC after error@1956571182) -> (continuation of Deferred@1043571526 after retry RPC after error@162004111) -> (continuation of Deferred@1602520292 after retry RPC after error@1557711010) -> (continuation of Deferred@2144496108 after retry RPC after error@1227338013) -> (continuation of Deferred@855621497 after retry RPC after error@679017564) -> (continuation of Deferred@1149857206 after retry RPC after error@810718051) -> (continuation of Deferred@2140792423 after retry RPC after error@283934676) -> (continuation of Deferred@520570018 after retry RPC after error@996804010) -> (continuation of Deferred@200304254 after retry RPC after error@2022816267) -> (continuation of Deferred@1570165743 after retry RPC after error@909826722) -> (continuation of Deferred@1056016781 after retry RPC after error@1271213498) -> (continuation of Deferred@547849862 after retry RPC after error@1084794874) -> (continuation of Deferred@1923605379 after retry RPC after error@275626128) -> (continuation of Deferred@216178605 after retry RPC after error@166756028) -> (continuation of Deferred@1141256186 after retry RPC after error@970106578) -> (continuation of Deferred@567630258 after retry RPC after error@735762090) -> (continuation of Deferred@1582712276 after retry RPC after error@1922997498) -> (continuation of Deferred@2039301074 after retry RPC after error@77571535)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.200.125:46459
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:44.203 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_6).
08:09:44.210 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#6 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_6.
08:09:44.213 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from INITIALIZING to FAILED on 602375e5-074a-479e-9f69-650d6717a4da @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27588), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [5ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [7ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [7ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [16ms] refreshing cache from master, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [17ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [18ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [18ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [18ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [36ms] refreshing cache from master, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [39ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [42ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [42ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [43ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [56ms] refreshing cache from master, [56ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [56ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [57ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [57ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [57ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [57ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [76ms] refreshing cache from master, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [76ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [76ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [76ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [77ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [95ms] refreshing cache from master, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [96ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [96ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [96ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [96ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [136ms] refreshing cache from master, [136ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [137ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [137ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [138ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [138ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [196ms] refreshing cache from master, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [197ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [197ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [198ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [198ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [275ms] refreshing cache from master, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [277ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [277ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [278ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [278ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [278ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [516ms] refreshing cache from master, [516ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [517ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [517ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [518ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [519ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [520ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [520ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [876ms] refreshing cache from master, [876ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [877ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [877ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [878ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [879ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [879ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [880ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1598ms] refreshing cache from master, [1598ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1598ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1598ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1598ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1599ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1599ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1599ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [3716ms] refreshing cache from master, [3716ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [3716ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [3716ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [3716ms] too many traces: truncated at 100 traces, deferred=Deferred@1043518532(state=PENDING, result=null, callback=(continuation of Deferred@942123602 after retry RPC after error@2123044940) -> (continuation of Deferred@1849245566 after retry RPC after error@1174488585) -> (continuation of Deferred@1139868065 after retry RPC after error@1696475371) -> (continuation of Deferred@1123756537 after retry RPC after error@243670689) -> (continuation of Deferred@1160899289 after retry RPC after error@1375521764) -> (continuation of Deferred@1255376067 after retry RPC after error@1956571182) -> (continuation of Deferred@1043571526 after retry RPC after error@162004111) -> (continuation of Deferred@1602520292 after retry RPC after error@1557711010) -> (continuation of Deferred@2144496108 after retry RPC after error@1227338013) -> (continuation of Deferred@855621497 after retry RPC after error@679017564) -> (continuation of Deferred@1149857206 after retry RPC after error@810718051) -> (continuation of Deferred@2140792423 after retry RPC after error@283934676) -> (continuation of Deferred@520570018 after retry RPC after error@996804010) -> (continuation of Deferred@200304254 after retry RPC after error@2022816267) -> (continuation of Deferred@1570165743 after retry RPC after error@909826722) -> (continuation of Deferred@1056016781 after retry RPC after error@1271213498) -> (continuation of Deferred@547849862 after retry RPC after error@1084794874) -> (continuation of Deferred@1923605379 after retry RPC after error@275626128) -> (continuation of Deferred@216178605 after retry RPC after error@166756028) -> (continuation of Deferred@1141256186 after retry RPC after error@970106578) -> (continuation of Deferred@567630258 after retry RPC after error@735762090) -> (continuation of Deferred@1582712276 after retry RPC after error@1922997498) -> (continuation of Deferred@2039301074 after retry RPC after error@77571535), errback=(continuation of Deferred@942123602 after retry RPC after error@2123044940) -> (continuation of Deferred@1849245566 after retry RPC after error@1174488585) -> (continuation of Deferred@1139868065 after retry RPC after error@1696475371) -> (continuation of Deferred@1123756537 after retry RPC after error@243670689) -> (continuation of Deferred@1160899289 after retry RPC after error@1375521764) -> (continuation of Deferred@1255376067 after retry RPC after error@1956571182) -> (continuation of Deferred@1043571526 after retry RPC after error@162004111) -> (continuation of Deferred@1602520292 after retry RPC after error@1557711010) -> (continuation of Deferred@2144496108 after retry RPC after error@1227338013) -> (continuation of Deferred@855621497 after retry RPC after error@679017564) -> (continuation of Deferred@1149857206 after retry RPC after error@810718051) -> (continuation of Deferred@2140792423 after retry RPC after error@283934676) -> (continuation of Deferred@520570018 after retry RPC after error@996804010) -> (continuation of Deferred@200304254 after retry RPC after error@2022816267) -> (continuation of Deferred@1570165743 after retry RPC after error@909826722) -> (continuation of Deferred@1056016781 after retry RPC after error@1271213498) -> (continuation of Deferred@547849862 after retry RPC after error@1084794874) -> (continuation of Deferred@1923605379 after retry RPC after error@275626128) -> (continuation of Deferred@216178605 after retry RPC after error@166756028) -> (continuation of Deferred@1141256186 after retry RPC after error@970106578) -> (continuation of Deferred@567630258 after retry RPC after error@735762090) -> (continuation of Deferred@1582712276 after retry RPC after error@1922997498) -> (continuation of Deferred@2039301074 after retry RPC after error@77571535)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.200.125:46459
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:44.217 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#6) of source Source: KuduSource.
08:09:44.217 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 0d2ddb76420639a9ec06ca05e894cb50: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
08:09:44.217 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_1_6.
08:09:44.271 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:44.271 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:44.271 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:44.272 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:44.272 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:44.272 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:44.272 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:44.272 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:44.272 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:44.272 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:44.273 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:44.273 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:44.273 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:44.285 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:44.285 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:44.285 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:44.285 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:44.285 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:44.285 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:44.286 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:44.286 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:44.286 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:44.286 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:44.286 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:44.286 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:44.286 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:44.309 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:44.310 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:44.310 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:44.310 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:44.310 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:44.310 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:44.310 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:44.311 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:44.311 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:44.317 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:44.317 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:44.317 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:44.317 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:44.395 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:44.395 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:44.395 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:44.396 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:44.396 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:44.396 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:44.396 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:44.398 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:44.398 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:44.398 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:44.396 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:44.398 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:44.398 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:44.421 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:44.424 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:44.424 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:44.425 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:44.425 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:44.425 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:44.425 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:44.425 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:44.425 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:44.425 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:44.425 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:44.425 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:44.425 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:44.426 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:44.528 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:44.558 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:44.559 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:44.644 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:44.644 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:44.644 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:44.644 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:44.644 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:44.645 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:44.645 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:44.645 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:44.645 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:44.645 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:44.645 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:44.645 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:44.645 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:44.654 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:44.654 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:44.654 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:44.654 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.654 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.654 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.654 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.654 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.655 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.655 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.655 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.655 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.655 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:44.656 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28023), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [4ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [6ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [10ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [10ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [25ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [39ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [39ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [44ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [45ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [45ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [45ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [61ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [62ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [81ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [82ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [102ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [102ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [102ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [102ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [121ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [122ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [122ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [122ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [161ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [161ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [161ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [162ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [321ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [321ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [322ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [803ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [803ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [804ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [804ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1344ms] refreshing cache from master, [1344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1344ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1345ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1345ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1345ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1421ms] refreshing cache from master, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1423ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1423ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1423ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1841ms] refreshing cache from master, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1843ms] too many traces: truncated at 100 traces, deferred=Deferred@1780964820(state=PENDING, result=null, callback=(continuation of Deferred@129760504 after retry RPC after error@1552109406) -> (continuation of Deferred@815587107 after retry RPC after error@1619393817) -> (continuation of Deferred@939626957 after retry RPC after error@2126430252) -> (continuation of Deferred@680361247 after retry RPC after error@1739534370) -> (continuation of Deferred@1402231523 after retry RPC after error@1529040669) -> (continuation of Deferred@411411683 after retry RPC after error@104184305) -> (continuation of Deferred@2005383318 after retry RPC after error@916282076) -> (continuation of Deferred@59396688 after retry RPC after error@685480417) -> (continuation of Deferred@1649592164 after retry RPC after error@1044724296) -> (continuation of Deferred@1863120642 after retry RPC after error@460095379) -> (continuation of Deferred@1878127229 after retry RPC after error@2020672177) -> (continuation of Deferred@1892503130 after retry RPC after error@136652599) -> (continuation of Deferred@1747406420 after retry RPC after error@406044011) -> (continuation of Deferred@35033001 after retry RPC after error@598412355) -> (continuation of Deferred@1898750860 after retry RPC after error@1961988135) -> (continuation of Deferred@1110192855 after retry RPC after error@958330821) -> (continuation of Deferred@758776745 after retry RPC after error@1437785729) -> (continuation of Deferred@1990980714 after retry RPC after error@952468901) -> (continuation of Deferred@1159724639 after retry RPC after error@102393515) -> (continuation of Deferred@792447654 after retry RPC after error@994544201) -> (continuation of Deferred@17856120 after retry RPC after error@1424648143) -> (continuation of Deferred@628484366 after retry RPC after error@585579051) -> (continuation of Deferred@549862329 after retry RPC after error@664138865) -> (continuation of Deferred@757220372 after retry RPC after error@915346937), errback=(continuation of Deferred@129760504 after retry RPC after error@1552109406) -> (continuation of Deferred@815587107 after retry RPC after error@1619393817) -> (continuation of Deferred@939626957 after retry RPC after error@2126430252) -> (continuation of Deferred@680361247 after retry RPC after error@1739534370) -> (continuation of Deferred@1402231523 after retry RPC after error@1529040669) -> (continuation of Deferred@411411683 after retry RPC after error@104184305) -> (continuation of Deferred@2005383318 after retry RPC after error@916282076) -> (continuation of Deferred@59396688 after retry RPC after error@685480417) -> (continuation of Deferred@1649592164 after retry RPC after error@1044724296) -> (continuation of Deferred@1863120642 after retry RPC after error@460095379) -> (continuation of Deferred@1878127229 after retry RPC after error@2020672177) -> (continuation of Deferred@1892503130 after retry RPC after error@136652599) -> (continuation of Deferred@1747406420 after retry RPC after error@406044011) -> (continuation of Deferred@35033001 after retry RPC after error@598412355) -> (continuation of Deferred@1898750860 after retry RPC after error@1961988135) -> (continuation of Deferred@1110192855 after retry RPC after error@958330821) -> (continuation of Deferred@758776745 after retry RPC after error@1437785729) -> (continuation of Deferred@1990980714 after retry RPC after error@952468901) -> (continuation of Deferred@1159724639 after retry RPC after error@102393515) -> (continuation of Deferred@792447654 after retry RPC after error@994544201) -> (continuation of Deferred@17856120 after retry RPC after error@1424648143) -> (continuation of Deferred@628484366 after retry RPC after error@585579051) -> (continuation of Deferred@549862329 after retry RPC after error@664138865) -> (continuation of Deferred@757220372 after retry RPC after error@915346937)))
08:09:44.657 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:44.658 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:44.658 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:44.658 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.658 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.658 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.658 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28023), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [4ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [6ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [10ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [10ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [25ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [39ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [39ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [44ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [45ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [45ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [45ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [61ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [62ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [81ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [82ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [102ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [102ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [102ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [102ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [121ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [122ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [122ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [122ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [161ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [161ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [161ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [162ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [321ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [321ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [322ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [803ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [803ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [804ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [804ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1344ms] refreshing cache from master, [1344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1344ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1345ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1345ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1345ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1421ms] refreshing cache from master, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1423ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1423ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1423ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1841ms] refreshing cache from master, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1843ms] too many traces: truncated at 100 traces, deferred=Deferred@1780964820(state=PENDING, result=null, callback=(continuation of Deferred@129760504 after retry RPC after error@1552109406) -> (continuation of Deferred@815587107 after retry RPC after error@1619393817) -> (continuation of Deferred@939626957 after retry RPC after error@2126430252) -> (continuation of Deferred@680361247 after retry RPC after error@1739534370) -> (continuation of Deferred@1402231523 after retry RPC after error@1529040669) -> (continuation of Deferred@411411683 after retry RPC after error@104184305) -> (continuation of Deferred@2005383318 after retry RPC after error@916282076) -> (continuation of Deferred@59396688 after retry RPC after error@685480417) -> (continuation of Deferred@1649592164 after retry RPC after error@1044724296) -> (continuation of Deferred@1863120642 after retry RPC after error@460095379) -> (continuation of Deferred@1878127229 after retry RPC after error@2020672177) -> (continuation of Deferred@1892503130 after retry RPC after error@136652599) -> (continuation of Deferred@1747406420 after retry RPC after error@406044011) -> (continuation of Deferred@35033001 after retry RPC after error@598412355) -> (continuation of Deferred@1898750860 after retry RPC after error@1961988135) -> (continuation of Deferred@1110192855 after retry RPC after error@958330821) -> (continuation of Deferred@758776745 after retry RPC after error@1437785729) -> (continuation of Deferred@1990980714 after retry RPC after error@952468901) -> (continuation of Deferred@1159724639 after retry RPC after error@102393515) -> (continuation of Deferred@792447654 after retry RPC after error@994544201) -> (continuation of Deferred@17856120 after retry RPC after error@1424648143) -> (continuation of Deferred@628484366 after retry RPC after error@585579051) -> (continuation of Deferred@549862329 after retry RPC after error@664138865) -> (continuation of Deferred@757220372 after retry RPC after error@915346937), errback=(continuation of Deferred@129760504 after retry RPC after error@1552109406) -> (continuation of Deferred@815587107 after retry RPC after error@1619393817) -> (continuation of Deferred@939626957 after retry RPC after error@2126430252) -> (continuation of Deferred@680361247 after retry RPC after error@1739534370) -> (continuation of Deferred@1402231523 after retry RPC after error@1529040669) -> (continuation of Deferred@411411683 after retry RPC after error@104184305) -> (continuation of Deferred@2005383318 after retry RPC after error@916282076) -> (continuation of Deferred@59396688 after retry RPC after error@685480417) -> (continuation of Deferred@1649592164 after retry RPC after error@1044724296) -> (continuation of Deferred@1863120642 after retry RPC after error@460095379) -> (continuation of Deferred@1878127229 after retry RPC after error@2020672177) -> (continuation of Deferred@1892503130 after retry RPC after error@136652599) -> (continuation of Deferred@1747406420 after retry RPC after error@406044011) -> (continuation of Deferred@35033001 after retry RPC after error@598412355) -> (continuation of Deferred@1898750860 after retry RPC after error@1961988135) -> (continuation of Deferred@1110192855 after retry RPC after error@958330821) -> (continuation of Deferred@758776745 after retry RPC after error@1437785729) -> (continuation of Deferred@1990980714 after retry RPC after error@952468901) -> (continuation of Deferred@1159724639 after retry RPC after error@102393515) -> (continuation of Deferred@792447654 after retry RPC after error@994544201) -> (continuation of Deferred@17856120 after retry RPC after error@1424648143) -> (continuation of Deferred@628484366 after retry RPC after error@585579051) -> (continuation of Deferred@549862329 after retry RPC after error@664138865) -> (continuation of Deferred@757220372 after retry RPC after error@915346937)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28023), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [4ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [6ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [10ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [10ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [25ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [39ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [39ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [44ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [45ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [45ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [45ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [61ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [62ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [81ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [82ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [102ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [102ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [102ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [102ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [121ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [122ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [122ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [122ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [161ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [161ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [161ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [162ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [321ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [321ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [322ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [803ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [803ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [804ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [804ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1344ms] refreshing cache from master, [1344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1344ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1345ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1345ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1345ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1421ms] refreshing cache from master, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1423ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1423ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1423ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1841ms] refreshing cache from master, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1843ms] too many traces: truncated at 100 traces, deferred=Deferred@1780964820(state=PENDING, result=null, callback=(continuation of Deferred@129760504 after retry RPC after error@1552109406) -> (continuation of Deferred@815587107 after retry RPC after error@1619393817) -> (continuation of Deferred@939626957 after retry RPC after error@2126430252) -> (continuation of Deferred@680361247 after retry RPC after error@1739534370) -> (continuation of Deferred@1402231523 after retry RPC after error@1529040669) -> (continuation of Deferred@411411683 after retry RPC after error@104184305) -> (continuation of Deferred@2005383318 after retry RPC after error@916282076) -> (continuation of Deferred@59396688 after retry RPC after error@685480417) -> (continuation of Deferred@1649592164 after retry RPC after error@1044724296) -> (continuation of Deferred@1863120642 after retry RPC after error@460095379) -> (continuation of Deferred@1878127229 after retry RPC after error@2020672177) -> (continuation of Deferred@1892503130 after retry RPC after error@136652599) -> (continuation of Deferred@1747406420 after retry RPC after error@406044011) -> (continuation of Deferred@35033001 after retry RPC after error@598412355) -> (continuation of Deferred@1898750860 after retry RPC after error@1961988135) -> (continuation of Deferred@1110192855 after retry RPC after error@958330821) -> (continuation of Deferred@758776745 after retry RPC after error@1437785729) -> (continuation of Deferred@1990980714 after retry RPC after error@952468901) -> (continuation of Deferred@1159724639 after retry RPC after error@102393515) -> (continuation of Deferred@792447654 after retry RPC after error@994544201) -> (continuation of Deferred@17856120 after retry RPC after error@1424648143) -> (continuation of Deferred@628484366 after retry RPC after error@585579051) -> (continuation of Deferred@549862329 after retry RPC after error@664138865) -> (continuation of Deferred@757220372 after retry RPC after error@915346937), errback=(continuation of Deferred@129760504 after retry RPC after error@1552109406) -> (continuation of Deferred@815587107 after retry RPC after error@1619393817) -> (continuation of Deferred@939626957 after retry RPC after error@2126430252) -> (continuation of Deferred@680361247 after retry RPC after error@1739534370) -> (continuation of Deferred@1402231523 after retry RPC after error@1529040669) -> (continuation of Deferred@411411683 after retry RPC after error@104184305) -> (continuation of Deferred@2005383318 after retry RPC after error@916282076) -> (continuation of Deferred@59396688 after retry RPC after error@685480417) -> (continuation of Deferred@1649592164 after retry RPC after error@1044724296) -> (continuation of Deferred@1863120642 after retry RPC after error@460095379) -> (continuation of Deferred@1878127229 after retry RPC after error@2020672177) -> (continuation of Deferred@1892503130 after retry RPC after error@136652599) -> (continuation of Deferred@1747406420 after retry RPC after error@406044011) -> (continuation of Deferred@35033001 after retry RPC after error@598412355) -> (continuation of Deferred@1898750860 after retry RPC after error@1961988135) -> (continuation of Deferred@1110192855 after retry RPC after error@958330821) -> (continuation of Deferred@758776745 after retry RPC after error@1437785729) -> (continuation of Deferred@1990980714 after retry RPC after error@952468901) -> (continuation of Deferred@1159724639 after retry RPC after error@102393515) -> (continuation of Deferred@792447654 after retry RPC after error@994544201) -> (continuation of Deferred@17856120 after retry RPC after error@1424648143) -> (continuation of Deferred@628484366 after retry RPC after error@585579051) -> (continuation of Deferred@549862329 after retry RPC after error@664138865) -> (continuation of Deferred@757220372 after retry RPC after error@915346937)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.17.254:45447
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:44.658 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.658 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.658 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.658 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.658 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.659 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.659 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:44.667 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28023), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [4ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [6ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [10ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [10ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [25ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [39ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [39ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [44ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [45ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [45ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [45ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [61ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [62ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [81ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [82ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [102ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [102ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [102ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [102ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [121ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [122ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [122ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [122ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [161ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [161ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [161ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [162ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [321ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [321ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [322ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [803ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [803ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [804ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [804ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1344ms] refreshing cache from master, [1344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1344ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1345ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1345ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1345ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1421ms] refreshing cache from master, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1423ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1423ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1423ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1841ms] refreshing cache from master, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1843ms] too many traces: truncated at 100 traces, deferred=Deferred@1780964820(state=PENDING, result=null, callback=(continuation of Deferred@129760504 after retry RPC after error@1552109406) -> (continuation of Deferred@815587107 after retry RPC after error@1619393817) -> (continuation of Deferred@939626957 after retry RPC after error@2126430252) -> (continuation of Deferred@680361247 after retry RPC after error@1739534370) -> (continuation of Deferred@1402231523 after retry RPC after error@1529040669) -> (continuation of Deferred@411411683 after retry RPC after error@104184305) -> (continuation of Deferred@2005383318 after retry RPC after error@916282076) -> (continuation of Deferred@59396688 after retry RPC after error@685480417) -> (continuation of Deferred@1649592164 after retry RPC after error@1044724296) -> (continuation of Deferred@1863120642 after retry RPC after error@460095379) -> (continuation of Deferred@1878127229 after retry RPC after error@2020672177) -> (continuation of Deferred@1892503130 after retry RPC after error@136652599) -> (continuation of Deferred@1747406420 after retry RPC after error@406044011) -> (continuation of Deferred@35033001 after retry RPC after error@598412355) -> (continuation of Deferred@1898750860 after retry RPC after error@1961988135) -> (continuation of Deferred@1110192855 after retry RPC after error@958330821) -> (continuation of Deferred@758776745 after retry RPC after error@1437785729) -> (continuation of Deferred@1990980714 after retry RPC after error@952468901) -> (continuation of Deferred@1159724639 after retry RPC after error@102393515) -> (continuation of Deferred@792447654 after retry RPC after error@994544201) -> (continuation of Deferred@17856120 after retry RPC after error@1424648143) -> (continuation of Deferred@628484366 after retry RPC after error@585579051) -> (continuation of Deferred@549862329 after retry RPC after error@664138865) -> (continuation of Deferred@757220372 after retry RPC after error@915346937), errback=(continuation of Deferred@129760504 after retry RPC after error@1552109406) -> (continuation of Deferred@815587107 after retry RPC after error@1619393817) -> (continuation of Deferred@939626957 after retry RPC after error@2126430252) -> (continuation of Deferred@680361247 after retry RPC after error@1739534370) -> (continuation of Deferred@1402231523 after retry RPC after error@1529040669) -> (continuation of Deferred@411411683 after retry RPC after error@104184305) -> (continuation of Deferred@2005383318 after retry RPC after error@916282076) -> (continuation of Deferred@59396688 after retry RPC after error@685480417) -> (continuation of Deferred@1649592164 after retry RPC after error@1044724296) -> (continuation of Deferred@1863120642 after retry RPC after error@460095379) -> (continuation of Deferred@1878127229 after retry RPC after error@2020672177) -> (continuation of Deferred@1892503130 after retry RPC after error@136652599) -> (continuation of Deferred@1747406420 after retry RPC after error@406044011) -> (continuation of Deferred@35033001 after retry RPC after error@598412355) -> (continuation of Deferred@1898750860 after retry RPC after error@1961988135) -> (continuation of Deferred@1110192855 after retry RPC after error@958330821) -> (continuation of Deferred@758776745 after retry RPC after error@1437785729) -> (continuation of Deferred@1990980714 after retry RPC after error@952468901) -> (continuation of Deferred@1159724639 after retry RPC after error@102393515) -> (continuation of Deferred@792447654 after retry RPC after error@994544201) -> (continuation of Deferred@17856120 after retry RPC after error@1424648143) -> (continuation of Deferred@628484366 after retry RPC after error@585579051) -> (continuation of Deferred@549862329 after retry RPC after error@664138865) -> (continuation of Deferred@757220372 after retry RPC after error@915346937)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28023), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [4ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [6ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [10ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [10ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [25ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [39ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [39ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [44ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [45ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [45ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [45ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [61ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [62ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [81ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [82ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [102ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [102ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [102ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [102ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [121ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [122ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [122ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [122ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [161ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [161ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [161ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [162ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [321ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [321ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [322ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [322ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [803ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [803ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [804ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [804ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1344ms] refreshing cache from master, [1344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1344ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1345ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1345ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1345ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1421ms] refreshing cache from master, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.252:43595: Network error: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595, [1423ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.254:45447: Network error: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447, [1423ms] Sub RPC ConnectToMaster: received response from server master-127.27.17.253:37621: Network error: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1423ms] delaying RPC due to: Service unavailable: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621, [1841ms] refreshing cache from master, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.252:43595, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.254:45447, [1842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.17.253:37621, [1843ms] too many traces: truncated at 100 traces, deferred=Deferred@1780964820(state=PENDING, result=null, callback=(continuation of Deferred@129760504 after retry RPC after error@1552109406) -> (continuation of Deferred@815587107 after retry RPC after error@1619393817) -> (continuation of Deferred@939626957 after retry RPC after error@2126430252) -> (continuation of Deferred@680361247 after retry RPC after error@1739534370) -> (continuation of Deferred@1402231523 after retry RPC after error@1529040669) -> (continuation of Deferred@411411683 after retry RPC after error@104184305) -> (continuation of Deferred@2005383318 after retry RPC after error@916282076) -> (continuation of Deferred@59396688 after retry RPC after error@685480417) -> (continuation of Deferred@1649592164 after retry RPC after error@1044724296) -> (continuation of Deferred@1863120642 after retry RPC after error@460095379) -> (continuation of Deferred@1878127229 after retry RPC after error@2020672177) -> (continuation of Deferred@1892503130 after retry RPC after error@136652599) -> (continuation of Deferred@1747406420 after retry RPC after error@406044011) -> (continuation of Deferred@35033001 after retry RPC after error@598412355) -> (continuation of Deferred@1898750860 after retry RPC after error@1961988135) -> (continuation of Deferred@1110192855 after retry RPC after error@958330821) -> (continuation of Deferred@758776745 after retry RPC after error@1437785729) -> (continuation of Deferred@1990980714 after retry RPC after error@952468901) -> (continuation of Deferred@1159724639 after retry RPC after error@102393515) -> (continuation of Deferred@792447654 after retry RPC after error@994544201) -> (continuation of Deferred@17856120 after retry RPC after error@1424648143) -> (continuation of Deferred@628484366 after retry RPC after error@585579051) -> (continuation of Deferred@549862329 after retry RPC after error@664138865) -> (continuation of Deferred@757220372 after retry RPC after error@915346937), errback=(continuation of Deferred@129760504 after retry RPC after error@1552109406) -> (continuation of Deferred@815587107 after retry RPC after error@1619393817) -> (continuation of Deferred@939626957 after retry RPC after error@2126430252) -> (continuation of Deferred@680361247 after retry RPC after error@1739534370) -> (continuation of Deferred@1402231523 after retry RPC after error@1529040669) -> (continuation of Deferred@411411683 after retry RPC after error@104184305) -> (continuation of Deferred@2005383318 after retry RPC after error@916282076) -> (continuation of Deferred@59396688 after retry RPC after error@685480417) -> (continuation of Deferred@1649592164 after retry RPC after error@1044724296) -> (continuation of Deferred@1863120642 after retry RPC after error@460095379) -> (continuation of Deferred@1878127229 after retry RPC after error@2020672177) -> (continuation of Deferred@1892503130 after retry RPC after error@136652599) -> (continuation of Deferred@1747406420 after retry RPC after error@406044011) -> (continuation of Deferred@35033001 after retry RPC after error@598412355) -> (continuation of Deferred@1898750860 after retry RPC after error@1961988135) -> (continuation of Deferred@1110192855 after retry RPC after error@958330821) -> (continuation of Deferred@758776745 after retry RPC after error@1437785729) -> (continuation of Deferred@1990980714 after retry RPC after error@952468901) -> (continuation of Deferred@1159724639 after retry RPC after error@102393515) -> (continuation of Deferred@792447654 after retry RPC after error@994544201) -> (continuation of Deferred@17856120 after retry RPC after error@1424648143) -> (continuation of Deferred@628484366 after retry RPC after error@585579051) -> (continuation of Deferred@549862329 after retry RPC after error@664138865) -> (continuation of Deferred@757220372 after retry RPC after error@915346937)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.27.17.254:45447
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:44.673 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
08:09:44.673 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:44.674 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:44.674 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:44.674 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.674 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.674 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.674 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.674 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.674 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.674 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.674 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.674 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.674 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:44.675 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#6) of source Source: KuduSource.
08:09:44.675 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from INITIALIZING to CANCELING.
08:09:44.675 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_6).
08:09:44.675 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from INITIALIZING to CANCELING.
08:09:44.676 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_6).
08:09:44.677 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
08:09:44.677 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from CANCELING to CANCELED.
08:09:44.677 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#6 (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_6).
08:09:44.678 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#6 bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_6.
08:09:44.678 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (bc67995db6a61b8ee40948722213b72d_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from CANCELING to CANCELED.
08:09:44.679 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 0d2ddb76420639a9ec06ca05e894cb50
08:09:44.689 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:44.690 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:44.690 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:44.690 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:44.690 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:44.690 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:44.690 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:44.690 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:44.690 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:44.690 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:44.690 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:44.690 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:44.691 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:44.694 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:44.694 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:44.694 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:44.694 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.694 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.694 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.694 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.694 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.695 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.695 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.695 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.695 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.695 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:44.714 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:44.714 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:44.714 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:44.714 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.714 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.714 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.714 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.714 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.714 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.714 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.714 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.715 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.715 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:44.733 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:44.734 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:44.734 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:44.734 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.734 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.734 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.734 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.734 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.734 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.735 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.735 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.735 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.735 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:44.754 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:44.755 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:44.755 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:44.755 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.755 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.755 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.755 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.755 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.755 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.755 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.755 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.755 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.755 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:44.813 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:44.814 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:44.814 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:44.814 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.814 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.814 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.814 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.814 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.814 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.814 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.814 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.814 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.814 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:44.821 [INFO - flink-pekko.actor.default-dispatcher-5] (Slf4jLogger.scala:117) Slf4jLogger started
08:09:44.846 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:44.846 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:44.846 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:44.847 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:44.847 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:44.847 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:44.847 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:44.847 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:44.847 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:44.847 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:44.847 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:44.847 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:44.847 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:44.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:44.934 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:44.934 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:44.934 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:44.935 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.935 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.935 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:44.936 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.936 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.936 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:44.937 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.937 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.937 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:44.937 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:44.972 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
08:09:44.985 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:44.985 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:44.985 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:44.985 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:44.985 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:44.986 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:44.986 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:44.986 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:44.986 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:44.986 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:44.986 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:44.986 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:44.986 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:44.991 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
08:09:45.024 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
08:09:45.028 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:45.033 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:45.034 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:45.034 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:45.034 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:45.034 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:45.034 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:45.034 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:45.034 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:45.034 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:45.035 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:45.035 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:45.035 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:45.035 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:45.039 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
08:09:45.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:45.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:45.058 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
08:09:45.064 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
08:09:45.065 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
08:09:45.065 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
08:09:45.066 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
08:09:45.066 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
08:09:45.066 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
08:09:45.067 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
08:09:45.067 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
08:09:45.067 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
08:09:45.068 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
08:09:45.068 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
08:09:45.068 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
08:09:45.068 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
08:09:45.068 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
08:09:45.068 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
08:09:45.068 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
08:09:45.068 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
08:09:45.068 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
08:09:45.069 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
08:09:45.069 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
08:09:45.069 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
08:09:45.070 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
08:09:45.070 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
08:09:45.070 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
08:09:45.070 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:45.070 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_069fec2081707d0cba9d58fc9c4dfaca/blobStorage
08:09:45.070 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:45.070 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:45.071 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:45.071 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:45.071 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:45.071 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:45.071 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:45.071 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:45.071 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:45.071 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:45.071 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:45.071 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:45.074 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:39553 - max concurrent requests: 50 - max backlog: 1000
08:09:45.075 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_069fec2081707d0cba9d58fc9c4dfaca/blobStorage
08:09:45.078 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_069fec2081707d0cba9d58fc9c4dfaca/blobStorage
08:09:45.079 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
08:09:45.080 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: e0ec56e8-97c4-4f63-b461-3ae00ff39d6a
08:09:45.084 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 37 GB (77.08% usable)
08:09:45.085 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-778c714b-b1f9-4930-9905-c6380e283f75
08:09:45.104 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-a0f3b808-a500-4c70-8d92-50e6d1a0f3f0
08:09:45.180 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
08:09:45.180 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
08:09:45.180 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
08:09:45.180 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
08:09:45.181 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
08:09:45.184 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_24 .
08:09:45.189 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultJobLeaderService.java:127) Start job leader service.
08:09:45.190 [INFO - flink-pekko.actor.default-dispatcher-5] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-139309be-754d-4c6b-941e-6b4e0699f20b
08:09:45.190 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
08:09:45.190 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
08:09:45.201 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
08:09:45.201 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
08:09:45.206 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:39631
08:09:45.207 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
08:09:45.242 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:39631 was granted leadership with leaderSessionID=5643103f-b840-4550-b372-cea4a6a049cf
08:09:45.242 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:39631 , session=5643103f-b840-4550-b372-cea4a6a049cf
08:09:45.243 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
08:09:45.248 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
08:09:45.249 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
08:09:45.250 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id 4868f588-4278-40f5-b468-012f6dce436c. Creating new DispatcherLeaderProcess.
08:09:45.251 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
08:09:45.255 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
08:09:45.263 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:45.263 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
08:09:45.263 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
08:09:45.263 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:45.263 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:45.263 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:45.263 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:45.264 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:45.264 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:45.264 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:45.264 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:45.264 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:45.263 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:45.264 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:45.264 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:45.266 [INFO - pool-523-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id bc3b1bcc-3a8d-4d07-b5c2-d3913688c653.
08:09:45.268 [INFO - mini-cluster-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_25 .
08:09:45.269 [INFO - pool-523-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_26 .
08:09:45.276 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:253) Starting the resource manager.
08:09:45.277 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:212) Starting the slot manager.
08:09:45.277 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:308) Starting tokens update task
08:09:45.278 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
08:09:45.278 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
08:09:45.278 [INFO - mini-cluster-io-thread-2] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_26 , session=bc3b1bcc-3a8d-4d07-b5c2-d3913688c653
08:09:45.279 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_26(b5c2d3913688c653bc3b1bcc3a8d4d07).
08:09:45.282 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_25 , session=4868f588-4278-40f5-b468-012f6dce436c
08:09:45.323 [INFO - flink-pekko.actor.default-dispatcher-8] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
08:09:45.331 [INFO - flink-pekko.actor.default-dispatcher-9] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (32f61c84b0337638563df63016a801c9).
08:09:45.332 [INFO - flink-pekko.actor.default-dispatcher-9] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (32f61c84b0337638563df63016a801c9).
08:09:45.332 [INFO - flink-pekko.actor.default-dispatcher-9] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-32f61c84b0337638563df63016a801c9'.
08:09:45.333 [INFO - mini-cluster-io-thread-4] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job 32f61c84b0337638563df63016a801c9 was granted leadership with leader id 5426d3db-9898-4625-8cc1-9b1861128fb7. Creating new JobMasterServiceProcess.
08:09:45.334 [INFO - flink-pekko.actor.default-dispatcher-7] (ResourceManager.java:1080) Registering TaskManager with ResourceID e0ec56e8-97c4-4f63-b461-3ae00ff39d6a (pekko://flink/user/rpc/taskmanager_24) at ResourceManager
08:09:45.335 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_26 under registration id 44fd5f038431c5e8dad96537f8a317b0.
08:09:45.335 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_27 .
08:09:45.336 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:344) Registering task executor e0ec56e8-97c4-4f63-b461-3ae00ff39d6a under 44fd5f038431c5e8dad96537f8a317b0 at the slot manager.
08:09:45.343 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (32f61c84b0337638563df63016a801c9).
08:09:45.345 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (32f61c84b0337638563df63016a801c9).
08:09:45.346 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph 45be7f41566175980c115e651a8ad8a0 for job 32f61c84b0337638563df63016a801c9.
08:09:45.346 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (32f61c84b0337638563df63016a801c9).
08:09:45.346 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
08:09:45.348 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
08:09:45.348 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1487c903
08:09:45.348 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:45.349 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit11592401093178161655/checkpoints")
08:09:45.351 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
08:09:45.352 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@51b575db for Flink Streaming Job (32f61c84b0337638563df63016a801c9).
08:09:45.352 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_27 , session=5426d3db-9898-4625-8cc1-9b1861128fb7
08:09:45.358 [INFO - flink-pekko.actor.default-dispatcher-5] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (32f61c84b0337638563df63016a801c9) under job master id 8cc19b1861128fb75426d3db98984625.
08:09:45.359 [INFO - flink-pekko.actor.default-dispatcher-5] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
08:09:45.361 [DEBUG - flink-pekko.actor.default-dispatcher-5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:45.366 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
08:09:45.366 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (32f61c84b0337638563df63016a801c9) switched from state CREATED to RUNNING.
08:09:45.374 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
08:09:45.375 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
08:09:45.375 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
08:09:45.375 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
08:09:45.376 [INFO - flink-pekko.actor.default-dispatcher-5] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_26(b5c2d3913688c653bc3b1bcc3a8d4d07)
08:09:45.378 [INFO - flink-pekko.actor.default-dispatcher-7] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
08:09:45.379 [INFO - flink-pekko.actor.default-dispatcher-8] (ResourceManager.java:390) Registering job manager 8cc19b1861128fb75426d3db98984625@pekko://flink/user/rpc/jobmanager_27 for job 32f61c84b0337638563df63016a801c9.
08:09:45.385 [INFO - flink-pekko.actor.default-dispatcher-7] (ResourceManager.java:1015) Registered job manager 8cc19b1861128fb75426d3db98984625@pekko://flink/user/rpc/jobmanager_27 for job 32f61c84b0337638563df63016a801c9.
08:09:45.388 [INFO - flink-pekko.actor.default-dispatcher-7] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: b5c2d3913688c653bc3b1bcc3a8d4d07.
08:09:45.388 [DEBUG - main] (Connection.java:748) [peer master-127.4.224.189:45505(127.4.224.189:45505)] connecting to peer
08:09:45.388 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 32f61c84b0337638563df63016a801c9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:09:45.388 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.4.9.126:44985(127.4.9.126:44985)] connecting to peer
08:09:45.389 [DEBUG - main] (Connection.java:748) [peer master-127.4.224.190:36787(127.4.224.190:36787)] connecting to peer
08:09:45.389 [DEBUG - main] (Connection.java:748) [peer master-127.4.224.188:40437(127.4.224.188:40437)] connecting to peer
08:09:45.390 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.4.224.189:45505(127.4.224.189:45505)] Successfully connected to peer
08:09:45.398 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.4.224.190:36787(127.4.224.190:36787)] Successfully connected to peer
08:09:45.400 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.224.189
08:09:45.406 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job 32f61c84b0337638563df63016a801c9
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager e0ec56e8-97c4-4f63-b461-3ae00ff39d6a
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
08:09:45.407 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.224.190
08:09:45.407 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot a7bc02a30d02cb10b503d1fd68e9f1a7 from e0ec56e8-97c4-4f63-b461-3ae00ff39d6a for job 32f61c84b0337638563df63016a801c9 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:09:45.409 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1149) Receive slot request a7bc02a30d02cb10b503d1fd68e9f1a7 for job 32f61c84b0337638563df63016a801c9 from resource manager with leader id b5c2d3913688c653bc3b1bcc3a8d4d07.
08:09:45.410 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:321) Allocated slot for a7bc02a30d02cb10b503d1fd68e9f1a7 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:09:45.410 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot d8c48216461f65c7a10cdf35079c9456 from e0ec56e8-97c4-4f63-b461-3ae00ff39d6a for job 32f61c84b0337638563df63016a801c9 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:09:45.410 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 1007ed4b8b85c3932e5da012cebf7be7 from e0ec56e8-97c4-4f63-b461-3ae00ff39d6a for job 32f61c84b0337638563df63016a801c9 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:09:45.411 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 700b91d9459a680512c81aed823fcc3c from e0ec56e8-97c4-4f63-b461-3ae00ff39d6a for job 32f61c84b0337638563df63016a801c9 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:09:45.414 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.4.9.125:45723(127.4.9.125:45723)] connecting to peer
08:09:45.416 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:45.416 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:45.419 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.4.224.188:40437(127.4.224.188:40437)] Successfully connected to peer
08:09:45.420 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultJobLeaderService.java:192) Add job 32f61c84b0337638563df63016a801c9 for job leader monitoring.
08:09:45.421 [INFO - mini-cluster-io-thread-4] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_27 with leader id 5426d3db-9898-4625-8cc1-9b1861128fb7.
08:09:45.421 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1149) Receive slot request d8c48216461f65c7a10cdf35079c9456 for job 32f61c84b0337638563df63016a801c9 from resource manager with leader id b5c2d3913688c653bc3b1bcc3a8d4d07.
08:09:45.421 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:321) Allocated slot for d8c48216461f65c7a10cdf35079c9456 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:09:45.421 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.4.9.126:44985(127.4.9.126:44985)] Successfully connected to peer
08:09:45.421 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1149) Receive slot request 1007ed4b8b85c3932e5da012cebf7be7 for job 32f61c84b0337638563df63016a801c9 from resource manager with leader id b5c2d3913688c653bc3b1bcc3a8d4d07.
08:09:45.421 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:321) Allocated slot for 1007ed4b8b85c3932e5da012cebf7be7 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:09:45.422 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1149) Receive slot request 700b91d9459a680512c81aed823fcc3c for job 32f61c84b0337638563df63016a801c9 from resource manager with leader id b5c2d3913688c653bc3b1bcc3a8d4d07.
08:09:45.422 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:321) Allocated slot for 700b91d9459a680512c81aed823fcc3c with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
08:09:45.423 [INFO - flink-pekko.actor.default-dispatcher-8] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
08:09:45.424 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:45.424 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xb8b4600a, L:/127.0.0.1:54270 - R:/127.4.224.190:36787] using SASL/PLAIN
08:09:45.428 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_27 for job 32f61c84b0337638563df63016a801c9.
08:09:45.428 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1783) Establish JobManager connection for job 32f61c84b0337638563df63016a801c9.
08:09:45.428 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 32f61c84b0337638563df63016a801c9.
08:09:45.429 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7df4b07e, L:/127.0.0.1:47778 - R:/127.4.224.189:45505] using SASL/PLAIN
08:09:45.433 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
08:09:45.434 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id 45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to e0ec56e8-97c4-4f63-b461-3ae00ff39d6a @ 127.0.0.1 (dataPort=-1) with allocation id d8c48216461f65c7a10cdf35079c9456
08:09:45.434 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.224.188
08:09:45.434 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.9.126
08:09:45.436 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot d8c48216461f65c7a10cdf35079c9456.
08:09:45.442 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job 32f61c84b0337638563df63016a801c9.
08:09:45.442 [INFO - flink-pekko.actor.default-dispatcher-9] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
08:09:45.443 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id 32f61c84b0337638563df63016a801c9
08:09:45.446 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.4.9.124:41733(127.4.9.124:41733)] connecting to peer
08:09:45.447 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id d8c48216461f65c7a10cdf35079c9456.
08:09:45.448 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:45.453 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x12ea8908, L:/127.0.0.1:43738 - R:/127.4.9.126:44985] using SASL/PLAIN
08:09:45.453 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:45.454 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.4.9.125:45723(127.4.9.125:45723)] Successfully connected to peer
08:09:45.456 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xfeab5f61, L:/127.0.0.1:34668 - R:/127.4.224.188:40437] using SASL/PLAIN
08:09:45.461 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:09:45.462 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=74), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.224.189:45505, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.224.190:36787, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.224.188:40437, [41ms] Sub RPC ConnectToMaster: received response from server master-127.4.224.190:36787: OK, [45ms] Sub RPC ConnectToMaster: received response from server master-127.4.224.189:45505: OK, [72ms] Sub RPC ConnectToMaster: received response from server master-127.4.224.188:40437: OK, deferred=null) after lookup
08:09:45.464 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:45.464 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:45.465 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:45.465 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:45.465 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:45.465 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:45.465 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:45.465 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:45.465 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:45.465 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:45.465 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:45.465 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:45.465 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:45.466 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.4.9.124:41733(127.4.9.124:41733)] Successfully connected to peer
08:09:45.467 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
08:09:45.467 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id 45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to e0ec56e8-97c4-4f63-b461-3ae00ff39d6a @ 127.0.0.1 (dataPort=-1) with allocation id 700b91d9459a680512c81aed823fcc3c
08:09:45.469 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
08:09:45.469 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id 45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to e0ec56e8-97c4-4f63-b461-3ae00ff39d6a @ 127.0.0.1 (dataPort=-1) with allocation id a7bc02a30d02cb10b503d1fd68e9f1a7
08:09:45.470 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
08:09:45.470 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id 45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to e0ec56e8-97c4-4f63-b461-3ae00ff39d6a @ 127.0.0.1 (dataPort=-1) with allocation id 1007ed4b8b85c3932e5da012cebf7be7
08:09:45.477 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.9.125
08:09:45.479 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 16cb6bf6f4d643eea297d8fcccff08b6
08:09:45.481 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
08:09:45.481 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
08:09:45.481 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 700b91d9459a680512c81aed823fcc3c.
08:09:45.484 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id 700b91d9459a680512c81aed823fcc3c.
08:09:45.487 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot a7bc02a30d02cb10b503d1fd68e9f1a7.
08:09:45.491 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 00c766741b374f8193ab6ebd940ea4d2 for table 'replication_test_table' with partition [<start>, <end>)
08:09:45.491 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=00c766741b374f8193ab6ebd940ea4d2@[0fedadaec47b41689759821a31ad4da5(127.4.224.129:40841),6970736694d04ba2a93e80cda13d1533(127.4.224.130:37197)[L],be6a60c33c2943c9973c8f63d1e4fb49(127.4.224.131:39813)]}]
08:09:45.491 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=10), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.224.188:40437, [10ms] Sub RPC GetTableLocations: received response from server master-127.4.224.188:40437: OK, deferred=null)) after lookup
08:09:45.491 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:45.492 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 6970736694d04ba2a93e80cda13d1533(127.4.224.130:37197)] connecting to peer
08:09:45.494 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:45.494 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:45.494 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:45.494 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:45.494 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:45.494 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:45.495 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:45.495 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:45.495 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:45.495 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:45.495 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:45.495 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:45.495 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:45.496 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xde9d5a18, L:/127.0.0.1:45104 - R:/127.4.9.125:45723] using SASL/PLAIN
08:09:45.500 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 6970736694d04ba2a93e80cda13d1533(127.4.224.130:37197)] Successfully connected to peer
08:09:45.509 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id a7bc02a30d02cb10b503d1fd68e9f1a7.
08:09:45.521 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot d8c48216461f65c7a10cdf35079c9456.
08:09:45.521 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 700b91d9459a680512c81aed823fcc3c.
08:09:45.521 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot a7bc02a30d02cb10b503d1fd68e9f1a7.
08:09:45.521 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 1007ed4b8b85c3932e5da012cebf7be7.
08:09:45.522 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 1007ed4b8b85c3932e5da012cebf7be7.
08:09:45.524 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:45.527 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:45.529 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x0910933c, L:/127.0.0.1:60630 - R:/127.4.224.130:37197] using TOKEN/null
08:09:45.530 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
08:09:45.532 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
08:09:45.534 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3201d36b
08:09:45.534 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:45.535 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit11592401093178161655/checkpoints")
08:09:45.535 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
08:09:45.535 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
08:09:45.542 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id 1007ed4b8b85c3932e5da012cebf7be7.
08:09:45.542 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
08:09:45.545 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@79301ba6
08:09:45.548 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=00c766741b374f8193ab6ebd940ea4d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:09:45.550 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:45.552 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:45.552 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
08:09:45.552 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.9.124
08:09:45.553 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:45.553 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:45.553 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@39261b82
08:09:45.554 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:45.554 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:45.554 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:45.554 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:45.554 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:45.554 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:45.554 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:45.554 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:45.554 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:45.554 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:45.554 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:45.553 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.126:43511(127.27.200.126:43511)] connecting to peer
08:09:45.555 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.124:34439(127.27.200.124:34439)] connecting to peer
08:09:45.555 [DEBUG - pool-476-thread-1] (Connection.java:748) [peer master-127.27.200.125:46459(127.27.200.125:46459)] connecting to peer
08:09:45.555 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:45.555 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.200.126:43511(127.27.200.126:43511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:45.555 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.126:43511: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511
08:09:45.555 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:45.555 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.200.125:46459(127.27.200.125:46459)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:45.555 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.125:46459: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459
08:09:45.555 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:45.555 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.200.124:34439(127.27.200.124:34439)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:45.555 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.200.124:34439: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439
08:09:45.555 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459; will retry
08:09:45.556 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=28946), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [3ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [6ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [7ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [7ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [18ms] refreshing cache from master, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [19ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [21ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [35ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [35ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [38ms] refreshing cache from master, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [39ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [40ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [41ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [41ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [58ms] refreshing cache from master, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [58ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [59ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [59ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [60ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [78ms] refreshing cache from master, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [78ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [79ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [79ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [80ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [97ms] refreshing cache from master, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [98ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [98ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [98ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [98ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [157ms] refreshing cache from master, [157ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [158ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [158ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [158ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [159ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [159ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [159ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [177ms] refreshing cache from master, [177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [178ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [178ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [179ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [179ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [297ms] refreshing cache from master, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [298ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [298ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [298ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [298ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [299ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [299ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [478ms] refreshing cache from master, [478ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [479ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [479ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [479ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [479ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [481ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [481ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1338ms] refreshing cache from master, [1338ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [1338ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [1339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [1339ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [1341ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [1341ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [1341ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2018ms] refreshing cache from master, [2018ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [2018ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [2018ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [2019ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.126:43511: Network error: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511, [2019ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.124:34439: Network error: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439, [2020ms] Sub RPC ConnectToMaster: received response from server master-127.27.200.125:46459: Network error: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [2020ms] delaying RPC due to: Service unavailable: Master config (127.27.200.126:43511,127.27.200.124:34439,127.27.200.125:46459) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.126:43511(127.27.200.126:43511): Connection refused: /127.27.200.126:43511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.124:34439(127.27.200.124:34439): Connection refused: /127.27.200.124:34439,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.200.125:46459(127.27.200.125:46459): Connection refused: /127.27.200.125:46459, [5877ms] refreshing cache from master, [5878ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.126:43511, [5878ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.124:34439, [5878ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.200.125:46459, [5879ms] too many traces: truncated at 100 traces, deferred=Deferred@1359368647(state=PENDING, result=null, callback=(continuation of Deferred@744685373 after retry RPC after error@153724653) -> (continuation of Deferred@546807779 after retry RPC after error@1140619871) -> (continuation of Deferred@2019356170 after retry RPC after error@1015423266) -> (continuation of Deferred@544393686 after retry RPC after error@8155397) -> (continuation of Deferred@525333438 after retry RPC after error@315448900) -> (continuation of Deferred@617023922 after retry RPC after error@1196470390) -> (continuation of Deferred@660764961 after retry RPC after error@1604664567) -> (continuation of Deferred@1135817768 after retry RPC after error@19066664) -> (continuation of Deferred@901592412 after retry RPC after error@1124726168) -> (continuation of Deferred@432114597 after retry RPC after error@260865050) -> (continuation of Deferred@1397210978 after retry RPC after error@1601058215) -> (continuation of Deferred@1256653132 after retry RPC after error@652724390) -> (continuation of Deferred@1219878839 after retry RPC after error@1717045259) -> (continuation of Deferred@348625133 after retry RPC after error@209571883) -> (continuation of Deferred@1783885428 after retry RPC after error@1282259813) -> (continuation of Deferred@1690653429 after retry RPC after error@106638030) -> (continuation of Deferred@1930314815 after retry RPC after error@1377398696) -> (continuation of Deferred@470146532 after retry RPC after error@1138203120) -> (continuation of Deferred@1123615241 after retry RPC after error@1535394257) -> (continuation of Deferred@1776049592 after retry RPC after error@372982122), errback=(continuation of Deferred@744685373 after retry RPC after error@153724653) -> (continuation of Deferred@546807779 after retry RPC after error@1140619871) -> (continuation of Deferred@2019356170 after retry RPC after error@1015423266) -> (continuation of Deferred@544393686 after retry RPC after error@8155397) -> (continuation of Deferred@525333438 after retry RPC after error@315448900) -> (continuation of Deferred@617023922 after retry RPC after error@1196470390) -> (continuation of Deferred@660764961 after retry RPC after error@1604664567) -> (continuation of Deferred@1135817768 after retry RPC after error@19066664) -> (continuation of Deferred@901592412 after retry RPC after error@1124726168) -> (continuation of Deferred@432114597 after retry RPC after error@260865050) -> (continuation of Deferred@1397210978 after retry RPC after error@1601058215) -> (continuation of Deferred@1256653132 after retry RPC after error@652724390) -> (continuation of Deferred@1219878839 after retry RPC after error@1717045259) -> (continuation of Deferred@348625133 after retry RPC after error@209571883) -> (continuation of Deferred@1783885428 after retry RPC after error@1282259813) -> (continuation of Deferred@1690653429 after retry RPC after error@106638030) -> (continuation of Deferred@1930314815 after retry RPC after error@1377398696) -> (continuation of Deferred@470146532 after retry RPC after error@1138203120) -> (continuation of Deferred@1123615241 after retry RPC after error@1535394257) -> (continuation of Deferred@1776049592 after retry RPC after error@372982122)))
08:09:45.556 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:45.558 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:45.558 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit11592401093178161655/checkpoints")
08:09:45.558 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
08:09:45.559 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
08:09:45.558 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit11592401093178161655/checkpoints")
08:09:45.560 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
08:09:45.560 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
08:09:45.563 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
08:09:45.563 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
08:09:45.565 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7d758bea
08:09:45.565 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:45.565 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit11592401093178161655/checkpoints")
08:09:45.565 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
08:09:45.565 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
08:09:45.570 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@349ba107
08:09:45.570 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@ca823af
08:09:45.578 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 32f61c84b0337638563df63016a801c9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 32f61c84b0337638563df63016a801c9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:45.578 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@17c7d1e0
08:09:45.579 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@49429ae0
08:09:45.580 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:45.584 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:45.585 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:45.586 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:45.587 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:45.593 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.4.224.189:45505(127.4.224.189:45505)] connecting to peer
08:09:45.593 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x553802e1, L:/127.0.0.1:40264 - R:/127.4.9.124:41733] using SASL/PLAIN
08:09:45.597 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:09:45.598 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=211), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.9.126:44985, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.9.125:45723, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.9.124:41733, [72ms] Sub RPC ConnectToMaster: received response from server master-127.4.9.126:44985: OK, [124ms] Sub RPC ConnectToMaster: received response from server master-127.4.9.125:45723: OK, [209ms] Sub RPC ConnectToMaster: received response from server master-127.4.9.124:41733: OK, deferred=null) after lookup
08:09:45.598 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.4.224.189:45505(127.4.224.189:45505)] connecting to peer
08:09:45.602 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 6de1c5d6e18848f98421ddb9a0206801
08:09:45.605 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 575ff3b76e2c433182dc6c13ceccca59 for table 'replication_test_table' with partition [<start>, <end>)
08:09:45.606 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=575ff3b76e2c433182dc6c13ceccca59@[0a7023e11f684b96aa2d4965a85ddaa3(127.4.9.65:39865),17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705),f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907)[L]]}]
08:09:45.615 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=00c766741b374f8193ab6ebd940ea4d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:09:45.618 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.4.224.189:45505(127.4.224.189:45505)] connecting to peer
08:09:45.618 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.4.224.189:45505(127.4.224.189:45505)] connecting to peer
08:09:45.619 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.4.224.190:36787(127.4.224.190:36787)] connecting to peer
08:09:45.620 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.4.224.189:45505(127.4.224.189:45505)] Successfully connected to peer
08:09:45.623 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.224.189
08:09:45.629 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.4.224.190:36787(127.4.224.190:36787)] connecting to peer
08:09:45.629 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.4.224.189:45505(127.4.224.189:45505)] Successfully connected to peer
08:09:45.634 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.4.224.188:40437(127.4.224.188:40437)] connecting to peer
08:09:45.637 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.4.224.190:36787(127.4.224.190:36787)] Successfully connected to peer
08:09:45.640 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:45.640 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.224.190
08:09:45.647 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.224.189
08:09:45.645 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x695c1bed, L:/127.0.0.1:47780 - R:/127.4.224.189:45505] using SASL/PLAIN
08:09:45.650 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.4.224.190:36787(127.4.224.190:36787)] connecting to peer
08:09:45.653 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.4.224.189:45505(127.4.224.189:45505)] Successfully connected to peer
08:09:45.657 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.224.189
08:09:45.657 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:45.661 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x4d4b422c, L:/127.0.0.1:47794 - R:/127.4.224.189:45505] using SASL/PLAIN
08:09:45.662 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:45.669 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xf8b45f0a, L:/127.0.0.1:54286 - R:/127.4.224.190:36787] using SASL/PLAIN
08:09:45.674 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=00c766741b374f8193ab6ebd940ea4d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:09:45.678 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.4.224.188:40437(127.4.224.188:40437)] connecting to peer
08:09:45.680 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.4.224.190:36787(127.4.224.190:36787)] Successfully connected to peer
08:09:45.682 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.224.190
08:09:45.687 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:45.687 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.4.224.188:40437(127.4.224.188:40437)] Successfully connected to peer
08:09:45.696 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x80746ca9, L:/127.0.0.1:47810 - R:/127.4.224.189:45505] using SASL/PLAIN
08:09:45.698 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.224.188
08:09:45.705 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.4.224.188:40437(127.4.224.188:40437)] Successfully connected to peer
08:09:45.709 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:45.712 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x675ceb51, L:/127.0.0.1:54298 - R:/127.4.224.190:36787] using SASL/PLAIN
08:09:45.712 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.4.224.188:40437(127.4.224.188:40437)] connecting to peer
08:09:45.714 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.4.224.190:36787(127.4.224.190:36787)] Successfully connected to peer
08:09:45.717 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:45.717 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.224.188
08:09:45.719 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.4.224.190:36787(127.4.224.190:36787)] connecting to peer
08:09:45.720 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.4.224.189:45505(127.4.224.189:45505)] Successfully connected to peer
08:09:45.721 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.4.224.188:40437(127.4.224.188:40437)] connecting to peer
08:09:45.722 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.4.224.190:36787(127.4.224.190:36787)] Successfully connected to peer
08:09:45.723 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.4.224.188:40437(127.4.224.188:40437)] Successfully connected to peer
08:09:45.723 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.224.189
08:09:45.735 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=00c766741b374f8193ab6ebd940ea4d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:09:45.739 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.224.190
08:09:45.752 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:45.757 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:45.758 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xa57e8219, L:/127.0.0.1:34678 - R:/127.4.224.188:40437] using SASL/PLAIN
08:09:45.760 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.4.224.188:40437(127.4.224.188:40437)] Successfully connected to peer
08:09:45.767 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xdc64d384, L:/127.0.0.1:54310 - R:/127.4.224.190:36787] using SASL/PLAIN
08:09:45.772 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xc94d67ae, L:/127.0.0.1:34682 - R:/127.4.224.188:40437] using SASL/PLAIN
08:09:45.775 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.224.190
08:09:45.782 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:45.785 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:09:45.785 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=200), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.224.189:45505, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.224.190:36787, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.224.188:40437, [66ms] Sub RPC ConnectToMaster: received response from server master-127.4.224.189:45505: OK, [75ms] Sub RPC ConnectToMaster: received response from server master-127.4.224.190:36787: OK, [186ms] Sub RPC ConnectToMaster: received response from server master-127.4.224.188:40437: OK, deferred=null) after lookup
08:09:45.787 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.224.188
08:09:45.789 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 16cb6bf6f4d643eea297d8fcccff08b6
08:09:45.789 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x8f802abe, L:/127.0.0.1:47818 - R:/127.4.224.189:45505] using SASL/PLAIN
08:09:45.791 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.224.188
08:09:45.794 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:09:45.794 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=206), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.224.189:45505, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.224.190:36787, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.224.188:40437, [84ms] Sub RPC ConnectToMaster: received response from server master-127.4.224.189:45505: OK, [98ms] Sub RPC ConnectToMaster: received response from server master-127.4.224.190:36787: OK, [175ms] Sub RPC ConnectToMaster: received response from server master-127.4.224.188:40437: OK, deferred=null) after lookup
08:09:45.796 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=00c766741b374f8193ab6ebd940ea4d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:09:45.797 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:45.798 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:45.798 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:45.798 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:45.798 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:45.798 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:45.799 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:45.799 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:45.800 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:45.800 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:45.800 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:45.800 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:45.800 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:45.800 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:45.802 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 16cb6bf6f4d643eea297d8fcccff08b6
08:09:45.802 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@58b27060
08:09:45.804 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
08:09:45.805 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
08:09:45.807 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 16cb6bf6f4d643eea297d8fcccff08b6
08:09:45.807 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xba319751, L:/127.0.0.1:54324 - R:/127.4.224.190:36787] using SASL/PLAIN
08:09:45.811 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 16cb6bf6f4d643eea297d8fcccff08b6
08:09:45.812 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@700e99e8
08:09:45.813 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
08:09:45.813 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
08:09:45.817 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:45.818 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
08:09:45.819 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='226d0767f34f3ad4ee68f960baa402e1bf7c994ac317e9071e259fdb7527576e'}]
08:09:45.822 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:45.823 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:45.825 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x80799071, L:/127.0.0.1:34692 - R:/127.4.224.188:40437] using SASL/PLAIN
08:09:45.829 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x42534a50, L:/127.0.0.1:34704 - R:/127.4.224.188:40437] using SASL/PLAIN
08:09:45.830 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:09:45.830 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=249), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.224.189:45505, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.224.190:36787, [129ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.224.188:40437, [212ms] Sub RPC ConnectToMaster: received response from server master-127.4.224.189:45505: OK, [225ms] Sub RPC ConnectToMaster: received response from server master-127.4.224.190:36787: OK, [237ms] Sub RPC ConnectToMaster: received response from server master-127.4.224.188:40437: OK, deferred=null) after lookup
08:09:45.832 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
08:09:45.835 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 16cb6bf6f4d643eea297d8fcccff08b6
08:09:45.836 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:09:45.838 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:09:45.839 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=252), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.224.189:45505, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.224.190:36787, [34ms] Sub RPC ConnectToMaster: received response from server master-127.4.224.189:45505: OK, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.224.188:40437, [156ms] Sub RPC ConnectToMaster: received response from server master-127.4.224.190:36787: OK, [217ms] Sub RPC ConnectToMaster: received response from server master-127.4.224.188:40437: OK, deferred=null) after lookup
08:09:45.839 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 16cb6bf6f4d643eea297d8fcccff08b6
08:09:45.839 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@431f2c7a
08:09:45.842 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299998, tablet=575ff3b76e2c433182dc6c13ceccca59@[0a7023e11f684b96aa2d4965a85ddaa3(127.4.9.65:39865),17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705),f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907)[L]]}]
08:09:45.843 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 16cb6bf6f4d643eea297d8fcccff08b6
08:09:45.844 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:45.844 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:45.844 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:45.845 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:45.845 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:45.846 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:45.846 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:45.846 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:45.846 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:45.847 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:45.847 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:45.847 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:45.847 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:45.850 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 16cb6bf6f4d643eea297d8fcccff08b6
08:09:45.850 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5ef47614
08:09:45.852 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
08:09:45.855 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=00c766741b374f8193ab6ebd940ea4d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:09:45.856 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
08:09:45.856 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
08:09:45.857 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
08:09:45.857 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
08:09:45.857 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
08:09:45.861 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705)] connecting to peer
08:09:45.862 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
08:09:45.863 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705)] Successfully connected to peer
08:09:45.864 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
08:09:45.867 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.9.66
08:09:45.867 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
08:09:45.868 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (45be7f41566175980c115e651a8ad8a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
08:09:45.877 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:45.887 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x9ca4469a, L:/127.0.0.1:47154 - R:/127.4.9.66:45705] using SASL/PLAIN
08:09:45.915 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=00c766741b374f8193ab6ebd940ea4d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:09:45.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:45.930 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false, responseScanTimestamp = 7287159952941056001) for scanner KuduScanner(table=replication_test_table, tablet=575ff3b76e2c433182dc6c13ceccca59, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:09:45.931 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [226d0767f34f3ad4ee68f960baa402e1bf7c994ac317e9071e259fdb7527576e]
08:09:45.932 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
08:09:45.944 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:45.944 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:45.944 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:45.944 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:45.944 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:45.945 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:45.945 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:45.945 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:45.945 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:45.945 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:45.945 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:45.945 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:45.945 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:45.950 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 00c766741b374f8193ab6ebd940ea4d2 for table 'replication_test_table' with partition [<start>, <end>)
08:09:45.950 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=00c766741b374f8193ab6ebd940ea4d2@[0fedadaec47b41689759821a31ad4da5(127.4.224.129:40841),6970736694d04ba2a93e80cda13d1533(127.4.224.130:37197)[L],be6a60c33c2943c9973c8f63d1e4fb49(127.4.224.131:39813)]}]
08:09:45.952 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 00c766741b374f8193ab6ebd940ea4d2 for table 'replication_test_table' with partition [<start>, <end>)
08:09:45.952 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=00c766741b374f8193ab6ebd940ea4d2@[0fedadaec47b41689759821a31ad4da5(127.4.224.129:40841),6970736694d04ba2a93e80cda13d1533(127.4.224.130:37197)[L],be6a60c33c2943c9973c8f63d1e4fb49(127.4.224.131:39813)]}]
08:09:45.968 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [226d0767f34f3ad4ee68f960baa402e1bf7c994ac317e9071e259fdb7527576e]
08:09:45.972 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 226d0767f34f3ad4ee68f960baa402e1bf7c994ac317e9071e259fdb7527576e finished by subtask 3; deferring removal (restored in pending)
08:09:45.973 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=00c766741b374f8193ab6ebd940ea4d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:09:45.975 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
08:09:45.975 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
08:09:45.975 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705)] disconnecting while in state READY
08:09:45.976 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:09:46.012 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705)] handling channelInactive
08:09:46.013 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705)] cleaning up while in state READY due to: connection closed
08:09:46.013 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
08:09:46.014 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
08:09:46.028 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:46.044 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:46.044 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:46.044 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:46.044 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:46.045 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:46.045 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:46.045 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:46.045 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:46.045 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:46.045 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:46.045 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:46.045 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:46.045 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:46.054 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:46.054 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:46.074 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=00c766741b374f8193ab6ebd940ea4d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:09:46.078 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091786077 for job 32f61c84b0337638563df63016a801c9.
08:09:46.084 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=10, operationSize=1800, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@687ac23a, flushNotification=Deferred@1841157923(state=PENDING, result=null, callback=<none>, errback=<none>)}
08:09:46.085 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 6970736694d04ba2a93e80cda13d1533(127.4.224.130:37197)] connecting to peer
08:09:46.119 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 6970736694d04ba2a93e80cda13d1533(127.4.224.130:37197)] Successfully connected to peer
08:09:46.142 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=00c766741b374f8193ab6ebd940ea4d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:09:46.152 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:46.152 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:46.153 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:46.153 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:46.153 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:46.153 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:46.154 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:46.154 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:46.154 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:46.154 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:46.154 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:46.154 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:46.154 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:46.162 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:46.167 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x1200fb53, L:/127.0.0.1:60644 - R:/127.4.224.130:37197] using TOKEN/null
08:09:46.198 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:46.199 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:46.199 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:46.199 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:46.199 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:46.199 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:46.200 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:46.200 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:46.200 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:46.200 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:46.200 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:46.201 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:46.201 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:46.212 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=00c766741b374f8193ab6ebd940ea4d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:09:46.274 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=00c766741b374f8193ab6ebd940ea4d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:09:46.340 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=00c766741b374f8193ab6ebd940ea4d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:09:46.391 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job 32f61c84b0337638563df63016a801c9 (1949 bytes, checkpointDuration=313 ms, finalizationTime=0 ms).
08:09:46.392 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:46.392 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:46.393 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:46.393 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:46.393 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:46.393 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:46.396 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:46.396 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:46.396 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:46.396 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:46.396 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:46.396 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:46.396 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:46.397 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:46.397 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:46.397 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:46.398 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
08:09:46.398 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 226d0767f34f3ad4ee68f960baa402e1bf7c994ac317e9071e259fdb7527576e from pending
08:09:46.398 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 1 finished splits from enumerator state
08:09:46.399 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:46.399 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:46.399 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:46.400 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:46.400 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:46.400 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:46.400 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:46.400 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:46.400 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:46.400 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:46.411 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=00c766741b374f8193ab6ebd940ea4d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:09:46.417 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 6de1c5d6e18848f98421ddb9a0206801
08:09:46.423 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:46.485 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=575ff3b76e2c433182dc6c13ceccca59, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:09:46.495 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 16cb6bf6f4d643eea297d8fcccff08b6
08:09:46.515 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=00c766741b374f8193ab6ebd940ea4d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:09:46.517 [DEBUG - main] (Connection.java:575) [peer master-127.4.224.190:36787(127.4.224.190:36787)] disconnecting while in state READY
08:09:46.518 [DEBUG - main] (Connection.java:575) [peer master-127.4.224.188:40437(127.4.224.188:40437)] disconnecting while in state READY
08:09:46.518 [DEBUG - main] (Connection.java:575) [peer 6970736694d04ba2a93e80cda13d1533(127.4.224.130:37197)] disconnecting while in state READY
08:09:46.518 [DEBUG - main] (Connection.java:575) [peer master-127.4.224.189:45505(127.4.224.189:45505)] disconnecting while in state READY
08:09:46.518 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.4.224.190:36787(127.4.224.190:36787)] handling channelInactive
08:09:46.518 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.224.190:36787(127.4.224.190:36787)] cleaning up while in state READY due to: connection closed
08:09:46.519 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.4.224.189:45505(127.4.224.189:45505)] handling channelInactive
08:09:46.519 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.224.189:45505(127.4.224.189:45505)] cleaning up while in state READY due to: connection closed
08:09:46.522 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.4.224.188:40437(127.4.224.188:40437)] handling channelInactive
08:09:46.522 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.224.188:40437(127.4.224.188:40437)] cleaning up while in state READY due to: connection closed
08:09:46.523 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:09:46.526 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
08:09:46.526 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
08:09:46.526 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-2
08:09:46.527 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:46.530 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 6970736694d04ba2a93e80cda13d1533(127.4.224.130:37197)] handling channelInactive
08:09:46.530 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 6970736694d04ba2a93e80cda13d1533(127.4.224.130:37197)] cleaning up while in state READY due to: connection closed
08:09:46.530 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 28 thread-local buffer(s) from thread: kudu-nio-3
08:09:46.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:46.531113  4994 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 5373
08:09:46.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:46.556 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:46.577 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091786577 for job 32f61c84b0337638563df63016a801c9.
08:09:46.590 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job 32f61c84b0337638563df63016a801c9 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
08:09:46.591 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
08:09:46.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:46.678480  4994 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 5619
08:09:46.736 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 6970736694d04ba2a93e80cda13d1533(127.4.224.130:37197)] handling channelInactive
08:09:46.736 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 6970736694d04ba2a93e80cda13d1533(127.4.224.130:37197)] cleaning up while in state READY due to: connection closed
08:09:46.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:46.738332  4994 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 5768
08:09:46.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:46.791805  4994 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 5006
08:09:46.842 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.4.224.190:36787(127.4.224.190:36787)] handling channelInactive
08:09:46.842 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.4.224.190:36787(127.4.224.190:36787)] handling channelInactive
08:09:46.842 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.224.190:36787(127.4.224.190:36787)] cleaning up while in state READY due to: connection closed
08:09:46.842 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.4.224.190:36787(127.4.224.190:36787)] handling channelInactive
08:09:46.843 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.224.190:36787(127.4.224.190:36787)] cleaning up while in state READY due to: connection closed
08:09:46.842 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.224.190:36787(127.4.224.190:36787)] cleaning up while in state READY due to: connection closed
08:09:46.843 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.4.224.190:36787(127.4.224.190:36787)] handling channelInactive
08:09:46.843 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.224.190:36787(127.4.224.190:36787)] cleaning up while in state READY due to: connection closed
08:09:46.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:46.856657  4994 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 5100
08:09:46.903 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.4.224.189:45505(127.4.224.189:45505)] handling channelInactive
08:09:46.904 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.224.189:45505(127.4.224.189:45505)] cleaning up while in state READY due to: connection closed
08:09:46.904 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.4.224.189:45505(127.4.224.189:45505)] handling channelInactive
08:09:46.904 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.224.189:45505(127.4.224.189:45505)] cleaning up while in state READY due to: connection closed
08:09:46.904 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.4.224.189:45505(127.4.224.189:45505)] handling channelInactive
08:09:46.904 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.224.189:45505(127.4.224.189:45505)] cleaning up while in state READY due to: connection closed
08:09:46.903 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.4.224.189:45505(127.4.224.189:45505)] handling channelInactive
08:09:46.905 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.224.189:45505(127.4.224.189:45505)] cleaning up while in state READY due to: connection closed
08:09:46.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:46.906046  4994 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 5189
08:09:46.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:46.962 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:46.962 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:46.962 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:46.963 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:46.963 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:46.963 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:46.964 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:46.964 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:46.964 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:46.964 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:46.963 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:46.964 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:46.964 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:46.965 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.4.224.188:40437(127.4.224.188:40437)] handling channelInactive
08:09:46.965 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.4.224.188:40437(127.4.224.188:40437)] handling channelInactive
08:09:46.966 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.224.188:40437(127.4.224.188:40437)] cleaning up while in state READY due to: connection closed
08:09:46.966 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.224.188:40437(127.4.224.188:40437)] cleaning up while in state READY due to: connection closed
08:09:46.966 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.4.224.188:40437(127.4.224.188:40437)] handling channelInactive
08:09:46.967 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.224.188:40437(127.4.224.188:40437)] cleaning up while in state READY due to: connection closed
08:09:46.967 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.4.224.188:40437(127.4.224.188:40437)] handling channelInactive
08:09:46.967 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.224.188:40437(127.4.224.188:40437)] cleaning up while in state READY due to: connection closed
08:09:47.028 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:47.038 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:47.038 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:47.038 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:47.039 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:47.039 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:47.039 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:47.040 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:47.040 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:47.040 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:47.040 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:47.040 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:47.040 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:47.040 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:47.041 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=26806), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [20ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [26ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [37ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [37ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [48ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [54ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [60ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [61ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [103ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [112ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [117ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [118ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [143ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [164ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [165ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [165ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [166ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [202ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [202ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [203ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [203ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [242ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [242ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [243ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [243ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [301ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [302ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [302ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [302ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [482ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [482ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [483ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [483ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [803ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [804ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [804ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [804ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1163ms] refreshing cache from master, [1163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1165ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1166ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1167ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1168ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3060ms] refreshing cache from master, [3060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [3061ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [3063ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [3063ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3063ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3821ms] refreshing cache from master, [3821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [3821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [3822ms] too many traces: truncated at 100 traces, deferred=Deferred@1161617518(state=PENDING, result=null, callback=(continuation of Deferred@1982074838 after retry RPC after error@473892479) -> (continuation of Deferred@1553500087 after retry RPC after error@2114270170) -> (continuation of Deferred@671734131 after retry RPC after error@1281437427) -> (continuation of Deferred@1423752695 after retry RPC after error@51433301) -> (continuation of Deferred@1706314757 after retry RPC after error@552067318) -> (continuation of Deferred@291885592 after retry RPC after error@344640774) -> (continuation of Deferred@1402568694 after retry RPC after error@1281807651) -> (continuation of Deferred@1932274597 after retry RPC after error@831273531) -> (continuation of Deferred@703763763 after retry RPC after error@1405588195) -> (continuation of Deferred@1101331005 after retry RPC after error@296312272) -> (continuation of Deferred@743381467 after retry RPC after error@1139852859) -> (continuation of Deferred@627292522 after retry RPC after error@2130651083) -> (continuation of Deferred@707426318 after retry RPC after error@1873719918) -> (continuation of Deferred@1463741976 after retry RPC after error@1358449227) -> (continuation of Deferred@703312466 after retry RPC after error@860637379) -> (continuation of Deferred@321011356 after retry RPC after error@26907809) -> (continuation of Deferred@1972887522 after retry RPC after error@609000387) -> (continuation of Deferred@639145736 after retry RPC after error@1936859382) -> (continuation of Deferred@944871861 after retry RPC after error@2021892095) -> (continuation of Deferred@440530736 after retry RPC after error@2018902302) -> (continuation of Deferred@1291760528 after retry RPC after error@677818775) -> (continuation of Deferred@1024146396 after retry RPC after error@1964868498) -> (continuation of Deferred@1279708306 after retry RPC after error@1370568324) -> (continuation of Deferred@897589941 after retry RPC after error@748172932) -> (continuation of Deferred@1447054809 after retry RPC after error@236799107), errback=(continuation of Deferred@1982074838 after retry RPC after error@473892479) -> (continuation of Deferred@1553500087 after retry RPC after error@2114270170) -> (continuation of Deferred@671734131 after retry RPC after error@1281437427) -> (continuation of Deferred@1423752695 after retry RPC after error@51433301) -> (continuation of Deferred@1706314757 after retry RPC after error@552067318) -> (continuation of Deferred@291885592 after retry RPC after error@344640774) -> (continuation of Deferred@1402568694 after retry RPC after error@1281807651) -> (continuation of Deferred@1932274597 after retry RPC after error@831273531) -> (continuation of Deferred@703763763 after retry RPC after error@1405588195) -> (continuation of Deferred@1101331005 after retry RPC after error@296312272) -> (continuation of Deferred@743381467 after retry RPC after error@1139852859) -> (continuation of Deferred@627292522 after retry RPC after error@2130651083) -> (continuation of Deferred@707426318 after retry RPC after error@1873719918) -> (continuation of Deferred@1463741976 after retry RPC after error@1358449227) -> (continuation of Deferred@703312466 after retry RPC after error@860637379) -> (continuation of Deferred@321011356 after retry RPC after error@26907809) -> (continuation of Deferred@1972887522 after retry RPC after error@609000387) -> (continuation of Deferred@639145736 after retry RPC after error@1936859382) -> (continuation of Deferred@944871861 after retry RPC after error@2021892095) -> (continuation of Deferred@440530736 after retry RPC after error@2018902302) -> (continuation of Deferred@1291760528 after retry RPC after error@677818775) -> (continuation of Deferred@1024146396 after retry RPC after error@1964868498) -> (continuation of Deferred@1279708306 after retry RPC after error@1370568324) -> (continuation of Deferred@897589941 after retry RPC after error@748172932) -> (continuation of Deferred@1447054809 after retry RPC after error@236799107)))
08:09:47.044 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (SourceReaderBase.java:338) Closing Source Reader.
08:09:47.044 [WARN - Source: KuduSource -> Sink: Writer (1/4)#8] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#8 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_8) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=26806), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [20ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [26ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [37ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [37ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [48ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [54ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [60ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [61ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [103ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [112ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [117ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [118ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [143ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [164ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [165ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [165ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [166ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [202ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [202ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [203ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [203ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [242ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [242ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [243ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [243ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [301ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [302ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [302ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [302ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [482ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [482ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [483ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [483ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [803ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [804ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [804ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [804ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1163ms] refreshing cache from master, [1163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1165ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1166ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1167ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1168ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3060ms] refreshing cache from master, [3060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [3061ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [3063ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [3063ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3063ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3821ms] refreshing cache from master, [3821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [3821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [3822ms] too many traces: truncated at 100 traces, deferred=Deferred@1161617518(state=PENDING, result=null, callback=(continuation of Deferred@1982074838 after retry RPC after error@473892479) -> (continuation of Deferred@1553500087 after retry RPC after error@2114270170) -> (continuation of Deferred@671734131 after retry RPC after error@1281437427) -> (continuation of Deferred@1423752695 after retry RPC after error@51433301) -> (continuation of Deferred@1706314757 after retry RPC after error@552067318) -> (continuation of Deferred@291885592 after retry RPC after error@344640774) -> (continuation of Deferred@1402568694 after retry RPC after error@1281807651) -> (continuation of Deferred@1932274597 after retry RPC after error@831273531) -> (continuation of Deferred@703763763 after retry RPC after error@1405588195) -> (continuation of Deferred@1101331005 after retry RPC after error@296312272) -> (continuation of Deferred@743381467 after retry RPC after error@1139852859) -> (continuation of Deferred@627292522 after retry RPC after error@2130651083) -> (continuation of Deferred@707426318 after retry RPC after error@1873719918) -> (continuation of Deferred@1463741976 after retry RPC after error@1358449227) -> (continuation of Deferred@703312466 after retry RPC after error@860637379) -> (continuation of Deferred@321011356 after retry RPC after error@26907809) -> (continuation of Deferred@1972887522 after retry RPC after error@609000387) -> (continuation of Deferred@639145736 after retry RPC after error@1936859382) -> (continuation of Deferred@944871861 after retry RPC after error@2021892095) -> (continuation of Deferred@440530736 after retry RPC after error@2018902302) -> (continuation of Deferred@1291760528 after retry RPC after error@677818775) -> (continuation of Deferred@1024146396 after retry RPC after error@1964868498) -> (continuation of Deferred@1279708306 after retry RPC after error@1370568324) -> (continuation of Deferred@897589941 after retry RPC after error@748172932) -> (continuation of Deferred@1447054809 after retry RPC after error@236799107), errback=(continuation of Deferred@1982074838 after retry RPC after error@473892479) -> (continuation of Deferred@1553500087 after retry RPC after error@2114270170) -> (continuation of Deferred@671734131 after retry RPC after error@1281437427) -> (continuation of Deferred@1423752695 after retry RPC after error@51433301) -> (continuation of Deferred@1706314757 after retry RPC after error@552067318) -> (continuation of Deferred@291885592 after retry RPC after error@344640774) -> (continuation of Deferred@1402568694 after retry RPC after error@1281807651) -> (continuation of Deferred@1932274597 after retry RPC after error@831273531) -> (continuation of Deferred@703763763 after retry RPC after error@1405588195) -> (continuation of Deferred@1101331005 after retry RPC after error@296312272) -> (continuation of Deferred@743381467 after retry RPC after error@1139852859) -> (continuation of Deferred@627292522 after retry RPC after error@2130651083) -> (continuation of Deferred@707426318 after retry RPC after error@1873719918) -> (continuation of Deferred@1463741976 after retry RPC after error@1358449227) -> (continuation of Deferred@703312466 after retry RPC after error@860637379) -> (continuation of Deferred@321011356 after retry RPC after error@26907809) -> (continuation of Deferred@1972887522 after retry RPC after error@609000387) -> (continuation of Deferred@639145736 after retry RPC after error@1936859382) -> (continuation of Deferred@944871861 after retry RPC after error@2021892095) -> (continuation of Deferred@440530736 after retry RPC after error@2018902302) -> (continuation of Deferred@1291760528 after retry RPC after error@677818775) -> (continuation of Deferred@1024146396 after retry RPC after error@1964868498) -> (continuation of Deferred@1279708306 after retry RPC after error@1370568324) -> (continuation of Deferred@897589941 after retry RPC after error@748172932) -> (continuation of Deferred@1447054809 after retry RPC after error@236799107)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:47.048 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#8 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_8).
08:09:47.050 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#8 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_8.
08:09:47.052 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_8) switched from INITIALIZING to FAILED on 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=26806), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [20ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [26ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [37ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [37ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [48ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [54ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [60ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [61ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [103ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [112ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [117ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [118ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [142ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [143ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [143ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [164ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [165ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [165ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [166ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [202ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [202ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [203ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [203ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [242ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [242ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [243ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [243ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [301ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [302ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [302ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [302ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [482ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [482ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [483ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [483ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [803ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [804ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [804ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [804ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1163ms] refreshing cache from master, [1163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1165ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1166ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1167ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1168ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3060ms] refreshing cache from master, [3060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [3061ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [3063ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [3063ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3063ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3821ms] refreshing cache from master, [3821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [3821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [3822ms] too many traces: truncated at 100 traces, deferred=Deferred@1161617518(state=PENDING, result=null, callback=(continuation of Deferred@1982074838 after retry RPC after error@473892479) -> (continuation of Deferred@1553500087 after retry RPC after error@2114270170) -> (continuation of Deferred@671734131 after retry RPC after error@1281437427) -> (continuation of Deferred@1423752695 after retry RPC after error@51433301) -> (continuation of Deferred@1706314757 after retry RPC after error@552067318) -> (continuation of Deferred@291885592 after retry RPC after error@344640774) -> (continuation of Deferred@1402568694 after retry RPC after error@1281807651) -> (continuation of Deferred@1932274597 after retry RPC after error@831273531) -> (continuation of Deferred@703763763 after retry RPC after error@1405588195) -> (continuation of Deferred@1101331005 after retry RPC after error@296312272) -> (continuation of Deferred@743381467 after retry RPC after error@1139852859) -> (continuation of Deferred@627292522 after retry RPC after error@2130651083) -> (continuation of Deferred@707426318 after retry RPC after error@1873719918) -> (continuation of Deferred@1463741976 after retry RPC after error@1358449227) -> (continuation of Deferred@703312466 after retry RPC after error@860637379) -> (continuation of Deferred@321011356 after retry RPC after error@26907809) -> (continuation of Deferred@1972887522 after retry RPC after error@609000387) -> (continuation of Deferred@639145736 after retry RPC after error@1936859382) -> (continuation of Deferred@944871861 after retry RPC after error@2021892095) -> (continuation of Deferred@440530736 after retry RPC after error@2018902302) -> (continuation of Deferred@1291760528 after retry RPC after error@677818775) -> (continuation of Deferred@1024146396 after retry RPC after error@1964868498) -> (continuation of Deferred@1279708306 after retry RPC after error@1370568324) -> (continuation of Deferred@897589941 after retry RPC after error@748172932) -> (continuation of Deferred@1447054809 after retry RPC after error@236799107), errback=(continuation of Deferred@1982074838 after retry RPC after error@473892479) -> (continuation of Deferred@1553500087 after retry RPC after error@2114270170) -> (continuation of Deferred@671734131 after retry RPC after error@1281437427) -> (continuation of Deferred@1423752695 after retry RPC after error@51433301) -> (continuation of Deferred@1706314757 after retry RPC after error@552067318) -> (continuation of Deferred@291885592 after retry RPC after error@344640774) -> (continuation of Deferred@1402568694 after retry RPC after error@1281807651) -> (continuation of Deferred@1932274597 after retry RPC after error@831273531) -> (continuation of Deferred@703763763 after retry RPC after error@1405588195) -> (continuation of Deferred@1101331005 after retry RPC after error@296312272) -> (continuation of Deferred@743381467 after retry RPC after error@1139852859) -> (continuation of Deferred@627292522 after retry RPC after error@2130651083) -> (continuation of Deferred@707426318 after retry RPC after error@1873719918) -> (continuation of Deferred@1463741976 after retry RPC after error@1358449227) -> (continuation of Deferred@703312466 after retry RPC after error@860637379) -> (continuation of Deferred@321011356 after retry RPC after error@26907809) -> (continuation of Deferred@1972887522 after retry RPC after error@609000387) -> (continuation of Deferred@639145736 after retry RPC after error@1936859382) -> (continuation of Deferred@944871861 after retry RPC after error@2021892095) -> (continuation of Deferred@440530736 after retry RPC after error@2018902302) -> (continuation of Deferred@1291760528 after retry RPC after error@677818775) -> (continuation of Deferred@1024146396 after retry RPC after error@1964868498) -> (continuation of Deferred@1279708306 after retry RPC after error@1370568324) -> (continuation of Deferred@897589941 after retry RPC after error@748172932) -> (continuation of Deferred@1447054809 after retry RPC after error@236799107)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:47.054 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:47.058 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:09:47.059 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#8) of source Source: KuduSource.
08:09:47.060 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_0_8.
08:09:47.060 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (b42812d69c586178cf7556c3c92998f3) switched from state RUNNING to RESTARTING.
08:09:47.061 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job b42812d69c586178cf7556c3c92998f3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job b42812d69c586178cf7556c3c92998f3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:47.078 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091787077 for job 32f61c84b0337638563df63016a801c9.
08:09:47.090 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job 32f61c84b0337638563df63016a801c9 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
08:09:47.091 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
08:09:47.107 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:47.107 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:47.107 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:47.108 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:47.108 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:47.108 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:47.108 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:47.108 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:47.108 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:47.109 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:47.109 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:47.110 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:47.110 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:47.235 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:47.235 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:47.235 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:47.236 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:47.236 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:47.236 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:47.236 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:47.237 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:47.237 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:47.236 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:47.237 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:47.237 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:47.237 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:47.375 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 6de1c5d6e18848f98421ddb9a0206801
08:09:47.380 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='72788bdad0fbe53640c32a067e6b091d6af19f1cebf5ec1944cca87359778221'}]
08:09:47.384 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:47.385 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:09:47.390 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=298226, tablet=575ff3b76e2c433182dc6c13ceccca59@[0a7023e11f684b96aa2d4965a85ddaa3(127.4.9.65:39865),17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705),f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907)[L]]}]
08:09:47.398 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705)] connecting to peer
08:09:47.411 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705)] Successfully connected to peer
08:09:47.420 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.9.66
08:09:47.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:47.441 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:47.443 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:47.443 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:47.443 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:47.444 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:47.444 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:47.444 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:47.444 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:47.444 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:47.444 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:47.444 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:47.444 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:47.444 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:47.444 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:47.449 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x118e832b, L:/127.0.0.1:34116 - R:/127.4.9.66:45705] using SASL/PLAIN
08:09:47.470 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:47.470 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:47.471 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:47.471 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:47.472 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:47.472 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:47.472 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:47.472 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:47.473 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:47.473 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:47.474 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:47.474 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:47.474 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:47.483 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7287159961055232001) for scanner KuduScanner(table=replication_test_table, tablet=575ff3b76e2c433182dc6c13ceccca59, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:09:47.484 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [72788bdad0fbe53640c32a067e6b091d6af19f1cebf5ec1944cca87359778221]
08:09:47.484 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [72788bdad0fbe53640c32a067e6b091d6af19f1cebf5ec1944cca87359778221]
08:09:47.485 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
08:09:47.485 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
08:09:47.486 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 72788bdad0fbe53640c32a067e6b091d6af19f1cebf5ec1944cca87359778221 finished by subtask 0; deferring removal (restored in pending)
08:09:47.486 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705)] disconnecting while in state READY
08:09:47.488 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:09:47.497 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705)] handling channelInactive
08:09:47.498 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705)] cleaning up while in state READY due to: connection closed
08:09:47.498 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
08:09:47.498 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
08:09:47.528 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:47.554 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:47.556 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:47.556 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:47.556 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:47.556 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:47.556 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:47.556 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:47.557 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:47.557 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:47.557 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:47.557 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:47.557 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:47.557 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:47.557 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:47.578 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091787577 for job 32f61c84b0337638563df63016a801c9.
08:09:47.602 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job 32f61c84b0337638563df63016a801c9 (1959 bytes, checkpointDuration=25 ms, finalizationTime=0 ms).
08:09:47.605 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
08:09:47.605 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 4 complete: removed split 72788bdad0fbe53640c32a067e6b091d6af19f1cebf5ec1944cca87359778221 from pending
08:09:47.605 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 4 complete: removed 1 finished splits from enumerator state
08:09:47.634 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:47.634 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:47.634 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:47.634 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:47.635 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:47.635 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:47.635 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:47.635 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:47.636 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:47.636 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:47.636 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:47.636 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:47.636 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:47.643 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:47.643 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:47.644 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:47.644 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:47.644 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:47.644 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:47.644 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:47.644 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:47.644 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:47.645 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:47.645 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:47.645 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:47.645 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:47.810 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:47.810 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:47.810 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:47.811 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:47.811 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:47.811 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:47.811 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:47.811 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:47.811 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:47.812 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:47.812 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:47.812 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:47.812 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:47.844 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:47.844 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:47.844 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:47.845 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:47.845 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:47.845 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:47.846 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:47.846 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:47.846 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:47.846 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:47.846 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:47.846 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:47.846 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:47.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:47.928 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:47.928 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:47.928 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:47.929 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:47.929 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:47.929 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:47.930 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:47.930 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:47.930 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:47.930 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:47.930 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:47.930 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:47.930 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:47.973 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:47.973 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:47.973 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:47.974 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:47.974 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:47.974 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:47.974 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:47.974 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:47.974 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:47.975 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:47.975 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:47.975 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:47.975 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:48.028 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:48.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:48.078 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091788077 for job 32f61c84b0337638563df63016a801c9.
08:09:48.099 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job 32f61c84b0337638563df63016a801c9 (964 bytes, checkpointDuration=21 ms, finalizationTime=1 ms).
08:09:48.105 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
08:09:48.185 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:48.185 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:48.185 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:48.186 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:48.186 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:48.186 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:48.186 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:48.186 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:48.186 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:48.187 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:48.187 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:48.187 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:48.187 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:48.246 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:48.246 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:48.246 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:48.247 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:48.247 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:48.247 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:48.247 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:48.248 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:48.248 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:48.248 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:48.248 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:48.248 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:48.248 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:48.263 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:48.264 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:48.264 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:48.264 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:48.264 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:48.264 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:48.264 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:48.265 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:48.265 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:48.265 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:48.264 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:48.266 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:48.266 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:48.285 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:48.286 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:48.286 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:48.287 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:48.287 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:48.287 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:48.288 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:48.288 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:48.288 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:48.288 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:48.288 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:48.288 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:48.288 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:48.303 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:48.304 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:48.304 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:48.304 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:48.304 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:48.304 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:48.304 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:48.304 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:48.304 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:48.304 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:48.305 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:48.305 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:48.305 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:48.386 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:48.387 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:48.387 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:48.387 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:48.388 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:48.388 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:48.388 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:48.388 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:48.388 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:48.389 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:48.389 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:48.389 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:48.389 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:48.424 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:48.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:09:48Z chronyd exiting
08:09:48.528 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:48.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:48.566 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:48.567 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:48.567 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:48.567 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:48.567 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:48.567 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:48.567 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:48.567 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:48.567 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:48.568 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:48.568 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:48.568 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:48.568 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:48.578 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091788576 for job 32f61c84b0337638563df63016a801c9.
08:09:48.584 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:48.585 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:48.585 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:48.585 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:48.585 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:48.585 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:48.586 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:48.586 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:48.586 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:48.586 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:48.587 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:48.587 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:48.587 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:48.593 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job 32f61c84b0337638563df63016a801c9 (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
08:09:48.595 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
08:09:48.605 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:48.606 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:48.606 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:48.607 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:48.607 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:48.607 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:48.607 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:48.607 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:48.607 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:48.607 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:48.608 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:48.608 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:48.608 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:48.786 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:48.786 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:48.786 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:48.786 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:48.787 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:48.787 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:48.787 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:48.787 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:48.787 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:48.787 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:48.787 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:48.787 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:48.787 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:48.824 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:48.824 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:48.824 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:48.825 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:48.825 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:48.825 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:48.826 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:48.826 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:48.826 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:48.827 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:48.827 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:48.827 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:48.827 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:48.870 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:48.870 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:48.870 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:48.871 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:48.871 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:48.871 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:48.871 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:48.871 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:48.871 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:48.871 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:48.871 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:48.872 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:48.872 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:48.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:49.028 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:49.054 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:49.078 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091789077 for job 32f61c84b0337638563df63016a801c9.
08:09:49.092 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job 32f61c84b0337638563df63016a801c9 (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
08:09:49.093 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
08:09:49.150 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:49.151 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:49.151 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:49.151 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:49.151 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:49.152 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:49.152 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:49.152 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:49.152 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:49.152 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:49.152 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:49.152 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:49.152 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:49.273 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:49.274 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:49.274 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:49.275 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:49.275 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:49.275 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:49.275 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:49.275 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:49.275 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:49.275 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:49.276 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:49.276 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:49.276 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:49.292 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:49.292 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:49.292 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:49.293 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:49.293 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:49.293 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:49.293 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:49.293 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:49.293 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:49.293 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:49.293 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:49.293 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:49.293 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:49.372 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 6de1c5d6e18848f98421ddb9a0206801
08:09:49.375 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='64a58b1cb2e0c1fe52edeb41c77766478063d2edba07a7de9ad859654fe25119'}]
08:09:49.378 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:49.379 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
08:09:49.380 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=296231, tablet=575ff3b76e2c433182dc6c13ceccca59@[0a7023e11f684b96aa2d4965a85ddaa3(127.4.9.65:39865),17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705),f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907)[L]]}]
08:09:49.381 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705)] connecting to peer
08:09:49.385 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705)] Successfully connected to peer
08:09:49.394 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.9.66
08:09:49.406 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:49.421 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:49.422 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7a6612f3, L:/127.0.0.1:34124 - R:/127.4.9.66:45705] using SASL/PLAIN
08:09:49.434 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:49.434 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:49.435 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:49.435 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:49.435 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:49.435 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:49.435 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:49.435 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:49.435 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:49.435 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:49.435 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:49.436 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:49.436 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:49.453 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.254:38449(127.1.134.254:38449)] connecting to peer
08:09:49.454 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:49.454 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.134.254:38449(127.1.134.254:38449)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:49.454 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.254:38449: Failed to connect to peer master-127.1.134.254:38449(127.1.134.254:38449): Connection refused: /127.1.134.254:38449
08:09:49.453 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.253:41425(127.1.134.253:41425)] connecting to peer
08:09:49.455 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.1.134.252:42093(127.1.134.252:42093)] connecting to peer
08:09:49.455 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:49.455 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.134.253:41425(127.1.134.253:41425)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:49.455 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.253:41425: Failed to connect to peer master-127.1.134.253:41425(127.1.134.253:41425): Connection refused: /127.1.134.253:41425
08:09:49.456 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:49.456 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.134.252:42093(127.1.134.252:42093)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:49.456 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.134.252:42093: Failed to connect to peer master-127.1.134.252:42093(127.1.134.252:42093): Connection refused: /127.1.134.252:42093
08:09:49.456 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.134.254:38449,127.1.134.253:41425,127.1.134.252:42093; will retry
08:09:49.469 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:49.470 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:49.470 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:49.470 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:49.471 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:49.471 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:49.471 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:49.471 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:49.471 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:49.471 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:49.471 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:49.471 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:49.472 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:49.527 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:49.556 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:49.578 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091789577 for job 32f61c84b0337638563df63016a801c9.
08:09:49.590 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job 32f61c84b0337638563df63016a801c9 (1959 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
08:09:49.592 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
08:09:49.604 [ERROR - main] (RetryRule.java:206) org.apache.kudu.replication.TestReplicationTableInitializer.testTableInitializationSmoke: failed attempt 1
org.apache.kudu.shaded.org.apache.commons.logging.LogConfigurationException: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl (Caused by java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1158)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory$2.run(LogFactory.java:960)
	at java.base/java.security.AccessController.doPrivileged(AccessController.java:318)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.newFactory(LogFactory.java:957)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getFactory(LogFactory.java:624)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getLog(LogFactory.java:655)
	at org.apache.kudu.shaded.org.apache.http.conn.ssl.DefaultHostnameVerifier.<init>(DefaultHostnameVerifier.java:82)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClientBuilder.build(HttpClientBuilder.java:970)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClients.createDefault(HttpClients.java:56)
	at org.apache.kudu.test.junit.ResultReporter.reportResult(ResultReporter.java:207)
	at org.apache.kudu.test.junit.ResultReporter.tryReportResult(ResultReporter.java:244)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.report(RetryRule.java:165)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:191)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
Caused by: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1020)
	... 42 more
08:09:49.674 [ERROR - main] (RetryRule.java:253) org.apache.kudu.replication.TestReplicationTableInitializer.testTableInitializationSmoke: giving up after 1 attempts
08:09:49.674 [DEBUG - main] (Connection.java:575) [peer f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907)] disconnecting while in state READY
08:09:49.674 [DEBUG - main] (Connection.java:575) [peer master-127.4.9.126:44985(127.4.9.126:44985)] disconnecting while in state READY
08:09:49.674 [DEBUG - main] (Connection.java:575) [peer master-127.4.9.124:41733(127.4.9.124:41733)] disconnecting while in state READY
08:09:49.675 [DEBUG - main] (Connection.java:575) [peer master-127.4.9.125:45723(127.4.9.125:45723)] disconnecting while in state READY
08:09:49.675 [DEBUG - kudu-nio-3] (Connection.java:239) [peer f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907)] handling channelInactive
08:09:49.675 [DEBUG - kudu-nio-3] (Connection.java:709) [peer f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907)] cleaning up while in state READY due to: connection closed
08:09:49.675 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.4.9.124:41733(127.4.9.124:41733)] handling channelInactive
08:09:49.675 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.9.124:41733(127.4.9.124:41733)] cleaning up while in state READY due to: connection closed
08:09:49.676 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.4.9.126:44985(127.4.9.126:44985)] handling channelInactive
08:09:49.676 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.9.126:44985(127.4.9.126:44985)] cleaning up while in state READY due to: connection closed
08:09:49.676 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:09:49.680 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-2
08:09:49.680 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-3
08:09:49.680 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
08:09:49.681 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.4.9.125:45723(127.4.9.125:45723)] handling channelInactive
08:09:49.681 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.9.125:45723(127.4.9.125:45723)] cleaning up while in state READY due to: connection closed
08:09:49.681 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-1
08:09:49.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:49.683007  4133 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 4509
08:09:49.685 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:49.685 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:49.685 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:49.685 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:49.685 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:49.686 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:49.686 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:49.686 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:49.686 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:49.686 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:49.686 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:49.686 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:49.686 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:49.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:49.748353  4133 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 4655
08:09:49.817 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705)] handling channelInactive
08:09:49.817 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705)] cleaning up while in state READY due to: connection closed
08:09:49.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:09:49.816977  4872 connection.cc:582] client connection to 127.4.9.66:45705 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:09:49.818 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705) for tablet 575ff3b76e2c433182dc6c13ceccca59: connection closed
08:09:49.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:49.818249  4133 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 4800
08:09:49.822 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907)] connecting to peer
08:09:49.823 [DEBUG - kudu-nio-1] (Connection.java:757) [peer f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907)] Successfully connected to peer
08:09:49.877 [ERROR - kudu-nio-1] (Connection.java:452) [peer f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907)] unexpected exception from downstream on [id: 0xf49080fa, L:/127.0.0.1:37308 - R:/127.4.9.67:37907]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:49.878 [DEBUG - kudu-nio-1] (Connection.java:709) [peer f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907)] cleaning up while in state NEGOTIATING due to: [peer f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907)] unexpected exception from downstream on [id: 0xf49080fa, L:/127.0.0.1:37308 - R:/127.4.9.67:37907]
08:09:49.878 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907) for tablet 575ff3b76e2c433182dc6c13ceccca59: [peer f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907)] unexpected exception from downstream on [id: 0xf49080fa, L:/127.0.0.1:37308 - R:/127.4.9.67:37907]
08:09:49.878 [DEBUG - kudu-nio-1] (Connection.java:239) [peer f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907)] handling channelInactive
08:09:49.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:49.879587  4133 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 4145
08:09:49.883 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer 0a7023e11f684b96aa2d4965a85ddaa3(127.4.9.65:39865)] connecting to peer
08:09:49.884 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer 0a7023e11f684b96aa2d4965a85ddaa3(127.4.9.65:39865): Connection refused: /127.4.9.65:39865
08:09:49.884 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 0a7023e11f684b96aa2d4965a85ddaa3(127.4.9.65:39865)] cleaning up while in state CONNECTING due to: Failed to connect to peer 0a7023e11f684b96aa2d4965a85ddaa3(127.4.9.65:39865): Connection refused: /127.4.9.65:39865
08:09:49.884 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 0a7023e11f684b96aa2d4965a85ddaa3(127.4.9.65:39865) for tablet 575ff3b76e2c433182dc6c13ceccca59: Failed to connect to peer 0a7023e11f684b96aa2d4965a85ddaa3(127.4.9.65:39865): Connection refused: /127.4.9.65:39865
08:09:49.902 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.126:44985(127.4.9.126:44985)] connecting to peer
08:09:49.902 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.125:45723(127.4.9.125:45723)] connecting to peer
08:09:49.903 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.124:41733(127.4.9.124:41733)] connecting to peer
08:09:49.903 [DEBUG - kudu-nio-3] (Connection.java:757) [peer master-127.4.9.126:44985(127.4.9.126:44985)] Successfully connected to peer
08:09:49.904 [DEBUG - kudu-nio-4] (Connection.java:757) [peer master-127.4.9.125:45723(127.4.9.125:45723)] Successfully connected to peer
08:09:49.905 [DEBUG - kudu-nio-5] (Connection.java:757) [peer master-127.4.9.124:41733(127.4.9.124:41733)] Successfully connected to peer
08:09:49.910 [DEBUG - kudu-nio-5] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.9.124
08:09:49.910 [DEBUG - kudu-nio-4] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.9.125
08:09:49.919 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:49.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:49.923 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0x4ff5b834, L:/127.0.0.1:42508 - R:/127.4.9.124:41733] using SASL/PLAIN
08:09:49.926 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
08:09:49.928 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:09:49.928 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=null, attempt=1, TimeoutTracker(timeout=29480, elapsed=26), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.9.126:44985, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.9.125:45723, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.9.124:41733, [26ms] Sub RPC ConnectToMaster: received response from server master-127.4.9.124:41733: OK, deferred=null) after lookup
08:09:49.929 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x6c40626a, L:/127.0.0.1:50864 - R:/127.4.9.125:45723] using SASL/PLAIN
08:09:49.930 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.4.9.126:44985(127.4.9.126:44985)] handling channelInactive
08:09:49.930 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.9.126:44985(127.4.9.126:44985)] cleaning up while in state READY due to: connection closed
08:09:49.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:49.932083  4133 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 4215
08:09:49.935 [ERROR - kudu-nio-3] (Connection.java:452) [peer master-127.4.9.126:44985(127.4.9.126:44985)] unexpected exception from downstream on [id: 0x8ec003b5, L:/127.0.0.1:34596 - R:/127.4.9.126:44985]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:49.935 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.9.126:44985(127.4.9.126:44985)] cleaning up while in state NEGOTIATING due to: [peer master-127.4.9.126:44985(127.4.9.126:44985)] unexpected exception from downstream on [id: 0x8ec003b5, L:/127.0.0.1:34596 - R:/127.4.9.126:44985]
08:09:49.935 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.126:44985: [peer master-127.4.9.126:44985(127.4.9.126:44985)] unexpected exception from downstream on [id: 0x8ec003b5, L:/127.0.0.1:34596 - R:/127.4.9.126:44985]
08:09:49.936 [DEBUG - kudu-nio-3] (Connection.java:239) [peer master-127.4.9.126:44985(127.4.9.126:44985)] handling channelInactive
08:09:49.936 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2538) Learned about tablet 575ff3b76e2c433182dc6c13ceccca59 for table 'replication_test_table' with partition [<start>, <end>)
08:09:49.937 [DEBUG - kudu-nio-5] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=575ff3b76e2c433182dc6c13ceccca59@[0a7023e11f684b96aa2d4965a85ddaa3(127.4.9.65:39865),17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705),f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907)[L]]}]
08:09:49.937 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=575ff3b76e2c433182dc6c13ceccca59, attempt=4, KuduRpc(method=Scan, tablet=575ff3b76e2c433182dc6c13ceccca59, attempt=4, TimeoutTracker(timeout=30000, elapsed=555), Traces: [0ms] sending RPC to server 17223fa74c2243e899d62a8a629c92ea, [436ms] received response from server 17223fa74c2243e899d62a8a629c92ea: Network error: connection closed, [437ms] delaying RPC due to: Network error: connection closed, [441ms] sending RPC to server f4307e383fdb4861a47655fcaa08be4e, [497ms] received response from server f4307e383fdb4861a47655fcaa08be4e: Network error: [peer f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907)] unexpected exception from downstream on [id: 0xf49080fa, L:/127.0.0.1:37308 - R:/127.4.9.67:37907], [497ms] delaying RPC due to: Network error: [peer f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907)] unexpected exception from downstream on [id: 0xf49080fa, L:/127.0.0.1:37308 - R:/127.4.9.67:37907], [501ms] sending RPC to server 0a7023e11f684b96aa2d4965a85ddaa3, [503ms] received response from server 0a7023e11f684b96aa2d4965a85ddaa3: Network error: Failed to connect to peer 0a7023e11f684b96aa2d4965a85ddaa3(127.4.9.65:39865): Connection refused: /127.4.9.65:39865, [503ms] delaying RPC due to: Network error: Failed to connect to peer 0a7023e11f684b96aa2d4965a85ddaa3(127.4.9.65:39865): Connection refused: /127.4.9.65:39865, [520ms] refreshing cache from master, [520ms] Sub RPC GetTableLocations: refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.9.126:44985, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.9.125:45723, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.9.124:41733, [546ms] Sub RPC ConnectToMaster: received response from server master-127.4.9.124:41733: OK, [547ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.9.124:41733, [554ms] Sub RPC ConnectToMaster: received response from server master-127.4.9.126:44985: Network error: [peer master-127.4.9.126:44985(127.4.9.126:44985)] unexpected exception from downstream on [id: 0x8ec003b5, L:/127.0.0.1:34596 - R:/127.4.9.126:44985], [555ms] Sub RPC GetTableLocations: received response from server master-127.4.9.124:41733: OK, deferred=Deferred@1113609806(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0, errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0))) after lookup
08:09:49.937 [DEBUG - kudu-nio-5] (Connection.java:748) [peer 17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705)] connecting to peer
08:09:49.938 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer 17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705): Connection refused: /127.4.9.66:45705
08:09:49.938 [DEBUG - kudu-nio-6] (Connection.java:709) [peer 17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705)] cleaning up while in state CONNECTING due to: Failed to connect to peer 17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705): Connection refused: /127.4.9.66:45705
08:09:49.939 [INFO - kudu-nio-6] (AsyncKuduClient.java:2355) Invalidating location 17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705) for tablet 575ff3b76e2c433182dc6c13ceccca59: Failed to connect to peer 17223fa74c2243e899d62a8a629c92ea(127.4.9.66:45705): Connection refused: /127.4.9.66:45705
08:09:49.962 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907)] connecting to peer
08:09:49.964 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907): Connection refused: /127.4.9.67:37907
08:09:49.964 [DEBUG - kudu-nio-7] (Connection.java:709) [peer f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907)] cleaning up while in state CONNECTING due to: Failed to connect to peer f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907): Connection refused: /127.4.9.67:37907
08:09:49.964 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907) for tablet 575ff3b76e2c433182dc6c13ceccca59: Failed to connect to peer f4307e383fdb4861a47655fcaa08be4e(127.4.9.67:37907): Connection refused: /127.4.9.67:37907
08:09:49.982 [DEBUG - kudu-nio-4] (Connection.java:239) [peer master-127.4.9.125:45723(127.4.9.125:45723)] handling channelInactive
08:09:49.982 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.9.125:45723(127.4.9.125:45723)] cleaning up while in state READY due to: connection closed
08:09:49.982 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.125:45723: connection closed
08:09:49.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:09:49.983611  4133 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskk4_r_T/build/tsan/bin/kudu with pid 4296
08:09:49.982 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.4.9.125:45723(127.4.9.125:45723)] handling channelInactive
08:09:49.986 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.9.125:45723(127.4.9.125:45723)] cleaning up while in state READY due to: connection closed
08:09:49.989 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.126:38579(127.23.194.126:38579)] connecting to peer
08:09:49.989 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.125:38689(127.23.194.125:38689)] connecting to peer
08:09:49.989 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.23.194.124:38943(127.23.194.124:38943)] connecting to peer
08:09:49.990 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:49.990 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.194.126:38579(127.23.194.126:38579)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:49.990 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:49.990 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.194.125:38689(127.23.194.125:38689)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:49.990 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.126:38579: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579
08:09:49.990 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.125:38689: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689
08:09:49.991 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:49.991 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.194.124:38943(127.23.194.124:38943)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:49.991 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.194.124:38943: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
08:09:49.991 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943; will retry
08:09:49.991 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29764), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [4ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [5ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [9ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [9ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [41ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [45ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [50ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [50ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [94ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [100ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [100ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [101ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [121ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [121ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [122ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [141ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [141ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [141ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [142ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [181ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [181ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [181ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [181ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [241ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [242ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [242ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [242ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [282ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [282ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [283ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [283ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [482ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [484ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [484ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [494ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [902ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [903ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [904ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [904ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1620ms] refreshing cache from master, [1620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1622ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3340ms] refreshing cache from master, [3340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [3340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [3341ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [3342ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [3342ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3342ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [6240ms] refreshing cache from master, [6240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [6240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [6240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [6241ms] too many traces: truncated at 100 traces, deferred=Deferred@526836035(state=PENDING, result=null, callback=(continuation of Deferred@43504567 after retry RPC after error@441620466) -> (continuation of Deferred@1655285028 after retry RPC after error@1248668875) -> (continuation of Deferred@1985692762 after retry RPC after error@2025365604) -> (continuation of Deferred@1469557458 after retry RPC after error@1958727583) -> (continuation of Deferred@1483357382 after retry RPC after error@1701579823) -> (continuation of Deferred@264760170 after retry RPC after error@84807226) -> (continuation of Deferred@210476625 after retry RPC after error@151254683) -> (continuation of Deferred@959434858 after retry RPC after error@1285908139) -> (continuation of Deferred@470548600 after retry RPC after error@179145292) -> (continuation of Deferred@1304868851 after retry RPC after error@707858654) -> (continuation of Deferred@1455610400 after retry RPC after error@819713374) -> (continuation of Deferred@1222280601 after retry RPC after error@1792007100) -> (continuation of Deferred@706481951 after retry RPC after error@1149460007) -> (continuation of Deferred@1491729763 after retry RPC after error@1282400249) -> (continuation of Deferred@113333660 after retry RPC after error@1483555077) -> (continuation of Deferred@1333312910 after retry RPC after error@2103059343) -> (continuation of Deferred@1899754509 after retry RPC after error@1139603014) -> (continuation of Deferred@1232254840 after retry RPC after error@1704506242) -> (continuation of Deferred@1269676192 after retry RPC after error@1867987285) -> (continuation of Deferred@868387504 after retry RPC after error@325463017) -> (continuation of Deferred@900262301 after retry RPC after error@1675879404) -> (continuation of Deferred@1146315306 after retry RPC after error@1724391466) -> (continuation of Deferred@341756271 after retry RPC after error@1751037067) -> (continuation of Deferred@927193496 after retry RPC after error@279803434) -> (continuation of Deferred@1918550241 after retry RPC after error@1874712781) -> (continuation of Deferred@1184580539 after retry RPC after error@1031561572) -> (continuation of Deferred@428209122 after retry RPC after error@410987439), errback=(continuation of Deferred@43504567 after retry RPC after error@441620466) -> (continuation of Deferred@1655285028 after retry RPC after error@1248668875) -> (continuation of Deferred@1985692762 after retry RPC after error@2025365604) -> (continuation of Deferred@1469557458 after retry RPC after error@1958727583) -> (continuation of Deferred@1483357382 after retry RPC after error@1701579823) -> (continuation of Deferred@264760170 after retry RPC after error@84807226) -> (continuation of Deferred@210476625 after retry RPC after error@151254683) -> (continuation of Deferred@959434858 after retry RPC after error@1285908139) -> (continuation of Deferred@470548600 after retry RPC after error@179145292) -> (continuation of Deferred@1304868851 after retry RPC after error@707858654) -> (continuation of Deferred@1455610400 after retry RPC after error@819713374) -> (continuation of Deferred@1222280601 after retry RPC after error@1792007100) -> (continuation of Deferred@706481951 after retry RPC after error@1149460007) -> (continuation of Deferred@1491729763 after retry RPC after error@1282400249) -> (continuation of Deferred@113333660 after retry RPC after error@1483555077) -> (continuation of Deferred@1333312910 after retry RPC after error@2103059343) -> (continuation of Deferred@1899754509 after retry RPC after error@1139603014) -> (continuation of Deferred@1232254840 after retry RPC after error@1704506242) -> (continuation of Deferred@1269676192 after retry RPC after error@1867987285) -> (continuation of Deferred@868387504 after retry RPC after error@325463017) -> (continuation of Deferred@900262301 after retry RPC after error@1675879404) -> (continuation of Deferred@1146315306 after retry RPC after error@1724391466) -> (continuation of Deferred@341756271 after retry RPC after error@1751037067) -> (continuation of Deferred@927193496 after retry RPC after error@279803434) -> (continuation of Deferred@1918550241 after retry RPC after error@1874712781) -> (continuation of Deferred@1184580539 after retry RPC after error@1031561572) -> (continuation of Deferred@428209122 after retry RPC after error@410987439)))
08:09:49.993 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (SourceReaderBase.java:338) Closing Source Reader.
08:09:49.993 [WARN - Source: KuduSource -> Sink: Writer (4/4)#8] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#8 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_8) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29764), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [4ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [5ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [9ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [9ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [41ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [45ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [50ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [50ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [94ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [100ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [100ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [101ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [121ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [121ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [122ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [141ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [141ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [141ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [142ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [181ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [181ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [181ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [181ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [241ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [242ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [242ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [242ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [282ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [282ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [283ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [283ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [482ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [484ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [484ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [494ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [902ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [903ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [904ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [904ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1620ms] refreshing cache from master, [1620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1622ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3340ms] refreshing cache from master, [3340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [3340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [3341ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [3342ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [3342ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3342ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [6240ms] refreshing cache from master, [6240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [6240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [6240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [6241ms] too many traces: truncated at 100 traces, deferred=Deferred@526836035(state=PENDING, result=null, callback=(continuation of Deferred@43504567 after retry RPC after error@441620466) -> (continuation of Deferred@1655285028 after retry RPC after error@1248668875) -> (continuation of Deferred@1985692762 after retry RPC after error@2025365604) -> (continuation of Deferred@1469557458 after retry RPC after error@1958727583) -> (continuation of Deferred@1483357382 after retry RPC after error@1701579823) -> (continuation of Deferred@264760170 after retry RPC after error@84807226) -> (continuation of Deferred@210476625 after retry RPC after error@151254683) -> (continuation of Deferred@959434858 after retry RPC after error@1285908139) -> (continuation of Deferred@470548600 after retry RPC after error@179145292) -> (continuation of Deferred@1304868851 after retry RPC after error@707858654) -> (continuation of Deferred@1455610400 after retry RPC after error@819713374) -> (continuation of Deferred@1222280601 after retry RPC after error@1792007100) -> (continuation of Deferred@706481951 after retry RPC after error@1149460007) -> (continuation of Deferred@1491729763 after retry RPC after error@1282400249) -> (continuation of Deferred@113333660 after retry RPC after error@1483555077) -> (continuation of Deferred@1333312910 after retry RPC after error@2103059343) -> (continuation of Deferred@1899754509 after retry RPC after error@1139603014) -> (continuation of Deferred@1232254840 after retry RPC after error@1704506242) -> (continuation of Deferred@1269676192 after retry RPC after error@1867987285) -> (continuation of Deferred@868387504 after retry RPC after error@325463017) -> (continuation of Deferred@900262301 after retry RPC after error@1675879404) -> (continuation of Deferred@1146315306 after retry RPC after error@1724391466) -> (continuation of Deferred@341756271 after retry RPC after error@1751037067) -> (continuation of Deferred@927193496 after retry RPC after error@279803434) -> (continuation of Deferred@1918550241 after retry RPC after error@1874712781) -> (continuation of Deferred@1184580539 after retry RPC after error@1031561572) -> (continuation of Deferred@428209122 after retry RPC after error@410987439), errback=(continuation of Deferred@43504567 after retry RPC after error@441620466) -> (continuation of Deferred@1655285028 after retry RPC after error@1248668875) -> (continuation of Deferred@1985692762 after retry RPC after error@2025365604) -> (continuation of Deferred@1469557458 after retry RPC after error@1958727583) -> (continuation of Deferred@1483357382 after retry RPC after error@1701579823) -> (continuation of Deferred@264760170 after retry RPC after error@84807226) -> (continuation of Deferred@210476625 after retry RPC after error@151254683) -> (continuation of Deferred@959434858 after retry RPC after error@1285908139) -> (continuation of Deferred@470548600 after retry RPC after error@179145292) -> (continuation of Deferred@1304868851 after retry RPC after error@707858654) -> (continuation of Deferred@1455610400 after retry RPC after error@819713374) -> (continuation of Deferred@1222280601 after retry RPC after error@1792007100) -> (continuation of Deferred@706481951 after retry RPC after error@1149460007) -> (continuation of Deferred@1491729763 after retry RPC after error@1282400249) -> (continuation of Deferred@113333660 after retry RPC after error@1483555077) -> (continuation of Deferred@1333312910 after retry RPC after error@2103059343) -> (continuation of Deferred@1899754509 after retry RPC after error@1139603014) -> (continuation of Deferred@1232254840 after retry RPC after error@1704506242) -> (continuation of Deferred@1269676192 after retry RPC after error@1867987285) -> (continuation of Deferred@868387504 after retry RPC after error@325463017) -> (continuation of Deferred@900262301 after retry RPC after error@1675879404) -> (continuation of Deferred@1146315306 after retry RPC after error@1724391466) -> (continuation of Deferred@341756271 after retry RPC after error@1751037067) -> (continuation of Deferred@927193496 after retry RPC after error@279803434) -> (continuation of Deferred@1918550241 after retry RPC after error@1874712781) -> (continuation of Deferred@1184580539 after retry RPC after error@1031561572) -> (continuation of Deferred@428209122 after retry RPC after error@410987439)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:49.995 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#8 (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_8).
08:09:49.997 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#8 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_8.
08:09:49.999 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_8) switched from INITIALIZING to FAILED on 3f60cd48-2db8-44da-a97b-80d36cd69725 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29764), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [4ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [5ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [9ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [9ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [41ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [45ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [50ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [50ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [94ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [100ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [100ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [101ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [121ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [121ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [122ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [122ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [141ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [141ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [141ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [142ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [181ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [181ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [181ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [181ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [241ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [242ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [242ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [242ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [282ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [282ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [283ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [283ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [482ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [484ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [484ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [494ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [902ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [903ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [904ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [904ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1620ms] refreshing cache from master, [1620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [1622ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3340ms] refreshing cache from master, [3340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [3340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [3340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [3341ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.126:38579: Network error: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579, [3342ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.125:38689: Network error: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689, [3342ms] Sub RPC ConnectToMaster: received response from server master-127.23.194.124:38943: Network error: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [3342ms] delaying RPC due to: Service unavailable: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943, [6240ms] refreshing cache from master, [6240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.126:38579, [6240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.125:38689, [6240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.194.124:38943, [6241ms] too many traces: truncated at 100 traces, deferred=Deferred@526836035(state=PENDING, result=null, callback=(continuation of Deferred@43504567 after retry RPC after error@441620466) -> (continuation of Deferred@1655285028 after retry RPC after error@1248668875) -> (continuation of Deferred@1985692762 after retry RPC after error@2025365604) -> (continuation of Deferred@1469557458 after retry RPC after error@1958727583) -> (continuation of Deferred@1483357382 after retry RPC after error@1701579823) -> (continuation of Deferred@264760170 after retry RPC after error@84807226) -> (continuation of Deferred@210476625 after retry RPC after error@151254683) -> (continuation of Deferred@959434858 after retry RPC after error@1285908139) -> (continuation of Deferred@470548600 after retry RPC after error@179145292) -> (continuation of Deferred@1304868851 after retry RPC after error@707858654) -> (continuation of Deferred@1455610400 after retry RPC after error@819713374) -> (continuation of Deferred@1222280601 after retry RPC after error@1792007100) -> (continuation of Deferred@706481951 after retry RPC after error@1149460007) -> (continuation of Deferred@1491729763 after retry RPC after error@1282400249) -> (continuation of Deferred@113333660 after retry RPC after error@1483555077) -> (continuation of Deferred@1333312910 after retry RPC after error@2103059343) -> (continuation of Deferred@1899754509 after retry RPC after error@1139603014) -> (continuation of Deferred@1232254840 after retry RPC after error@1704506242) -> (continuation of Deferred@1269676192 after retry RPC after error@1867987285) -> (continuation of Deferred@868387504 after retry RPC after error@325463017) -> (continuation of Deferred@900262301 after retry RPC after error@1675879404) -> (continuation of Deferred@1146315306 after retry RPC after error@1724391466) -> (continuation of Deferred@341756271 after retry RPC after error@1751037067) -> (continuation of Deferred@927193496 after retry RPC after error@279803434) -> (continuation of Deferred@1918550241 after retry RPC after error@1874712781) -> (continuation of Deferred@1184580539 after retry RPC after error@1031561572) -> (continuation of Deferred@428209122 after retry RPC after error@410987439), errback=(continuation of Deferred@43504567 after retry RPC after error@441620466) -> (continuation of Deferred@1655285028 after retry RPC after error@1248668875) -> (continuation of Deferred@1985692762 after retry RPC after error@2025365604) -> (continuation of Deferred@1469557458 after retry RPC after error@1958727583) -> (continuation of Deferred@1483357382 after retry RPC after error@1701579823) -> (continuation of Deferred@264760170 after retry RPC after error@84807226) -> (continuation of Deferred@210476625 after retry RPC after error@151254683) -> (continuation of Deferred@959434858 after retry RPC after error@1285908139) -> (continuation of Deferred@470548600 after retry RPC after error@179145292) -> (continuation of Deferred@1304868851 after retry RPC after error@707858654) -> (continuation of Deferred@1455610400 after retry RPC after error@819713374) -> (continuation of Deferred@1222280601 after retry RPC after error@1792007100) -> (continuation of Deferred@706481951 after retry RPC after error@1149460007) -> (continuation of Deferred@1491729763 after retry RPC after error@1282400249) -> (continuation of Deferred@113333660 after retry RPC after error@1483555077) -> (continuation of Deferred@1333312910 after retry RPC after error@2103059343) -> (continuation of Deferred@1899754509 after retry RPC after error@1139603014) -> (continuation of Deferred@1232254840 after retry RPC after error@1704506242) -> (continuation of Deferred@1269676192 after retry RPC after error@1867987285) -> (continuation of Deferred@868387504 after retry RPC after error@325463017) -> (continuation of Deferred@900262301 after retry RPC after error@1675879404) -> (continuation of Deferred@1146315306 after retry RPC after error@1724391466) -> (continuation of Deferred@341756271 after retry RPC after error@1751037067) -> (continuation of Deferred@927193496 after retry RPC after error@279803434) -> (continuation of Deferred@1918550241 after retry RPC after error@1874712781) -> (continuation of Deferred@1184580539 after retry RPC after error@1031561572) -> (continuation of Deferred@428209122 after retry RPC after error@410987439)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.23.194.126:38579,127.23.194.125:38689,127.23.194.124:38943) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.126:38579(127.23.194.126:38579): Connection refused: /127.23.194.126:38579,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.125:38689(127.23.194.125:38689): Connection refused: /127.23.194.125:38689,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.194.124:38943(127.23.194.124:38943): Connection refused: /127.23.194.124:38943
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.23.194.124:38943
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
08:09:50.002 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#8) of source Source: KuduSource.
08:09:50.002 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 76e1c5722212c7e382eed42461b63c38_cbc357ccb763df2852fee8c4fc7d55f2_3_8.
08:09:50.003 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job b42812d69c586178cf7556c3c92998f3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
08:09:50.022 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer 0a7023e11f684b96aa2d4965a85ddaa3(127.4.9.65:39865)] connecting to peer
08:09:50.023 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 0a7023e11f684b96aa2d4965a85ddaa3(127.4.9.65:39865): Connection refused: /127.4.9.65:39865
08:09:50.023 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 0a7023e11f684b96aa2d4965a85ddaa3(127.4.9.65:39865)] cleaning up while in state CONNECTING due to: Failed to connect to peer 0a7023e11f684b96aa2d4965a85ddaa3(127.4.9.65:39865): Connection refused: /127.4.9.65:39865
08:09:50.024 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 0a7023e11f684b96aa2d4965a85ddaa3(127.4.9.65:39865) for tablet 575ff3b76e2c433182dc6c13ceccca59: Failed to connect to peer 0a7023e11f684b96aa2d4965a85ddaa3(127.4.9.65:39865): Connection refused: /127.4.9.65:39865
08:09:50.027 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:50.035 [DEBUG - kudu-nio-5] (Connection.java:239) [peer master-127.4.9.124:41733(127.4.9.124:41733)] handling channelInactive
08:09:50.035 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.9.124:41733(127.4.9.124:41733)] cleaning up while in state READY due to: connection closed
08:09:50.035 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.4.9.124:41733(127.4.9.124:41733)] handling channelInactive
08:09:50.036 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.9.124:41733(127.4.9.124:41733)] cleaning up while in state READY due to: connection closed
08:09:50.042 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.124:41733(127.4.9.124:41733)] connecting to peer
08:09:50.043 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.043 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.9.124:41733(127.4.9.124:41733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.043 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location master-127.4.9.124:41733(127.4.9.124:41733) for tablet Kudu Master: Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.054 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:50.062 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.126:44985(127.4.9.126:44985)] connecting to peer
08:09:50.062 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.125:45723(127.4.9.125:45723)] connecting to peer
08:09:50.062 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.124:41733(127.4.9.124:41733)] connecting to peer
08:09:50.062 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.062 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.062 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.062 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.9.125:45723(127.4.9.125:45723)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.062 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.9.124:41733(127.4.9.124:41733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.062 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.125:45723: Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.062 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.9.126:44985(127.4.9.126:44985)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.062 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.124:41733: Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.062 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.126:44985: Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.062 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.9.126:44985,127.4.9.125:45723,127.4.9.124:41733; will retry
08:09:50.078 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091790077 for job 32f61c84b0337638563df63016a801c9.
08:09:50.082 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.126:44985(127.4.9.126:44985)] connecting to peer
08:09:50.083 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.125:45723(127.4.9.125:45723)] connecting to peer
08:09:50.083 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.124:41733(127.4.9.124:41733)] connecting to peer
08:09:50.083 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.083 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.9.126:44985(127.4.9.126:44985)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.083 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.126:44985: Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.083 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.083 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.9.125:45723(127.4.9.125:45723)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.084 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.125:45723: Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.084 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.084 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.9.124:41733(127.4.9.124:41733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.084 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.124:41733: Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.084 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.9.126:44985,127.4.9.125:45723,127.4.9.124:41733; will retry
08:09:50.088 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job 32f61c84b0337638563df63016a801c9 (1959 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
08:09:50.090 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
08:09:50.096 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:50.096 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:50.096 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:50.097 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:50.097 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:50.097 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:50.097 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:50.097 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:50.097 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:50.097 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:50.097 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:50.097 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:50.097 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:50.102 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.126:44985(127.4.9.126:44985)] connecting to peer
08:09:50.102 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.125:45723(127.4.9.125:45723)] connecting to peer
08:09:50.102 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.124:41733(127.4.9.124:41733)] connecting to peer
08:09:50.103 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.103 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.103 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.9.126:44985(127.4.9.126:44985)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.103 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.9.125:45723(127.4.9.125:45723)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.103 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.103 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.9.124:41733(127.4.9.124:41733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.103 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.125:45723: Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.103 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.124:41733: Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.103 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.126:44985: Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.103 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.4.9.126:44985,127.4.9.125:45723,127.4.9.124:41733; will retry
08:09:50.122 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.126:44985(127.4.9.126:44985)] connecting to peer
08:09:50.122 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.125:45723(127.4.9.125:45723)] connecting to peer
08:09:50.122 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.124:41733(127.4.9.124:41733)] connecting to peer
08:09:50.123 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.123 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.123 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.9.126:44985(127.4.9.126:44985)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.123 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.9.125:45723(127.4.9.125:45723)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.123 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.126:44985: Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.123 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.123 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.9.124:41733(127.4.9.124:41733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.123 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.125:45723: Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.123 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.124:41733: Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.123 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.9.126:44985,127.4.9.125:45723,127.4.9.124:41733; will retry
08:09:50.142 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.126:44985(127.4.9.126:44985)] connecting to peer
08:09:50.142 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.125:45723(127.4.9.125:45723)] connecting to peer
08:09:50.142 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.124:41733(127.4.9.124:41733)] connecting to peer
08:09:50.142 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.142 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.142 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.143 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.9.126:44985(127.4.9.126:44985)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.143 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.9.124:41733(127.4.9.124:41733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.143 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.9.125:45723(127.4.9.125:45723)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.143 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.124:41733: Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.143 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.126:44985: Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.143 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.125:45723: Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.143 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.9.126:44985,127.4.9.125:45723,127.4.9.124:41733; will retry
08:09:50.167 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:50.168 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:50.168 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:50.168 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:50.168 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:50.168 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:50.168 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:50.169 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:50.169 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:50.169 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:50.168 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:50.169 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:50.169 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:50.202 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.126:44985(127.4.9.126:44985)] connecting to peer
08:09:50.202 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.125:45723(127.4.9.125:45723)] connecting to peer
08:09:50.202 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.124:41733(127.4.9.124:41733)] connecting to peer
08:09:50.203 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.203 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.203 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.9.126:44985(127.4.9.126:44985)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.203 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.126:44985: Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.203 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.203 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.9.124:41733(127.4.9.124:41733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.203 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.9.125:45723(127.4.9.125:45723)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.203 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.125:45723: Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.203 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.124:41733: Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.203 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.9.126:44985,127.4.9.125:45723,127.4.9.124:41733; will retry
08:09:50.262 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.126:44985(127.4.9.126:44985)] connecting to peer
08:09:50.263 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.125:45723(127.4.9.125:45723)] connecting to peer
08:09:50.263 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.124:41733(127.4.9.124:41733)] connecting to peer
08:09:50.263 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.263 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.263 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.9.124:41733(127.4.9.124:41733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.263 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.263 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.9.125:45723(127.4.9.125:45723)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.263 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.124:41733: Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.264 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.9.126:44985(127.4.9.126:44985)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.264 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.126:44985: Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.264 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.125:45723: Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.264 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.9.126:44985,127.4.9.125:45723,127.4.9.124:41733; will retry
08:09:50.282 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.126:44985(127.4.9.126:44985)] connecting to peer
08:09:50.283 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.125:45723(127.4.9.125:45723)] connecting to peer
08:09:50.283 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.124:41733(127.4.9.124:41733)] connecting to peer
08:09:50.283 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.283 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.283 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.283 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.9.124:41733(127.4.9.124:41733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.284 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.9.125:45723(127.4.9.125:45723)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.284 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.124:41733: Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.283 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.9.126:44985(127.4.9.126:44985)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.284 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.125:45723: Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.284 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.126:44985: Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.284 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.9.126:44985,127.4.9.125:45723,127.4.9.124:41733; will retry
08:09:50.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:50.426 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:50.426 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:50.426 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:50.426 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:50.426 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:50.426 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:50.426 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:50.426 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:50.427 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:50.427 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:50.427 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:50.427 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:50.427 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:50.465 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:50.465 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:50.465 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:50.466 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:50.466 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:50.466 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:50.466 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:50.466 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:50.466 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:50.467 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:50.467 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:50.467 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:50.467 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:50.527 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:50.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:50.565 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:50.566 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:50.566 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:50.566 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:50.566 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:50.566 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:50.566 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:50.566 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:50.566 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:50.566 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:50.566 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:50.566 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:50.566 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:50.578 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091790577 for job 32f61c84b0337638563df63016a801c9.
08:09:50.585 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.126:44985(127.4.9.126:44985)] connecting to peer
08:09:50.586 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.586 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.9.126:44985(127.4.9.126:44985)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.586 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.125:45723(127.4.9.125:45723)] connecting to peer
08:09:50.586 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.126:44985: Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:50.586 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.124:41733(127.4.9.124:41733)] connecting to peer
08:09:50.586 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.587 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.587 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.9.124:41733(127.4.9.124:41733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.587 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.9.125:45723(127.4.9.125:45723)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.587 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.124:41733: Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:50.587 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.125:45723: Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:50.587 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.9.126:44985,127.4.9.125:45723,127.4.9.124:41733; will retry
08:09:50.589 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job 32f61c84b0337638563df63016a801c9 (1959 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
08:09:50.590 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
08:09:50.662 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.254:45015(127.31.46.254:45015)] connecting to peer
08:09:50.663 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.253:46697(127.31.46.253:46697)] connecting to peer
08:09:50.663 [DEBUG - pool-486-thread-1] (Connection.java:748) [peer master-127.31.46.252:40541(127.31.46.252:40541)] connecting to peer
08:09:50.663 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:50.664 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:50.664 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.46.252:40541(127.31.46.252:40541)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:50.664 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.46.254:45015(127.31.46.254:45015)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:50.664 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:50.664 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.46.253:46697(127.31.46.253:46697)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:50.664 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.254:45015: Failed to connect to peer master-127.31.46.254:45015(127.31.46.254:45015): Connection refused: /127.31.46.254:45015
08:09:50.664 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.252:40541: Failed to connect to peer master-127.31.46.252:40541(127.31.46.252:40541): Connection refused: /127.31.46.252:40541
08:09:50.664 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.46.253:46697: Failed to connect to peer master-127.31.46.253:46697(127.31.46.253:46697): Connection refused: /127.31.46.253:46697
08:09:50.664 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.46.254:45015,127.31.46.253:46697,127.31.46.252:40541; will retry
08:09:50.850 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:50.850 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:50.850 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:50.851 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:50.851 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:50.851 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:50.851 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:50.851 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:50.851 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:50.851 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:50.851 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:50.851 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:50.851 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:50.904 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:50.904 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:50.904 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:50.904 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:50.904 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:50.904 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:50.905 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:50.905 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:50.905 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:50.905 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:50.905 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:50.905 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:50.905 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:50.905 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:50.905 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:50.905 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:50.905 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:50.906 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:50.906 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:50.906 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:50.906 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:50.906 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:50.906 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:50.906 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:50.906 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:50.906 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:50.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:50.986 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:50.987 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:50.987 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:50.987 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:50.987 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:50.987 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:50.987 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:50.987 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:50.987 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:50.987 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:50.987 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:50.988 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:50.988 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:51.023 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.253:45079(127.28.220.253:45079)] connecting to peer
08:09:51.023 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.254:37365(127.28.220.254:37365)] connecting to peer
08:09:51.024 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.28.220.252:33543(127.28.220.252:33543)] connecting to peer
08:09:51.024 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:51.024 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.220.253:45079(127.28.220.253:45079)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:51.024 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:51.024 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:51.024 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.220.252:33543(127.28.220.252:33543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:51.024 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.220.254:37365(127.28.220.254:37365)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:51.024 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.253:45079: Failed to connect to peer master-127.28.220.253:45079(127.28.220.253:45079): Connection refused: /127.28.220.253:45079
08:09:51.024 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.252:33543: Failed to connect to peer master-127.28.220.252:33543(127.28.220.252:33543): Connection refused: /127.28.220.252:33543
08:09:51.024 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.220.254:37365: Failed to connect to peer master-127.28.220.254:37365(127.28.220.254:37365): Connection refused: /127.28.220.254:37365
08:09:51.024 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.220.253:45079,127.28.220.254:37365,127.28.220.252:33543; will retry
08:09:51.027 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:51.031 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:51.031 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:51.031 [DEBUG - pool-491-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:51.031 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:51.032 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:51.032 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:51.032 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:51.032 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:51.031 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:51.032 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:51.032 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:51.032 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:51.032 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:51.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:51.078 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091791077 for job 32f61c84b0337638563df63016a801c9.
08:09:51.082 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.126:44985(127.4.9.126:44985)] connecting to peer
08:09:51.082 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.125:45723(127.4.9.125:45723)] connecting to peer
08:09:51.083 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:51.083 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:51.083 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.9.126:44985(127.4.9.126:44985)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:51.083 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.126:44985: Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:51.083 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.124:41733(127.4.9.124:41733)] connecting to peer
08:09:51.083 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.9.125:45723(127.4.9.125:45723)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:51.084 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.125:45723: Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:51.084 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:51.084 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.9.124:41733(127.4.9.124:41733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:51.085 [INFO - pool-538-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.124:41733: Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:51.085 [WARN - pool-538-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.9.126:44985,127.4.9.125:45723,127.4.9.124:41733; will retry
08:09:51.090 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job 32f61c84b0337638563df63016a801c9 (1959 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
08:09:51.090 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
08:09:51.154 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.252:43595(127.27.17.252:43595)] connecting to peer
08:09:51.154 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.254:45447(127.27.17.254:45447)] connecting to peer
08:09:51.155 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.27.17.253:37621(127.27.17.253:37621)] connecting to peer
08:09:51.155 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:51.155 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:51.155 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.17.252:43595(127.27.17.252:43595)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:51.155 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.17.254:45447(127.27.17.254:45447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:51.155 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:51.155 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.17.253:37621(127.27.17.253:37621)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:51.155 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.254:45447: Failed to connect to peer master-127.27.17.254:45447(127.27.17.254:45447): Connection refused: /127.27.17.254:45447
08:09:51.155 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.252:43595: Failed to connect to peer master-127.27.17.252:43595(127.27.17.252:43595): Connection refused: /127.27.17.252:43595
08:09:51.155 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.17.253:37621: Failed to connect to peer master-127.27.17.253:37621(127.27.17.253:37621): Connection refused: /127.27.17.253:37621
08:09:51.155 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.17.252:43595,127.27.17.254:45447,127.27.17.253:37621; will retry
08:09:51.164 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:51.165 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:51.165 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:51.165 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:51.165 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:51.165 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:51.165 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:51.165 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:51.166 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:51.166 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:51.166 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:51.166 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:51.166 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:51.184 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.254:35197(127.31.233.254:35197)] connecting to peer
08:09:51.184 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.253:33393(127.31.233.253:33393)] connecting to peer
08:09:51.184 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.31.233.252:36101(127.31.233.252:36101)] connecting to peer
08:09:51.184 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:51.184 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:51.185 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.31.233.252:36101(127.31.233.252:36101)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:51.185 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.233.254:35197(127.31.233.254:35197)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:51.185 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:51.185 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.31.233.253:33393(127.31.233.253:33393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:51.185 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.252:36101: Failed to connect to peer master-127.31.233.252:36101(127.31.233.252:36101): Connection refused: /127.31.233.252:36101
08:09:51.185 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.254:35197: Failed to connect to peer master-127.31.233.254:35197(127.31.233.254:35197): Connection refused: /127.31.233.254:35197
08:09:51.185 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.31.233.253:33393: Failed to connect to peer master-127.31.233.253:33393(127.31.233.253:33393): Connection refused: /127.31.233.253:33393
08:09:51.185 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.31.233.254:35197,127.31.233.253:33393,127.31.233.252:36101; will retry
08:09:51.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:09:51Z chronyd exiting
08:09:51.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:51.525 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:51.526 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:51.526 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:51.526 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:51.526 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:51.526 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:51.526 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:51.526 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:51.526 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:51.526 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:51.526 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:51.526 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:51.527 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:51.527 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:51.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:51.578 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091791577 for job 32f61c84b0337638563df63016a801c9.
08:09:51.587 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job 32f61c84b0337638563df63016a801c9 (1959 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
08:09:51.587 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
08:09:51.647 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.190:38071(127.29.158.190:38071)] connecting to peer
08:09:51.648 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.189:41727(127.29.158.189:41727)] connecting to peer
08:09:51.648 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.29.158.188:39061(127.29.158.188:39061)] connecting to peer
08:09:51.648 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:51.648 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:51.648 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.158.189:41727(127.29.158.189:41727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:51.648 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:51.648 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.158.190:38071(127.29.158.190:38071)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:51.648 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.158.188:39061(127.29.158.188:39061)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:51.649 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.190:38071: Failed to connect to peer master-127.29.158.190:38071(127.29.158.190:38071): Connection refused: /127.29.158.190:38071
08:09:51.649 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.189:41727: Failed to connect to peer master-127.29.158.189:41727(127.29.158.189:41727): Connection refused: /127.29.158.189:41727
08:09:51.649 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.158.188:39061: Failed to connect to peer master-127.29.158.188:39061(127.29.158.188:39061): Connection refused: /127.29.158.188:39061
08:09:51.649 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.29.158.190:38071,127.29.158.189:41727,127.29.158.188:39061; will retry
08:09:51.765 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.189:41065(127.2.90.189:41065)] connecting to peer
08:09:51.765 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.188:42457(127.2.90.188:42457)] connecting to peer
08:09:51.765 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.2.90.190:42265(127.2.90.190:42265)] connecting to peer
08:09:51.765 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:51.765 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:51.765 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.90.189:41065(127.2.90.189:41065)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:51.765 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:51.766 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.90.188:42457(127.2.90.188:42457)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:51.766 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.90.190:42265(127.2.90.190:42265)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:51.766 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.189:41065: Failed to connect to peer master-127.2.90.189:41065(127.2.90.189:41065): Connection refused: /127.2.90.189:41065
08:09:51.766 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.190:42265: Failed to connect to peer master-127.2.90.190:42265(127.2.90.190:42265): Connection refused: /127.2.90.190:42265
08:09:51.766 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.90.188:42457: Failed to connect to peer master-127.2.90.188:42457(127.2.90.188:42457): Connection refused: /127.2.90.188:42457
08:09:51.766 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.90.189:41065,127.2.90.188:42457,127.2.90.190:42265; will retry
08:09:51.799 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job e26b904229418d0e047d5d94c5b9f905 from Checkpoint 76 @ 1779091546865 for e26b904229418d0e047d5d94c5b9f905 located at file:/tmp/junit16937918701930502306/checkpoints/e26b904229418d0e047d5d94c5b9f905/chk-76.
08:09:51.800 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
08:09:51.801 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 2 to checkpoint 76 for source Source: KuduSource to checkpoint.
08:09:51.801 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_8) switched from CREATED to SCHEDULED.
08:09:51.801 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
08:09:51.802 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_8) switched from SCHEDULED to DEPLOYING.
08:09:51.802 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #8) with attempt id 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_8 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1) with allocation id 0f1066b174fb1f271b9fbb4939140659
08:09:51.802 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (e26b904229418d0e047d5d94c5b9f905) switched from state RESTARTING to RUNNING.
08:09:51.803 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 0f1066b174fb1f271b9fbb4939140659.
08:09:51.803 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job e26b904229418d0e047d5d94c5b9f905 from Checkpoint 76 @ 1779091546865 for e26b904229418d0e047d5d94c5b9f905 located at file:/tmp/junit16937918701930502306/checkpoints/e26b904229418d0e047d5d94c5b9f905/chk-76.
08:09:51.803 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
08:09:51.803 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 76 for source Source: KuduSource to checkpoint.
08:09:51.803 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_8) switched from CREATED to SCHEDULED.
08:09:51.804 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#8 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_8), deploy into slot with allocation id 0f1066b174fb1f271b9fbb4939140659.
08:09:51.804 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job e26b904229418d0e047d5d94c5b9f905: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
08:09:51.804 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_8) switched from SCHEDULED to DEPLOYING.
08:09:51.804 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #8) with attempt id 3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_8 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 845ae898-e62b-48b1-b30d-b2afd2a7ff61 @ 127.0.0.1 (dataPort=-1) with allocation id bc35714883422bae5e4de5056d4b8678
08:09:51.805 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot bc35714883422bae5e4de5056d4b8678.
08:09:51.805 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#8 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_8) switched from CREATED to DEPLOYING.
08:09:51.805 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#8 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_8) [DEPLOYING].
08:09:51.805 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4ff1926f
08:09:51.806 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:51.806 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#8 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_8), deploy into slot with allocation id bc35714883422bae5e4de5056d4b8678.
08:09:51.806 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16937918701930502306/checkpoints")
08:09:51.806 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#8 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_8) switched from DEPLOYING to INITIALIZING.
08:09:51.806 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#8 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_8) switched from CREATED to DEPLOYING.
08:09:51.806 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#8 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_8) [DEPLOYING].
08:09:51.806 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_2_8) switched from DEPLOYING to INITIALIZING.
08:09:51.807 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4e8a7b88
08:09:51.807 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
08:09:51.807 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16937918701930502306/checkpoints")
08:09:51.807 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#8 (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_8) switched from DEPLOYING to INITIALIZING.
08:09:51.807 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3f201711463feaa87f92da6fcf850b18_cbc357ccb763df2852fee8c4fc7d55f2_1_8) switched from DEPLOYING to INITIALIZING.
08:09:51.809 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@20b06d7d
08:09:51.809 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2b62bc92
08:09:51.811 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:51.811 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:09:51.812 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#8] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:51.813 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#8] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:51.813 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#8] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:51.813 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.813 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.813 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.814 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#8] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:51.814 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.814 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.814 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.822 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#8] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:51.822 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.822 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.822 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.826 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#8] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:51.826 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.826 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.826 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.828 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.828 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.828 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.828 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.828 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.828 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:51.829 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.829 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:51.832 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:51.833 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:51.837 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:51.837 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:51.838 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.838 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.838 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.838 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.838 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.838 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.838 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:51.839 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.839 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.839 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.842 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:51.842 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.842 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.842 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.849 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.849 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.849 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.849 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.850 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.850 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.850 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:51.850 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:51.853 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:51.854 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:51.854 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.854 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.854 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:51.854 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.854 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.854 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.854 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.854 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.854 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.854 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.855 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:51.873 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:51.873 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:51.874 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:51.874 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:51.874 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.874 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.874 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.874 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.874 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.874 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.874 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.874 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.874 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:51.874 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.874 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:51.874 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.875 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.875 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.875 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:51.875 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.875 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.875 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.875 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.875 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.876 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.876 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:51.893 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:51.893 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:51.894 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:51.894 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:51.894 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:51.894 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:51.894 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.894 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.894 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.894 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.894 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.894 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.894 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.894 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.894 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.894 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.894 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:51.895 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.895 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.895 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.894 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.894 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.897 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.897 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.897 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.897 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:51.912 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:51.913 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:51.913 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:51.913 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.913 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.913 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.913 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.913 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.913 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.913 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.913 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.913 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.914 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:51.914 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:51.914 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.914 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.914 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:51.914 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.914 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:51.914 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.914 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.914 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.915 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.915 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.915 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.915 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:51.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:51.933 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:51.933 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:51.934 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:51.934 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:51.934 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:51.934 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:51.934 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.934 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.934 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.934 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.934 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.934 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.934 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.934 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.934 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.934 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.934 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.934 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.934 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.934 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.935 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:51.935 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.935 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.935 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.935 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.935 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:51.976 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job e26b904229418d0e047d5d94c5b9f905 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job e26b904229418d0e047d5d94c5b9f905 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:51.992 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:51.993 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:51.993 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:51.993 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.993 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.993 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.993 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.993 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.993 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.994 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:51.994 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:51.994 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:51.994 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:52.012 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:52.013 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:52.013 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:52.013 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:52.013 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:52.013 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:52.013 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:52.013 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:52.013 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:52.013 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:52.013 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:52.014 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:52.014 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:52.028 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 09c2845f1c2e95ee63afce247a128bdd since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 09c2845f1c2e95ee63afce247a128bdd is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:52.042 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.126:44985(127.4.9.126:44985)] connecting to peer
08:09:52.043 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.125:45723(127.4.9.125:45723)] connecting to peer
08:09:52.043 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.4.9.124:41733(127.4.9.124:41733)] connecting to peer
08:09:52.043 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:52.043 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:52.043 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:52.043 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.9.124:41733(127.4.9.124:41733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:52.043 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.9.126:44985(127.4.9.126:44985)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:52.043 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.9.125:45723(127.4.9.125:45723)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:52.043 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.124:41733: Failed to connect to peer master-127.4.9.124:41733(127.4.9.124:41733): Connection refused: /127.4.9.124:41733
08:09:52.043 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.126:44985: Failed to connect to peer master-127.4.9.126:44985(127.4.9.126:44985): Connection refused: /127.4.9.126:44985
08:09:52.044 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.9.125:45723: Failed to connect to peer master-127.4.9.125:45723(127.4.9.125:45723): Connection refused: /127.4.9.125:45723
08:09:52.044 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.9.126:44985,127.4.9.125:45723,127.4.9.124:41733; will retry
08:09:52.053 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:52.053 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:52.053 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:52.053 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:52.053 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:52.053 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:52.053 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:52.053 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:52.053 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:52.053 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:52.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job da74ffd3de6ba1563e412fcb34de5c51 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job da74ffd3de6ba1563e412fcb34de5c51 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:52.053 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:52.054 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:52.054 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:52.077 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1779091792077 for job 32f61c84b0337638563df63016a801c9.
08:09:52.086 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job 32f61c84b0337638563df63016a801c9 (1959 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
08:09:52.086 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
08:09:52.213 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:52.214 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:52.214 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:52.214 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:52.214 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:52.214 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:52.214 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:52.214 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:52.214 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:52.214 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:52.214 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:52.214 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:52.214 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:52.273 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.25.158.188:41049(127.25.158.188:41049)] connecting to peer
08:09:52.274 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.25.158.190:44627(127.25.158.190:44627)] connecting to peer
08:09:52.274 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.25.158.189:46677(127.25.158.189:46677)] connecting to peer
08:09:52.274 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:52.274 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:52.274 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.158.188:41049(127.25.158.188:41049)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:52.274 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:52.274 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.158.190:44627(127.25.158.190:44627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:52.275 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.188:41049: Failed to connect to peer master-127.25.158.188:41049(127.25.158.188:41049): Connection refused: /127.25.158.188:41049
08:09:52.275 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.190:44627: Failed to connect to peer master-127.25.158.190:44627(127.25.158.190:44627): Connection refused: /127.25.158.190:44627
08:09:52.275 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.25.158.189:46677(127.25.158.189:46677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:52.275 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.25.158.189:46677: Failed to connect to peer master-127.25.158.189:46677(127.25.158.189:46677): Connection refused: /127.25.158.189:46677
08:09:52.275 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.25.158.188:41049,127.25.158.190:44627,127.25.158.189:46677; will retry
08:09:52.355 [ERROR - main] (RetryRule.java:206) org.apache.kudu.replication.TestReplicationTableInitializer.testTableInitializationSmoke: failed attempt 1
org.apache.kudu.shaded.org.apache.commons.logging.LogConfigurationException: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl (Caused by java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1158)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory$2.run(LogFactory.java:960)
	at java.base/java.security.AccessController.doPrivileged(AccessController.java:318)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.newFactory(LogFactory.java:957)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getFactory(LogFactory.java:624)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getLog(LogFactory.java:655)
	at org.apache.kudu.shaded.org.apache.http.conn.ssl.DefaultHostnameVerifier.<init>(DefaultHostnameVerifier.java:82)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClientBuilder.build(HttpClientBuilder.java:970)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClients.createDefault(HttpClients.java:56)
	at org.apache.kudu.test.junit.ResultReporter.reportResult(ResultReporter.java:207)
	at org.apache.kudu.test.junit.ResultReporter.tryReportResult(ResultReporter.java:244)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.report(RetryRule.java:165)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:216)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
Caused by: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1020)
	... 42 more
08:09:52.409 [ERROR - main] (RetryRule.java:253) org.apache.kudu.replication.TestReplicationTableInitializer.testTableInitializationSmoke: giving up after 1 attempts
E
Time: 381.021
There were 7 failures:
1) testNonCoveredRangePartitioning(org.apache.kudu.replication.TestReplicationTableInitializer)
org.apache.kudu.shaded.org.apache.commons.logging.LogConfigurationException: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl (Caused by java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1158)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory$2.run(LogFactory.java:960)
	at java.base/java.security.AccessController.doPrivileged(AccessController.java:318)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.newFactory(LogFactory.java:957)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getFactory(LogFactory.java:624)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getLog(LogFactory.java:655)
	at org.apache.kudu.shaded.org.apache.http.conn.ssl.DefaultHostnameVerifier.<init>(DefaultHostnameVerifier.java:82)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClientBuilder.build(HttpClientBuilder.java:970)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClients.createDefault(HttpClients.java:56)
	at org.apache.kudu.test.junit.ResultReporter.reportResult(ResultReporter.java:207)
	at org.apache.kudu.test.junit.ResultReporter.tryReportResult(ResultReporter.java:244)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.report(RetryRule.java:165)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:216)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
Caused by: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1020)
	... 39 more
2) testRangeWithCustomHashSchemas(org.apache.kudu.replication.TestReplicationTableInitializer)
org.apache.kudu.shaded.org.apache.commons.logging.LogConfigurationException: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl (Caused by java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1158)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory$2.run(LogFactory.java:960)
	at java.base/java.security.AccessController.doPrivileged(AccessController.java:318)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.newFactory(LogFactory.java:957)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getFactory(LogFactory.java:624)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getLog(LogFactory.java:655)
	at org.apache.kudu.shaded.org.apache.http.conn.ssl.DefaultHostnameVerifier.<init>(DefaultHostnameVerifier.java:82)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClientBuilder.build(HttpClientBuilder.java:970)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClients.createDefault(HttpClients.java:56)
	at org.apache.kudu.test.junit.ResultReporter.reportResult(ResultReporter.java:207)
	at org.apache.kudu.test.junit.ResultReporter.tryReportResult(ResultReporter.java:244)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.report(RetryRule.java:165)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:216)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
Caused by: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1020)
	... 39 more
3) testUnpartitionedTable(org.apache.kudu.replication.TestReplicationTableInitializer)
org.apache.kudu.shaded.org.apache.commons.logging.LogConfigurationException: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl (Caused by java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1158)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory$2.run(LogFactory.java:960)
	at java.base/java.security.AccessController.doPrivileged(AccessController.java:318)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.newFactory(LogFactory.java:957)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getFactory(LogFactory.java:624)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getLog(LogFactory.java:655)
	at org.apache.kudu.shaded.org.apache.http.conn.ssl.DefaultHostnameVerifier.<init>(DefaultHostnameVerifier.java:82)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClientBuilder.build(HttpClientBuilder.java:970)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClients.createDefault(HttpClients.java:56)
	at org.apache.kudu.test.junit.ResultReporter.reportResult(ResultReporter.java:207)
	at org.apache.kudu.test.junit.ResultReporter.tryReportResult(ResultReporter.java:244)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.report(RetryRule.java:165)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:216)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
Caused by: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1020)
	... 39 more
4) testHashAndRangePartitioning(org.apache.kudu.replication.TestReplicationTableInitializer)
org.apache.kudu.shaded.org.apache.commons.logging.LogConfigurationException: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl (Caused by java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1158)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory$2.run(LogFactory.java:960)
	at java.base/java.security.AccessController.doPrivileged(AccessController.java:318)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.newFactory(LogFactory.java:957)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getFactory(LogFactory.java:624)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getLog(LogFactory.java:655)
	at org.apache.kudu.shaded.org.apache.http.conn.ssl.DefaultHostnameVerifier.<init>(DefaultHostnameVerifier.java:82)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClientBuilder.build(HttpClientBuilder.java:970)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClients.createDefault(HttpClients.java:56)
	at org.apache.kudu.test.junit.ResultReporter.reportResult(ResultReporter.java:207)
	at org.apache.kudu.test.junit.ResultReporter.tryReportResult(ResultReporter.java:244)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.report(RetryRule.java:165)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:216)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
Caused by: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1020)
	... 39 more
5) testRangeOnlyPartitioning(org.apache.kudu.replication.TestReplicationTableInitializer)
org.apache.kudu.shaded.org.apache.commons.logging.LogConfigurationException: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl (Caused by java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1158)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory$2.run(LogFactory.java:960)
	at java.base/java.security.AccessController.doPrivileged(AccessController.java:318)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.newFactory(LogFactory.java:957)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getFactory(LogFactory.java:624)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getLog(LogFactory.java:655)
	at org.apache.kudu.shaded.org.apache.http.conn.ssl.DefaultHostnameVerifier.<init>(DefaultHostnameVerifier.java:82)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClientBuilder.build(HttpClientBuilder.java:970)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClients.createDefault(HttpClients.java:56)
	at org.apache.kudu.test.junit.ResultReporter.reportResult(ResultReporter.java:207)
	at org.apache.kudu.test.junit.ResultReporter.tryReportResult(ResultReporter.java:244)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.report(RetryRule.java:165)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:216)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
Caused by: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1020)
	... 39 more
6) testHashOnlyPartitioning(org.apache.kudu.replication.TestReplicationTableInitializer)
org.apache.kudu.shaded.org.apache.commons.logging.LogConfigurationException: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl (Caused by java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1158)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory$2.run(LogFactory.java:960)
	at java.base/java.security.AccessController.doPrivileged(AccessController.java:318)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.newFactory(LogFactory.java:957)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getFactory(LogFactory.java:624)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getLog(LogFactory.java:655)
	at org.apache.kudu.shaded.org.apache.http.conn.ssl.DefaultHostnameVerifier.<init>(DefaultHostnameVerifier.java:82)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClientBuilder.build(HttpClientBuilder.java:970)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClients.createDefault(HttpClients.java:56)
	at org.apache.kudu.test.junit.ResultReporter.reportResult(ResultReporter.java:207)
	at org.apache.kudu.test.junit.ResultReporter.tryReportResult(ResultReporter.java:244)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.report(RetryRule.java:165)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:216)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
Caused by: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1020)
	... 39 more
7) testTableInitializationSmoke(org.apache.kudu.replication.TestReplicationTableInitializer)
org.apache.kudu.shaded.org.apache.commons.logging.LogConfigurationException: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl (Caused by java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1158)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory$2.run(LogFactory.java:960)
	at java.base/java.security.AccessController.doPrivileged(AccessController.java:318)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.newFactory(LogFactory.java:957)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getFactory(LogFactory.java:624)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.getLog(LogFactory.java:655)
	at org.apache.kudu.shaded.org.apache.http.conn.ssl.DefaultHostnameVerifier.<init>(DefaultHostnameVerifier.java:82)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClientBuilder.build(HttpClientBuilder.java:970)
	at org.apache.kudu.shaded.org.apache.http.impl.client.HttpClients.createDefault(HttpClients.java:56)
	at org.apache.kudu.test.junit.ResultReporter.reportResult(ResultReporter.java:207)
	at org.apache.kudu.test.junit.ResultReporter.tryReportResult(ResultReporter.java:244)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.report(RetryRule.java:165)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:216)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
Caused by: java.lang.ClassNotFoundException: org.apache.kudu.shaded.org.apache.commons.logging.impl.LogFactoryImpl
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
	at org.apache.kudu.shaded.org.apache.commons.logging.LogFactory.createFactory(LogFactory.java:1020)
	... 39 more

FAILURES!!!
Tests run: 7,  Failures: 7

08:09:52.418 [INFO - TaskExecutorStateChangelogStoragesManager shutdown hook] (TaskExecutorStateChangelogStoragesManager.java:234) Shutting down TaskExecutorStateChangelogStoragesManager.
08:09:52.418 [INFO - TaskExecutorStateChangelogStoragesManager shutdown hook] (TaskExecutorStateChangelogStoragesManager.java:234) Shutting down TaskExecutorStateChangelogStoragesManager.
08:09:52.418 [INFO - PermanentBlobCache shutdown hook] (AbstractBlobCache.java:251) Shutting down BLOB cache
08:09:52.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a72e6b48022ef36361b5eef11ee7c683 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a72e6b48022ef36361b5eef11ee7c683 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
08:09:52.422 [INFO - TransientBlobCache shutdown hook] (AbstractBlobCache.java:251) Shutting down BLOB cache
08:09:52.422 [INFO - TransientBlobCache shutdown hook] (AbstractBlobCache.java:251) Shutting down BLOB cache
08:09:52.422 [INFO - FileChannelManagerImpl-io shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-io-555eb079-9fe3-4fb6-80d5-8df565beb7d6
08:09:52.423 [INFO - FileCache shutdown hook] (FileCache.java:160) removed file cache directory /tmp/flink-dist-cache-071a76e9-40a7-4fcc-9e58-b63f45e6157b
08:09:52.423 [INFO - FileChannelManagerImpl-netty-shuffle shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-d2bde091-7409-462e-8716-abd2bb994dd9
08:09:52.425 [INFO - FileChannelManagerImpl-io shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-io-030e22c3-a396-4b26-b355-2d50328be2bb
08:09:52.425 [INFO - TaskExecutorLocalStateStoresManager shutdown hook] (TaskExecutorLocalStateStoresManager.java:314) Shutting down TaskExecutorLocalStateStoresManager.
08:09:52.425 [INFO - PermanentBlobCache shutdown hook] (AbstractBlobCache.java:251) Shutting down BLOB cache
08:09:52.427 [INFO - BlobServer shutdown hook] (BlobServer.java:401) Stopped BLOB server at 0.0.0.0:33995
08:09:52.427 [INFO - TaskExecutorStateChangelogStoragesManager shutdown hook] (TaskExecutorStateChangelogStoragesManager.java:234) Shutting down TaskExecutorStateChangelogStoragesManager.
